An experimental design on the SPEM 2.0 process model element classification algorithm of the AVISPA tool through ANOVA variance analysis

Main Article Content

Jhon Jairo Álvarez Londoño
Julio Ariel Hurtado Alegría

Abstract

Introduction: This publication is the product of research: “SPEM 2.0 Process Model Metrics in the Reliability of its Visual Analysis” throughout 2019, which supports the work of a master’s degree in Systems Engineering at the University of Cauca.


Objective: Rebase a process model metrics set in order to increase AVISPA reliability to support the visual analysis of SPEM 2.0 software process models.


Methodology: In order to improve AVISPA, a systematic literature review had been performed to find software process model metrics that are potentially apt to be represented in AVISPA. Next, a set of assessments were performed in order to enhance visual analysis tool. Finally, an ANOVA statistical assessment was realized in order to find a variance differential between AVISPA versions by comparing their F1-Score process model elements classification values.


Results: AVISPA significantly improved its general classification algorithm. Most of errors were found in SPEM 2.0 variability resolution feature and collections with duplicated elements. Multiple misclassifications still persists.


Conclusion: General AVISPA process model elements classification is improved. However, some process model samples remain scattered according to ANOVA results.


Originality: AVISPA is a recent solution for SPEM 2.0 software process model assessment. It's recent emergence carried to a lack of articles about software process model metrics and few works about AVISPA improvements. These are the main contributions of this paper.


Limitations: The project has been widely expensive in terms of execution time, traceability with all software process model elements, and mainly to find experts in software process that can meet the research requirements

Downloads

Download data is not yet available.

Article Details

How to Cite
[1]
Álvarez LondoñoJ. J. and Hurtado Alegría J. A., “An experimental design on the SPEM 2.0 process model element classification algorithm of the AVISPA tool through ANOVA variance analysis”, ing. Solidar, vol. 16, no. 1, Jan. 2020.
Section
Research Articles

References

[1] J. Lonchamp, “A structured conceptual and terminological framework for software process engineering,” in [1993] Proceedings of the Second International Conference on the Software Process-Continuous Software Process Improvement, Feb 1993, pp. 41–53. [Online]. doi: http://dx.doi.org/10.1109/SPCON.1993.236823

[2] W. Humphrey, Managing the Software Process. Ed. Boston: Addison-Wesley Professional, 1989. Accessed on: Nov. 26, 2019. [Online]. Available: https://dl.acm.org/citation.cfm?id=64795.

[3] “Software & systems process engineering metamodel (SPEM) 2.0,”2008, version 2.0. Accessed on: Nov. 26, 2019. [Online]. Available: https://www.omg.org/spec/SPEM/2.0/PDF.

[4] J. A. Hurtado Alegría, M. C. Bastarrica, and A. Bergel, “Analyzing software process models with AVISPA,” in Proceedings of the 2011 International Conference on Software and Systems Process, ser. ICSSP’11. New York, NY, USA: ACM, 2011, pp. 23–32. [Online]. doi: http://dx.doi.org/10.1145/1987875.1987882

[5] J. A. H. Alegría, A. Lagos, A. Bergel, and M. C. Bastarrica, “Software process model blueprints,” in New Modeling Concepts for Today’s Software Processes, J. Münch, Y. Yang, and W. Schäfer, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2010, pp. 273–284. [Online]. doi: http://dx.doi.org/10.1007/978-3-642-14347-2_24

[6] J. A. H. Alegría, M. C. Bastarrica, and A. Bergel, “AVISPA: a tool for analyzing software process models” Journal of Software: Evolution and Process, vol. 26, pp. 434–450, 2014. [Online]. doi: http://dx.doi.org/10.1145/1987875.1987882

[7] J. Salgado, J. Alvarez, and J. Alegría, “Análisis visual de la variabilidad de modelos de procesos de software,” in Colombian Conference on Computing, vol. 11, 2016. Accessed on: Nov. 26, 2019. [Online]. Available: https://www.researchgate.net/publication/337547656_Analisis_Visual_de_la_Variabilidad_en_Modelos_de_Procesos_Software.

[8] J. Simmonds, M. Bastarrica, L. Silvestre, and A. Quispe, “Analyzing methodologies and tools for specifying variability in software processes” Universidad de Chile, 2011. pp. 3–5. Accessed on: Nov. 26, 2019. [Online]. Available: https://pdfs.semanticscholar.org/31f9/6465e0a55d57a97e7b4c0aa2e41d50617788.pdf

[9] M. C. Bastarrica, G. Matturro, R. Robbes, L. Silvestre, and R. Vidal, “How does quality of formalized software processes affect adoption?” in Advanced Information Systems Engineering, M. Jarke, J. Mylopoulos,C. Quix, C. Rolland, Y. Manolopoulos, H. Mouratidis, and J. Horkoff,Eds.Cham: Springer International Publishing, 2014, pp. 226–240.[Online]. doi: http://dx.doi.org/10.1007/978-3-319-07881-6_16

[10] F. B. Cardenas, J. S. Martinez, M. C. Camacho, and J. A. Hurtado, “Análisis visual de la modularidad de modelos de procesos de software avimo-ps,” in Computing Colombian Conference, vol. 8, 2013. pp. 2–43. Accessed on: Nov. 26, 2019. [Online]. Available: https://www.slideserve.com/cathal/an-lisis-visual-de-la-modularidad-de-modelos-de-procesos-de-software-avimo-ps

[11] G. Canfora, F. García, M. Piattini, F. Ruiz, and C. Visaggio, “A family of experiments to validate metrics for software process models,” Journal of Systems and Software, vol. 77, no. 2, pp. 113–129, aug 2005. [Online]. doi: http://dx.doi.org/10.1016/j.jss.2004.11.007

[12] E. Rolón, F. Ruiz, F. O. G. Rubio, and M. G. P. Velthuis, “Applying software process metrics in business process models.” Revista de Procesos y Métricas de las Tecnologías de la Información, vol. 3, no. 2, pp. 45–61, 2006. Accessed on: Nov. 26, 2019. [Online]. Available: https://www.aemes.org/biblioteca/revistas-de-procesos-y-metricas/numeros-publicados/category/25-numero-8.html?download=32:applying-software-process-metrics-in-business-process-models

[13] M. Nørgaard and K. Hornbæk, “What do usability evaluators do in practice?: An explorative study of think-aloud testing,” in Proceedings of the 6th Conference on Designing Interactive Systems, ser. DIS ’06. New York, NY, USA: ACM, 2006, pp. 209–218. [Online]. doi: http://dx.doi.org/10.1145/1142405.1142439

[14] M. E. Khan, F. Khan et al., “A comparative study of white box, black box and grey box testing techniques,” Int. J. Adv. Comput. Sci. Appl, vol. 3, no. 6, 2012. Accessed on: Nov. 26, 2019. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.261.1758&rep=rep1&type=pdf

[15] R. C. Martin and M. Martin, Agile principles, patterns, and practices in C# (Robert C. Martin). Prentice Hall PTR, 2006. Accessed on: Nov. 26, 2019. [Online]. Available: https://ivanderevianko.com/wp-content/uploads/2013/10/Agile-Principles-Patterns-and-Practices-in-C.pdf

[16] S. C. Allala, J. P. Sotomayor, D. Santiago, T. M. King, and P. J. Clarke, “Towards transforming user requirements to test cases using MDE and NPL,” in 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), vol. 2. IEEE, 2019, pp. 350–355. [Online]. doi: http://dx.doi.org/10.1109/COMPSAC.2019.10231

[17] A. Cockburn, Writing Effective Use Cases, 1st ed. Boston, MA, USA: Addison-Wesley Longman Publishing Co., Inc., 2000. pp. 133–192. Accessed on: Nov. 26, 2019. [Online]. Available: https://dl.acm.org/citation.cfm?id=517669

[18] S. L. Pfleeger, “Experimental design and analysis in software engineering,” Annals of Software Engineering, vol. 1, no. 1, pp. 219–253, Dec 1995. [Online]. doi: http://dx.doi.org/10.1007/BF02249052

[19] “AVISPA wiki”. [Online]. Avaliable: https://bit.ly/2OVO3yd, accessed: 2019-08-13.

[20] J. Alvarez and J. Hurtado, “UP-VSE: A unified process - based lifecycle model for very small entities,” in Advances in Computing, J. E. Serrano C. and J. C. Martínez-Santos, Eds. Cham: Springer International Publishing, 2018, pp. 260–275. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-98998-3_21

[21] M. I. Kellner, P. H. Feiler, A. Finkelstein, T. Katayama, L. J. Osterweil, M. H. Penedo, and H. D. Rombach, “Ispw-6 software process example,” in Proceedings. First International Conference on the Software Process, Oct 1991, pp. 176–186. [Online]. doi: http://dx.doi.org/10.1109/ICSP.1991.664348

[22] “Proceso de Desarrollo Industrial del Grupo de Ingeniería Automática (PRODIGIA).”. [Online]. Avaliable: http://artemisa.unicauca.edu.co/~jjalvarezl/PRODIGIA/

[23] K. Kluza, G. J. Nalepa, and J. Lisiecki, Square Complexity Metrics for Business Process Models. Cham: Springer International Publishing, 2014, pp. 89–107. [Online]. doi: http://dx.doi.org/978-3-319-03677-9_6

[24] A. Burattin, V. Bernstein, M. Neurauter, P. Soffer, and B. Weber, “Detection and quantification of flow consistency in business process models,” Software & Systems Modeling, vol. 17, no. 2, pp. 633–654, May 2018. [Online]. doi: 10.1007/s10270-017-0576-y

[25] K. Kluza, “Measuring complexity of business process models integrated with rules” in Artificial Intelligence and Soft Computing, L. Rutkowski, M. Korytkowski, R. Scherer, R. Tadeusiewicz, L. A. Zadeh, and J. M. Zurada, Eds. Cham: Springer International Publishing, 2015, pp. 649–659. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-19369-4_57

[26] K. Figl, “Comprehension of procedural visual business process models,” Business & Information Systems Engineering, vol. 59, no. 1, pp. 41–67, Feb 2017. [Online]. doi: http://dx.doi.org/10.1007/s12599-016-0460-2

[27] J. Pavlicek, R. Hronza, P. Pavlickova, and K. Jelinkova, “The business process model quality metrics,” in Enterprise and Organizational Modeling and Simulation, R. Pergl, R. Lock, E. Babkin, and M. Molhanec, Eds. Cham: Springer International Publishing, 2017, pp. 134–148. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-68185-6_10

[28] J. Pflug and S. Rinderle-Ma, “Process instance similarity: Potentials, metrics, applications,” in On the Move to Meaningful Internet Systems: OTM 2016 Conferences, C. Debruyne, H. Panetto, R. Meersman, T. Dillon, e. Kühn, D. O’Sullivan, and C. A. Ardagna, Eds. Cham: Springer International Publishing, 2016, pp. 136–154. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-48472-3_8

[29] A. del Río-Ortega, M. Resinas, A. Durán, B. Bernárdez, A. Ruiz-Cortés, and M. Toro, “Visual ppinot: A graphical notation for process performance indicators,” Business & Information Systems Engineering, Jun 2017. [Online]. doi: http://dx.doi.org/10.1007/s12599-017-0483-3

[30] J. Geisel, B. Hamid, D. Gonzales, and J.-M. Bruel, “Towards a methodological tool support for modeling security-oriented processes,” in Model and Data Engineering, L. Bellatreche, Ó. Pastor, J. M. Almendros Jiménez, and Y. Aït-Ameur, Eds. Cham: Springer International Publishing, 2016, pp. 31–41. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-45547-1_3

[31] M. Smatti, M. Oussalah, and M. Ahmed Nacer, “Supporting deviations on software processes: A literature overview,” in Software Technologies, P. Lorenz, J. Cardoso, L. A. Maciaszek, and M. van Sinderen, Eds. Cham: Springer International Publishing, 2016, pp. 191–209. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-30142-6_11

[32] G. Kaur and K. B. Bahl, “Software reliability, metrics, reliability improvement using agile process,” 2014. Accessed on: Nov. 26, 2019. [Online]. Available: http://ijiset.com/v1s3/IJISET_V1_I3_24.pdf

[33] M. Marques, J. Simmonds, P. O. Rossel and M. Bastarrica, “Software product line evolution: A systematic literature review”, in Information and Software Technology, 2019, pp. 190–208. [Online]. doi: http://dx.doi.org/10.1016/j.infsof.2018.08.014.

[34] J. Alvarez and J. Hurtado, “UP-VSE: A Unified Process - Based Lifecycle Model for Very Small Entities” in Software Technologies, C. Serrano, E. Jairo and J. Martínez-Santos, Eds. Cham: Springer International Publishing, 2018, pp. 260–275. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-98998-3_21

[35] J. Kim, “Execution Environment for Process Defined in EPF” in Big Data, Cloud Computing, Data Science & Engineering, R. Lee, 2019, pp. 117–129. [Online]. doi: http://dx.doi.org/10.1007/978-3-319-96803-2_10

[36] E. Nogueira, F. Araújo, F. Dione, E. Oliveira Jr, U. Kulesza and C. Werner, “Software process line as an approach to support software process reuse: A systematic literature review”, in Information and Software Technology, vol 116, 2019. [Online]. doi: http://dx.doi.org/10.1016/j.infsof.2019.08.007.

[37] T. Mens, A. Decan, and N. Spanoudakis, “A method for testing and validating executable statechart models”, in Software & Systems Modeling, vol. 18, no. 2, pp. 837–863, Apr. 2019, [Online]. doi: http://dx.doi.org/10.1007/s10270-018-0676-3