On Integrating Multiple Restriction Domains to Automatically Generate Test Cases of Model Transformations

Hanh Thi Nguyen, Hanh Duc Dang

Abstract


Testing model transformations poses several challenges, one of which is how to automatically generate effective test suites. Existing approaches in the literature often focus on exploiting either structural aspects of models captured by a metamodel or restrictions as contracts within the specification of model transformation for a partition analysis to generate test suites. However, test cases for model transformation, i.e., test models, often need to be defined not only from one restriction source as within the current methods but also from many different sources. This paper introduces a method to facilitate defining test models on such multiple restriction domains. This method also allows the tester to flexibly select and combine constraints as a restriction on test models for different strategies and objectives of the model transformation testing. We develop a support tool based on the OCL tool USE and perform experiments on several different transformations to point out the effectiveness of our method.


Full Text:

PDF

References


E. Brottier, F. Fleurey, J. Steel, B. Baudry, and L.T. Yves. (2006). Metamodel-based Test Generation for Model Transformations: an Algorithm and a Tool. Symposium on Software Reliability Engineering, IEEE, pp.85-94.

J. Wang, S.K. Kim, and D. Carrington. (2006). Verifying metamodel coverage of model transformations. Australian Software Engineering Conference, IEEE, pp.270–282.

S. Sen, B. Baudry, and J.M. Mottu. (2008). On combining multi-formalism knowledge to select models for model transformation testing. Software Testing, Verification and Validation (ICST), IEEE, pp. 328–337.

B. Baudry, D.T. Trung, J. M. Mottu, D. Simmonds, R. France, S. Ghosh, F. Fleurey, and L.T. Yves. (2006). Model Transformation Testing Challenges. Workshop on Integration of Model Driven Development and

Model Driven Testing.

E. Guerra. (2012). Specification-driven test generation for model transformations. International Conference on Model Transformation, pp. 40–55.

A.C. Carlos and J. Cabot. (2014). Test Data Generation for Model Transformations Combining Partition and Constraint Analysis. International Conference on Model Transformation, pp. 25-41.

F. Hilken, M. Gogolla, L. Burgueno, and A. Vallecillo. (2018). Testing models and model transformations using classifying terms. Software and Systems Modeling, pp. 885-912.

J. Wang, S.K. Kim, and D. Carrington. (2008). Automatic generation of test models for model transformations. Australian Conf. on Software Engineering, IEEE, pp. 432–440.

M. Lamari. (2007). Towards an automated test generation for the verification of model transformations. ACM Symposium on Applied Computing (SAC), ACM, pp. 998–1005.

J.M. K¨uster and M. Abd-El-Razik. (2006). Validation of Model Transformations - First Experiences Using a White Box Approach. Models in Software Engineering, Workshops and Symposia at MoDELS 2006, pp. 193-204.

C.A. Gonzalez and J. Cabot. (2012). Atltest: A white-box test generation approach for ATL transformations. Conf. on Model

Driven Engineering Languages and Systems, pp. 449–464.

D. Calegari and A. Delgado. (2013). Rule Chains Coverage for Testing QVT-Relations Transformations. Proceedings of the Second

Workshop on the Analysis of Model Transformations (AMT 2013).

M. Wieber, A. Anjorin, and A. Schurr. (2014). On the Usage of TGGs for Automated Model Transformation Testing. Theory and Practice of Model Transformations, pp. 1-16.

L. Lengyel and H. Charaf. (2015). Testdriven verification/validation of model transformations. Frontiers of Information Technology and Electronic Engineering, pp. 85-97.

http://www.eclipse.org/atl/atlTransformations/

J.S. Cuadrado. (2020). Towards Interactive, Test-driven Development of Model Transformations. Journal of Object Technology, 19(1), pp. 1-22.

H. Ehrig, C. Ermel, U. Golas, and F. Hermann. (2015). Graph and Model Transformation - General Framework and Applications. Monographs in Theoretical Computer Science, Springer, pp. 5-399.

http://www.omg.org/spec/MOF/

A. Vallecillo, M. Gogolla, L. Burgueno, M. Wimmer, and Lars Hamann. (2012). Formal Specification and Testing of Model Transformations. Formal Methods for Model-Driven Engineering, Springer, pp. 399-437.

M. Gogolla, F. B¨uttner, and M. Richters. (2007). USE: A UML-based specification environment for validating UML and OCL. Science of Computer Programming, 69(1), pp. 27-34.

E. Torlak, and D. Jackson. (2007). Kodkod: A Relational Model Finder. International Conference on Tools and Algorithms for Construction and Analysis of Systems, pp. 632-647.

A.A. Andrews, R.B. France, S. Ghosh, and G. Craig. (2003). Test adequacy criteria for UML design models. Softw. Test. Verification

Reliab, 13(2), pp. 95-127.

F. Fleurey, J. Steel, and B. Baudry. (2004). Validation in Model-Driven Engineering: Testing Model Transformation. First International Workshop on Model, Design and Validation, IEEE, pp.29-40.

T.H. Nguyen and D.H. Dang. (2021). A Graph Analysis Based Approach for Specification-Driven Testing of Model Transformations. NAFOSTED Conference on Information and Computer Science, pp. 224-

K. Lano, S. Fang, and S.K. Rahimi. (2020). Model Transformation Specification and Verification. Proceedings - International Conference on Quality Software, pp. 45-54.

K. Fogen, H. Lichter. (2019). Combinatorial Robustness Testing with Negative Test Cases. International Conference on Software

Quality, Reliability and Security, pp. 34-45.

D.H. Dang. (2009). On integrating triple graph grammars and OCL for model-driven development. University of Bremen, Ph.D. thesis, 2009.

A.G. Dom´ınguez and G. Hinkel. (2019). The TTC 2019 Live Case: BibTeX to DocBook. Proceedings of the 12th Transformation Tool

Contest, co-located with the 2019 Software Technologies: Applications and Foundation, pp. 61-65.

A. Anjorin, T. Buchmann, and B. Westfechtel. (2017). The Families to Persons Case. Proceedings of the 10th Transformation Tool Contest (TTC 2017), pp. 27-34.

Z. Li, X. Zhou, Z. Ye. (2019). A Formalization Model Transformation Approach on Workflow Automatic Execution from CIM

Level to PIM Level. International Journal of Software Engineering and Knowledge Engineering, pp. 1179-1217.

J.M. Mottu, B. Baudry, and Y. L. Traon. (2006). Mutation analysis testing for model transformations. Model Driven Architecture

- Foundations and Applications, 2nd European Conference, pp. 376–390.

A.R. Lukman and J. Whittle. (2013). A survey of approaches for verifying model transformations. Software and Systems Modeling, pp. 1003-1028.




DOI: https://doi.org/10.31449/inf.v47i1.4421

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.