Model-Based Testing: Automatic Generation of Test Cases, Test Data and Test Procedures from SysML Models 2015-01-2553
Model-based development is a well-established and widely used technique to design and implement systems by specifying the overall architecture of a system and its behavior directly in modeling tools such as PTC Integrity Modeler, Enterprise Architect, Modelio, or Papyrus/Eclipse. The next step forward in this process is using the same framework also for the design and specification of the tests for these systems. Verified Systems International GmbH offers with RT-Tester MBT a novel approach to model-based embedded systems testing, which we are going to present in this paper. Model-based testing (MBT) offers automated generation of test cases, test data and test procedures for model-in-the-loop, hardware-in-the-loop and system testing from UML/SysML models describing the intended system behavior [ 17 , 20 ]. The presented approach offers a number of different testing strategies which can be used to tailor the generated test suites, e.g., according to the targeted criticality level for safety-critical systems. Moreover, it provides full traceability of requirements and test data for the entire testing workflow from the test model to the test execution reports. This feature is of special relevance for safety-critical systems from the avionics, automotive or railway domains. These application domains additionally require that a tool qualification is performed for automated testing tools.
SAE MOBILUS
Subscribers can view annotate, and download all of SAE's content. Learn More »
Access SAE MOBILUS »
Creating a Systems Simulation Framework & Roadmap
2013-01-2282
View Details
PEGASE - A Robust and Efficient Tool for Worst-Case Network Traversal Time Evaluation on AFDX
2011-01-2711
Evaluation of Future Topologies and Architectures for High-Reliability Electrical Distribution Systems
2020-01-1296
Generative Model-Based Testing on Decision-Making Policies
Ieee account.
- Change Username/Password
- Update Address
Purchase Details
- Payment Options
- Order History
- View Purchased Documents
Profile Information
- Communications Preferences
- Profession and Education
- Technical Interests
- US & Canada: +1 800 678 4333
- Worldwide: +1 732 981 0060
- Contact & Support
- About IEEE Xplore
- Accessibility
- Terms of Use
- Nondiscrimination Policy
- Privacy & Opting Out of Cookies
A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. © Copyright 2024 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.
International Conference on Tools and Methods for Program Analysis
TMPA 2017: Tools and Methods of Program Analysis pp 77–89 Cite as
A Survey on Model-Based Testing Tools for Test Case Generation
- Wenbin Li 12 ,
- Franck Le Gall 12 &
- Naum Spaseski 12
- Conference paper
- First Online: 30 December 2017
1261 Accesses
21 Citations
Part of the book series: Communications in Computer and Information Science ((CCIS,volume 779))
Compared to traditional testing methods, Model-Based Testing (MBT) is able to manage and accomplish testing tasks in a cheaper and more efficient way. A number of MBT tools are developed to support MBT activities in the past few years, whereas the characteristics of these tools largely vary from one to another and users without prior knowledge can hardly choose appropriate tools. This paper aims at providing a survey on the emerging MBT tools following a list of criteria emphasizing on test case generation while illustrating aspects of test data and test script generation. Firstly, we introduce the general MBT process for a common understanding; we then present a list of criteria oriented to test case generation covering fours dimensions i.e., model specification, test generation, test description and overall support; following our proposed criteria, we survey and characterize the emerging MBT tools; at last we summarize the current limitations based on our survey and shed light on further directions of MBT tool development.
- Model-Based Testing
- Test generation
- Model specification
- Test description
This is a preview of subscription content, log in via an institution .
Buying options
- Available as PDF
- Read on any device
- Instant download
- Own it forever
- Available as EPUB and PDF
- Compact, lightweight edition
- Dispatched in 3 to 5 business days
- Free shipping worldwide - see info
Tax calculation will be finalised at checkout
Purchases are for personal use only
Kramer, A., Legeard, B.: Model-Based Testing Essentials: Guide to the ISTQB Certified Model-Based Tester Foundation Level. Wiley, Hoboken (2016)
Book Google Scholar
Capgemini, World Quality Report 2016–17
Google Scholar
Model-Based Engineering Forum. http://modelbasedengineering.com/
Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann Publishers, Amsterdam, Boston (2007)
Spillner, A., Linz, T., Schaefer, H.: Software testing foundations: a study guide for the certified tester exam: foundation level, ISTQB compliant. Rocky Nook Inc, Santa Barbara (2014)
Hartman, A.: Model based test generation tools. Agedis Consortium (2002). http://wwwagedis.de/documents/ModelBasedTestGenerationTools_cs.pdf
Budnik, C.J., Subramanyan, R., Vieira, M.: Peer-to-Peer comparison of model-based test tools. GI Jahrestagung 1 (133), 223–226 (2008)
Shafique, M., Labiche, Y.: A systematic review of model based testing tool support. Carleton University, Canada, Technical Report SCE-10-04 (2010)
Marinescu, R., Seceleanu, C., Le Guen, H., Pettersson, P.: A research overview of tool-supported model-based testing of requirements-based designs. In: Advances in Computers, pp. 89–140. Elsevier (2015)
Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Softw. Test. Verification Reliab. 22 , 297–312 (2012)
Article Google Scholar
Willcock, C. (ed.): An introduction to TTCN-3. Wiley, Chichester, Hoboken (2011)
JUnit. http://junit.org/junit4/
Selenium - Web Browser Automation. http://www.seleniumhq.org/
Robot Framework. http://robotframework.org/
Eclipse Formal Modeling Project. https://projects.eclipse.org/proposals/eclipse-formal-modeling-project
Faivre, A., Gaston, C., Le Gall, P.: Symbolic model based testing for component oriented systems. In: Petrenko, A., Veanes, M., Tretmans, J., Grieskamp, W. (eds.) FATES/TestCom -2007. LNCS, vol. 4581, pp. 90–106. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73066-8_7
Chapter Google Scholar
FMBT. https://01.org/fmbt/
Modbat. https://people.kth.se/~artho/modbat/
Muniz, L.L., Netto, U.S., Maia, P.H.M.: TCG: a model-based testing tool for functional and statistical testing. In: ICEIS 2015-Proceedings of the 17th International Conference on Enterprise Information Systems, pp. 404–411 (2015)
LoTuS. http://jeri.larces.uece.br/lotus/
Tcases. https://github.com/Cornutum/tcases
Sanchez, J.: A review of pair-wise testing (2016). arXiv:1606.00288 [cs]
MISTA - Model-Based Testing. http://cs.boisestate.edu/~dxu/research/MBT.html
Momut. https://momut.org/
Herzner, W., Schlick, R., Brandl, H., Wiessalla, J.: Towards fault-based generation of test cases for dependable embedded software
HTG. https://sites.google.com/site/htgtestgenerationtool/home
Netlist Syntax. http://fides.fe.uni-lj.si/spice/netlist.html
LaValle, S.M., Branicky, M.S.: On the relationship between classical grid search and probabilistic roadmaps, pp. 59–75 (2004)
Lurrette. http://www-verimag.imag.fr/Lurette,107.html
Raymond, P., Roux, Y., Jahier, E.: Lutin: a language for specifying and executing reactive scenarios. EURASIP J. Embedded Syst. 2008 , 753821 (2008)
Lustre V6. http://www-verimag.imag.fr/Lustre-V6.html
Vera. http://www.spacios.eu/index.php/spacios-tool/
CompleteTest. http://www.completetest.org/about/
Larsen, K.G., Pettersson, P., Yi, W.: UPPAAL in a Nutshell (1997)
Smartesting CertifyIt. http://www.smartesting.com/en/certifyit/
IBM - Rational Software Architect Designer. http://www-03.ibm.com/software/products/en/ratsadesigner
PragmaDev - Modeling and Testing tools. http://pragmadev.com/
Li, N., Offutt, J.: An empirical analysis of test oracle strategies for model-based testing. Presented at the March 2014
Download references
Acknowledgement
Preparation of this paper was supported by the PHANTOM project, which receives funding from the European Union’s Horizon 2020 Research and Innovation Programme under grant agreement No. 688146. The content of this article does not reflect the official opinion of the European Union. Responsibility for the information and views expressed in this article lies entirely with the author(s).
Author information
Authors and affiliations.
Easy Global Market, Sophia Antipolis, France
Wenbin Li, Franck Le Gall & Naum Spaseski
You can also search for this author in PubMed Google Scholar
Corresponding author
Correspondence to Wenbin Li .
Editor information
Editors and affiliations.
St. Petersburg Polytechnic University, St. Petersburg, Russia
Vladimir Itsykson
University of Pennsylvania, Philadelphia, Pennsylvania, USA
Andre Scedrov
FRC CSC, Moscow, Russia
Victor Zakharov
Rights and permissions
Reprints and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper.
Li, W., Le Gall, F., Spaseski, N. (2018). A Survey on Model-Based Testing Tools for Test Case Generation. In: Itsykson, V., Scedrov, A., Zakharov, V. (eds) Tools and Methods of Program Analysis. TMPA 2017. Communications in Computer and Information Science, vol 779. Springer, Cham. https://doi.org/10.1007/978-3-319-71734-0_7
Download citation
DOI : https://doi.org/10.1007/978-3-319-71734-0_7
Published : 30 December 2017
Publisher Name : Springer, Cham
Print ISBN : 978-3-319-71733-3
Online ISBN : 978-3-319-71734-0
eBook Packages : Computer Science Computer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Publish with us
Policies and ethics
- Find a journal
- Track your research
- 30s Summary
- 3min Overview
- Model Usage Demo
LATTE3D Usage Demo
Result visualizations, comparisons with other text-to-3d methods, benefit: quickly assemble scenes, benefit: enhanced quality with test-time optimization, benefit: enhanced user-controllability via interpolations, downstream application: text-to-4d, additional comparison results.
IMAGES
VIDEO
COMMENTS
Model-based testing in practice: ... The goal of this experience report (applied research report), done based on "action research", is to share our experience of applying and evaluating MBT as a software technology (technique and tool) in a real industrial setting. ... By learning from the best practices in this paper, other test engineers ...
Model-Based Testing (MBT) is a blac k-box testing technique that generates tests from abstract behav- ioral models [21]. It allows to automate or semi-automate the entire testing process.
Model-based test case generation (MB-TCG) and prioritization (MB-TCP) utilize models that represent the system under test (SUT) for test generation and prioritization in software testing. They are based on model-based testing (MBT), a technique that facilitates automation in testing. Automated testing is indispensable for testing complex and industrial-size systems because of its advantages ...
In this paper, we research the application of industry strength Model-Based Testing (MBT) within the IoT domain. This technique contributes to higher quality specifications and more efficient and ...
The GTRI has conducted a pilot model-based approach leveraging the Systems Modeling Language (SysML) and the UML Testing Profile (UTP) to expedite the Test and Evaluation (T&E) craft by automatically generating test cases based upon a canonical system specification. Using a model-based approach creates a sustainable and maintainable process to ...
In this intersection fall two types of research: 1. test-based learning: various (active) ... Since the scope of this paper is the combination of model-based testing and ... black-box programs in this volume for a complementary survey): 1. Model-based test-based learning, i.e., the use of model-based testing as a ...
Explore the latest full-text research PDFs, articles, conference papers, preprints and more on MODEL-BASED TESTING. Find methods information, sources, references or conduct a literature review on ...
Model-based testing. Model-Based Testing (MBT) is a black-box testing technique that generates tests from abstract behavioral models [21]. It allows to automate or semi-automate the entire testing process. Moreover, the testing activities can be left-shifted and the SUT can be tested at an early stage in the software development life cycle.
Model-based testing (MBT) is a structured testing technique in which models are used to guide the testing process. Specification test models can, for example, describe the input-output functionality of a unit (function, class, module, or component) [HRD07, MN10], specify the state-based behavior of a unit [] or a system [], or sequences of interactions with graphical user interface [].
Model-based testing builds on model-driven development in which models are used to automate the testing process. According to Utting et al. [27], [28] MBT is a type of testing that utilizes the information in model which is the intended behavior of the system and its environment. There are several motivations for performing model based testing such as easy test maintenance, automated test ...
Download a PDF of the paper titled Model-based testing in practice: An experience report from the web applications domain, by Vahid Garousi and 4 other authors. ... The goal of this experience report (applied research report), done based on "action research", is to share our experience of applying and evaluating MBT as a software technology ...
The main topics addressed in this Rapid Review span over two major research directions that are: model-based security testing and IoT security testing. ... we wanted to exclude papers not targeting the Rapid Review topics, i.e., papers not addressing model-based testing solutions for guaranteeing security in IoT domains. Also works not ...
Model-based testing in practice: An experience report from ... The goal of this experience report (applied research report), done based on "action research", is to share our experience of applying and ... this paper, other test engineers could conduct more mature MBT in their test projects. Keywords: Software testing; test automation; model ...
Model-based testing (MBT) offers automated generation of test cases, test data and test procedures for model-in-the-loop, hardware-in-the-loop and system testing from UML/SysML models describing the intended system behavior [17, 20].The presented approach offers a number of different testing strategies which can be used to tailor the generated test suites, e.g., according to the targeted ...
This paper describes a novel approach to developing a model-based framework for production testing of aerospace hardware. The project team maintains a systems approach to process transformation, while addressing multiple business concerns including organizational structure, talent retention, product lifecycle management, and test equipment ...
In this issue, we are pleased to present three papers on model-based testing, test case prioritization and testing of virtual reality applications. The first paper, 'On transforming model-based tests into code: A systematic literature review' by Fabiano C. Ferrari, Vinicius H. S. Durelli, Sten F. Andler, Jeff Offutt, Mehrdad Saadatmand and ...
Model-Based Testing. Abstract: Model-based testing (MBT) strives to automatically and systematically generate test cases. In this column, Ina Schieferdecker introduces MBT technologies and methods. Published in: IEEE Software ( Volume: 29 , Issue: 1 , Jan.-Feb. 2012 )
7 Concluding remarks. This paper has presented a model-based approach to leverage existing Web test cases, and a supporting tool named MoLeWe. The tool supports the model generation, extension and test generation, improving the synergy between existing automated tests and model-based testing.
The reliability of decision-making policies is urgently important today as they have established the fundamentals of many critical applications, such as autonomous driving and robotics. To ensure reliability, there have been a number of research efforts on testing decision-making policies that solve Markov decision processes (MDPs). However, due to the deep neural network (DNN)-based inherit ...
The sensitivity of this blood-based test for colorectal cancer was 83.1%, whereas reported sensitivity of other noninvasive screening tests ranges from 67.3% (95% CI, 57.1 to 76.5) with FIT 15 and ...
The goal of this experience report (applied research report), done based on "action research", is to share our experience of applying and evaluating MBT as a software technology (technique and tool) in a real industrial setting.
The basic idea of model-based testing (MBT) is that instead of creating test cases manually, selected algorithms are generating them automatically from a (set of) model(s) of the system under test or of its ... research papers addressing model-based security (see e.g. [2, 9] and model-based testing (see e.g. [1]),
Model-based GUI testing: 33: 2010: Memon and Nguyen (2010) Literature review: TDD of user interfaces: 6: ... However, since we only assessed the rubrics for papers with research facets of "validation research" and "evaluation research" in our study, the trends are better, in that we are observing quite a reasonable level of rigor and ...
different types of test cases within MBT (Model Based Test). In this paper, we focus only on generating test cases from models, the source code generation part was presented in our previous works, namely [5] and [6]. Before presenting our approach we note that developing software systems go through three major testing phases.
Abstract. Compared to traditional testing methods, Model-Based Testing (MBT) is able to manage and accomplish testing tasks in a cheaper and more efficient way. A number of MBT tools are developed to support MBT activities in the past few years, whereas the characteristics of these tools largely vary from one to another and users without prior ...
To test generalization to arbitrary prompts, we train our model on a larger set of 100k prompts, constructed by using ChatGPT to augment the captions of the lvis Objaverse subset. We generalize to unseen, in-distribution augmented captions. Even more, we generalize to unseen, out-of-distribution prompts from DreamFusion.
Fretting fatigue is a specific fatigue phenomenon. Due to the complex mechanisms and multitude of influencing factors, it is still hard to predict fretting fatigue life accurately, despite there being many works on this topic. This paper developed a particle-swarm-optimized back propagation neural network to predict the fretting fatigue life of aluminum alloys using the test data gathered from ...