The University of Southampton
University of Southampton Institutional Repository

Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs

Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs
Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs
Testing is a key activity to assure the quality of concurrent applications. In recent years, a variety of different mechanisms have been proposed to test concurrent software. However, a persistent problem is the high testing cost because of the large number of different synchronization sequences that must be tested. When structural testing criteria are adopted, a large number of infeasible synchronization sequences is generated, increasing the testing cost. Although the use of reachability testing reduces the number of infeasible combination (because only feasible synchronization sequences are generated), many synchronization combinations are also generated, and this again results in a testing cost with exponential behavior. This paper presents a new composite approach that uses reachability testing to guide the selection of the synchronization sequences tests according to a specific structural testing criterion. This new composite approach is empirically evaluated in the context of message-passing concurrent programs developed with MPI. The experimental study evaluates both the cost and effectiveness of proposed composite approach in comparison with traditional reachability testing and structural testing. The results confirm that the use of the new composite approach has advantages for testing of concurrent applications.
structural testing, reachability testing, concurrent programs, experimental study
0960-0833
310-332
Souza, S. R. S.
fa81fe9b-fd41-43ff-814f-448f634eea2e
Souza, P.S.L.
f1bd1a4c-cf13-4b01-b8ed-f33c92f26cf8
Brito, M. A. S.
b497ea14-b5ac-43dd-923a-59a0fb4a6df8
Simao, A. S.
e154c13e-8fda-48af-923f-198c87beebd6
Zaluska, E. J.
43f6a989-9542-497e-bc9d-fe20f03cad35
Souza, S. R. S.
fa81fe9b-fd41-43ff-814f-448f634eea2e
Souza, P.S.L.
f1bd1a4c-cf13-4b01-b8ed-f33c92f26cf8
Brito, M. A. S.
b497ea14-b5ac-43dd-923a-59a0fb4a6df8
Simao, A. S.
e154c13e-8fda-48af-923f-198c87beebd6
Zaluska, E. J.
43f6a989-9542-497e-bc9d-fe20f03cad35

Souza, S. R. S., Souza, P.S.L., Brito, M. A. S., Simao, A. S. and Zaluska, E. J. (2015) Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs. [in special issue: Testing, Analysis and Debugging of Concurrent Programs] Software Testing, Verification and Reliability, 25 (3), 310-332. (doi:10.1002/stvr.1568).

Record type: Article

Abstract

Testing is a key activity to assure the quality of concurrent applications. In recent years, a variety of different mechanisms have been proposed to test concurrent software. However, a persistent problem is the high testing cost because of the large number of different synchronization sequences that must be tested. When structural testing criteria are adopted, a large number of infeasible synchronization sequences is generated, increasing the testing cost. Although the use of reachability testing reduces the number of infeasible combination (because only feasible synchronization sequences are generated), many synchronization combinations are also generated, and this again results in a testing cost with exponential behavior. This paper presents a new composite approach that uses reachability testing to guide the selection of the synchronization sequences tests according to a specific structural testing criterion. This new composite approach is empirically evaluated in the context of message-passing concurrent programs developed with MPI. The experimental study evaluates both the cost and effectiveness of proposed composite approach in comparison with traditional reachability testing and structural testing. The results confirm that the use of the new composite approach has advantages for testing of concurrent applications.

Text
stvr1568.pdf - Accepted Manuscript
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 11 January 2015
e-pub ahead of print date: 9 February 2015
Published date: May 2015
Keywords: structural testing, reachability testing, concurrent programs, experimental study
Organisations: Web & Internet Science

Identifiers

Local EPrints ID: 376611
URI: http://eprints.soton.ac.uk/id/eprint/376611
ISSN: 0960-0833
PURE UUID: 707f126b-e366-49a5-81c0-f52bdb311049

Catalogue record

Date deposited: 05 May 2015 15:28
Last modified: 06 Oct 2020 23:31

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×