Behaviour Abstraction Coverage as Black-Box Adequacy Criteria

HERNAN CZEMERINSKI; VICTOR A. BRABERMAN; SEBASTIÁN UCHITEL

Simposio; 15 Simposio Argentino de Ingeniería de Software; 2014

Code artefacts that have non-trivial requirements with respect to the order- ing in which their methods or procedures ought to be called are common and appear, for instance, in the form of API implementations and objects. Testing such code artefacts to gain condence in that they conform to their intended protocols is an important and challenging problem. In this paper we propose and study experimentally conformance testing adequacy criteria based on cov- ering an abstraction of the intended behavior´s semantics. Thus, the criteria are independent of the specication language and structure used to describe the intended protocol and the language used to implement it. The coverage criteria are dened over enabledness preserving abstractions (EPAs). These abstractions quotient an innite state space into nite classes of states which allow the same method calls. We evaluate failure detection ability on ve industrially relevant Java classes with rich protocols by analysing the mutant detection capability of randomly generated test suites.