Orthogonal array testing


Orthogonal array testing is a black box testing technique that is a systematic, statistical way of software testing. It is used when the number of inputs to the system is relatively small, but too large to allow for exhaustive testing of every possible input to the systems. It is particularly effective in finding errors associated with faulty logic within computer software systems. Orthogonal arrays can be applied in user interface testing, system testing, regression testing, configuration testing and performance testing.
The permutations of factor levels comprising a single treatment are so chosen that their responses are uncorrelated and therefore each treatment gives a unique piece of information. The net effects of organizing the experiment in such treatments is that the same piece of information is gathered in the minimum number of experiments.

Background

Orthogonal vector

Orthogonal vectors exhibit orthogonality. Orthogonal vectors exhibit the following properties:
Consider a system which has three parameters and each of them has three values. To test all the possible combinations of these parameters we will need a set of 33 = 27 test cases. But instead of testing the system for each combination of parameters, we can use an orthogonal array to select only a subset of these combinations. Using orthogonal array testing, we can maximize the test coverage while minimizing the number of test cases to consider. We here assume that the pair that maximizes interaction between the parameters will have more defects and that the technique works.
Test case ↓CountryProductSalesperson
TC-1DENotebookCharlie
TC-2DEDesktopBob
TC-3DEMouseAlice
TC-4USNotebookBob
TC-5USDesktopAlice
TC-6USMouseCharlie
TC-7GBNotebookAlice
TC-8GBDesktopCharlie
TC-9GBMouseBob

Given that assumption, the table shows the set of nine combination of parameters which are sufficient to catch the fault, considering the interaction of the input parameters, which is very effective and economical. The array is orthogonal, because all possible pair-wise combinations between parameters occurs only once.
The given L9 Orthogonal Array assess result of test cases as follows:
Single-mode faults – Single mode faults occur only due to one parameter. For example, in above Orthogonal array if test cases TC-7, TC-8 and TC-9 show error, we can expect that value of parameter is causing the error. Likewise we can detect as well as isolate the error.
Double-mode fault – Double mode fault is caused by the two specific parameters values interacting together. Such an interaction is a harmful interaction between interacting parameters.
Multimode faults – If more than two interacting components produce the consistent erroneous output, then it is a multimode fault. Orthogonal array detects the multimode faults.
Refer the following link for more details:
http://www.51testing.com/ddimg/uploadsoft/20090113/OATSEN.pdf

Benefits