Test Metrics can be used to measure test coverage prior to software delivery. It provides a measure of the percentage of the software tested at any point during testing.
It is calculated as follows:
Functional Test Coverage = FE/FT
Where,
FE is the number of test requirements that are covered by test cases that were executed against the software
FT is the total number of test requirements
Software Release Metrics
The software is ready for release when:
1. It has been tested with a test suite that provides 100% functional coverage, 80% branch coverage, and 100% procedure coverage.
2. There are no level 1 or 2 severity defects.
3. The defect finding rate is less than 40 new defects per 1000 hours of testing
4. Stress testing, configuration testing, installation testing, NaĂŻve user testing, usability testing, and sanity testing have been completed
Software Maturity Metric
Software Maturity Index is that which can be used to determine the readiness for release of a software system. This index is especially useful for assessing release readiness when changes, additions, or deletions are made to existing software systems. It also provides a historical index of the impact of changes. It is calculated as follows:
SMI = Mt – ( Fa + Fc + Fd)/Mt
Where
SMI is the Software Maturity Index value
Mt is the number of software functions/modules in the current release
Fc is the number of functions/modules that contain changes from the previous release
Fa is the number of functions/modules that contain additions to the previous release
Fd is the number of functions/modules that are deleted from the previous release
Reliability Metrics
Reliability is calculated as follows:
Reliability = 1 – Number of errors (actual or predicted)/Total number of lines of executable code
This reliability value is calculated for the number of errors during a specified time interval.
Three other metrics can be calculated during extended testing or after the system is in production. They are:
MTTFF (Mean Time to First Failure)
MTTFF = The number of time intervals the system is operable until its first failure (functional failure only).
MTBF (Mean Time Between Failures)
MTBF = Sum of the time intervals the system is operable
MTTR (Mean Time To Repair)
MTTR = sum of the time intervals required to repair the system
The number of repairs during the time period
February 22, 2010 at 10:58 am
Fantastic article! Thank you Rajeev.
March 29, 2010 at 6:35 am
Excellent blog. Thanks Rajeev.
March 29, 2010 at 6:36 am
Excellent bLog
June 17, 2012 at 6:24 am
Thanks Rajeev for your brief explanation…..
February 2, 2012 at 3:25 pm
nice answer…
for more details please visit
this will definitely help you…
February 13, 2012 at 2:05 pm
The problem with some testing metrics is that they can give testers incentive to pad their numbers to meet the metrics, rather than doing what’s right for the product. I discuss this issue here:
March 27, 2012 at 6:47 am
Nice blog. Thanks
September 5, 2012 at 5:48 am
Thanks rajeev. nice blog
December 3, 2012 at 11:21 am
very good article.