-
Time
-
Deadline
- for testing
- for iteration
- for release
- other important dates for the project
- We stopped maintaining the product
- Dates are known, consistent, write down in the test plan
- Budget
-
All planned testing was completed
- All goals have been achieved
-
The required level of test coverage is achieved
- For new functions
- For regress
-
The main scenarios are stable
- All the critical test cases successfully passed
- All test cases successfully passed
- All interactions are taken into account
-
Defects
-
No defects with high priority and severity
- Fixed
- Retest
-
Defects with low priority and severity
-
Agreed with Team and Managers
- The final decisions are made and they are clears for all members
- Do not affect the basic user scenarios or their impact is minimall
- MTBF (Mean Time Between Failure) corresponds to the expected time
- Defect detection rate is lower than set value
- We can not to find defects more
- All risks are taken into account
- All needed information about testing is documented
-
Use metrics
-
For Test-Cases
- % of executed test case corresponds to the required
- % passed test-cases corresponds to the required
-
% failed test-cases corresponds to the required
- Such test cases do not refer to the base scenarios
- Required level of test coverage is achieved
-
For Defects
- The density / number of finding defects corresponds to the required
-
For autotests
- All autotests passed successfully
- % passed autotests corresponds to the required
-
For requirements
- All requirements have been testing
-
Technical problem
- Problems with the servers, network, and other force majeure
-
Product crash
- Too many critical and blocking defects
-
Personal feelings
-
What our intuition tells us
- Is there an inner sense of incompleteness?
- Are there any questions, uncertainties?
- I do not know what to do next
-
External events
- The requirements have changed
- Testing was canceled by managers
- The release time was changed
- Functional became irrelevant
- Task priority was changed
-
What we remember
-
Testing Result
- Successful
- Unsuccessful
- Testing should be continued
- Never compromise on quality
-
Impossibility of Complete Testing
- Principle: exhaustive testing is impossible
- The longer we test, the more defects we will find
- Any product contains an unlimited number of defects
- We can not be sure that the product does not contain defects
- All used metrics and its values, the models should be agreed with the Team and Managers
-
Parkinson's law
- work expands so as to fill the time available for its completion
-
Useful links
-
Michael Bolton
- http://www.developsense.com/blog/2009/09/when-do-we-stop-test/
-
The Art of Software Testing
- https://www.amazon.com/dp/0471043281/?tag=stackoverflow17-20
-
Simon Knight
- https://blog.gurock.com/when-do-i-stop-testing/
-
Yegor Bugayenko
-
The Formula for Software Quality
- http://www.yegor256.com/2017/12/26/software-quality-formula.html
-
Any Program Has an Unlimited Number of Bugs
- http://www.yegor256.com/2017/05/23/unlimited-number-of-bugs.html
-
http://www.softwaretestinghelp.com Renuka K.
- http://www.softwaretestinghelp.com/when-to-stop-testing-exit-criteria-in-software-testing/