Many companies/teams/people are bragging about their automation. However I have few questions that help me to find the truth
- How many test cases do you have?
- Can you show me the "morning run" results?
- How are you handling bugs that blocks automated tests?
- What is average failure rate for the daily runs?
- How you are dealing with flaky tests?
- How much time are you spending in analyzing and support of the automation tests?
- What kind of CI your team is using and how your tests are integrated with it?
- What is your testing lab?
Note that there is no right answer for each question, but yet those questions work well to find the truth :-)
No comments:
Post a Comment