Triaged Tester

January 4, 2009

Automation Health Index – 2

Filed under: Automation — Triaged Tester @ 12:45 pm
Tags:

Time to put the thoughts in excel for tracking and implementation

Area TC # # Run Run/TC Pass % Test Issue Envronment Issue Product Bug ! Investigated Other Pass last duration Pass Avg Duration
BVT 35 58 1.7 94% 0% 0% 0% 0% 0% 17 min 18 min
Save                      
Open                      
                       

Most of the headers are self explanatory. The Areas correspond to the functional areas that have been selected for automation. We added another level of traceability for each such areas

ID Title #Run Pass Test Issue Env Issue Product Bug ! Investigated Other Pass last duration Pass Avg Duration
10 verify the save 3                
11                    
12                    
                     
                     

The user can then add more info on the details for test  issue, environ etc using

Result Resolution Cause Bug  Count
Automation Env Issue      
  Timing Issue   2
  Control not loaded   1
  Automation name changed   4
Test Issue      
  Failed prematurely   2
  Bug # , Blocking   1
       

 Automated test case with low Test Automation Health Index might be not reliable, not effective or having bad performance.  From this index, we can easily tell that this test case have failed multiple times due to test issue. Analyzing and resolving test results as test issue is expensive and causing test automation to be not effective and impacting the successfulness of test automation. The further action that we can take is to put automated test cases with low Test Automation Health Index to a bucket and then fix the problem that these automated test cases encounter.Also it will help us to determine where we are in our test automation. Instead of having abstract measurement, we have concrete index that we can use to measure the reliability, effectiveness and performance of our test automation. These will help us to plan further actions to improve this index over time to have healthy and successful test automation.  

Happy Automating 🙂

Advertisements

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Create a free website or blog at WordPress.com.

%d bloggers like this: