Triaged Tester

January 3, 2009

Automation Health Index – 1

Filed under: Automation — Triaged Tester @ 12:27 pm
Tags:

It is no doubt that the role of test automation has become more and more important in keeping the quality of our product at the top level. I have seen companies invest a lot in test automation and seen the result where we can automatically kick off a bunch of test cases with minimum user intervention.

All of these achievements are great, but i still needed a way to

1. Measure the successfullness of our automation

2. Track and take the automation to next level

I think if we fullfil – Reliability(Successful test automation needs to deliver consistent and reliable results every time test automation is being run), Effectiveness & performance(how long it will take for the test automation to run) of the automation, we can add them as accountable to the successfullness.

Using the past history of information , i have come up with a Test Automation Health index. To be specific

  • How many times the automated test case has been run?
  • How many times the automated test case produce complete and pass result?
  • How many times the automated test case is resolved as passed due to test issue?
  • How many times the automated test case is resolved as passed due to environment issue?
  • How many times the automated test case is resolved as failed due to product bug?
  • How many product bugs has the automated test case found?
  • How long is the duration for the test case to run?
  • We will take into account the run purpose so that Test Automation Health Index will gather results for specific run purpose.

For ease i have created an excel format which i will post tomorrow..

Advertisements

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Blog at WordPress.com.

%d bloggers like this: