Simply enter your keyword and we will help you find what you need.

What are you looking for?

Test Automation

← Back to timetable

MAIN TRACK TALK

Meaningful Metrics of Test Automation

The question about what success looks like for test automation has been on Irja’s mind since the beginning of her career, and the answer has evolved and changed drastically over the years. With all the shinny new tools and AI, it’s easy to neglect what value does our test automation efforts bring, and we are often fooled by wrong metrics such as only relying on test coverage. In this talk, Irja will present the evolving thought on how success and value looked different from different angles, and why it is important to know and calculate the value of your invested efforts.

The talk begins with a brief introduction, followed by personal anecdotes illustrating the speaker’s evolving understanding of success in test automation across different roles. The core of the presentation explores the complexities of defining and measuring success in this context. Key terminology is defined, and the calculation of ROI is discussed, emphasizing the importance of considering both direct and indirect costs. Common pitfalls, such as over-reliance on test coverage, are highlighted, and the focus shifts towards more meaningful metrics. The talk concludes with practical takeaways, underscoring the significance of actionable metrics and the influence of roles on success.


What you’ll learn


From this talk you will learn:

How to calculate the return of investment in a meaningful way for test automation projects and which metrics to look at.


Importance of considering different aspects of costs (especially the indirect ones such as opportunity cost) when measuring.


Understanding why success looks very different depending on the role.


Session details

Track 2

15:15h - 16:00h · May 21st

40 mins + 5 mins Q&A

Test Automation

General Level

Talk in English, translated to Spanish

irja_straus

Irja Straus

Irja Straus has founded her own consulting company specializing in quality engineering and testing. She started her professional adventure as a software tester and business analyst, after which she took over the product manager role in the company that became the first Croatian unicorn. After a multi-year product adventure, Irja accepted the challenge of establishing testing practices and integrating quality from the early on. For the past few years, she has focused on modern exploratory testing, quality engineering practices, process organization, and encouraging healthy team collaboration.