Luis Goncalves
Last updated on | Agile General Knowledge

How long does it take to run your Regression Testing Set?

by Luís Gonçalves
regression testing


I want to dedicate this blog to a specific problem that we had during this iteration; this will be about regression testing.

This post is for people who have the same problem, therefore can benefit from it and get some ideas from what we are trying to do.

Our feedback time is giant (Too long to know if we broke anything after committing code). After performing a quick value stream map for the development task, we found out that we take between 24h to 48h depending on committed time and working hours.

Scenario I = 48 hours

Commit at 9:00 AM
Automatic build ready to be tested at 00:00 AM
Results at 6:00 PM (It takes 18h to run all the test cases, at this time developers are out from office)
Developers are back at 9:00 AM

Scenario II = 24 hours

Commit at 06:00 PM
Automatic build ready to be tested at 00:00 AM
Results at 6:00 PM (It takes 18h to run all the test cases, developers are still at the office)

Currently, the team has 2 Test Sets, first one for smoke testing, second Full regression testing set; The smoke testing covers just the basic part, all new test cases for new features are added to the Full Regression testing set.

New Approach:
The team decided to create a third test set called “Release Test Set”, this test set will contain the test cases for features developed during the ongoing release, this means, all the automated test cases created by the team during the iterations will end on this “Release Test Set”.

When the product is released all these test cases will be moved to the “Regression Testing Set”. With this approach, the team will save around 17h of waiting time.

We will continue to run the Regression Testing Set on a daily basis but this time the team has the possibility to get quicker feedback about their actions during the iteration.

I will keep you posted about the results… If you liked this topic I am sure you will like my topic about Green Build Policy, take a look at ti.

Please comment ;);) And give me your ideas 😉

Working with Me Or Evolution4all

I have developed the Organisational Mastery” product. The aim of this product is to create a coalition that drives change and internal innovation alongside shared knowledge throughout the organisation. It’s extremely suitable for companies that want drastically improve the alignment between executive leadership and delivery teams.


We have developed a free assessment in the form of a Scorecard to help you establish which areas of business you need to focus on to achieve your particular Organisational Mastery.

Take The Test

If you liked this article, feel free to visit my company Products and Services pages.

We provide Team CoachingAgile Training, and Agile ConsultingOKR TrainingOKR ConsultingInnovation Training and Innovation Consulting.

With my team, I built 5 main products: High Performing TeamsScrum Team CoachScrum Master MentoringOrganisational Mastery and the External Business Accelerator.

Luís Gonçalves

About Luís Gonçalvesçalves1979

Luis Gonçalves is an Entrepreneur, Author & International Keynote Speaker. He works with Senior Executives to implement his ‘Organisational Mastery’ system so they can greatly increase the effectiveness and efficiency of their organisations; enabling them to become recognised and highly rewarded Leaders.


Share your point of view

  1. HI
    Thanks for sharing your experience. Its really help getting some idea. also any chance can you tell “how many test case” in each test like smoke, regression etc. also how big the script is(how many line of code)