Tag Archives: doneness

Measurements Towards Continuous Delivery

I was asked yesterday what measurements a team could start to take to track their progress towards continuous delivery. Here are some initial thoughts.

Lead time per work item to production

Lead time starts the moment we have enough information that we could start the work (ie it’s “ready”). Most teams that measure lead time will stop the clock when that item reaches the teams definition of “done” which may or may not mean that the work is in production. In this case, we want to explicitly keep tracking the time until it really is in production.
Note that when we’re talking about continuous delivery, we make the distinction between deploy and release. Deploy is when we’ve pushed it to the production environment and release is when we turn it on. This measurement stops at the end of deploy.

Cycle time to “done”

If the lead time above is excessively long then we might want to track just cycle time. Cycle time starts when we begin working on the item and stops when we reach “done”.
When teams are first starting their journey to continuous delivery, lead times to production are often measured in months and it can be hard to get sufficient feedback with cycles that long. Measuring cycle time to “done” can be a good intermediate measurement while we work on reducing lead time to production.

Escaped defects

If a bug is discovered after the team said the work was done then we want to track that. Prior to hitting “done”, it’s not really a bug – it’s just unfinished work.
Shipping buggy code is bad and this should be obvious. Continuously delivering buggy code is worse. Let’s get the code in good shape before we start pushing deploys out regularly.

Defect fix times

How old is the oldest reported bug? I’ve seen teams that had bug lists that went on for pages and where the oldest were measured in years. Really successful teams fix bugs as fast as they appear.

Total regression test time

Track the total time it takes to do a full regression test. This includes both manual and automated tests. Teams that have primarily manual tests will measure this in weeks or months. Teams that have primarily automated tests will measure this in minutes or hours.
This is important because we would like to do a full regression test prior to any production deploy. Not doing that regression test introduces risk to the deployment. We can’t turn on continuous delivery if the risk is too high.

Time the build can be broken

How long can your continuous integration build be broken before it’s fixed? We all make mistakes. Sometimes something gets checked in that breaks the build. The question is how important is it to the team to get that build fixed? Does the team drop everything else to get it fixed or do they let it stay broken for days at a time?

Continuous delivery isn’t possible with a broken build.

Number of branches in version control

By the time you’ll be ready to turn on continuous delivery, you’ll only have one branch. Measuring how many you have now and tracking that over time will give you some indication of where you stand.

If your code isn’t in version control at all then stop taking measurements and just fix that one right now. I’m aware of teams in 2015 that still aren’t using version control and you’ll never get to continuous delivery that way.

Production outages during deployment

If your production deployments require taking the system offline then measure how much time it’s offline. If you achieve zero-downtime deploys then stop measuring this one.  Some applications such as batch processes may never require zero-downtime deploys. Interactive applications like webapps absolutely do.

I don’t suggest starting with everything at once. Pick one or two measurements and start there.


Affiliated Promotions:

Try our automated online Scrum coach: Scrum Insight - free scores and basic advice, upgrade to get in-depth insight for your team. It takes between 8 and 11 minutes for each team member to fill in the survey, and your results are available immediately. Try it in your next retrospective.

Please share!
Facebooktwittergoogle_plusredditpinterestlinkedinmailFacebooktwittergoogle_plusredditpinterestlinkedinmail
Berteig
Upcoming Courses
View Full Course Schedule
BERTEIG Professional No Agenda Networking [Exclusive Event]
Online
C$0.00
Oct 21
2021
Details
Dealing with Slackers, Idiots and Subversives in Agile Teams
Online
C$149.00
Oct 21
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Oct 21
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Oct 21
2021
Details
Advanced Certified ScrumMaster® (A-CSM) [Virtual Learning]
Online
C$1695.00
Oct 25
2021
Details
ICAgile Certified Professional in Leading With Agility® (ICP-LEA)
Online
C$2195.00
Oct 26
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Oct 26
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Oct 26
2021
Details
Team Kanban Practitioner® (TKP) [Virtual Learning]
Online
C$1195.00
Oct 27
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1795.00
Oct 27
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Oct 28
2021
Details
Advanced Certified Scrum Product Owner® (A-CSPO) [Virtual Learning]
Online
C$1695.00
Oct 29
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 1
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 1
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$750.00
Nov 2
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 3
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1795.00
Nov 4
2021
Details
Scrum Inc Scrum Master and Product Owner® (SSMPO) [Virtual Learning]
Online
C$1995.00
Nov 8
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 8
2021
Details
Scrum Master Bootcamp with CSM® (Certified Scrum Master®) [Virtual Learning]
Online
C$1795.00
Nov 9
2021
Details
Certified Scrum Master® (CSM) [Virtual Learning]
Online
C$595.00
Nov 9
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 9
2021
Details
Introduction to REALagility™ with ICP® (ICAgile Certified Professional®) [Virtual Learning]
Online
C$695.00
Nov 10
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 11
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 11
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 15
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1795.00
Nov 16
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 16
2021
Details
Kanban System Design® (KSD) [Virtual Learning]
Online
C$1525.75
Nov 17
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 17
2021
Details
BERTEIG Professional No Agenda Networking [Exclusive Event]
Online
C$0.00
Nov 18
2021
Details
Kanban for Scrum Masters - Improve Your Scrum Mastering Skills
Online
C$149.00
Nov 18
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 18
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$750.00
Nov 19
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 22
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 22
2021
Details
Scrum Master Bootcamp with CSM® (Certified Scrum Master®) [Virtual Learning]
Online
C$1525.75
Nov 23
2021
Details
Certified Scrum Master® (CSM) [Virtual Learning]
Online
C$595.00
Nov 23
2021
Details
Leadership for Managers - How to be an Effective Leader
Online
C$149.00
Nov 23
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 24
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1525.75
Nov 25
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Nov 29
2021
Details
Team Kanban Practitioner® (TKP) [Virtual Learning]
Online
C$1015.75
Nov 30
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$345.00
Nov 30
2021
Details
Advanced Certified ScrumMaster® (A-CSM) [Virtual Learning]
Online
C$1440.75
Nov 30
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1525.75
Dec 1
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Dec 6
2021
Details
Scrum Master Bootcamp with CSM® (Certified Scrum Master®) [Virtual Learning]
Online
C$1525.75
Dec 7
2021
Details
Certified Scrum Master® (CSM) [Virtual Learning]
Online
C$595.00
Dec 7
2021
Details
Introduction to REALagility™ with ICP® (ICAgile Certified Professional®) [Virtual Learning]
Online
C$1185.75
Dec 8
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1525.75
Dec 9
2021
Details
ICAgile Certified Professional in Agile Coaching® (ICP-ACC)
Online
C$1995.00
Dec 13
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Dec 13
2021
Details
Scrum Master Bootcamp with CSM® (Certified Scrum Master®) [Virtual Learning]
Online
C$1525.75
Dec 14
2021
Details
Certified Scrum Master® (CSM) [Virtual Learning]
Online
C$595.00
Dec 14
2021
Details
Kanban Systems Improvement® (KMPII) [Virtual Learning]
Online
C$1525.75
Dec 14
2021
Details
BERTEIG Professional No Agenda Networking [Exclusive Event]
Online
C$0.00
Dec 16
2021
Details
Certified Scrum Product Owner® (CSPO) [Virtual Learning]
Online
C$1525.75
Dec 16
2021
Details
Kanban for Product Owners - Improve Your Project Ownership Skills
Online
C$149.00
Dec 16
2021
Details
Real Agility™ Team Performance Coaching with BERTEIG
Online
C$495.00
Dec 20
2021
Details
Advanced Certified Scrum Product Owner® (A-CSPO) [Virtual Learning]
Online
C$1440.75
Dec 21
2021
Details
Kanban for Scrum Masters - Improve Your Scrum Mastering Skills
Online
C$149.00
Jan 6
2022
Details
Introduction to REALagility™ with ICP® (ICAgile Certified Professional®) [Virtual Learning]
Online
C$1185.75
Jan 12
2022
Details
BERTEIG Professional No Agenda Networking [Exclusive Event]
Online
C$0.00
Jan 20
2022
Details
Kanban for Product Owners - Improve Your Project Ownership Skills
Online
C$149.00
Feb 9
2022
Details
Certified Scrum Professional - ScrumMaster® (CSP-SM)
Online
C$1695.75
Feb 24
2022
Details