Leadership · Engineering

DORA metrics in the AI era: what engineering leaders should actually measure

AI coding tools are now near-universal. DORA's 2025 research suggests they raise throughput but can hurt stability, and that they amplify whatever a team already is. That changes what a CTO should measure.

EssaySumanta Mukhopadhyay7 min read6 sources
#leadership#engineering#ai#platform
ESSAY · LEADERSHIP · ENGINEERING20 Oct 2026 · 08:30 GST

A board member asks a familiar question: "We bought AI coding tools for every engineer. Are we faster?" Usage dashboards say yes. Engineers say yes. And yet the incident count is up and the roadmap hasn't moved much. The 2025 DORA research helps explain why, and it changes how I set up measurement when I join a company as a fractional CTO.

What the research found

Google's DORA team surveyed nearly 5,000 technology professionals for its 2025 report, retitled the State of AI-assisted Software Development1. Some headline figures from Google's summary2:

  • AI adoption among software professionals reached 90%, with a median of two hours a day spent working with it.
  • Over 80% said AI had improved their productivity.
  • Trust is lower: 24% reported a great deal or a lot of trust in AI output, while 30% reported a little or none.

The central finding is that AI works mainly as an amplifier. It magnifies the strengths of high-performing organisations and the dysfunctions of struggling ones1. Reviews of the report note that AI adoption is now associated with higher delivery throughput, but still with lower delivery stability56.

If your delivery system is healthy, AI makes it faster. If it is fragile, AI makes it fail faster. Measuring only speed hides the second case.

What changed in the metrics

For years, DORA's four keys were deployment frequency, lead time for changes, change failure rate and time to restore service. The 2025 work added a fifth, rework rate: unplanned deployments made to fix user-facing problems in production, relative to all deployments46. It also replaced the old low, medium, high and elite tiers with seven team profiles, built from a wider set of measures that include wellbeing and friction as well as delivery45.

Rework rate is the metric I would add first if a team tracks nothing else. AI-generated code that ships quickly and then needs hot fixes looks like productivity on a throughput chart. Rework rate shows the cost.

MetricQuestion it answersAI-era failure it catches
Deployment frequencyHow often do we ship?Little on its own; easy to inflate
Lead time for changesHow long from commit to production?Review queues swelling with larger AI-written changes
Change failure rateHow often does a change cause a failure?Plausible code that breaks in production
Time to restoreHow fast do we recover?Teams that can't debug code they didn't write
Rework rateHow much work is unplanned fixing?Speed paid for later in hot fixes

Capabilities, not tools

DORA's companion AI Capabilities Model identifies seven practices that amplify AI's benefits. Google's summary includes a clear and communicated AI stance, healthy data ecosystems, quality internal platforms and a strong user-centric focus among them3. None of these is a tool purchase. They are the same foundations that made teams good before AI: small batches, strong version control, good platforms, clear policy.

It is also what I look for in technical due diligence. A team with trunk-based development, fast CI and decent test coverage is positioned to benefit from AI coding tools. A team without them risks producing more code than it can safely review.

How I set up measurement

  1. Baseline before rollout. Capture the five delivery metrics for a quarter before changing tools or policies, so improvements are real rather than remembered.
  2. Measure from systems, not surveys. Derive metrics from version control, CI/CD and incident tooling. Use surveys for friction and wellbeing, which systems can't see.
  3. Pair every speed metric with a stability metric on the same dashboard, so no one can celebrate one without seeing the other.
  4. Write the AI stance down: which tools, which data they may see, how AI-written code is reviewed. Record it as an architecture decision record.
  5. Review at team level, never individual. DORA metrics describe systems. Used to rank people, they get gamed within weeks.
  6. Tie it to product outcomes. Faster delivery of the wrong thing is still waste. Track whether shipped work moves the metrics the business cares about.

What to tell the board

The honest answer to "are we faster?" is a pair of numbers: throughput and stability, before and after, with the trend in rework. If both improve, the investment is working. If throughput rose and stability fell, the next investment is in foundations such as tests, platform and review practice, not more tools. That framing turns AI spending into an engineering decision the board can follow.

How I can help

As a fractional CTO I set up delivery measurement, define AI coding policy and fix the foundations that decide whether AI tools help or hurt. Or analyse your challenge and bring the result to a call.

References
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
    DORA 2025 reviewRedMonk · 18 Dec 2025
  6. 6
FAQ

Common questions

What did the 2025 DORA report find about AI?

Google's DORA team surveyed nearly 5,000 technology professionals. It reported that AI adoption reached 90% and that AI acts mainly as an amplifier, magnifying the strengths of high-performing organisations and the dysfunctions of struggling ones.

What is rework rate?

A delivery metric DORA added alongside the original four. It tracks unplanned deployments made to fix user-facing problems in production, as a share of all deployments.

Should I measure developer productivity with AI usage statistics?

Not on their own. Usage and perceived productivity are inputs. Leaders should watch delivery outcomes, including stability measures such as change failure rate and rework rate, alongside product outcomes.

Keep reading

Related

Open to advisory, fractional CTO & select builds

Let's talk about what you're building.

The fastest route is a free 30-minute call. Prefer to write? Send a message and I'll reply personally within two business days.

Start a conversation

How would you like to reach me?

Book a 30-min callFastest. Pick any open slot on my calendar.→ Write in GmailOpens a pre-filled draft in your browser.→ Use my email appOutlook, Apple Mail or your default client.→

I reply personally within two business days. US & UAE time zones.