A board member asks a familiar question: "We bought AI coding tools for every engineer. Are we faster?" Usage dashboards say yes. Engineers say yes. And yet the incident count is up and the roadmap hasn't moved much. The 2025 DORA research helps explain why, and it changes how I set up measurement when I join a company as a fractional CTO.
What the research found
Google's DORA team surveyed nearly 5,000 technology professionals for its 2025 report, retitled the State of AI-assisted Software Development1. Some headline figures from Google's summary2:
- AI adoption among software professionals reached 90%, with a median of two hours a day spent working with it.
- Over 80% said AI had improved their productivity.
- Trust is lower: 24% reported a great deal or a lot of trust in AI output, while 30% reported a little or none.
The central finding is that AI works mainly as an amplifier. It magnifies the strengths of high-performing organisations and the dysfunctions of struggling ones1. Reviews of the report note that AI adoption is now associated with higher delivery throughput, but still with lower delivery stability56.
If your delivery system is healthy, AI makes it faster. If it is fragile, AI makes it fail faster. Measuring only speed hides the second case.
What changed in the metrics
For years, DORA's four keys were deployment frequency, lead time for changes, change failure rate and time to restore service. The 2025 work added a fifth, rework rate: unplanned deployments made to fix user-facing problems in production, relative to all deployments46. It also replaced the old low, medium, high and elite tiers with seven team profiles, built from a wider set of measures that include wellbeing and friction as well as delivery45.
Rework rate is the metric I would add first if a team tracks nothing else. AI-generated code that ships quickly and then needs hot fixes looks like productivity on a throughput chart. Rework rate shows the cost.
| Metric | Question it answers | AI-era failure it catches |
|---|---|---|
| Deployment frequency | How often do we ship? | Little on its own; easy to inflate |
| Lead time for changes | How long from commit to production? | Review queues swelling with larger AI-written changes |
| Change failure rate | How often does a change cause a failure? | Plausible code that breaks in production |
| Time to restore | How fast do we recover? | Teams that can't debug code they didn't write |
| Rework rate | How much work is unplanned fixing? | Speed paid for later in hot fixes |
Capabilities, not tools
DORA's companion AI Capabilities Model identifies seven practices that amplify AI's benefits. Google's summary includes a clear and communicated AI stance, healthy data ecosystems, quality internal platforms and a strong user-centric focus among them3. None of these is a tool purchase. They are the same foundations that made teams good before AI: small batches, strong version control, good platforms, clear policy.
It is also what I look for in technical due diligence. A team with trunk-based development, fast CI and decent test coverage is positioned to benefit from AI coding tools. A team without them risks producing more code than it can safely review.
How I set up measurement
- Baseline before rollout. Capture the five delivery metrics for a quarter before changing tools or policies, so improvements are real rather than remembered.
- Measure from systems, not surveys. Derive metrics from version control, CI/CD and incident tooling. Use surveys for friction and wellbeing, which systems can't see.
- Pair every speed metric with a stability metric on the same dashboard, so no one can celebrate one without seeing the other.
- Write the AI stance down: which tools, which data they may see, how AI-written code is reviewed. Record it as an architecture decision record.
- Review at team level, never individual. DORA metrics describe systems. Used to rank people, they get gamed within weeks.
- Tie it to product outcomes. Faster delivery of the wrong thing is still waste. Track whether shipped work moves the metrics the business cares about.
What to tell the board
The honest answer to "are we faster?" is a pair of numbers: throughput and stability, before and after, with the trend in rework. If both improve, the investment is working. If throughput rose and stability fell, the next investment is in foundations such as tests, platform and review practice, not more tools. That framing turns AI spending into an engineering decision the board can follow.
How I can help
As a fractional CTO I set up delivery measurement, define AI coding policy and fix the foundations that decide whether AI tools help or hurt. Or analyse your challenge and bring the result to a call.
- 1DORA 2025 State of AI-assisted Software Development ReportGoogle Research · 2025
- 2
- 3
- 4
- 5DORA 2025 reviewRedMonk · 18 Dec 2025
- 6