Analysis · Cloud and FinOps

The AI capacity crunch: what Microsoft's quarter means for how you plan compute

Azure grew 48% last quarter and Microsoft still says demand outruns supply. For engineering leaders, that is not a stock story. It means AI capacity is a constrained resource you plan, prioritise and hedge, like any other scarce input.

AnalysisSumanta Mukhopadhyay7 min read5 sources
#news#platform#ai#architecture
ANALYSIS · ANALYSIS · CLOUD AND FINOPS29 Oct 2026 · 16:40 GST

What was reported

Microsoft's results for the quarter to 30 September showed Azure revenue growing 48%, ahead of analyst estimates, with guidance for faster growth in the current quarter1. Capital spending of $45.2 billion came in below the company's own projection, which it attributed to delivery timing rather than a change of plan1, and its finance chief said demand still exceeds supply2. Analysts also noted capital expenditure guidance was held steady3.

Why this matters to engineering leaders

When the largest providers are still building as fast as they can and demand outruns them, capacity for AI workloads, especially accelerators in specific regions, is not guaranteed on demand. That affects launch dates, data-residency plans and cost. The response is the same discipline used for any scarce resource: know what you need, decide what matters most, reserve for that, and have a fallback.

Critical
Customer-facing inferencereserved capacity, home region
Important
Internal assistantson demand, can queueEvaluation runsscheduled off-peak
Flexible
Batch enrichmentspot or preemptibleTraining and fine-tuningany region allowed by data rules
Fallback
Second provider or modeltested, not theoreticalSmaller private modelfloor for critical paths
Tier workloads by how much a shortage would hurt, and match each tier to a capacity strategy.

Let the scheduler enforce your priorities

On Kubernetes, the scheduler decides where each workload runs, and pod priority and preemption decide what happens when resources run out: higher-priority pods are scheduled first, and lower-priority ones can be evicted to make room45. Giving customer-facing inference a higher priority class than batch jobs means a capacity squeeze lands on work that can wait.

Diagram of Kubernetes scheduling: a client creates new pods, the API server stores them in etcd, the kube-scheduler assigns pods without a node to a node, and kubelets on each node launch them
How the scheduler places new workloads; priority classes decide who goes first, and who is evicted, when capacity is short. Source: Kubernetes blog, Sunny Bhambhani · CC BY 4.0

In a shortage, something will wait. Decide in advance what it is, and encode that decision in the platform rather than in a meeting during the incident.

A capacity plan in four steps

  1. MeasureAccelerator hours, tokens and latency per workload and region
  2. TierCritical, important and flexible, agreed with the business
  3. ReserveCommitted capacity for critical work where data rules require it
  4. PrioritisePriority classes and quotas so shortages hit flexible work first
  5. HedgeA second provider, region or model tested with real traffic
  6. ReviewMonthly: usage against reservations, cost, and upcoming launches
Capacity planning for AI is FinOps plus resilience.
LeverHelps withWatch out for
Reservations and commitmentsGuaranteed capacity for critical workPaying for idle capacity if forecasts are wrong
Priority classes and quotasShortages fall on flexible workNeeds agreed tiers, not engineering guesses
Second provider or regionAvailability and negotiating positionData residency and quality differences
Smaller or routed modelsLess capacity needed per taskQuality must be proven on your evaluation set

CTO take

Treat AI capacity as a supply chain. Know your demand by workload, reserve for what is critical in the regions your data rules require, and make sure a shortage degrades flexible work first. Regional constraints differ: residency rules in the EU, India, Saudi Arabia and elsewhere can limit where you are allowed to fail over, so check them before you count a region as a fallback (by region). Related reading: AI cost allocation with FOCUS, GPU scheduling with DRA, LLM model routing, AI provider resilience under CPS 230 and the tech news update for 29 October.

How I can help

I help teams plan AI capacity and cost alongside architecture, so launches are not hostage to a shortage. See fractional CTO and AI architecture, or analyse your challenge and bring the result to a call.

References
  1. 1
  2. 2
  3. 3
  4. 4
    Pod Priority and PreemptionKubernetes documentation
  5. 5
    Protect Your Mission-Critical Pods From Eviction With PriorityClassKubernetes blog (Sunny Bhambhani) · 12 Jan 2023
FAQ

Common questions

Is AI compute capacity really constrained?

Microsoft reported 48% Azure growth for the September quarter and its finance chief said demand still exceeds supply. Capacity for AI workloads in particular regions can be limited, so plan for it rather than assuming on-demand availability.

How should we plan AI capacity?

Separate critical from flexible workloads, reserve capacity for the critical ones in the regions you need, keep at least one alternative provider or model ready, and define what degrades first when capacity is short.

How does Kubernetes help in a capacity crunch?

Pod priority and preemption let the scheduler place important workloads first and evict lower-priority ones when resources are scarce, so a shortage hits batch jobs before customer-facing services.

Keep reading

Related

Open to advisory, fractional CTO & select builds

Let's talk about what you're building.

The fastest route is a free 30-minute call. Prefer to write? Send a message and I'll reply personally within two business days.

Start a conversation

How would you like to reach me?

Book a 30-min callFastest. Pick any open slot on my calendar.→ Write in GmailOpens a pre-filled draft in your browser.→ Use my email appOutlook, Apple Mail or your default client.→

I reply personally within two business days. Time zones from the Americas and Europe to the Middle East and Asia-Pacific.