Analysis · AI security and cost

LLMjacking after Black October: how to stop stolen AI keys becoming somebody else's compute budget

On 30 October, Wiz described a month of breaches at AI developer platforms, with stored AI credentials stolen and model access resold. LLMjacking is not new, but AI keys have quietly become some of the most valuable secrets a company holds, and many teams still treat them like a config value. Here is where they leak, how to limit the damage, and what to watch.

AnalysisSumanta Mukhopadhyay8 min read6 sources
#news#security#ai#finops
ANALYSIS · ANALYSIS · AI SECURITY AND COST1 Nov 2026 · 21:25 GST

What happened

Wiz published "Black October" on 30 October, describing a series of security incidents at AI developer and hosting platforms during the month1. Several platforms attributed their incidents to credential access, and the common thread was stored environment variables holding AI keys; Wiz found no single shared vulnerability and linked key-checking activity to resellers of model access, without claiming they carried out the intrusions12. In the same week, a tampered coding extension tried to plant backdoors on developer machines, the kind of foothold that exposes whatever keys a laptop holds5.

The pattern has a name. Sysdig described LLMjacking in 2024: attackers use stolen cloud credentials to reach hosted model services, check which keys work, and resell the access, leaving victims with the bill34. What has changed is scale: more teams, more platforms and more keys, often with no spending limits.

Why AI keys are different

A leaked database password is serious, but its damage is bounded by what is in the database. A leaked model key with no limits turns directly into spend, at machine speed, and the first sign is often the invoice. AI keys also spread more widely than most secrets: into notebooks, hosted dev platforms, CI variables, editor settings and personal accounts, because getting started with AI is designed to be easy.

Where keys leak
Hosted dev platformsenvironment variablesLaptops and editorsextensions, config filesCI and reposvariables, history
Contain
AI gatewayone route to every modelPer-team keyssmall blast radiusShort-lived credentialsexpire quickly
Cap
Spend limitsper key, per dayRate limitsper key, per model
Detect
Usage telemetrytokens by key and modelAnomaly alertsnew regions, models, hours
Respond
Revoke in minutesfrom one placeRotate everywherescripted
You cannot stop every leak. You can make each leaked key small, visible and quick to kill.

A practical playbook

1. Find every key. Inventory provider accounts, cloud model services and keys across teams, platforms and CI. Rotate anything stored on a platform named in the Wiz report or any third-party platform you cannot vouch for1.

2. Put a gateway in front of models. Applications and developers call your gateway, not providers directly. The gateway holds the real provider credentials, issues per-team or per-application keys, and enforces quotas. A key stolen from a laptop is then a key to your gateway, with your limits and your logs. See model routing and securing AI coding tools.

3. Set spend and rate limits per key. Every key gets a daily budget and an alert well below it. Production keys get headroom; experiment keys do not.

4. Use cloud identity instead of static keys where you can. For cloud-hosted models, prefer workload identity and short-lived credentials over long-lived access keys, and restrict which models and regions each identity can use. Sysdig's research noted that not every model API call appeared in default cloud audit logs, so check that your logging covers the calls you rely on3.

5. Watch usage like a security signal. Record tokens, model and caller on every request. The OpenTelemetry generative AI conventions capture model and token usage per call, which gives you the baseline that anomaly alerts need6. See AI cost allocation.

Jaeger trace of a chat call to a language model showing span tags including requested model, response model, input tokens and output tokens
Model and token usage recorded on every call: the baseline that makes stolen-key abuse visible quickly. Source: OpenTelemetry blog, Drew Robbins and Liudmila Molkova · CC BY 4.0

6. Rehearse revocation. Know how to revoke a key, rotate provider credentials behind the gateway and confirm usage stopped, in minutes, outside office hours.

Treat AI keys like payment cards: issue them per holder, set a limit, watch the statement daily and cancel at the first odd charge.

What to alert on

  1. BaselineNormal tokens per key by hour, model and region
  2. New modelA key starts calling a model it never used
  3. VolumeUsage jumps well above the key's normal range
  4. Odd hoursSustained traffic when the owning team is offline
  5. New originCalls from networks or regions the key never used
  6. ActAuto-throttle, page the owner, revoke if unexplained
Simple rules catch most abuse; the hard part is having per-key data at all.

Who should act

  • Any team using hosted AI dev platforms: rotate keys stored there this week.
  • Companies with cloud-hosted models: review which identities can invoke which models, and in which regions.
  • Finance and FinOps: add AI spend to daily anomaly checks, not monthly reviews.
  • Regulated firms: a stolen key that can reach customer data through a model is a data incident, not just a cost problem; see where I work for regional rules.

CTO take

October showed that attackers now go after AI keys directly, because those keys turn straight into resellable compute. The fix is not exotic: one gateway, keys per team, limits per key, telemetry per call and practised revocation. Teams that already run AI through a gateway for cost and quality reasons get most of this for free. Teams that do not should start there. For the wider week, see the 1 November tech news.

How I can help

I help teams design AI gateways, key management and spend controls that keep model access safe and affordable. I am based in India, the United States and the UAE, working globally. See AI architecture or analyse your challenge and bring the result to a call.

References
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
    OpenTelemetry for Generative AIOpenTelemetry blog · 5 Dec 2024
FAQ

Common questions

What is LLMjacking?

The theft of access to AI models, usually through stolen API keys or cloud credentials, so attackers can run or resell model usage at the victim's expense. Sysdig described the pattern in 2024; Wiz's October 2026 report links a run of AI developer platform breaches to it.

Where do AI keys usually leak from?

Environment variables on hosted development platforms, developer laptops, CI systems, code repositories and shared configuration. Wiz notes several October incidents involved stored environment variables holding AI keys.

What is the fastest way to limit the damage?

Route model access through your own gateway with per-team keys, spending limits and alerts, so any single leaked key has a small, visible blast radius and can be revoked in minutes.

Keep reading

Related

Open to advisory, fractional CTO & select builds

Let's talk about what you're building.

The fastest route is a free 30-minute call. Prefer to write? Send a message and I'll reply personally within two business days.

Start a conversation

How would you like to reach me?

Book a 30-min callFastest. Pick any open slot on my calendar.→ Write in GmailOpens a pre-filled draft in your browser.→ Use my email appOutlook, Apple Mail or your default client.→

I reply personally within two business days. Time zones from the Americas and Europe to the Middle East and Asia-Pacific.