Case study · Privacy engineering and AI

Ready before it bites: AI data governance for a Japanese retail chain under the amended APPI

A Japanese retail chain used loyalty data to forecast demand and store cameras to understand footfall, with several contractors doing the analytics. Japan's amended privacy law is now on the books, adding surcharges, rules for facial data and a route for using personal data in statistics and AI development. The duties are not in force yet. The aim was to make the data estate ready before they are.

Case studyRetail · JapanSumanta Mukhopadhyay9 min read
#governance#data#ai
CASE STUDY · CASE STUDY · PRIVACY ENGINEERING AND AI30 Oct 2026 · 13:10 GST
At a glance
SectorRetail · Japan
My roleFractional CTO and AI architect
EngagementAssessment, architecture and delivery leadership
ScopeData inventory, purpose tagging, facial data controls, contractor boundaries, telemetry masking, evidence
What changed
  • Every dataset used for AI tagged with source, purpose and legal basis
  • Camera analytics redesigned to keep counts, not faces, wherever possible
  • Contractors limited to scoped workspaces for the task they were given
  • Personal data masked in logs and traces by default
  • An evidence pack ready for the PPC rules as they are issued
Data cataloguePurpose and consent tagsLakehouse with row and column policiesPseudonymisation serviceEdge video processingContractor workspacesOpenTelemetry with maskingPolicy as code

Anonymised composite. Client names, identifying details and confidential figures are withheld; public facts are cited in the references.

The situation

A Japanese retail chain with several hundred stores ran a loyalty programme, an app and in-store cameras. Its data team trained demand forecasting and promotion models on loyalty purchases, and two outside contractors analysed camera footage to measure footfall and queue times. The data had grown up over a decade: copies in the warehouse, the contractors' environments and a few notebooks, with no single record of where personal data went or why.

Why now. Japan's amended Act on the Protection of Personal Information was promulgated in July 2026 as Act No. 56 of 2026, with most duties starting on dates set later by Cabinet Order2. As reported, it introduces an administrative surcharge, adds rules for facial recognition data, makes contractors' duty not to use data beyond their task explicit, and creates a consent exception for statistical processing and AI development13. Commentary expects strengthened penalties from early 2027 and the main reforms by mid-20282. The Personal Information Protection Commission (PPC) will set the detailed rules4. The chain wanted to use the time to get ready rather than react later.

What had to be true

  • Every dataset used for AI known: its source, purpose, legal basis and where copies live.
  • Facial data minimised: kept only where needed, disclosed clearly and never reused quietly.
  • Contractors bounded to the task they were hired for, technically and not just by contract.
  • Personal data out of telemetry by default.
  • Evidence on demand, ready to map to the PPC's rules when they arrive.

Architecture

Sources
Loyalty and apppurchases, profilesStore camerasvideo at the edgeStores and supplyno personal data
Edge
On-premises video processingcounts and queues, not faces
Govern
Data cataloguesource, purpose, basisPolicy as codewho may use what, for what
Platform
Lakehouserow and column policiesPseudonymisationkeys held centrally
Use
Forecasting and promotionspseudonymised featuresContractor workspacesscoped, logged, time-limited
Evidence
Access and lineage logsper datasetMasked telemetryOpenTelemetry
Purpose is recorded once in the catalogue and enforced everywhere the data is used.

The data flow, end to end

  1. CollectLoyalty data arrives with its notice and consent version attached
  2. TagThe catalogue records source, purpose and legal basis for each dataset
  3. PseudonymiseDirect identifiers are replaced before data reaches analytics
  4. GrantPolicy allows each team or contractor only the datasets for its purpose
  5. TrainModels train on permitted features; the run records which datasets it used
  6. ProveLineage and access logs answer who used what, for which purpose
Every model can be traced back to the purpose and basis of its data.

The hard part: cameras and contractors

The footfall project was the riskiest part of the estate. Contractors received video clips and ran their own models on them, which meant faces left the stores and their later use was hard to control. With facial data getting specific rules in the amendment1, the team changed the design rather than adding paperwork.

Video processing moved to on-premises devices in each store. They produce counts, dwell times and queue lengths, and discard frames after processing. Contractors now receive those aggregates, not footage. Where a use case truly needed identification, such as a loss-prevention pilot, it was split out as its own system with its own disclosure, retention and approval. That separation is what makes the purpose clear to customers and to a regulator.

Contractors moved into scoped workspaces on the chain's own platform, with access to named datasets for a set period, every query logged and no export by default. This turns the duty not to use data beyond the task into a technical control instead of a clause3.

The last gap was telemetry. Application logs and traces carried customer IDs, emails and auth headers, copied into tools that many people could see. The team set masking as the default in the OpenTelemetry pipeline, keeping useful context such as store or segment and hiding identifiers and credentials5.

Jaeger span tags for a GET /inventory request where the authorization header value is masked as three asterisks while tenant ID and user segment headers remain visible
Masked by default: the credential is hidden while the context needed for troubleshooting stays visible. Source: OpenTelemetry blog, Tyler Yahn and Nimrod Avni · CC BY 4.0

The cheapest compliance is data you never collect. Change the design so the sensitive data does not leave the store, then govern what remains.

How it ran

Legal and privacy
  1. APPI amendment tracking
  2. Purposes and notices
  3. Contractor terms
Data and platform
  1. Inventory and catalogue
  2. Pseudonymisation and policies
  3. Masked telemetry
Stores and analytics
  1. Edge video devices
  2. Contractor workspaces
  3. Model retraining
Privacy owned purposes, platform owned enforcement, the business owned the redesigned use cases.
Phase 1Inventory
  • Find every copy
  • Record purposes
  • Rank risks
Phase 2Redesign
  • Edge video
  • Contractor workspaces
  • Pseudonymisation
Phase 3Enforce
  • Policy as code
  • Masked telemetry
  • Retire old copies
Phase 4Evidence
  • Lineage reports
  • Model data records
  • Map to PPC rules
Inventory first: you cannot govern copies you do not know about.

Key decisions and trade-offs

DecisionAlternativeWhy
Process video at the edgeSend footage to contractorsFaces stay in the store; purpose is clear
Prepare nowWait for the PPC rulesInventory and redesign take longer than the rules will
Do not rely on the AI exception yetAssume all training is coveredIts reach depends on rules not yet issued
Contractor workspaces on our platformData shipped to contractor systemsTask limits enforced technically and logged
Mask telemetry by defaultClean up logs case by caseObservability tools are a common leak

What I'd do again, and differently

Again: redesign the camera use case instead of documenting it. It removed most of the risk in one move. Differently: put purpose tags on data at ingestion from the start, rather than adding them during the inventory; tagging old data took longer than building the platform. Related: ISO 42001 and the NIST AI RMF, high-impact AI under Korea's AI Basic Act and where I work.

If you use personal data for AI in Japan or across Asia, see my AI architecture work, or analyse your challenge and bring the result to a call.

References
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
FAQ

Common questions

Is the amended APPI in force?

It was promulgated in July 2026 as Act No. 56 of 2026, but most duties start on dates set by Cabinet Order. Commentary expects strengthened criminal penalties from early 2027 and the main reforms, including surcharges, by mid-2028 at the latest. Check the PPC's announcements for confirmed dates.

Does the amendment let companies train AI on personal data without consent?

It creates a consent exception for statistical processing and AI development in defined circumstances. The detailed rules from the Personal Information Protection Commission will decide how far it reaches, so design for it without assuming it covers everything.

What should retailers using cameras do now?

Know which systems process facial data and why, prefer edge processing that keeps counts rather than images, prepare clear disclosures, and make sure contractors use the data only for the task they were given.

Keep reading

Related

Open to advisory, fractional CTO & select builds

Let's talk about what you're building.

The fastest route is a free 30-minute call. Prefer to write? Send a message and I'll reply personally within two business days.

Start a conversation

How would you like to reach me?

Book a 30-min callFastest. Pick any open slot on my calendar.→ Write in GmailOpens a pre-filled draft in your browser.→ Use my email appOutlook, Apple Mail or your default client.→

I reply personally within two business days. Time zones from the Americas and Europe to the Middle East and Asia-Pacific.