Confusion Is Data. We Treat It Like Telemetry.

Production engineers would never run a system the way most schools run students: no metrics, no logs, no alerts — just a big exam at the end to find out what's been silently broken for months.

We run learning like a production system instead. And the most valuable signal in that system is the one traditional education teaches people to hide: confusion.

The most underreported metric in education

Ask a lecture hall 'any questions?' and you get silence. Not because everything is clear — because admitting confusion in public is socially expensive, and because learners are famously bad at knowing what they don't know. Cognitive scientists call the gap between feeling of knowing and actual knowing an illusion of competence, and it's exactly why re-reading feels productive while testing feels hard. The testing effect literature — Roediger and Karpicke's studies are the classic reference — shows retrieval attempts reveal and repair gaps that passive review leaves invisible.

So confusion data exists in every learner, every day. Almost no system collects it.

A learner's confusion, surfaced daily and taken seriously, is the highest-signal telemetry a teaching system can have.

The check-in as instrumentation

Every day at Miatz ends with a check-in that takes about two minutes. Alongside the visible work — cards reviewed, the day's coding rep, journal notes — we ask one deceptively simple question: what's still fuzzy?

Answers arrive in plain language. 'I can write the JOIN but I couldn't explain when the planner picks a hash join.' 'I get why we chunk documents but not how overlap size matters.' 'Honestly, I followed the RAG lab mechanically.'

Each of those sentences is an event in a telemetry stream. One event is an anecdote. Thirty days of events, indexed into a learner's personal memory engine, is a profile of exactly where understanding frays. And across a cohort, the aggregate is a heatmap of the curriculum itself.

What the system does with it

Telemetry is only worth collecting if something reacts. Three consumers read the stream:

• The review engine. Fuzziness flags feed scheduling. A concept you marked fuzzy gets probed sooner and from a different angle — a new card, a variant of the coding rep — rather than waiting for the spaced-repetition interval to come around on its own.
• The tutor. Because check-ins are indexed into your personal [RAG](/glossary/retrieval-augmented-generation), the AI tutor grounds tomorrow's explanation in tonight's confession. It opens with your gap, not chapter one.
• The mentors. Humans see the aggregate. When a third of a cohort flags the same fuzziness after the embeddings lab, that's not thirty struggling learners — that's one underspecified lesson. We fix the lesson. Mentor office hours get an agenda built from real gaps instead of whoever speaks loudest.

The Saturday [Week Review](/program) then closes the loop: each learner looks at their own week of confusion telemetry, sees which gaps closed and which persisted, and sets intent for the next week accordingly.

Why honesty has to be cheap

None of this works if reporting confusion feels like admitting failure. So we engineered the incentives deliberately.

Fuzziness reports never lower any score, ever. They change what you're served, not how you're judged — the same way an error log doesn't punish a server, it routes attention to it. Progress at Miatz is gated on demonstrated competence, so hiding a gap doesn't help you; the gate will find it anyway, later and more expensively. Reporting it early just means the system spends the week helping you close it.

Learners internalize this quickly. Within a couple of weeks the check-ins stop reading like report cards and start reading like engineers writing postmortems on their own understanding — specific, blameless, actionable.

Instrument yourself

You can run this loop solo, starting tonight, with a text file:

• End each study day with one honest sentence beginning 'What's still fuzzy is…'
• Begin the next session by attacking yesterday's sentence before touching new material.
• On Saturdays, read the week's sentences in order and notice which fuzziness keeps recurring. That recurrence is your real curriculum.

Confusion isn't the opposite of learning. It's the leading indicator of it — the compile error that tells you exactly which line to look at. Systems that suppress the signal fly blind. Systems that collect it get to steer.

We'd rather steer.