miatz™
Log inSit Chuun
Free concept playground · no account

Truth Meter

Same confident tone, one answer is grounded truth.

All 90 playgrounds Join the free cohort

Truth Meter

AvailableFree

Every answer arrives in the same confident voice. But only some are grounded in a real source — the rest are fluent fabrications. Judge each one.

  • What is the capital of France?

    “Paris is the capital of France and its largest city, on the river Seine.” 95% confident

  • What was Acme Corp's closing share price on 3 June 2019?

    “Acme Corp closed at exactly $47.82 on 3 June 2019, up 1.2% on the day.” 93% confident

  • What does HTTP status 404 mean?

    “404 means the server was reached but could not find the requested resource — the URL maps to nothing.” 90% confident

  • Which Nobel Prize did Rosalind Franklin win?

    “Rosalind Franklin won the 1962 Nobel Prize in Chemistry for her X-ray work on DNA structure.” 90% confident

  • What is the boiling point of water at sea level?

    “Water boils at 100°C (212°F) at standard sea-level atmospheric pressure.” 92% confident

  • What is the population of Middleford, Vermont?

    “Middleford, Vermont had a population of 3,412 residents as of the 2020 US Census.” 91% confident

  • Who wrote the play 'Hamlet'?

    “William Shakespeare wrote Hamlet, most likely composed around 1600.” 89% confident

Was this playground useful?

Truth meter

Seven AI answers arrive in the same confident voice at the same high confidence — but only some are grounded in a real, checkable source; the rest are fluent fabrications. Judge each one, then see the trap: the average confidence of the true answers and the made-up ones is nearly identical. Tone is not evidence of truth. Runs entirely in your browser (0 uploads, works offline).

How to use it

  1. Read each question and its confidently-worded answer.
  2. Mark each Grounded or Fabricated on your best read.
  3. Score it — and see the confidence gap between the two piles, which is essentially zero.

What this clears up (the fundamentals)

  • Confidence is generated, not earned — a model sounds equally sure when it's right and when it's inventing.
  • Tone carries no signal — the true and fabricated answers here are delivered at nearly identical confidence, so fluency can't separate them.
  • A source is the only reliable tell — grounded claims cite something checkable; fabrications say "no source" behind the same smooth wording.
  • Verify specifics — precise numbers, names, and citations are exactly where confident fabrication hides.

Where it's used

An AI-literacy drill — the fastest way to internalise that confident output must be verified, not trusted. It's a miatz build-lab concept playable; learn to build it yourself.

FAQ

Why can't I tell truth from fabrication by tone?

Because a language model writes both in the same fluent, assured style. Confidence is a property of the writing, not of whether the claim is true, so tone gives you nothing to go on.

What is the "confidence gap"?

The average stated confidence of the grounded answers minus that of the fabricated ones. Here it's near zero by design — proof that how sure an answer sounds tells you nothing about whether it's real.

What's the reliable signal then?

Whether the claim carries a checkable source. Grounded answers point to something you can verify; fabrications don't, no matter how confident they sound.

Is anything uploaded?

No. The cards and scoring run entirely in your browser — nothing is transmitted or stored. Turn off your Wi-Fi and it still works.

Limits

A teaching deck of illustrative answers, not a live model — real fabrications are open-ended. The reflex it trains (distrust tone, verify sources) transfers directly.

Related

Part of the Demystify Playgrounds. Explore the rest from the Playgrounds home.

Bookmark this page (Ctrl+D, or ⌘D on Mac) — it works offline the next time you need it.

More playgrounds

Ninety playgrounds. Zero setup.

Every concept here is playable free, no account — and inside the program you learn to rebuild the machinery yourself.

Browse all playgrounds Join free