PaperBleachPaperBleach
logo

How AI Watermarking Actually Works: SynthID, Statistical Signatures, and Why You Probably Won’t Notice It

P
Paperbleach

09 Aug 2025

There’s a recurring idea in the AI debate: what if the model just signed its own work? Not with a visible stamp, but with a pattern baked so deep into the word choices that a matching tool could spot it later. That’s watermarking, and it’s already real in places like Google’s SynthID. Here’s how it actually works, and why you’d almost never catch it by reading.

Key takeaways

  • AI text watermarking nudges the model’s word choices toward a secret pattern, so the same statistical fingerprint appears across many outputs without changing what the text says.
  • Google’s SynthID-Text is the clearest public example. It adjusts token probabilities while the model writes, then a paired detector scores how strongly the pattern shows up.
  • You won’t notice it by reading. The mark lives in *which* of several near-equivalent words got picked, not in a symbol or hidden character.
  • Watermarks are fragile. Paraphrasing, translating, or mixing in human writing dilutes them, and only outputs from a watermark-enabled model carry one at all.
  • Detection is probabilistic. A watermark score is evidence, not proof, and a missing watermark says nothing about who wrote the text.

The core trick: bias the dice, don’t change the message

Every time a language model writes a word, it isn’t picking from one option. It’s sampling from a ranked list of likely next tokens. After “The coffee was,” the model might weigh *hot*, *bitter*, *strong*, *cold*, and a few dozen others, each with its own probability.

Most of the time several of those choices are basically interchangeable. *Strong* and *bold* would both read fine. That wiggle room is exactly where a watermark hides.

One family of watermarking schemes uses a secret key to split the vocabulary into a “green” group and a “red” group at each step. The key is seeded by the recent context, so the split changes word to word. The model is then nudged to slightly prefer green tokens when the quality cost is negligible. No single sentence looks odd. But across hundreds of words, the output ends up using more green tokens than random chance would produce.

That imbalance is the watermark. A detector that holds the same secret key can re-run the green/red split over a suspect passage and ask one question: are there suspiciously more green tokens here than you’d expect by luck? If yes, the text probably came from the watermarked model.

This is a cousin of how AI detection works in the real world, but with a crucial difference. A perplexity-based detector guesses from the raw shape of your text. A watermark is a signal someone *planted on purpose* and then went looking for.

SynthID-Text: the best-documented real version

Google DeepMind’s SynthID is the most concrete example to point at, partly because they published the method in *Nature* in 2024 and released open tooling for it.

For text, SynthID uses an approach called Tournament sampling. Instead of one green/red split, it runs a little bracket. At each generation step it samples several candidate tokens, then uses a secret watermarking key to score them and let them “compete,” advancing the tokens the key favors. The winner gets emitted. Do that across a whole response and you get the same effect: a measurable lean toward key-preferred tokens that a human reader can’t feel but a detector can measure.

Two things about SynthID are worth holding onto. First, Google designed it to be quality-neutral, so the watermarked text reads about as well as unwatermarked text. Second, the detector outputs a *score*, not a verdict, and it can land on “watermarked,” “not watermarked,” or “uncertain.” Confidence climbs with longer passages and falls with shorter ones, which is why SynthID works best on something like a full essay rather than a single sentence.

A quick scenario

Say a student pastes a 600-word essay into a chatbot and submits the result untouched. If that chatbot had a watermark turned on, the detector might come back with high confidence the pattern is present. Strong evidence.

Now say a second student takes the same draft, rewrites every other sentence in their own words, swaps the structure around, and folds in two paragraphs they wrote from scratch. The green-token surplus gets buried under all that new text. The detector’s confidence drops, maybe far enough to be inconclusive.

Same starting point, very different outcomes. The watermark didn’t get “removed” by some clever hack. It just got diluted by ordinary editing, the way a drop of food coloring fades when you keep adding water. That’s the real mechanism, and it’s worth understanding before you draw conclusions about anyone’s writing.

Why you probably won’t notice it

People expect a watermark to be like the faint logo on a stock photo, something you could spot if you squinted. Statistical text watermarks aren’t like that at all.

  • It’s not a hidden character. Some early tricks tried smuggling invisible Unicode characters or odd spacing into text. Those are trivial to strip and easy to catch by accident, so they’re not what serious schemes rely on. SynthID-style watermarks change *which real word* the model chose, and every word it picked is a perfectly normal word.
  • No single choice looks wrong. The model only leans green when the alternatives are about equally good. You can’t point at *strong* in “strong coffee” and say “aha, watermark.” Only the aggregate over many tokens means anything.
  • The signal is statistical, not visible. Reading the text gives you nothing. You’d need the secret key and a detector running the math to even attempt a read.

So the “you won’t notice it” part isn’t marketing softening. It’s a direct consequence of how the technique works. The whole point is to be invisible to humans and visible only to a tool that knows what to look for.

Where watermarking breaks down

Watermarking sounds airtight until you push on it. It has real, well-known limits.

It only exists if the model added it

A watermark detector finds watermarks. It cannot find AI writing in general. Run it on text from a model that doesn’t watermark, or on something a person typed, and there’s simply no pattern to find. So watermark detection covers a narrow slice of all possible AI text, not the whole thing.

Editing erodes it

The signal lives in the model’s specific token choices. Change those choices and you change the signal. Paraphrasing tools, translation into another language and back, or just genuine human revision all chip away at the green-token surplus. SynthID’s own creators note it holds up under mild edits but loses confidence when text is thoroughly rewritten or translated. This isn’t really a loophole: a watermark is a fingerprint on the original words, and rewriting replaces the words.

It’s a coordination problem

For watermarking to matter at scale, the companies running the models have to turn it on, keep their detection keys secure, and ideally agree on standards so one detector works across providers. That’s a big ask. Open-source models that anyone can run locally won’t carry anyone’s watermark unless the operator chooses to add one, which a determined user obviously won’t.

Detection is still probabilistic

Here’s the part people skip. A watermark detector reports a probability, the same as any AI detector. Short texts give weak signals. False positives and false negatives both exist. Treating a watermark score as a confession is the same mistake as treating a 98% AI-detector reading as proof. It’s evidence to weigh, not a verdict to hand down.

That last point connects to a theme worth internalizing across this whole topic, and it’s the same reason why detectors will never be 100% accurate: these tools deal in likelihoods, and the absence of a signal proves nothing on its own.

So what should you actually take from this?

Watermarking is a genuinely clever idea, and SynthID shows it can be done without wrecking the writing. But it’s one narrow tool, not a truth machine. It only catches unedited output from a cooperating model, it fades under normal revision, and it speaks in probabilities.

The bigger lesson runs through every honest take on AI detection. None of these systems read minds. They read patterns, and patterns can be ambiguous, diluted, or absent for perfectly innocent reasons. Understanding the mechanism is what lets you respond calmly instead of panicking at a score or trusting one blindly. If you want to dig further, there are more guides on AI detection that follow the same thread.

If you want to see how your own writing reads to a detector and where it leans machine-like, run a draft through PaperBleach and look at the breakdown before you decide anything.

Frequently asked questions

Does ChatGPT or Claude watermark my text right now? As of mid-2026 there’s no confirmed, always-on text watermark on mainstream chatbot output that you can count on. Google has published SynthID-Text and shipped tooling for it, and OpenAI has said it built a text-watermarking method it hasn’t released, but neither says every chat response carries a detectable mark. Watermarking is a real technique being deployed in places, but don’t assume any given paragraph is watermarked.

Can I see or remove an AI watermark by editing the text? You can’t see a statistical watermark by reading, since it’s spread across word choices rather than hidden in a symbol. Editing weakens it, though. The more you rewrite, paraphrase, translate, or blend in your own sentences, the more the original token pattern degrades. That’s a side effect of real revision, not a magic eraser.

Is watermark detection more reliable than a normal AI detector? For one narrow case, yes: catching unedited output from the exact model that added the watermark, because it checks for a known pattern instead of guessing. But it fails on text from a non-watermarking model, on human writing, and on heavily edited output. It’s a different tool with different blind spots, not a universal upgrade.

If my writing has no watermark, does that prove a human wrote it? No. A missing watermark only means the text didn’t come from a watermark-enabled model in a way that survived. Human writing has no watermark, and neither does output from any model that doesn’t add one, or AI text that was paraphrased. Absence of a watermark isn’t evidence of human authorship.

How is a watermark different from perplexity-based detection? Perplexity-based detectors look at how predictable your existing text is and infer whether a machine wrote it. A watermark is planted at generation time and looked for later. One is forensic guesswork on any text; the other is a designed signal that only exists if a cooperating model put it there.

Try it on your own text

Paste your draft into PaperBleach to humanize AI text so it reads naturally — then check your score against built-in AI detection. Free on your first run.