PaperBleachPaperBleach
logo

Myth: AI Watermarking Already Makes Detection Foolproof

P
Paperbleach

29 Mar 2025

There’s a comfortable story going around: AI companies already stamp every sentence their models write with an invisible watermark, so detection is basically solved and any tool can catch ChatGPT instantly. It sounds plausible, and it would make life simpler for everyone arguing about AI in essays and articles. It’s also wrong in almost every detail that matters.

This post takes the myth apart. Not to help anyone “beat” a system, but because believing in a foolproof watermark leads people to make bad decisions, whether they’re a student worried about a false accusation or an instructor about to trust a number too much.

Key takeaways

  • Watermarking only marks text that a *participating* model deliberately tags as it writes. It can’t reach into finished text from a tool that never applied a mark.
  • ChatGPT output isn’t reliably watermarked, so “watermark detection” isn’t quietly catching your drafts the way the rumor suggests.
  • Text watermarks are fragile. Paraphrasing, translating, or even retyping can wash them out, which is exactly why no one serious calls them foolproof.
  • Most teachers and platforms can’t even *check* a watermark. They use statistical detectors that guess from patterns and produce false positives.
  • The honest goal isn’t dodging an imaginary unbeatable system. It’s writing text you understand and can defend.

What a watermark actually is

Start with what the word means here, because “watermark” misleads people. It’s not a visible logo, and it’s not metadata buried in a file. A text watermark is a statistical fingerprint baked into the *word choices themselves* as the model writes.

The most discussed approach, Google DeepMind’s SynthID, works roughly like this. While the model picks each next word, it gently biases the choice toward a hidden, pseudo-random pattern that only a matching detector — one holding a secret key — can later recognize. To a reader, the text looks normal. To the right verifier, the pattern lights up like a signature.

Notice the load-bearing phrase: *as the model writes.* The mark gets applied at the moment of generation by the model’s own maker. That single fact controls everything else, and it’s where the myth quietly falls apart.

The myth: “they can already catch ChatGPT”

The belief usually shows up as a worry or a boast. A student: “It doesn’t matter how I edit it, they can read the watermark.” A marketer: “The detector found the invisible tag OpenAI puts on everything.” Both assume two things that aren’t true.

First, that ChatGPT reliably watermarks its output. It doesn’t, at least not in any confirmed, always-on way. OpenAI has researched text watermarking and discussed the trade-offs publicly, but it hasn’t shipped a default watermark you can count on being present in your ChatGPT text. The company actually pulled in the other direction once before. In July 2023 it retired its own AI-text classifier because the accuracy was too low to be useful. So the picture of a secret, universal ChatGPT stamp quietly flagging drafts is fiction.

Second, that the detectors people run can read a watermark at all. They can’t. Turnitin, GPTZero, Originality, Copyleaks — none of these read SynthID or any provider’s watermark. They’re statistical detectors. They look at how the writing behaves and estimate a probability. Which brings us to the part most people skip.

Watermarking and detection are two different things

This is the heart of the confusion. There are two separate ideas wearing similar clothes.

  • Watermarking is *proactive.* The model’s maker hides a signal during generation, then verifies it later with a private key. High confidence — but only for text that maker actually marked, and only if the mark survived.
  • Detection is *reactive.* A tool takes finished text it had nothing to do with creating and guesses how AI-like it reads, using patterns like sentence predictability and rhythm. Works on anything; reliably accurate on nothing.

When your professor pastes your essay into a checker, that’s detection, not watermark verification. The number it spits out is a guess based on statistics like perplexity and burstiness, not a key reading a hidden stamp. So even in the imaginary world where ChatGPT watermarked everything, the everyday tools doing the accusing still wouldn’t be looking at it.

Who can even check a watermark?

Almost nobody outside the company that built the model. Verifying a text watermark like SynthID generally requires the maker’s secret key, and that key stays private — publish it and the mark becomes easy to strip or forge. So a teacher, an editor, or a freelance client can’t paste your work into a public “watermark checker,” because for the most part one doesn’t exist for them. That’s a big reason real disputes hinge on a detector score, never a watermark result.

A quick scenario

Picture Maya, a sophomore who drafted a literature response with ChatGPT, then spent an hour rewriting it in her own voice, adding two quotes from the novel and an argument her TA had nudged her toward in office hours.

In the myth, none of that matters — “the watermark is in there forever, they’ll see it.” In reality, three things are true at once. ChatGPT probably never applied a durable watermark to begin with. Even if some statistical mark had been present, her heavy rewriting would likely have scrambled it, because that’s how fragile these marks are. And her school’s tool reads patterns, not watermarks, so it’s running a probability estimate either way — one that could flag her honest work *or* miss genuine misuse.

The lesson isn’t “edit hard enough to defeat the watermark.” It’s that the watermark was never the thing judging her. A fallible statistical guess was. Knowing which threat is real changes how she’d defend herself: not by debating cryptography, but by showing her drafts, her sources, and that she can explain her own argument.

Why “foolproof” is the wrong word

Even setting ChatGPT aside, watermarking has built-in weak spots that rule out “foolproof.”

  • Coverage. Only cooperating generators leave a mark. Open-source models and any tool that opts out leave nothing to find. “No watermark detected” can simply mean “this came from something that doesn’t watermark” — not “a human wrote it.”
  • Fragility. Text watermarks lean on word-choice patterns, and those patterns are easy to disturb. Translating a passage out and back, paraphrasing it, or rewriting it by hand can weaken or erase the signal. Short or highly factual passages, where word choice is constrained, carry a weaker mark to begin with.
  • The false-negative trap. Because absence proves nothing, a clean watermark check can’t clear you and a missing one can’t convict you. It’s evidence of presence at best, never of authorship or intent.

A system with those gaps can be useful for *provenance* — confirming a specific cooperating model produced a specific passage. That’s a real, narrow job. It is not a universal lie detector for AI writing, and the researchers building it don’t claim it is.

What this means for you

If you’re a student or a writer, drop the fear of a secret unbeatable stamp and focus on the tool that’s actually in the room: a statistical detector that can be wrong. Those detectors carry documented bias — a 2023 Stanford study found they flagged writing by non-native English speakers far more often than writing by native speakers — and they routinely misfire on short or formulaic text. That’s the real risk to plan around.

The durable move is the same one it’s always been. Write text you understand and can stand behind. Keep your drafts and notes. Be ready to talk through your argument. If you’re using AI to get unstuck, treat its output as raw material you shape into your own voice, not a finished product to launder.

Want to go deeper on how any of this works? Our more guides on AI detection break down the statistics, the false positives, and the policy fights in plain language.

Frequently asked questions

Does AI watermarking detect ChatGPT? Not the way the rumor implies. A watermark can only be found in text a model deliberately marked while writing it. OpenAI hasn’t shipped a reliable, always-on text watermark for ChatGPT, and it retired its earlier AI-text classifier in July 2023 because the accuracy was too low. The tools schools and clients actually run are statistical detectors that guess from patterns, not watermark readers.

Does ChatGPT put an invisible watermark on everything it writes? No confirmed default watermark exists on ChatGPT output. Watermarking has been researched, but you shouldn’t assume your text carries a secret machine-readable tag — and the detectors people use don’t look for one anyway.

Can a watermark be removed from AI text? Text watermarks are fragile. They rely on subtle word-choice patterns, so paraphrasing, translating, heavy editing, or retyping can weaken or erase the mark. That fragility is a main reason no one calls text watermarking foolproof.

If watermarking isn’t foolproof, what are schools and clients using? Statistical detectors — Turnitin, GPTZero, Originality, Copyleaks. They read patterns like perplexity and burstiness, output a probability rather than proof, and produce false positives, especially for non-native English writers and short text.

So is it pointless to worry about detection? Worry less about an imaginary unbeatable watermark and more about whether your writing reads like you. Detectors can flag honest work, so the safe path is writing you understand, can explain, and have shaped with your own evidence and voice.

The bottom line

Watermarking is a real technology doing a narrow job for cooperating models. It is not a hidden net already catching every ChatGPT sentence, and the everyday tools doing the accusing can’t even read it. Treat detection as fallible, write like yourself, and you’re covered no matter which way the technology drifts. Want to see how your draft actually reads before someone else does? Try PaperBleach and revise the spots that sound machine-made — because the writing should sound like a person, and it is one.

Try it on your own text

Paste your draft into PaperBleach to humanize AI text so it reads naturally — then check your score against built-in AI detection. Free on your first run.