What Surrogate Models Are and Why AI Detectors Use One Model to Catch Another
22 Sep 2024
Here’s a question that trips up almost everyone the first time they think about it: how does an AI detector catch text written by a model it has never seen? It doesn’t have a copy of ChatGPT sitting in a back room, and it definitely can’t phone up every chatbot on earth and ask, “Hey, did you write this?” The trick is a stand-in. Detectors use one model to catch another, and that stand-in has a name: the surrogate model.
Key takeaways
- A surrogate model is the stand-in language model a detector runs your text through to judge how predictable it looks. The detector almost never has the model that actually wrote your text.
- Most detectors don’t read meaning. They measure statistics, like how surprised the surrogate is by each word, then convert that into a probability.
- Because the surrogate is a guess about how machines write, it can mistake fluent, confident human writing for AI. This is a major reason non-native English writers get flagged.
- A detection score is a probability produced by a proxy, not proof of authorship. It’s a signal, not a verdict.
- Understanding the surrogate explains both why detection works at all and why it fails in predictable ways.
The core problem detectors have to solve
Think about what a detector is actually up against. Right now there are dozens of widely used text generators, plus countless fine-tuned variants, paraphrasers, and humanizers layered on top. New ones ship every month. A detector that wanted to compare your essay against the exact model that produced it would need live access to all of them, all the time. That’s not realistic, and for closed commercial models it’s flat-out impossible.
So detectors do something cleverer and shakier at the same time. They pick a model they *do* control, run your text through it, and study how that model reacts. That model is the surrogate. The bet behind it is simple: AI-written text, no matter which system produced it, tends to share certain statistical habits. If the surrogate can spot those habits, it doesn’t need the original author. It just needs a good enough imitation of how machines write.
The word “surrogate” is doing real work here. It means a substitute that fills in for something you can’t reach directly. In medicine, a surrogate endpoint stands in for the outcome you actually care about. In AI detection, the surrogate model stands in for “the model that wrote this,” which the detector will basically never have.
What the surrogate model actually measures
The surrogate doesn’t ask, “Is this true?” or “Is this well argued?” It asks something much narrower: how predictable is each word, given the words before it?
Language models are, at heart, prediction machines. Show one the phrase “the cat sat on the,” and it assigns probabilities to what comes next. “Mat” scores high. “Refrigerator” scores low. When a detector feeds your text into its surrogate, it’s reading off those probabilities word by word. If the surrogate keeps thinking, “Yep, that’s exactly the word I’d have picked,” the text looks low-surprise and machine-like. If the surrogate keeps getting caught off guard, the text looks high-surprise and more human.
That “surprise” measurement has a formal name, perplexity, and there’s a companion measure, burstiness, that looks at how much the surprise varies from sentence to sentence. We dig into both in our piece on the statistics behind AI detectors, so I won’t rebuild the whole math here. The point for now is this: the surrogate model is the thing *producing* those numbers. Perplexity isn’t a property of your text floating in the air. It’s the surrogate’s reaction to your text. Swap in a different surrogate and the numbers shift.
Trained classifiers do a similar thing, differently
Not every detector works purely off surprise scores. Some train a classifier on big piles of human and AI text and let it learn whatever features separate the two. But even those usually run text through an underlying language model first to turn words into features the classifier can chew on. The base model is still acting as a surrogate, just feeding a different decision layer. The structure is the same: one model interprets the text, another decides.
A mini-scenario: why two students get different scores
Picture two students who hand in essays on the French Revolution.
Maria is a careful non-native English writer. She studied hard, leaned on textbook phrasing, and wrote clean, correct, slightly formal sentences. Every clause is grammatical. Nothing is weird. The surrogate model reads her essay and finds it remarkably easy to predict. Low surprise, even pacing. The detector reports a high AI probability.
Jordan dashed his off the night before, contractions everywhere, a tangent about a documentary he half-remembers, one run-on sentence and two fragments. The surrogate keeps tripping over his choices. High surprise, uneven rhythm. The detector reports low AI probability.
Maria wrote every word herself. Jordan was, let’s say, less diligent. The surrogate can’t tell who tried harder or who used a tool. It only knows whose writing matched its expectations of “predictable.” That’s not a glitch in one product. It’s the direct, logical consequence of using a surrogate that scores predictability instead of authorship. A 2023 Stanford study (Liang et al.) found exactly this pattern: detectors flagged writing by non-native English speakers as AI far more often than native-speaker writing, and the authors point to the low perplexity of careful, less varied phrasing as a likely cause. The surrogate mistakes that fluency for machine output.
Why a proxy is both genius and a built-in blind spot
It’s worth holding both truths at once.
The surrogate approach is genuinely smart engineering. It’s the only practical way to flag text from models you can’t query. It generalizes across systems you’ve never seen, which is wild when you think about it. A detector trained around one surrogate can still catch output from a brand-new chatbot, because that chatbot inherited the same statistical tendencies toward smooth, predictable prose.
But the same design carries a permanent weakness. A surrogate can only recognize the patterns it already expects. Three things follow from that:
- It overfits to its own idea of “AI.” Anything that happens to look predictable, including a lot of polished human writing, gets swept up.
- It lags the models it’s chasing. When generators change how they write, the surrogate’s assumptions go stale until it’s updated.
- It can be wrong with total confidence. A probability score *sounds* precise. It’s still a guess built on a stand-in.
This is why even the companies building these tools hedge. OpenAI retired its own AI text classifier in July 2023, saying its rate of accuracy was too low. If the team behind a leading model couldn’t reliably detect its own model’s output, that tells you something about how hard the surrogate problem really is.
What this means for you, practically
If you write, study, or manage a content team, the surrogate concept changes how you should read a detection result.
Treat the score as a probability, not a verdict. A high number means your text resembles the surrogate’s mental model of AI writing. It does not mean a machine wrote it, and it’s not evidence of what you did. Used as the sole basis for an accusation, it’s far weaker than it looks.
Know that “human” and “predictable” aren’t opposites. Plenty of excellent human writing is clean and confident, which reads as low-surprise to a surrogate. If your honest draft gets flagged, the realistic fix is to add the variety and specificity that machines tend to flatten out, not to assume you did something wrong. A good humanizing pass is about restoring that natural unevenness, not tricking anyone.
Don’t chase a perfect score across every tool. Different detectors use different surrogates, so a draft can pass one and fail another. That inconsistency isn’t a bug you can engineer your way around; it’s the surrogate problem showing through.
If you want to go deeper on how all of this fits together, browse the rest of our writing on detection mechanics, or check our pricing if you’re weighing a tool.
Frequently asked questions
What is a surrogate model in AI detection?
It’s a stand-in language model the detector uses to score your text. The detector runs your words through this model and measures how predictable they look. It does this because it usually can’t access the model that actually wrote the text, so it uses a proxy and assumes the patterns generalize.
Does the detector use the same model that wrote my essay?
Almost never. There are dozens of writing models, plus paraphrasers and humanizers, and a detector can’t query all of them in real time. So it relies on one or a few surrogate models and bets that AI text from any source shares similar statistical fingerprints. That bet is often right, but not always.
Why does the surrogate model flag my original writing as AI?
Because it scores predictability, not authorship. If you write in clean, confident, formulaic prose, the surrogate finds your words easy to predict and reads that as machine-like. This hits non-native English writers especially hard, since careful, textbook-correct phrasing looks “low surprise” to the model.
If detectors use a proxy, can I trust the score?
Trust it as a signal, not a verdict. The number is a probability generated by a guess about how machines write. A high score means your text resembles the surrogate’s idea of AI patterns. It isn’t evidence of what you actually did, which is why one score should never decide an academic or professional case on its own.
Is using a surrogate model a flaw or a feature?
Both. It’s the only practical way to detect text from models you can’t access, so it’s clever. But it bakes in a blind spot, because the proxy can only recognize patterns it already expects, which is why no detector reaches 100 percent accuracy.
The short version
A surrogate model is one model standing in for another. Detectors use it because they have no realistic alternative, and it works well enough to be useful and badly enough to be dangerous when treated as proof. Once you see that the score is a guess from a proxy rather than a readout of the truth, the whole system gets easier to reason about. If you’ve got a draft that reads as flagged but you wrote it honestly, run it through a humanizer and give it back the natural variety a surrogate keeps mistaking for a machine.
Try it on your own text
Paste your draft into PaperBleach to humanize AI text so it reads naturally — then check your score against built-in AI detection. Free on your first run.


