What an AI Detector Score on Your Manuscript Is Worth

Someone hands you a number and says a machine wrote your book. Do you know what that number measures? Start with something that does measure. A breathalyzer. You blow into it, the chemistry happens, and the figure that comes out corresponds to something physically present in your body. It can be calibrated. It can be challenged in court. When it says 0.09, there’s a molecule count behind it.

An AI detector measures nothing like that. It reads your sentences and estimates how closely they resemble sentences a language model would produce. There’s no residue in the paper. There’s no molecule to count. The output looks like a breathalyzer reading and people treat it like one. That mistake is costing writers work right now.

I’ve got no patience for the way these scores get used. Someone runs a manuscript through a detector, gets a percentage, and treats it like a conviction, and then the writer has to prove a negative to keep the work. You deserve to know what the tool measures before anyone uses it against you.

How do AI content detectors decide a text is machine written?

The detector is itself a model. It was trained on large piles of text labeled human and large piles labeled machine, and it learned the statistical fingerprint of each. Then it reads your paragraph and reports how closely it matches the machine pile.

What does that fingerprint consist of? Predictability, mostly. Language models choose likely words.

Across a few hundred words, that produces prose with fewer surprises than human writing carries, sentences of similar length, transitions that arrive on schedule, paragraph shapes that repeat. Researchers use the terms perplexity and burstiness for these measures. Low surprise and even rhythm read as machine.

Now consider what else produces low surprise and even rhythm. Professional editing does. A technical writer trained to keep sentences under twenty words does. A non-native English speaker working from a smaller pool of constructions does. A lawyer does. A writer who has been through six rounds of revision aimed at clarity does. The detector is looking for regularity. Machines produce regularity. So does discipline. I’ve found that jargon-heavy writing gets flagged too. A technical manual tends to show up as AI even when AI had nothing to do with it.

Watch: How does AI detection work? I designed an EXPERIMENT to show you, Qualitative Researcher Dr Kriukow

What does the detector score claim to prove?

The newer tools do more than return a single percentage.

The better ones grade into bands, fully machine written, moderately assisted, lightly assisted, human. One of them is now embedded in a major publishing platform. A reader-facing AI assessment now sits on writing that was never submitted for judgment at all. Turning it off is itself read as a confession.

The bands are an improvement, and I would rather see them than a bare percentage. They still rest on the same foundation. A guess about style.

Meanwhile the failure reports keep arriving. Authors paste in paragraphs from their own published books, work that predates these tools, and watch a detector call it ninety percent machine. Writing associations have run comparative tests on multiple detection products and found the accuracy claims didn’t survive contact with real manuscripts. False positives fall hardest on exactly the writers who can least afford them: students, non-native speakers, and anyone whose style runs clean. It happened to me in 2024. Someone ran a piece I’d written 5 or 10 years earlier, way before AI, through Originality.ai, and it said the whole thing was AI. The piece was full of spelling and grammar errors. In my opinion, Originality was a piece of crap.

It makes me angry that the writer least able to fight a false accusation is the one most likely to get it, and nobody who ran the tool pays anything when it’s wrong. A student loses a grade or a freelancer loses a client, and the vendor sells another subscription. A tool that’s right most of the time is useful to you for triage. It isn’t evidence, and I’ve written a whole piece on why publishing keeps treating it as though it were.

Why can’t a detector tell the difference between edited prose and generated prose?

Because there may be no difference to find.

Think about what good editing does to a sentence. It removes the wandering clause. It cuts the redundant modifier. It makes the rhythm consistent so the reader stops noticing the prose and starts noticing the argument. Every one of those moves reduces surprise. Surprise is the exact quantity the detector treats as suspicious. A heavily edited human manuscript and a generated manuscript can converge on similar statistical profiles from opposite directions. One got there by removing noise on purpose. The other never had any. The detector sees the destination and can’t see the road.

This is also why detectors do worse on short passages. Give a model two hundred words of your chapter and the signal is thin, so the confidence swings wildly.

Feed it a whole chapter and it steadies. That’s one reason the tools look better in vendor demonstrations than in the wild, where people paste in a paragraph and demand an answer.

I saw that myself back in 2024, when I still ran drafts through a detector during revision. The target I worked to was over 75% authentic, and my chapters came back in the high nineties. Paste in a single paragraph and it came out for shit. All that phase taught me was that the scores meant nothing. I don’t use AI checkers anymore. They’re worthless crap.

And there’s a moving target problem underneath all of it. Detectors learn the fingerprint of today’s models. The models change every few months. A detector tuned on last year’s output is grading this year’s writing with an outdated map, and nobody tells you which map is grading your pages.

I think any institution that makes decisions about people with a tool it can’t audit, on a map it can’t date, is being reckless with other people’s livelihoods. Schools and publishers wouldn’t accept that from a lab test. They shouldn’t accept it from software just because the result comes back with a percent sign.

What should you ask for instead of a detector score?

I’m asking you to trust a different kind of evidence, so you should see what it looks like in my own work.

When I ghostwrite a book, the process leaves a trail whether anyone plans to inspect it or not. There are recorded interviews, hours of the client talking in their own voice. There are transcripts of those recordings. There’s an outline the client read and approved before a word of prose existed. There are chapters delivered one at a time, each with the client’s comments on them, and the next version showing those comments applied. There are dated files going back to the first conversation.

A prompt can’t produce that trail. It’s what doing the work properly looks like, and it has existed in every project I’ve run.

So if you’re an author with doubts about a manuscript you paid for, don’t run it through a detector and open with the number. Ask four questions. Can I hear the interview recordings this chapter came from? Can I see the outline I approved and the draft that followed it? Can I see the version history with dates? Can you walk me through why this chapter opens the way it does?

The Caine Prize for African Writing is running that test in public. When a detector flagged its 2026 winning story, the prize’s chair, Ellah Wakatama, asked for evidence of real human investigation. The next steps included talks with the judges and a review of the author’s earlier drafts. A prize with its reputation on the line went straight to the drafts. The review is still open, and whatever it finds, it’ll find it on evidence a person can check.

France supplied a second test the same autumn. Thélyson Orélien’s novel C’était ça ou mourir was a bestseller with critics calling it a literary masterpiece when an anonymous account on X accused him of generating it with AI. The book was pulled from a major French prize list. Orélien denies using AI to write it.

In the AI authors’ group where the story circulated, one novelist ran her own first book through a detector and got an 85 percent AI score. She wrote it before AI existed, and she has the spiral notebooks to prove it.

That last one does more work than the other three. A writer who built the chapter can tell you why the second scene comes before the third and what they cut. Someone who generated it can’t, because the reasoning never happened. You’ll know inside five minutes, and no percentage was involved.

What a detector result should change about your next step

None of this makes detectors worthless. It makes them a smoke alarm instead of a verdict. Keep the smoke alarm. Just don’t sentence anyone on it.

My own view has moved on this. Back in 2024 I found ChatGPT’s output easy to spot, and I wouldn’t have dared use it to write a client’s book, because a traditional publisher would reject it. I ran everything through a detector called Originality.ai, whether I’d written it or not, to be sure. Now I use Claude.

If a manuscript scores high and everything else about the project is solid, the recordings exist, the drafts are there, the writer can talk about the choices, then you’ve got a false positive and a clean style. Let it go. If a manuscript scores high and the writer can’t produce a single draft earlier than the final one, has no recordings, and can’t explain a structural decision, the score isn’t what told you something is wrong. The absent trail did. The detector merely prompted you to look. Treat the number as a reason to ask questions and never as the answer to one. That framing protects the honest writer with a tidy style and still catches the person who prompted your book into existence over a weekend. That’s the outcome everyone claims to want.

The part authors keep missing

There’s a quieter cost to all of this, and I see it in my inbox.

You may have seen writers deliberately worsening their prose to pass detection. Adding clumsy transitions. Leaving in the wandering clause. Breaking a clean rhythm on purpose because clean reads as suspicious. I’ve had clients ask me to make their chapters a little messier so the book won’t get flagged.

Think about where that leads. We’ve built a system that penalizes clarity and rewards noise, and then we act surprised when writing gets worse. A reader has never once finished a book and thought the prose was too smooth. That standard exists only inside the detectors, and we’re now editing toward it.

I won’t do it, and I tell clients why. The answer to a bad measurement is to produce better evidence than the measurement can. Back to the drafts, the recordings, and the dates. If you want more on where the real lines fall, I’ve written about what you owe readers when AI touches your book and about using these tools for research without getting burned.

Back to the breathalyzer

A breathalyzer can be wrong, and it still holds up in court. It holds up because it measures a physical fact, it can be calibrated against a known standard, and its error rate has been studied and published. An AI detector has none of those properties. It measures resemblance, it can’t be calibrated against anything but yesterday’s models, and its error rate depends on who wrote the text and in what language and how carefully it was edited. Use it the way a smart nurse uses a thermometer reading that doesn’t match the patient in front of her. She doesn’t ignore it. She doesn’t write a diagnosis on it either. She looks at the patient.

Any publisher, school or platform that punishes a writer on a detector score alone is taking a shortcut with somebody else’s career, and I think that’s shameful. The writer usually never gets a chance to show the work that would have cleared them.

Look at the manuscript. Look at the trail behind it. Then decide. For a fuller picture of how AI fits into writing without the panic, start at my AI writing hub. If you want a book built by a person, with a process you can inspect at any point, that’s what my ghostwriting service does.

Frequently Asked Questions