Skip to content

Guides

How to Annotate an AI Chatbot Answer Before You Trust It

A chatbot answer reads like a finished article, which is exactly why it needs annotating. This method breaks an answer into claims you can check, marks each one with what you found, and leaves you with an answer you can actually rely on.

An answer broken into separate claims, each marked and ticked
Strips of a printed answer laid out in two columns, each marked in yellow and ticked or crossed in pencil

Chat assistants are useful for getting started on a question. They summarise, suggest and explain, and they do it in fluent, confident paragraphs. The trouble is that the confidence is the same whether the content is right or wrong. A good answer and a subtly wrong one look identical on the screen. The only way to tell them apart is to check, and the easiest way to check is to annotate: turn the paragraphs into a list of claims and mark each one with what you found.

The method

  1. Paste the answer into a document you can mark

    Copy the answer into a word processor, a notes app or a PDF. Chat windows are poor places to annotate: you cannot highlight, and the text may be regenerated or lost.

  2. Highlight every checkable claim

    Mark each statement of fact in yellow: names, dates, numbers, definitions, descriptions of what a law, study or product says. A long answer often contains fifteen or twenty. Leave general advice and opinion unmarked.

  3. Mark citations and quotations separately

    Give any cited source, link or quotation its own mark. These are the most likely parts to be invented, and they need opening one by one.

  4. Check each claim against a real source

    For each yellow mark, find an independent source that states the same fact: an official page, a reference work, the study itself. Search for the claim, not for the answer. When you find the supporting sentence, make a link to that highlighted sentence and paste it beside the claim.

  5. Record a verdict for each claim

    Tick claims you confirmed, cross those a source contradicts, and put a question mark on those you could not confirm. Keep the links next to the ticks and crosses.

  6. Rewrite from the ticks only

    Build your own answer, in your own words, from the confirmed claims and their sources. Drop the question marks or state them as open questions.

From answer to checked notes1Paste into adocument2Highlight each claim3Check against areal source4Keep the ticksand their links
The chatbot answer becomes a checklist, then a set of sourced notes.

What most often turns out to be wrong

Citations and quotations need the most care; general explanations are usually safer than specifics.
Part of the answerTypical problemHow to check
Citations and linksA plausible title, author or address that does not exist, or exists and says something elseOpen every one and find the passage
QuotationsInvented wording or the wrong speakerTrace it to a primary source
NumbersFigures that are out of date, from a different country, or not found anywhereFind the original dataset or report and its year
Recent eventsInformation older than the model's training, presented as currentCheck a dated news source
Specialist detailsA correct general picture with one wrong specific, such as a dosage, a deadline or a ruleCheck the official source for that field

For quotations, the full procedure is in tracing a quote back to its source. For the cited documents, the steps in annotating a source to verify its claims apply once you have opened them.

Why annotate rather than ask again

Asking the assistant whether its answer is correct produces another fluent paragraph, not evidence. Asking it for sources can produce more citations to check, which is useful as a lead but not as proof. Annotation moves the question out of the chat window and onto the page, where you can see which claims are confirmed, which are not, and where each confirmation came from. It is slower than trusting the answer, and much faster than finding out later that a key fact was wrong.

A note on style

While you annotate, you will notice the answer's style: the hedging, the balanced lists and the neat summary at the end. These habits are covered in close reading for AI writing patterns. They say nothing about whether a claim is true. Check the facts; do not grade the prose.

For students using chat assistants

If your school allows chat assistants for research, this method is how to use them responsibly: as a list of leads to check, never as a source. Keep your annotated copy with its links. It shows your teacher exactly what you verified and where, and it is the strongest evidence that the final work is yours.

Once you have pasted an answer into a document, the PDF highlight and note tools are a good place to mark it up, and links that land on the supporting sentence are the best way to record what you confirmed. More methods like these are on the guides index. When a chatbot answer ends up in your own work, citing a chatbot answer in APA, MLA or Chicago style covers the citation, and what detector scores do and do not mean explains the other side of the same question.

Common questions

How do you fact check an AI chatbot answer?

Paste it into a document, highlight every checkable claim, open or find an independent source for each, and record whether the source confirms, contradicts or cannot confirm it. Build your final answer only from the confirmed claims.

Are chatbot citations reliable?

Not on their own. They can be accurate, misdescribed or invented, so open every citation and find the passage before relying on it.

Why not just ask the chatbot if it is right?

Its reply is another generated answer, not evidence. Checking claims against independent sources is the only way to confirm them.

What should I save when I check an answer?

The annotated answer and, for each confirmed claim, a link to the exact supporting sentence in the source.