Curriculum › Output Evaluation and Validation · 21% of the exam

Fact-checking and knowing when a human must review

What you’ll be able to do

  • Check a claim against the source that actually has authority over it
  • Recognize when an output needs a human or expert review before use
  • Set up review that fits the risk instead of reviewing everything or nothing

What you need to know

Verify against the authoritative source

Fact-checking means comparing a claim with the source that actually decides whether it's true. For a regulation, that's the regulation's official text. For a price, it's the current price list. For a company policy, it's the published policy. For an employee's leave balance, it's the HR system. It is not asking Claude again, asking another AI tool, or searching until you find a page that agrees.

  • Go to the original. If a summary cites a clause, open the document and read that clause.
  • Check that the citation supports the claim. A real source can be cited for something it doesn't say. Check that the source is real and that it says what the output claims it says.
  • Check freshness. Policies, prices, and rules change. Confirm you're looking at the current version.
  • Trace it, don't just count agreement. Several AI-written pages repeating the same figure don't confirm it. Follow the figure back to whoever first published it.

Citations and research are where you start checking

Web search and research can give Claude real sources and return citations, which makes checking much faster. But a citation tells you where to look. It doesn't prove the claim. Sources can be outdated, low quality, or summarized imperfectly. For anything that matters, open the cited source and confirm the specific claim. Uploading the authoritative document into the chat or Project, and asking Claude to answer only from it and quote its passages, makes this check fast.

When you can't find an authoritative source for a claim, don't present it as fact. Remove it, rewrite it as clearly unconfirmed, or ask the person who owns the information. Unverified detail shouldn't reach the final version just because it was hard to check.

When a human must review

Some outputs must go to a human before anyone acts on them, however good they look. The triggers to recognize:

  • High stakes: an error would cost real money, harm someone, or damage trust.
  • Regulated or specialist content: legal, medical, financial, tax, safety, employment, or compliance material. These need someone qualified in the area, for example legal counsel, a clinician, finance, or HR.
  • External or broad audience: press releases, published reports, website copy, customer-wide emails, anything carrying the organization's name in public.
  • Irreversible decisions: terminating a contract, rejecting a candidate, making a payment, sending a message that can't be recalled.
  • Decisions about people: hiring, performance, discipline, eligibility. A human decides, and Claude assists.
  • Your organization's AI policy says this kind of content needs sign-off.

The more of these that apply, the stronger the case for review. Low-stakes, internal, easily corrected work, like a first-draft agenda or brainstormed subject lines, usually needs only your own read-through. Reviewing everything at expert level wastes effort and slows teams down. The skill is matching review to risk.

Make review effective

  • Pick the right reviewer. A colleague proofreading a contract summary isn't legal review. The reviewer must be qualified for the content.
  • Show your sources. Give the reviewer the output, the source documents, and the specific claims that matter. Flag anything you couldn't verify.
  • Draft until approved. Label it as a draft, and don't send, publish, or act on it until it's signed off.
  • Escalate when it's beyond you. If verifying properly needs technical work, such as checking a large automated pipeline, bring in the right specialist instead of skipping the check.

A reliable Project or template lowers the chance of error. It doesn't remove the need for review when the triggers apply. Each new output is new content.

Key concept

Check claims against the source that has authority over them, and route output to a qualified human whenever stakes, regulation, external publication, decisions about people, or irreversibility apply.

Exam questions often give you a confident, cited, or nicely formatted output in a high-stakes setting. The right answer checks it against the authoritative source and brings in the appropriate expert. Watch for the opposite trap too: a low-stakes internal task where demanding legal sign-off is out of proportion.

Practice scenario

ScenarioAn HR coordinator uses a Project loaded with the company's benefits handbook to draft an email to all 600 employees explaining a change to parental leave eligibility. Claude's draft is clear, references the handbook section, and states that employees become eligible after six months of service. The coordinator wants to send it before the end of the day.
Work it through, then open this

Several review triggers apply at once: the content is employment and benefits related, the audience is the whole company, the stakes are real (people will plan family leave around it), and a mass email can’t be taken back. First, the coordinator should check the six-month figure and any conditions against the current, official policy text, not just the handbook copy in the Project, which may be out of date. Then the draft should go to whoever owns the policy (HR leadership or benefits, and legal if eligibility rules are involved) for sign-off before it’s sent. The handbook reference makes checking quicker, but it doesn’t replace the check, and the deadline isn’t a reason to skip review.

Hands-on exercise — Build a review-trigger checklist

Beginner · 15 min

What you’ll learn

  • Verifying a cited claim at its source
  • Recognizing review triggers in your own work
  • Deciding who should review what
  1. Turn on web search or research (if your plan includes it) and ask Claude a factual question in your field that has a definite answer. Then open one cited source and find the exact sentence that supports the claim.

    • Why: It shows the difference between “has a citation” and “the citation says this.”
    • You should see: Either a clear match, or a source that only partly supports the claim or says something slightly different.
  2. List five outputs you’ve produced with Claude recently. Mark each one for the triggers: high stakes, regulated content, external audience, irreversible, decisions about people.

    • Why: Seeing the triggers in your own work makes them easier to recognize under exam conditions.
    • You should see: Most items need only your own read-through, and one or two clearly need someone else.
  3. For each flagged item, write down the qualified reviewer by role and what you would hand them.

    • Why: Review only works when the reviewer is qualified and has the sources.
    • You should see: A short reusable checklist you could add to a Project’s instructions as a reminder.

Exam traps

Treating a cited answer as already verified

A citation tells you where to look. Open the source and confirm it supports the specific claim.

Fact-checking by asking Claude, or another AI tool, the same question

Agreement between AI answers is not verification. Check against the authoritative source.

Skipping review because the output came from a trusted Project or template

A good setup lowers the error rate, but each output is new content and still needs review when the triggers apply.

Letting Claude make the final call on legal, medical, HR, or financial matters

Claude can draft and analyze. A qualified human decides and signs off in regulated or people-affecting areas.

Sending any reviewer rather than one qualified for the content

A proofreader isn’t a legal or clinical reviewer. Match the reviewer to the subject.

Treating every output as needing expert sign-off

Over-review wastes effort and slows teams down. Match review to stakes, audience, and reversibility.

Sources

Quick check

A program manager reviews a Claude-drafted board update. The executive summary says all milestones are on track, but the milestone table later in the document shows two milestones as delayed. What is the most appropriate action?