CCAO-F practice › Output Evaluation and Validation · Question 23 of 100
Output Evaluation and Validation
A customer support lead asks Claude how many days customers have to request a refund. Claude answers '45 days' confidently, but the company's refund policy was never uploaded, and the real window is different. What is the best way to get reliable answers going forward?
Show answer and explanation
Answer: B — Upload the current policy and tell Claude to answer only from it, saying when it doesn't cover a question
Claude can't know an internal policy it was never given, so it filled the gap. Grounding the task in the actual policy and giving permission to say the answer isn't there removes the cause (b). Asking it to be careful doesn't supply the missing information (a). A larger model still doesn't have internal company policy (c). Regenerating until it matches only works if you already know the answer, and it won't hold up for other questions (d).
Keep going
More Output Evaluation and Validation questions
- A strategy manager at a regional bakery chain reviews a Claude-drafted analysis of two…
- A communications officer had an event press release fact-checked and approved. She then…
- An office manager asks Claude, with web search on, what the company's per-night hotel…
- A clinic's operations coordinator uses Claude for several drafts. Select the two outputs…
- A team lead uses Claude to draft a short, light-hearted recap of last week's team lunch…