CCAO-F practice › Output Evaluation and Validation · Question 23 of 100

Output Evaluation and Validation

A customer support lead asks Claude how many days customers have to request a refund. Claude answers '45 days' confidently, but the company's refund policy was never uploaded, and the real window is different. What is the best way to get reliable answers going forward?

Show answer and explanation

Answer: B — Upload the current policy and tell Claude to answer only from it, saying when it doesn't cover a question

Claude can't know an internal policy it was never given, so it filled the gap. Grounding the task in the actual policy and giving permission to say the answer isn't there removes the cause (b). Asking it to be careful doesn't supply the missing information (a). A larger model still doesn't have internal company policy (c). Regenerating until it matches only works if you already know the answer, and it won't hold up for other questions (d).