CCAR-F practice › Context Management & Reliability · Question 102 of 105
Context Management & Reliability · Select TWO
A team has automated acceptance of high-confidence extractions. With a small review team, they want to keep measuring error rates, catch new kinds of errors, and spend reviewer time where it matters most. Which two practices should they adopt? (Select two.)
Show answer and explanation
Answer: A and C — Review a stratified random sample of high-confidence extractions, stratified by document type / Route low-confidence fields and documents with contradictory values to reviewers first
Stratified random sampling of high-confidence output measures ongoing error rates and surfaces novel patterns across every segment (A), and routing low-confidence or contradictory cases first puts limited capacity where errors are likely (C). (B) undersamples rare types. (D) can't catch errors the model is confident about.
Keep going
More Context Management & Reliability questions
- Reviewers cannot trace most statistics in a research system's final reports back to a…
- A document-analysis subagent finds two credible studies reporting different adoption…
- A synthesis agent reports a "major contradiction" between a survey finding 22% adoption…
- A returns agent calls lookup_order several times per session. Each call appends the…
- In long support sessions where customers raise several issues, older turns are…