CCAR-P practice › Solution Design & Architecture · Question 9 of 110
Solution Design & Architecture
A support-answer assistant collects thumbs-up/down ratings from agents. A dashboard shows satisfaction declining for two months. The prompt team keeps adjusting the prompt and checking a handful of examples by hand. What is the main architectural gap?
Show answer and explanation
Answer: A — Structured feedback: downvotes with a reason and correction, sampled into a versioned eval set run before each change
Feedback that ends in a dashboard improves nothing; (a) turns it into regression data so changes are tested against real failures. (b) iterates faster without measurement. (c) guesses at the cause. (d) collects more unstructured signal without closing the loop.
Keep going
More Solution Design & Architecture questions
- HR wants employees to ask questions about roughly 200 benefits policy documents…
- Select two tasks where an agentic pattern is better justified than a predefined workflow.
- A telecom support agent handles every contact. About 80% of contacts are six well-known…
- A team split contract drafting into six agents, one per clause type. Clauses…
- A research coordinator fans out to eight search workers, each given the full topic…