CCAR-P practice › Evaluation, Testing & Optimization · Question 69 of 110
Evaluation, Testing & Optimization
A media company runs two Claude workloads on the same large model: a real-time newsroom assistant, and a nightly job that tags and summarizes about 60,000 archived articles. The nightly job accounts for most of the spend, and its results are needed by 9 a.m. Quality on the tagging eval is currently acceptable. Which change most directly cuts cost without risking the quality bar?
Show answer and explanation
Answer: D — Move the nightly job to the Message Batches API, keeping model and prompt unchanged
(d) is right: the nightly job isn't latency-sensitive, and the Message Batches API is designed for asynchronous bulk work at lower cost, so moving it there reduces spend without changing what the model sees. (a) downsizes without evidence and risks both workloads. (b) cuts context the tags and summaries may depend on. (c) finishes faster but doesn't reduce cost per request.
Keep going
More Evaluation, Testing & Optimization questions
- A customer-service chat assistant has a p95 latency complaint from users, who mostly…
- A financial-services firm's research assistant shows healthy dashboards: 99.9% uptime…
- A SaaS company's monitoring shows that, after a release, cost per conversation rose 30%…
- A bank is preparing to launch a Claude-based assistant that answers customer questions…
- An engineering lead reports that a new configuration of a document-processing agent…