CCAR-F practice › Prompt Engineering & Structured Output · Question 69 of 105
Prompt Engineering & Structured Output
A review bot's security findings are almost always accepted, but its "performance" findings are dismissed about 85% of the time. Developers have started resolving every bot comment without reading it, including valid security findings. What is the best first step?
Show answer and explanation
Answer: D — Temporarily disable the performance category while its criteria are reworked
A high false positive category undermines trust in the accurate ones. Switching it off restores confidence in the security findings while its prompt is improved. A blanket "be conservative" instruction (a) doesn't target the noisy category. Confidence sorting (b) still posts the noise. Agreement across runs (c) suppresses intermittently caught real issues and leaves the category's criteria as vague as before.
Keep going
More Prompt Engineering & Structured Output questions
- A review prompt defines severity as "critical: severe problems; major: significant…
- A review prompt contains a detailed paragraph specifying that every finding must include…
- A test-generation reviewer is inconsistent about whether an untested error branch counts…
- An extractor pulls sample size from research papers. It is accurate when the paper has a…
- A pipeline prompts Claude to "reply only with a JSON object," but roughly 5% of…