What you’ll be able to do
- Identify where AI-assisted tooling improves a team’s development workflow and where it adds review burden
- Structure AI-assisted work as explore, plan, implement and verify, with tests or checks as the oracle
- Integrate Claude Code into CI and automation with scoped permissions and human gates
- Use Claude for debugging and incident triage grounded in logs, traces and reproductions
- Measure productivity impact with delivery and quality metrics
What you need to know
Find the bottleneck first
AI-assisted tooling helps most where developer time goes into work that is repetitive, well-specified and checkable: writing tests for existing behavior, mechanical migrations and upgrades, boilerplate, documentation, first-pass code review, explaining unfamiliar code. It helps least, or creates net cost, when the bottleneck is elsewhere: slow review queues, unclear requirements, flaky environments, release approval processes. Generating code faster into a review queue that is already the constraint makes cycle time worse. Map the delivery flow, find where work waits, and aim the tooling there.
Give the work a verifiable target
Claude does its best work when it can check its own output against something objective. For code that means tests, type checks, linters, a build, or a reproduction script. A reliable pattern for non-trivial changes:
- Explore: have Claude read the relevant code and summarize how it works before changing anything.
- Plan: for multi-file or architectural changes, use plan mode or ask for a written plan, and review it. Correcting a plan is cheaper than correcting a diff.
- Implement in small, reviewable steps.
- Verify by running the checks. For a bug fix, write a failing test that reproduces the bug first; the fix is done when that test passes and nothing else breaks.
Without an oracle, "it looks right" is the only check, and fluent code that looks right is exactly what makes subtle defects expensive.
Automation in CI and scheduled jobs
Claude Code can run non-interactively (for example with claude -p and a prompt) inside CI pipelines and integrations such as GitHub Actions: reviewing pull requests, triaging new issues, proposing fixes for failing checks, updating documentation. Automation changes the risk profile: there is no developer watching each action. Design for that:
- restrict tools explicitly to what the job needs (a review job needs read access and the ability to post comments, not push rights);
- prefer structured output that the pipeline parses, over free text a human must interpret;
- keep a human gate on merges, releases and anything irreversible; the job proposes, a person approves;
- give the job the same project context developers have (
CLAUDE.md, conventions) so its suggestions match team standards; - treat untrusted input, such as text in an external contributor's PR or issue, as data that could attempt to steer the job, which is another reason to keep its permissions narrow.
Debugging and operational issue resolution
For debugging and incidents, Claude is strongest as an investigator that reads quickly and reasons across evidence: logs, traces, metrics, recent deploys and diffs, configuration, runbooks. The professional design questions are about evidence and authority.
- Ground it in evidence. Provide or give tool access to the actual logs, traces and change history. Ask for hypotheses ranked by evidence, each tied to specific log lines, trace spans or commits, and for the check that would confirm or rule it out. A root cause that cites no evidence is a guess, however confident it sounds.
- Reproduce before fixing. A reproduction or failing test turns a plausible story into a confirmed one and gives the fix a target.
- Separate read from act. Triage tools (log search, metrics queries, deploy history) can be read-only and widely available, often through MCP servers. Remediation (rollbacks, config changes, restarts) stays with the on-call engineer or goes through the existing, audited change path with approval. The assistant can draft the command; a human runs or approves it.
- Encode operational knowledge. Turn runbooks into Skills or commands so the assistant follows the team's procedure, and after an incident, feed what was learned back into runbooks and project context.
Measure outcomes, not activity
Lines generated, suggestions accepted and prompts sent measure activity. Productivity is about delivery and quality: cycle time from first commit to production, review turnaround, change failure rate, escaped defects, time to restore service during incidents, and developer-reported friction. Compare against a pre-rollout baseline or a pilot-versus-control group, and watch for displaced effort: if reviewers now spend more time per pull request, part of the gain has moved rather than disappeared.
Key concept
AI-assisted workflows pay off when Claude works against a verifiable target with real evidence, inside narrow permissions, with humans owning merges and production changes, and when success is measured in delivery outcomes.
Exam questions in this area describe a team adopting tooling or responding to an incident. Prefer answers that add verification (tests, reproductions, evidence citations), keep write authority with humans or audited paths, narrow automation permissions, or change the metric to one that reflects delivery.
Practice scenario
Work it through, then open this
Do not apply the change. The diagnosis is unsupported: nothing ties it to connection-pool metrics, and it ignores the most salient evidence, the recent deploy. Ask the assistant to pull the deploy diff, error logs and pool metrics, and to rank hypotheses with the specific evidence for each and the check that would confirm it. If the deploy correlates, rollback through the normal, audited path is usually the faster mitigation.
Structurally, the assistant should not hold write credentials to production configuration. Make its tools read-only, keep remediation with the on-call engineer via the change process, and require evidence citations in its triage output format.
Build exercise — Instrument one AI-assisted workflow
Advanced · 40 min
What you’ll learn
- Targeting tooling at the real bottleneck
- Adding verification and human gates
- Measuring delivery impact
-
Map your team’s path from ticket to production and mark where work waits longest.
- Why: Tooling aimed at a non-bottleneck step adds activity without improving delivery.
- You should see: One or two steps where most elapsed time accumulates.
-
Pick one workflow at or near that step and define its oracle (tests, build, reproduction) and its human gate, then write the permissions an automated version would need.
- Why: Verifiable targets and narrow permissions make the workflow safe to automate.
- You should see: A tool list with no write access beyond what the step needs, and a named approver.
-
Choose two delivery metrics and one quality metric, record a baseline, and plan a pilot-versus-control comparison.
- Why: Without a baseline and a comparison, productivity claims are anecdotes.
- You should see: Metrics such as cycle time, review turnaround and change failure rate, not lines generated.
Exam traps
Measuring AI productivity by lines of code generated or number of prompts
Activity metrics can rise while delivery slows. Measure cycle time, quality and time to restore.
Letting an assistant change code with no test or check to verify the result
Without an oracle, plausible-looking defects slip through. Give the work tests, builds or a reproduction to verify against.
Giving an incident-triage agent write access to production “to save time”
Triage needs read access; remediation needs accountability. Keep production changes with humans or the audited change path.
Accepting a confident root-cause explanation that is not tied to log or trace evidence
Fluency is not evidence. Require hypotheses with specific citations and a confirming check.
Running headless automation with broad permissions because no one is watching the prompts
Unattended jobs need tighter permissions, not looser ones. Restrict tools to the job and keep humans on merges and releases.
Applying AI to the step that is not the bottleneck in the delivery process
Faster code generation into a saturated review queue lengthens cycle time. Find where work waits first.
Sources
- Claude Code documentation
- Model Context Protocol
- Anthropic, Claude Certified Architect – Professional Exam Guide v1.0 (July 2026)