Curriculum › Developer Productivity & Operational Enablement · 7% of the exam

AI-assisted developer workflows and operations

What you’ll be able to do

  • Identify where AI-assisted tooling improves a team’s development workflow and where it adds review burden
  • Structure AI-assisted work as explore, plan, implement and verify, with tests or checks as the oracle
  • Integrate Claude Code into CI and automation with scoped permissions and human gates
  • Use Claude for debugging and incident triage grounded in logs, traces and reproductions
  • Measure productivity impact with delivery and quality metrics

What you need to know

Find the bottleneck first

AI-assisted tooling helps most where developer time goes into work that is repetitive, well-specified and checkable: writing tests for existing behavior, mechanical migrations and upgrades, boilerplate, documentation, first-pass code review, explaining unfamiliar code. It helps least, or creates net cost, when the bottleneck is elsewhere: slow review queues, unclear requirements, flaky environments, release approval processes. Generating code faster into a review queue that is already the constraint makes cycle time worse. Map the delivery flow, find where work waits, and aim the tooling there.

Give the work a verifiable target

Claude does its best work when it can check its own output against something objective. For code that means tests, type checks, linters, a build, or a reproduction script. A reliable pattern for non-trivial changes:

  • Explore: have Claude read the relevant code and summarize how it works before changing anything.
  • Plan: for multi-file or architectural changes, use plan mode or ask for a written plan, and review it. Correcting a plan is cheaper than correcting a diff.
  • Implement in small, reviewable steps.
  • Verify by running the checks. For a bug fix, write a failing test that reproduces the bug first; the fix is done when that test passes and nothing else breaks.

Without an oracle, "it looks right" is the only check, and fluent code that looks right is exactly what makes subtle defects expensive.

Automation in CI and scheduled jobs

Claude Code can run non-interactively (for example with claude -p and a prompt) inside CI pipelines and integrations such as GitHub Actions: reviewing pull requests, triaging new issues, proposing fixes for failing checks, updating documentation. Automation changes the risk profile: there is no developer watching each action. Design for that:

  • restrict tools explicitly to what the job needs (a review job needs read access and the ability to post comments, not push rights);
  • prefer structured output that the pipeline parses, over free text a human must interpret;
  • keep a human gate on merges, releases and anything irreversible; the job proposes, a person approves;
  • give the job the same project context developers have (CLAUDE.md, conventions) so its suggestions match team standards;
  • treat untrusted input, such as text in an external contributor's PR or issue, as data that could attempt to steer the job, which is another reason to keep its permissions narrow.

Debugging and operational issue resolution

For debugging and incidents, Claude is strongest as an investigator that reads quickly and reasons across evidence: logs, traces, metrics, recent deploys and diffs, configuration, runbooks. The professional design questions are about evidence and authority.

  • Ground it in evidence. Provide or give tool access to the actual logs, traces and change history. Ask for hypotheses ranked by evidence, each tied to specific log lines, trace spans or commits, and for the check that would confirm or rule it out. A root cause that cites no evidence is a guess, however confident it sounds.
  • Reproduce before fixing. A reproduction or failing test turns a plausible story into a confirmed one and gives the fix a target.
  • Separate read from act. Triage tools (log search, metrics queries, deploy history) can be read-only and widely available, often through MCP servers. Remediation (rollbacks, config changes, restarts) stays with the on-call engineer or goes through the existing, audited change path with approval. The assistant can draft the command; a human runs or approves it.
  • Encode operational knowledge. Turn runbooks into Skills or commands so the assistant follows the team's procedure, and after an incident, feed what was learned back into runbooks and project context.

Measure outcomes, not activity

Lines generated, suggestions accepted and prompts sent measure activity. Productivity is about delivery and quality: cycle time from first commit to production, review turnaround, change failure rate, escaped defects, time to restore service during incidents, and developer-reported friction. Compare against a pre-rollout baseline or a pilot-versus-control group, and watch for displaced effort: if reviewers now spend more time per pull request, part of the gain has moved rather than disappeared.

Key concept

AI-assisted workflows pay off when Claude works against a verifiable target with real evidence, inside narrow permissions, with humans owning merges and production changes, and when success is measured in delivery outcomes.

Exam questions in this area describe a team adopting tooling or responding to an incident. Prefer answers that add verification (tests, reproductions, evidence citations), keep write authority with humans or audited paths, narrow automation permissions, or change the metric to one that reflects delivery.

Practice scenario

ScenarioDuring a payment-service incident, an on-call engineer asks an internal Claude-based assistant why error rates spiked. Within a minute it replies that a database connection pool is exhausted and recommends raising the pool size, offering to apply the change since it has credentials to the production configuration service. The explanation is plausible, but it cites no metrics, and a deploy of the payment service went out twenty minutes before the spike.
Work it through, then open this

Do not apply the change. The diagnosis is unsupported: nothing ties it to connection-pool metrics, and it ignores the most salient evidence, the recent deploy. Ask the assistant to pull the deploy diff, error logs and pool metrics, and to rank hypotheses with the specific evidence for each and the check that would confirm it. If the deploy correlates, rollback through the normal, audited path is usually the faster mitigation.

Structurally, the assistant should not hold write credentials to production configuration. Make its tools read-only, keep remediation with the on-call engineer via the change process, and require evidence citations in its triage output format.

Build exercise — Instrument one AI-assisted workflow

Advanced · 40 min

What you’ll learn

  • Targeting tooling at the real bottleneck
  • Adding verification and human gates
  • Measuring delivery impact
  1. Map your team’s path from ticket to production and mark where work waits longest.

    • Why: Tooling aimed at a non-bottleneck step adds activity without improving delivery.
    • You should see: One or two steps where most elapsed time accumulates.
  2. Pick one workflow at or near that step and define its oracle (tests, build, reproduction) and its human gate, then write the permissions an automated version would need.

    • Why: Verifiable targets and narrow permissions make the workflow safe to automate.
    • You should see: A tool list with no write access beyond what the step needs, and a named approver.
  3. Choose two delivery metrics and one quality metric, record a baseline, and plan a pilot-versus-control comparison.

    • Why: Without a baseline and a comparison, productivity claims are anecdotes.
    • You should see: Metrics such as cycle time, review turnaround and change failure rate, not lines generated.

Exam traps

Measuring AI productivity by lines of code generated or number of prompts

Activity metrics can rise while delivery slows. Measure cycle time, quality and time to restore.

Letting an assistant change code with no test or check to verify the result

Without an oracle, plausible-looking defects slip through. Give the work tests, builds or a reproduction to verify against.

Giving an incident-triage agent write access to production “to save time”

Triage needs read access; remediation needs accountability. Keep production changes with humans or the audited change path.

Accepting a confident root-cause explanation that is not tied to log or trace evidence

Fluency is not evidence. Require hypotheses with specific citations and a confirming check.

Running headless automation with broad permissions because no one is watching the prompts

Unattended jobs need tighter permissions, not looser ones. Restrict tools to the job and keep humans on merges and releases.

Applying AI to the step that is not the bottleneck in the delivery process

Faster code generation into a saturated review queue lengthens cycle time. Find where work waits first.

Sources

Quick check

Security requires that Claude Code never read files under a repository's secrets/ directory. The rule is currently written in the project CLAUDE.md, yet a developer's session read one of those files. What is the most appropriate fix?