Speaking from the SRE Lane

Speaking from the SRE Lane

Cross-Disciplinary Observations on AI Engineering Playbooks

Notes from a DevOps/SRE practitioner on where agentic-engineering playbooks land for work that crosses ownership boundaries. Written to stand on its own — you don't need the specific playbook it responds to.


Why this exists

A colleague recently shared an AI engineering playbook — a genre that's becoming common as teams systematize how they work with coding agents. What follows responds to the pattern these playbooks share, so the particular document isn't needed to follow along.

These playbooks are strong, and the strength is real: they convert vague AI advice into executable rituals. A structured prompt framework, so context isn't left implicit. A read-only reconnaissance pass before touching an existing system. Small, bounded increments instead of one big generation. A mid-build verification checkpoint. An explicit ship / fix / rebuild verdict at the end. A running lessons log, so a mistake gets made only once. None of that needs defending. It works.

They are also written, very effectively, for one shape of work: a single operator shipping inside their own domain of authority. The flagship examples — sprint reports, backlog refinement, dashboards, an intake triage agent — all live inside what their operator is already entitled to decide.

DevOps and SRE work usually doesn't. Because our practice is cross-disciplinary — which healthy engineering organizations treat as a strength — most of our changes touch operational surfaces owned by more than one team. An alert, an SLO, a routing rule, or a runbook creates obligations for whoever holds the pager, and that's frequently not the person who generated the change. This is about topology, not blame: nobody is hoarding anything. The cross-functional nature we value is precisely why a playbook tuned for single-owner delivery is incomplete for our work — and these notes extend it for that case.


The one idea: there are two kinds of "done"

When one of these playbooks declares work shippable, that's a technical gate — does the artifact meet its acceptance criteria. Cross-owner work has a second gate no reviewer inside the workflow can issue: acceptance by the people whose operational surface the change touches.

A skeptical AI reviewer can confirm an IAM policy is least-privilege. It cannot confirm that the team who lives with that policy has agreed to it. The first is correctness. The second is consent. Our work is not finished at the first.

The case most of us have already lived: a coding agent can generate the Datadog monitor and the Terraform resource that defines it, validate the diff, and prepare the rollback. It cannot decide who accepts the page that monitor will send. The code is done. The decision about whose 2 a.m. it touches is not.

Everything below follows from holding those two apart.


Humans in the loop — plural

These playbooks have a human in the loop: the operator, plus — at best — a separate review pass by an independent agent. That's a control point, and a good one. It is not the same thing as humans in the loop — the system of service owners, on-call rotations, escalation paths, security reviewers, and risk-acceptors that an operational change actually moves through.

A change to a shared surface is a commitment: someone will be woken by that alert. A commitment is something only the committing party can make. So the honest division of labor is:

The agent can prepare the change, map the blast radius, draft the rollback, check it against the runbook, and route it to the right approver. It cannot manufacture consent by completing those steps.

That sentence is the line these notes draw. Everything else is detail.


What acceleration does to coordination

The bottleneck relocates. When technical work took weeks, coordination with other owners happened in parallel and was nearly invisible. Collapse generation to minutes and the coordination doesn't disappear — it moves entirely onto the human layer and becomes the rate-limiting step. The wall you hit is not a tool failure. It's the tool succeeding all the way to the edge of what one person is entitled to decide, and the nature of the remaining work changing from technical to organizational.

Legitimacy lags capability. The tool can produce a cross-owner artifact faster than the organization can grant it standing. A finished, correct artifact that no one agreed to cuts both ways. As a concrete draft, it can unblock a conversation stuck in abstraction — a forcing function. As an unrequested change to someone's surface, it can read as an imposition and harden the boundary you needed to cross. Same artifact, opposite outcomes, decided almost entirely by whether the owners were brought in before generation or shown the result after.

The friction we're removing was partly load-bearing. The claim is not that slowness is virtuous — it's that some slow steps were quietly carrying coordination work. Plenty of organizational friction is pure transaction cost and deserves to die. But a meaningful share of it was doing real work:

  • a deliberation tax — a change that cost something forced the question of whether it was worth making; cheap changes are how an alerting surface fills with noise nobody trusts;
  • a broadcast mechanism — a slow approval left a wake of people who knew the change was coming, which is situational awareness the org loses when changes ship correctly and silently;
  • a consent-accrual process — buy-in accumulated through the asking and the waiting; the slowness was the legitimacy being manufactured.

Acceleration inverts the economics. Friction that was a small, proportionate cost on a long process now looks enormous by comparison — which is exactly when it gets cut — even though the coordination it performs scales up with throughput, not down. It stops being a serial cost paid once and becomes a rate problem: a queue that drained fine on slow input, now overflowing. You don't fix an overflowing queue by deleting it.

These playbooks already concede the principle. The mid-build verification checkpoint is deliberately reintroduced friction. So is the separate, independent review pass — you could let the builder approve its own output and go faster, and these playbooks explicitly tell you not to. So the idea that some slowness is load-bearing is already endorsed. The only question these notes add: by what principle do we keep the mid-build check and the independent review, but discard the consent step, when all three are slowness that catches a class of error the speed would otherwise hide?


Four concrete additions

Kept in the same executable-ritual style, because philosophy bolted onto an engineering doc gets skipped.

1. Widen "recon before building" to include ownership

The reconnaissance pass these playbooks already mandate — read the existing system before changing it — is the right hook. Extend its scope. Before generating, the recon should also answer:

  • Which operational surfaces does this change touch, and who owns each?
  • Who carries the pager for the affected services?
  • What would each owner need in order to accept this — an SLO, a threshold, a routing rule, a runbook they alone can change?
  • Where is the gate, and which kind is it: information (they hold data I need), consent (they must accept the artifact), or permission (I cannot deploy into their space)?

These three look identical from a distance — all of them read as "waiting on another team" — but they are different problems with different fixes. Name them, because an agent that collapses them into a single "blocked" status hides the one you're actually in:

  • Information — they know something I need. Fix: ask; this is the cheapest gate.
  • Consent — they must accept the operational burden. Fix: bring them in before the artifact exists, not after.
  • Permission — I am not authorized to act in that space. Fix: route to who is; do not work around it.

Naming the gate type early is what turns the relocated bottleneck into a planned step instead of a wall at the end.

2. Have the agent surface discrepancies, not smooth them

Feed an agent enough wiki, ticketing, and chat history and it will resolve contradictions by averaging them — which, for operational work, is the dangerous failure. Runbook drift and lagging ownership records are normal entropy, not blame, and the blameless, technical question — "where do our systems of record disagree with how work actually flows?" — is one a team can ask without it landing as an accusation.

Instruct standing agents and planners to reason from systems of record first, observed runtime state second, and chat/email/meeting transcripts last — and when those conflict, to surface the conflict and stop, not synthesize a confident recommendation on top of it.

What a useful agent produces:

"The runbook specifies Terraform Cloud rollback; the last incident used a manual ECS rollback. The catalog lists Team A as owner; the last three pages went to Team B. This is an ownership/runbook discrepancy, not something I should resolve by inference. Routing to a human."

What a quietly dangerous agent produces:

"Based on all available context, Team B should handle the rollback."

The second answer may even be right in practice — but it has converted organizational drift into automated policy without anyone deciding to.

3. An approval map keyed to blast radius

The hard "never do X" guardrails these playbooks put on autonomous agents, plus "when uncertain, tag a human and stop," are the right start. Make the human concrete: which class of change needs which owner. Keep it matched to blast radius — the minimum gate the risk warrants, never a universal approval tax.

Change class Blast radius Required human
Monitor/dashboard text or query cleanup — no severity, threshold, or routing change Low Self — ship
Any change to paging conditions, even for your own team (threshold, severity, wake-up logic) Medium On-call owner of the affected service
New/changed alert routing to another team Medium On-call owner of the alerted service
IAM scope expansion High Security review
Production change to a shared service High Service owner + platform review
Runbook procedure change Medium–High Someone who has executed the procedure
Standing-agent behavior change Varies Agent owner; audit-logged

The point worth making: this does not add a gate. It tells the agent which gate already exists, so it participates in the social contract instead of routing around it.

4. Extend the lessons log to the social layer

The lessons log these playbooks keep captures technical scars. The organizational ones compound just as hard and currently live only in people's heads:

- Ownership: Catalog owner != actual responder for service X.
  Cross-check against last-90-days pages before routing.
- Consent: Shipped a monitor change to Team Y's surface without
  bringing them in. Correct, but received as an imposition.
  -> Bring owners in at recon, not at review.
- Drift: A runbook reviewed in staging is not evidence of
  production consent. Staging-passed != owner-accepted.
- Broadcast: A fast, silent change cost situational awareness.
  Added an owner-notification step to the pipeline -- not because
  approval was needed, but because awareness was.

Two honest caveats

So this doesn't become its own kind of overreach:

Don't reintroduce the drag. Every gate above is also a chance to rebuild the bureaucracy the agentic approach was meant to remove. If these become a universal approval tax, they will be ignored, and the practice will be worse for it. Preserve the speed for low-blast-radius work; reserve the human gates for shared surfaces; revisit any gate that isn't catching anything.

Not all friction is sacred. Some of what looks load-bearing is turf, habit, or risk-aversion wearing the costume of prudence — and "it served a purpose" is exactly what people say to protect a process that served their purpose. The discipline isn't to preserve friction; it's to interrogate each gate for what it actually does and remove the ones doing nothing. The genuine cost of machine speed is subtler than any single gate: we used to learn which friction mattered from slow feedback — the failure arrived in time to put the gate back. At generation speed the lesson arrives after the hundredth change has shipped. So which gates matter now has to be instrumented deliberately; we can no longer rely on the old pace to teach us.


A phased way to adopt this

  • Weeks 1–2: Add the ownership questions to your recon habit. Start a social-layer lessons log alongside the technical one.
  • Week 3: When a planner / executor / reviewer workflow touches a shared surface, make "identify owners and the consent gate" the first planning output, before decomposition.
  • Week 4: Before deploying a standing agent, write its approval map and its "surface discrepancies, don't smooth them" rule into the system prompt — at design time, not after.

Quick reference

  • Two kinds of done: technical correctness and organizational consent. An AI reviewer issues the first, never the second.
  • Humans in the loop, plural: the agent prepares, maps, drafts, routes. Consent is a human act.
  • Recon includes owners: whose surface, whose pager, which gate.
  • The gate triad: distinguish Information (they know something I need), Consent (they must accept the burden), Permission (I'm not authorized there). Never collapse all three into "blocked."
  • Trust order: systems of record > runtime state > chatter. On conflict, surface and stop.
  • Approval keyed to blast radius: the minimum gate the risk warrants. Never a universal tax.
  • The lessons log covers ownership and consent, not just code.

This note is intentionally scoped to the SRE/DevOps lane — it speaks only for how these playbooks land on work that crosses ownership surfaces, and makes no claims about how other teams should run work inside their own. That scoping is not modesty; it's the same principle the note argues for, applied to itself.

Subscribe to The Grey Ledger Society

Don’t miss out on the latest issues. Sign up now to get access to the library of members-only issues.
jamie@example.com
Subscribe