BXUP Track progress & test yourself — free
Business & Systems Analysis · Hands-on lab · ~5 min read
BUSINESS & SYSTEMS ANALYSIS · HANDS-ON LAB

Lab 15 · Capstone 2 — Agent Process Redesign Blueprint

Redesign the claims process around an agent — not by bolting AI onto the old map, but with an autonomy tier on every step, exception queues and escalation SLAs as first-class branches, a change-impact summary, and a measurement plan with baseline and kill criteria. It must survive an SME walkthrough and a finance review.

Everything in the track converges here. Divya's validated as-is map (Lab 04), the opportunity scan with its refusals (Lab 10), the honest business case (Lab 11), the data-readiness prerequisites (Lab 12), the eval harness (Lab 13), and the AI-requirements patterns (Lab 14) — Meridian General Insurance's steering committee has approved designing the agent-era claims intake process. The deliverable is a blueprint: the process as it should run when an agent does real work inside it, with human authority engineered in rather than promised.

You will need

  • A chat AIfree ChatGPT, Claude, or Gemini.
  • A diagram toolMermaid (mermaid.live or any markdown preview), draw.io, or Miro.
  • Timeabout 90 minutes.
  • Carried-in artifactsthe corrected Lab 04 map, Lab 10's treatments, Lab 11's baseline. Condensed versions below so this lab stands alone.

The design inputs

AS-IS (validated, condensed) - 9,000 motor claims/month
S1 FNOL capture -> S2 policy validation -> S3 registration ->
S4 doc completeness check -> [34% incomplete -> S5 chase queue,
6.2-day avg] / [4% fraud signals -> S6 SIU triage] ->
S7 desk review (15% kickback loop) -> S8 surveyor assignment ->
S9 estimate review -> S10 payment approval (>1L human) -> S11 pay
-> S12 status comms (11,000 "where is my claim" contacts/mo)

APPROVED TREATMENTS (Lab 10) & CONSTRAINTS
T1 S3 eliminated via FNOL-ClaimsCore integration
T2 S4/S5 redesigned: dynamic doc checklist at FNOL; AI extraction
   and completeness checking at point of capture
T3 S10 stays a human control above threshold (finance mandate)
T4 SIU referral stays human-decided; AI may flag, never disposition
T5 Customer-facing AI-drafted comms: allowed with Art.50 disclosure,
   human review until eval evidence supports relaxing (Lab 14)

BASELINE (Lab 11, measured) - for the measurement plan
B1 S4 median 8.0 min/claim  B2 incomplete-on-arrival 34%
B3 chase wait 6.2 days      B4 downstream extraction errors 3.1%
B5 status contacts 11,000/mo  B6 intake staff cost INR 480/hr

OVERSIGHT STANDARD (steering-committee minute, verbatim)
O1 "Every agent-performed step carries a declared autonomy tier:
    SUGGEST (agent proposes, human acts), APPROVE-THEN-ACT (agent
    prepares, human approves, agent executes), ACT-AND-LOG (agent
    executes, logged, sampled audit). Tier assignments require a
    written rationale and a demotion trigger."

Steps

  1. Assign an autonomy tier to every to-be step before drawing anything. Build the tier table: Step | Agent role | Tier (SUGGEST / APPROVE-THEN-ACT / ACT-AND-LOG / NONE-human) | Rationale | Demotion trigger. Work from the treatments: extraction and completeness checks can start ACT-AND-LOG (low harm, reversible, eval-covered); customer-facing drafts start SUGGEST per T5; payment release above threshold is APPROVE-THEN-ACT at most, honoring T3; SIU disposition is NONE per T4. Every ACT-AND-LOG rationale must name why errors are reversible and how the sampled audit catches them. Demotion triggers are pre-written: "IF weekly eval accuracy < X or sampled-audit error rate > Y, step drops one tier automatically."

  2. Draw the to-be map with tiers on the diagram. Mermaid or draw.io: one lane or color per tier, tier stamped in each node label (e.g., Doc extraction [ACT-AND-LOG]). The map must show the redesign, not the old map annotated: S3 gone (T1), completeness checking moved into FNOL (T2), the chase queue shrunk to the residual incomplete cases. Prompt the AI for a first Mermaid draft from your tier table — then correct it with Lab 04 discipline; regeneration reintroduces deleted steps, and this time you know to look.

  3. Make exception queues first-class branches, not footnotes. Draw each as a named queue with an owner and an entry condition on the arrow: low-confidence extraction queue (intake, threshold from the eval harness), suspected-injection/anomalous-input queue (security + intake — the Lab 14 lesson applied to claims documents), SIU referral queue (SIU, T4), agent-outage fallback (all steps revert to manual routing — the process must be drawable with the agent switched off). If a branch only exists in prose, it does not exist; it must be a drawn path with somewhere to go.

  4. Attach escalation SLAs to every queue. Per queue: maximum dwell time, escalation target, and the breach action — e.g., low-confidence queue: 4 working hours to human verdict, breach pages the intake lead; SIU triage: 48h per the Lab 04 walkthrough; outage fallback: manual capacity plan invoked at 2 hours. An exception queue without an SLA is where the old 6.2-day wait will quietly reincarnate — the SLA is the requirement that stops the new process from growing the old process's tumor.

  5. Write the change-impact summary — whose work changes how. A table per affected role: Role | Tasks removed | Tasks added | New skills needed | Trust barrier | Verification duty. Intake staff: less typing and checking, more exception adjudication and audit sampling — a harder job, not a smaller one; say so. Team leads: new kill-switch authority and sampling duties. Assessors: receive structured extractions — their trust barrier is "why should I believe the agent's field values," answered by visible confidence scores and the audit trail. SIU: unchanged authority, new AI-flag input to triage. This page is what makes the blueprint adoptable instead of merely correct.

  6. Build the measurement plan on the captured baseline. For each redesign claim, a metric pair: baseline (B-line) → target with date. Minimum set: incomplete-on-arrival rate (B2 → target), residual chase dwell (B3 →), extraction error rate (B4 →, measured by the Lab 13 harness weekly), status contacts (B5 →, expected to fall as delays fall), S4-equivalent handling time (B1 →), and cost per claim (derived, B6). State the measurement mechanism and cadence for each — a target without a mechanism is a hope.

  7. Write the kill criteria and the demotion ladder. Blueprint-level kill criteria (Lab 11 discipline, now for the rollout): e.g., extraction accuracy below the eval floor for two consecutive weeks → all extraction steps demote to SUGGEST; any agent-caused wrongful payment → immediate APPROVE-THEN-ACT freeze pending review; customer-complaint rate about AI comms above threshold → drafts return to full human review. Plus the standing kill-switch: who can pull it, how fast, and what the process looks like the minute after (your step-3 outage path answers this — cross-reference it).

  8. Run the two survival reviews. First, the SME walkthrough (Lab 04 script style) against your to-be map: trace a clean claim, an incomplete claim, a fraud-flagged claim, an injection-suspect document, and an agent-outage hour — every token must have a path, an owner, and an SLA. Second, the finance review: give the AI your measurement plan and one-pager with "You are a skeptical CFO analyst: which target lacks a baseline, which benefit lacks a mechanism, which cost is missing?" — adjudicate and patch. Then assemble the final deliverable: the blueprint (map + tier table + queues/SLAs) and the adoption-and-measurement one-pager (change impact + metrics + kill criteria).

Remember:

Autonomy is not a property the agent has — it is a permission the process grants, per step, in writing, with a pre-agreed way to take it back.

Verify your work

A complete lab has all of the following:

  • A tier table covering every to-be step, each with rationale and an automatic demotion trigger.
  • A to-be map showing the redesign (S3 gone, checks at capture) with tiers stamped on nodes.
  • Four named exception queues drawn as branches, each with owner, entry condition, and escalation SLA.
  • A change-impact table for intake, team leads, assessors, and SIU, with trust barriers and verification duties.
  • A measurement plan pairing every target with a B-line baseline and a mechanism, plus kill criteria and the demotion ladder.
  • Evidence of both survival reviews: walkthrough traces for five token types, and the finance red-team adjudicated.
▸Answer key — minimum viable oversight points and review barsoptional deep dive — click to expand

The oversight points a reviewer must find present. A blueprint fails this capstone if any of the following is missing, regardless of how elegant the diagram is:

  • Payment release above threshold at APPROVE-THEN-ACT or stricter (T3): a human approves before money moves; the agent may prepare and execute after approval, never decide. ACT-AND-LOG on payments is an automatic fail — it removes the control Lab 10 taught you to protect.
  • SIU/fraud disposition at NONE (T4): the agent may flag with reasons; a human decides referral and outcome. Any tier that lets the agent close or clear a fraud signal fails.
  • Customer-facing communications at SUGGEST initially (T5), with Art. 50 disclosure on AI-drafted messages and a written promotion condition (eval evidence + complaint-rate floor) before APPROVE-THEN-ACT is even proposed.
  • A timed kill-switch with a drawn fallbacknamed role, minutes-not-days, and the outage path from step 3 showing the process running agent-less. A kill-switch whose aftermath is undrawn is a button connected to nothing.
  • Sampled audit on every ACT-AND-LOG step, including high-confidence outputsthe Lab 13 X23 lesson institutionalized: auditing only what the agent doubts misses what it is confidently wrong about.
  • Automatic demotion triggers on every tier assignmentthresholds pre-written so demotion is mechanical, not a meeting.

Expected tier assignments (calibration). Doc extraction & completeness check: ACT-AND-LOG (reversible, eval-covered, sampled). Dynamic checklist generation at FNOL: ACT-AND-LOG (rules+AI, low harm). Acknowledgment/status drafts: SUGGEST → promotion path. Surveyor assignment: rules, not agent — leave it (a candidate who agent-ifies a working rules step missed Lab 10's refusal lesson). Desk-review preparation: SUGGEST or APPROVE-THEN-ACT (assessor stays the decider). Payment: APPROVE-THEN-ACT ceiling. SIU: NONE. Reasonable variation is acceptable with rationale and demotion trigger; unreasoned optimism is not.

The walkthrough bar (step 8, first review). The five traces must show: clean claim never touches a human between capture and desk review except by sampling; incomplete claim resolved at capture or entering the residual chase queue with its SLA; fraud-flag reaching SIU without dwelling in any shared queue (the Lab 04 audit finding, still binding); injection-suspect document quarantined with security notified; outage hour showing manual routing live within the SLA — with no token stranded anywhere on the map.

The finance bar (step 8, second review). Every target paired to a B-line; agent run-cost (tokens, evals, monitoring — the Lab 11 stack) present in the one-pager's cost line; time-to-value stated; kill criteria measurable and dated. The classic finance-review kill: a status-contact reduction target (B5) with no mechanism linking it to the dwell-time improvements — if challenged, show the causal chain or soften the claim.

Grading yourself. All oversight points present, both reviews survived: you have produced the artifact this track exists to teach — a process that uses an agent without surrendering to one. Missing demotion triggers: tiers without take-backs are one bad week from becoming permanent; add them. Map is the as-is with AI stickers: reread T1/T2 — the redesign is the deliverable; augmentation of the old shape is the anti-pattern wearing a capstone costume.

Key Takeaway:

An agent-era process is designed in permissions, not features — a tier on every step, a queue for every exception, an SLA on every queue, a human who can see, correct, and stop, and a measurement plan that can kill the whole thing. Draw that, and both the SME and the CFO will sign.

This is the free reading view. Open BXUP to track your progress, run the hands-on labs, and prove it with original, exam-pattern assessments.
© Anvi Innovate · BXUP — Be Exponentially Upskilled · BXUP is an independent learning platform, not affiliated with or endorsed by AWS, Microsoft, Google, NVIDIA, IBM, Salesforce, Databricks, Oracle or Anthropic. All trademarks belong to their respective owners. · bxup.in