BXUP Track progress & test yourself — free
Business & Systems Analysis · Hands-on lab · ~5 min read
BUSINESS & SYSTEMS ANALYSIS · HANDS-ON LAB

Lab 11 · The Honest AI Business Case

A draft business case for the claims document-AI pilot is already circulating — built on an unmeasured baseline, with three cost lines missing. Critique it first, then rebuild it honestly: measured baseline, benefit ranges with confidence levels, the full cost stack including tokens and evals, time-to-value, and kill criteria agreed before a rupee is spent.

The COO liked Divya's opportunity scan from Lab 10 and asked for a business case for its top item: AI-assisted document extraction and completeness checking at claims intake (step S4). A strategy consultant got there first — a glossy two-pager is already in the COO's inbox claiming 4.2x ROI. Divya's job is not to compete on gloss. It is to do the thing that makes AI business cases survivable: anchor every benefit to a measured baseline, price every cost including the unglamorous ones, and pre-agree what failure looks like.

You will need

  • A chat AIfree ChatGPT, Claude, or Gemini.
  • A spreadsheet for the benefits model and cost stack.
  • Timeabout 75 minutes.
  • No real dataall figures are synthetic; treat currency as INR.

The measured operational baseline

From the ops team's time study and the Lab 10 operating data. This is what "measured" means — sourced, dated, reproducible.

BASELINE EXTRACT — Claims intake document handling (June, time study n=412 claims)
M1 Volume: 9,000 motor claims/month
M2 S4 completeness check: 8.0 min/claim median (measured), all claims
M3 Incomplete on arrival: 34% of claims (3,060/month)
M4 Doc-chase cost per incomplete claim: 22 min staff time across
   3 attempts (measured on the chase subset)
M5 Chase-queue delay: 6.2 days average (per claim in M3 subset)
M6 Extraction errors found downstream: 3.1% of claims, 18 min rework each
M7 Fully loaded intake staff cost: INR 480/hour
M8 Current software cost of S4: none (manual step)
M9 NOT MEASURED: what share of total intake time is "document work";
   customer NPS impact of chase delays; assessor time saved downstream

The consultant's draft case

Critique target. Read it the way a CFO's analyst will read yours.

DRAFT BUSINESS CASE v1.0 — "Intelligent Document Processing for Claims"
D1 "Intake agents spend 60% of their time on document handling.
   IDP will cut this by half, freeing 27 FTEs."
D2 Benefits: INR 3.9 Cr/year staff efficiency + "significant NPS
   uplift" + "fraud leakage reduction of up to 2%"
D3 Costs: IDP platform licence INR 36L/year + one-time integration
   INR 25L. Total year-1 cost: INR 61L.
D4 ROI: 4.2x in year one. Payback: 5 months.
D5 Recommendation: enterprise-wide rollout across motor, health,
   and property lines in Q1.

Steps

  1. Audit the draft against the baseline extract — line by line. Build a critique table: Draft claim | Baseline support? | Verdict (SUPPORTED / UNMEASURED / OMISSION / OVERREACH). Check D1's "60%" against M9 before anything else. Then list every cost category you would expect an AI system to incur across year one and mark which ones D3 contains. Expect one unmeasured foundation, at least three cost omissions, and one scope overreach.

  2. Rebuild the benefit model from measured lines only. Three benefit streams the baseline can support: S4 handling time (M1 × M2 — model what an assist can realistically shave, not "half" by assertion), chase reduction (M3 × M4, driven by catching incompleteness at capture), and downstream rework (M6). Compute each in staff-hours/month, convert via M7. Show every formula in the sheet — auditable means a reviewer can trace any rupee to a cell to a baseline line.

  3. Express benefits as ranges with confidence levels. For each stream, three cases with stated logic: conservative (e.g., assist saves 25% of S4 time; pilot-evidence confidence HIGH once measured), expected (40%), stretch (60% — confidence LOW, requires the model to handle the hard tail). Anything from M9 — NPS, assessor time — enters as unquantified qualitative benefit, listed but excluded from ROI. Ask the AI to sanity-check your ranges: "What assumptions must hold for a document-extraction assist to save 40% of an 8-minute review task? What typically prevents it?"

  4. Build the full cost stack. Columns: one-time / year-1 recurring / ongoing. Lines the honest stack must include: platform or API licences; inference/token costs (compute from volume: 9,000 claims × pages × tokens per page at current provider list prices — have the AI estimate tokens per claim document set, then price it at the published per-million-token rates of two providers and take the dearer for planning); integration build; evaluation and monitoring (golden-set construction, monthly eval runs, drift review — price the analyst and reviewer hours via M7); change management (training 40 intake staff, floor support in weeks 1–6, SOP rewrites); model/prompt maintenance. Every line priced or marked with a priced assumption.

  5. Compute honest ROI and time-to-value. Expected-case benefits over the full cost stack, year one and year two shown separately (year two drops one-time costs but keeps evals, licences, tokens, maintenance). Time-to-value: months until cumulative benefit exceeds cumulative cost, on the expected case — with the pilot ramp (limited volume in months 1–3) modelled, not assumed away. Compare your number to D4's "5 months" and note what drives the difference.

  6. Write the kill criteria — before anyone falls in love. Three to five pre-agreed conditions that end the pilot, each measurable and dated: e.g., extraction accuracy below X% on the eval set at week 8; S4 median time reduction below Y% at 90 days; chase-queue entry rate not moving by Z; token cost per claim exceeding budget by 50%. Include who reviews and the decision they are empowered to make. A case without kill criteria is a commitment, not an experiment.

  7. Scope the recommendation to what the evidence supports. D5 wants enterprise-wide rollout. Your baseline covers motor intake only (M1–M8). Write the recommendation as: pilot on motor intake, success gates from step 6, expansion decision only after gates pass — and name what would have to be measured before health/property lines could be cased.

  8. Assemble the two-pager. Page 1: problem (baseline numbers), proposal, expected-case ROI with the range table, time-to-value, kill criteria. Page 2: full cost stack, benefits model summary with formulas, assumptions register, qualitative benefits, scope limits. Then the closing paragraph: three sentences on why this case can be trusted — every number traces to M-lines or a priced assumption, failure is defined, scope matches evidence.

Warning

The most dangerous line in an AI business case is a benefit computed from a baseline nobody measured — the ROI can be arithmetically perfect and still be fiction all the way down.

Verify your work

A complete lab has all of the following:

  • A critique table cataloguing the draft's unmeasured baseline, its cost omissions (named), and its scope overreach.
  • A benefits model where every quantified stream traces to M-lines with formulas visible, and M9 items are excluded from ROI.
  • A cost stack including inference/tokens (with the volume arithmetic shown), evaluation/monitoring, and change management — each priced.
  • Ranges with confidence levels; year-1 and year-2 ROI computed separately; time-to-value with pilot ramp modelled.
  • Three to five dated, measurable kill criteria with a named decision-maker.
  • A recommendation scoped to motor intake with explicit expansion gates.
▸Answer key — the draft's defects and the expected rebuildoptional deep dive — click to expand

The unmeasured baseline (D1). "Agents spend 60% of their time on document handling" appears nowhere in the baseline — M9 explicitly lists the share of intake time on document work as NOT MEASURED. Everything downstream of D1 (27 FTEs, INR 3.9 Cr, the 4.2x ROI) inherits the fiction. The measured truth is narrower and stronger: 8 min/claim on S4 across 9,000 claims (M1×M2 = 1,200 staff-hours/month), plus the chase subset (3,060 × 22 min ≈ 1,122 hours), plus rework (279 claims × 18 min ≈ 84 hours) — about 2,406 measured staff-hours/month ≈ INR 11.5L/month ≈ INR 1.39 Cr/year of addressable cost at M7 rates, of which an assist captures only a fraction. A rebuilt expected case lands well below the draft's 3.9 Cr benefit line — that gap is the lab.

The three omitted cost lines (D3). (1) Inference/token costs — 9,000 claims/month with multi-page document sets is a real recurring bill; the draft prices the platform licence but not the usage. Expected treatment: tokens-per-claim estimate × volume × provider list price, dearer-of-two for planning, shown as its own recurring line. (2) Evaluation and monitoring — golden-set build (one-time) plus monthly eval runs and drift reviews (recurring analyst/reviewer hours at M7). A document-AI system without a priced eval line is a system nobody plans to check. (3) Change management — training 40 staff, hyper-care floor support, SOP rewrites; regularly the difference between a working pilot and shelfware, and always the first line consultants drop to protect the ROI headline. Accept "ongoing prompt/model maintenance" as an alternative third catch if evals were counted under it — but all three cost categories must appear somewhere, priced.

The scope overreach (D5). Enterprise rollout across three lines of business from a baseline measured on one. Expected fix: motor-only pilot with expansion gated on pilot evidence plus new baselines for health/property.

Also acceptable to flag. D2's "up to 2% fraud leakage reduction" — an M9-class claim with no baseline and an "up to" weasel; D4's 5-month payback — unreproducible once real costs enter; "significant NPS uplift" — unquantified, belongs in qualitative benefits.

Expected shape of the honest numbers. Expected case (40% S4 reduction, 50% chase reduction via capture-time checks, half of rework): roughly 480 + 561 + 42 ≈ 1,080 hours/month ≈ INR 62L/year benefit, against a year-1 cost stack realistically in the INR 55–75L range once all lines are priced — i.e., year one near breakeven, ROI arriving in year two, time-to-value 12–18 months with ramp. Exact figures vary with your assumptions; what is graded is that they trace, the ranges carry confidence labels, and the year-1 number is nowhere near 4.2x.

Grading yourself. All defects caught, rebuilt case traces end-to-end, kill criteria dated and owned: this case survives a finance review — the bar. Caught the cost omissions but kept a benefit resting on D1's 60%: the baseline audit is the first check for a reason; unmeasured foundations poison measured arithmetic. ROI still above 3x in year one: hunt the optimism — it is usually hiding in the S4-reduction percentage or an unpriced cost line.

Key Takeaway:

An honest AI business case is mostly subtraction — unmeasured baselines out of the benefits, missing lines into the costs, scope shrunk to the evidence — plus one addition no draft ever includes on its own: kill criteria agreed while everyone can still afford to be wrong.

This is the free reading view. Open BXUP to track your progress, run the hands-on labs, and prove it with original, exam-pattern assessments.
© Anvi Innovate · BXUP — Be Exponentially Upskilled · BXUP is an independent learning platform, not affiliated with or endorsed by AWS, Microsoft, Google, NVIDIA, IBM, Salesforce, Databricks, Oracle or Anthropic. All trademarks belong to their respective owners. · bxup.in