BXUP Track progress & test yourself — free
Database & ERP · Module · ~9 min read
DATABASE & ERP · MODULE

Governing AI in Systems of Record

The flagship question of this whole track: what may an AI agent do unsupervised in a system of record — and who signed off on that answer? This module builds the control set no vendor teaches: approval gates, audit trails you actually review, agent permissions that respect SoD, and an org policy an auditor accepts.

Everything in this track converges here. The verification discipline from tuning, the gate chain from change management, the guardrail stacks from MCP and NL-SQL, the eval mindset from platform agents — governance is those habits promoted to organizational controls, applied where the stakes are highest: agents acting on financial and HR data inside the systems the company's books and audits stand on. The vendors ship the capabilities and the trust marketing; the control design — thresholds, reviews, permissions, policy — is left to the org. That gap is this module, and it is the most defensible expertise in the track, because it compounds with regulation instead of being commoditized by the next release.

The scenario — in policy, out of judgment

Nandini leads the business-platforms team at a Bengaluru BFSI-adjacent services company running D365 Finance. The 2026 wave brings payment agents of the Payflow pattern: autonomous execution "within configured parameters." A pilot goes live for vendor payment scheduling.

  1. GO-LIVE + 12 DAYS

    The agent has scheduled 300+ payments flawlessly. Finance ops is warming to it. The configured gate: auto-execute below ₹5,00,000, human queue above.

  2. DAY 13 · 16:40

    A vendor submits four invoices — ₹4.2L, ₹4.6L, ₹3.9L, ₹4.8L — against one PO, same week. Each is under threshold. The agent schedules all four. No rule is violated: ₹17.5L flows to one vendor with zero human eyes on it.

  3. DAY 15

    An AP analyst notices during a routine run. The invoices turn out legitimate — a split billing arrangement nobody documented. No loss. Everyone exhales.

  4. THE AUDIT QUESTION

    Internal audit asks the question that matters: if they had been fraudulent, which control would have caught them, and when? The honest answer: none before payment. The gate tested per-transaction amounts; the risk was cumulative exposure. Split invoicing is the oldest AP fraud pattern there is — and the gate design had encoded none of that institutional knowledge.

  5. THE REDESIGN

    Velocity limits per vendor per window, cumulative-exposure thresholds, same-PO aggregation checks, and an anomaly rule: any vendor's first week above historical baseline goes to the queue. Plus the meta-fix: gate designs now get red-teamed against known fraud patterns before activation, and reviewed quarterly.

The lesson generalizes: an approval gate is a fraud-and-error model, not a number. "Within configured parameters" is exactly as safe as the thinking that configured the parameters.

Approval-gate design — the flagship control

The design method, applicable on any platform (Agentforce action config, Copilot Studio approval steps, Fusion Agent Studio validation flows, or custom gates):

  1. Inventory the actions. Everything the agent can do, from its action catalog — not what the use case says it will do. Each action classified: read, draft, state-changing, financially consequential.
  2. Decide per action, not per agent. Reads auto-execute. Drafts auto-produce for human posting. State changes queue by default and earn auto-execution thresholds. Financially consequential actions get the full model: amount limits, velocity limits, cumulative-exposure windows, counterparty checks.
  3. Red-team the thresholds. For every auto-execute rule, ask: how would a fraudster, a buggy upstream, or a confused model stay inside it? Split transactions, repeated small actions, and boundary values are the standard probes — Nandini's case in checklist form.
  4. Build the off-ramps. A kill switch that stops the agent without stopping the business process (manual fallback documented), and a rollback path per action class: reversible actions get inverse procedures, irreversible ones get stricter gates. The Module 2 data-fix package, at platform scale.
  5. Assign ownership. A named business owner per gate, review cadence on the calendar, and threshold changes routed through change control — a gate threshold is configuration of a financial control, and the change board treats it as one.
Pro Tip

Steal from the fraud playbook, not just the approval playbook. AP teams have decades of split-invoice, ghost-vendor and velocity heuristics; encoding that institutional knowledge into agent gate design is the highest-value meeting a platform person can convene — and almost nobody convenes it.

Audit trails you actually review

Every platform now emits AI audit surfaces: the Einstein Trust Layer's prompt-to-response chain (user, timestamp, masked prompt, grounding sources, response — with its Data Cloud dependency), agent session logs across Copilot Studio and Agentforce, Fusion agent validation logs. The trap is treating their existence as the control. An unreviewed log is evidence of negligence, not oversight — it proves the org could have known.

  • Enablement is step zero, and it has prerequisitesTrust Layer audit data needs its Data Cloud plumbing; agent session retention has defaults you must check against your record-retention policy. Verify capture before you rely on it.
  • The review procedure is the actual controla written cadence: weekly sampled session review in early rollout, exception-driven review (all overridden gates, all near-threshold actions, all kill-switch events) at steady state. Named reviewer, findings logged, escalation path defined.
  • Reviews close the loop to designNandini's split-invoice pattern should have been found by trail review in week one, tagged as a gate-design gap, and fed back. Review without a feedback path is theater with a rota.
  • Auditors get a rehearsed answer"show me every autonomous action above X, who reviewed the exceptions, and the sign-off for the current thresholds" should be a query and a folder, not a scramble. Build the evidence pack the way Module 3 built them — every claim linked to an artifact.

Agents are users — permissions and SoD

THE SHORTCUT THAT FAILS

The over-privileged agent

The agent runs under an integration user with admin-adjacent rights "so it just works." Every prompt injection, model error and scope bug now executes with those rights; FLS/RLS mean nothing because the runtime identity bypasses them. The audit finding writes itself.

THE DISCIPLINE THAT HOLDS

Least-privilege, SoD-checked

A dedicated agent identity per agent, a permission profile built from its action inventory and nothing more, platform entitlements (FLS/RLS/authorization objects) enforced in the agent's context, and an SoD check run over the profile before activation — the agent held to the same segregation rules as a human hire.

Segregation of duties is where AI helps govern AI: role matrices are large, agent action catalogs are new, and an LLM-assisted scan — "given these action grants and this SoD rule set, list conflicts an auditor would flag" — surfaces combinations like create vendor + schedule payment in one agent, the classic conflict that enables ghost-vendor fraud. The scan output is a draft for the compliance owner, evidence-per-claim style; the human rules on each finding. And permission review recurs: every new action added to an agent re-triggers the SoD check, because agents accrete capabilities exactly the way long-tenured employees accrete access.

Warning

An agent with an SoD conflict is worse than an employee with one — it executes at machine speed, around the clock, with no colleague noticing something odd at the next desk. The pre-activation SoD scan and per-action permission profile are not compliance decoration; they are the difference between an incident and a headline.

Grounding, hallucination controls, and the honest scoreboard

Wrong answers are a governed risk alongside wrong actions. The controls, assembled from earlier modules and formalized here:

  • Record-grounded retrievalanswers cite live system data rather than model memory: Trust Layer dynamic grounding, Joule business-data grounding, Copilot connectors, configured and verified rather than assumed.
  • An answer-with-citation standardanything feeding a decision carries drill-down references; per the month-end rule, one untraceable figure ends the program.
  • Wrong-answer probe sets before rolloutquestions with known answers, including known traps (the Z-table class from Module 6), scored for accuracy and for refusal behavior on the unanswerable.
  • Re-runs each platform wavethe probe set is the regression suite for truthfulness; model and grounding changes arrive whether or not you re-tested.

ROI honesty is a governance control too, because inflated benefit claims corrupt the risk calculus that gates expansion. Against a backdrop where most enterprise AI pilots report no measurable return, the credible program defines baseline metrics before launch (deflection, cycle time, queue length), instruments agent analytics (Agent Studio ships ROI tooling; the others expose usage data), and reports actuals against baseline — including zeros. A governance function that certifies honest zeros earns the credibility that lets it approve the next pilot.

The org AI policy — one page that answers the flagship question

The policy is where the control set becomes durable. The auditable minimum:

Policy elementWhat it specifiesMaps to
Feature-data matrixWhich AI features are approved per data classification (public → confidential → personal → financial)DPDP purpose limitation; client MSAs
Sub-processor registerWhich LLM providers see which data, retention terms, zero-retention contracts verified in writingDPDP §8 obligations; GDPR Art. 28
Agent change controlGate thresholds, instructions, action grants and grounding changes go through the change boardSOX-style ITGC change management
Review proceduresAudit-trail cadence, SoD re-scan triggers, probe-set re-runs per release waveNIST AI RMF Measure/Manage; ISO 42001 operation clauses
AI incident categoryMisbehavior defined (out-of-policy action, leak, material wrong answer), reporting path, kill-switch authorityIncident-management alignment; RBI/SEBI reporting where applicable
Accountability mapNamed owners: per-gate business owner, policy owner, review ownersISO 42001 leadership clauses; the auditor's first question

For India services, the policy work is client-facing casework. ERP master data is personal data under DPDP — employees, customers, vendors — so agent features that route data to LLM sub-processors trigger DPDP analysis plus the client's MSA, and BFSI clients layer RBI/SEBI localization on top. The consultant's duty is unglamorous and differentiating: read the sub-processor terms, map them to the client's obligations, and explain them in plain language to the client's DPO — "the vendor's trust page says it's fine" is not advice. The consultant who walks in with a gate-design method, a review procedure, and a DPDP mapping is selling governance, which outlasts every feature cycle.

Note

NIST AI RMF and ISO 42001 are free to read and map against — govern/map/measure/manage gives your policy a recognized skeleton, and "our controls map to AI RMF" is a sentence that shortens audits. Use them as scaffolding, not as a substitute for the specific gates and reviews this module builds.

Try it now

  1. Red-team one threshold. Take any auto-execute rule in your org (or design one for a mock payment agent) and write three attacks that stay inside it — split transactions, velocity abuse, boundary values. Redesign the rule to catch each.
  2. Run one SoD scan. Feed an agent action catalog (real or the lab's) plus five SoD rules to your assistant and ask for conflicts with reasoning. Verify each finding by hand — you are grading the scan as much as the roles.
  3. Draft the one-pager. Write your org's AI policy skeleton from the table above — six sections, one paragraph each, with named owners where you know them and gaps marked honestly where you do not.

Check yourself: An auditor asks: "Your payment agent runs autonomously within configured parameters. Convince me that is a controlled process, not a delegated one." Name the five artifacts you produce, and what each proves.

▸Show answeroptional deep dive — click to expand

The gate design document with its red-team analysis (the thresholds encode fraud-and-error thinking, not a guessed number); the change-control records for those thresholds (parameters are governed configuration — nobody quietly widened them); the audit-trail review log with findings and escalations (the org actually looks, on a cadence, and feeds findings back); the agent's least-privilege permission profile with its pre-activation SoD scan (the agent cannot exceed its mandate even when wrong); and the kill-switch/rollback procedure with a named owner and test evidence (autonomy is revocable in minutes, with a manual fallback). Together they answer the flagship question: what the agent may do unsupervised is a designed, reviewed, revocable decision with named sign-offs — delegation with controls, which is what "controlled process" means.

This module anchors LAB-15 (governance capstone) — the full control set for a mock ERP agent: gate thresholds on the Payflow pattern, a least-privilege profile, an SoD scan with three seeded conflicts, an audit-log review, and the one-page policy mapped to DPDP and NIST AI RMF. Do it at work this week → pb-51 (approval-gate design for financial-data agents) and pb-52 (audit trails, review procedure, and the org policy).

Key Takeaway:

Systems of record run on controls, and AI does not get an exemption — it gets the same treatment, redesigned for machine speed: gates that model fraud rather than trust thresholds, trails that are reviewed rather than retained, agent permissions that pass SoD before activation, and a one-page policy with named owners. Whoever builds that control set governs the platform wave instead of being governed by its incidents.

This is the free reading view. Open BXUP to track your progress, run the hands-on labs, and prove it with original, exam-pattern assessments.
© Anvi Innovate · BXUP — Be Exponentially Upskilled · BXUP is an independent learning platform, not affiliated with or endorsed by AWS, Microsoft, Google, NVIDIA, IBM, Salesforce, Databricks, Oracle or Anthropic. All trademarks belong to their respective owners. · bxup.in