# Evidence an Audit Committee Needs from Agentic Service Providers

An Audit Committee Decision on Assurance Scope

Author: Phil Hatch
Publisher: Akholi
Paper ID: AAO-063
Published: October 23, 2026
Language: en
Canonical: https://akholi.com/papers/evidence-an-audit-committee-needs-from-agentic-service-providers/
Audience: Financial institution audit committee, chief audit executive and CFO

The audit committee should require an evidence chain from material outsourced agent activity to the assurance conclusion presented to the board. Supplier reports must disclose scope, exceptions, manual intervention, and unresolved limitations sufficiently to support that conclusion.

<h2 id="section-1">Ask What the Assurance Conclusion Covers</h2>
<p>The audit committee should begin with the material service and the conclusion management asks it to accept. A provider may present cybersecurity certification, model evaluations, service-level reports, and internal reviews. Each can be useful while leaving the bank’s consequential workflow outside its scope.</p>
<p><a href="https://www.ey.com/en_us/insights/assurance/ai-governance-has-entered-its-next-phase-closing-the-confidence-gap">EY</a>’s governance survey reports that formal assurance reviews can surface issues and lead organizations to modify or stop systems.<sup id="ref-1"><a href="#note-1" aria-label="Note 1">1</a></sup> It covers US executive reports, not independently verified bank engagement outcomes. Its relevance is the difference between obtaining an assurance document and using assurance to change a decision.</p>
<p>Ask management to state the legal entity, service configuration, period, data population, subcontractors, and control objectives covered. Then identify exclusions. The committee should understand whether a favorable conclusion applies to the service operating today or to a narrower process tested before a material change.</p>
<h2 id="section-2">Make Unreported Intervention an Assurance Question</h2>
<p>In the supplied <a href="https://akholi.com/outsourcing-2026-agentic-ai-tier-1-banks/part-5-manual-alteration/">study</a>, all 150 sampled engagements had a reported manual alteration across the five methods. Thirteen of 1,004 pooled valid disclosure-question answers indicated informing the customer, approximately 1.29%.<sup id="ref-2"><a href="#note-2" aria-label="Note 2">2</a></sup> These denominators differ; the answers may repeat respondents and do not establish bank knowledge.</p>
<p>The committee should therefore ask whether the assurance process can detect and classify human intervention, including legitimate review and corrective work. The finding is not proof that every provider concealed a breach. It is a reason to test whether management’s evidence depends on supplier reporting that omits the work sustaining the service.</p>
<p>A hypothetical clean performance report could exclude cases completed manually. The committee needs the inclusion rule and reconciled case history before interpreting the automation claim. Where the population cannot be reconciled, the assurance conclusion should disclose that limitation rather than imply comprehensive coverage.</p>
<h2 id="section-3">Use an Assurance Coverage Record</h2>
<p>Figure 1 proposes a record connecting material exposure, evidence, independent challenge, and corrective decision. Management should identify the source of each important claim and the person who tested it. Distinguish provider assertion, bank observation, and independent assurance.</p>
<p>The record should include material exceptions, missing evidence, changed configurations, and overdue remediation. A risk rating without the underlying limitation can be misleading. The committee should see what could not be established and whether the gap affects continued reliance, service scope, or reporting to another responsible body.</p>
<p>The Basel third-party principles retain <a href="https://www.bis.org/publications/fsi-summary-sound-management-third-party-risk-executive-summary">board and senior management responsibilities across the relationship lifecycle.</a><sup id="ref-3"><a href="#note-3" aria-label="Note 3">3</a></sup> An external report can support those responsibilities; it cannot discharge them merely by existing. The bank must connect assurance scope to the particular service and its own controls.</p>
<figure><img loading="lazy" src="https://akholi.com/wp-content/uploads/2026/10/063-f1.webp" width="1950" height="918" alt="The audit committee assurance coverage record. Exposure; Which material claim is at risk; Service population and consequence. Evidence; What establishes the claim; Scope source and intervention history. Challenge; Who tested the evidence; Independent findings and limitations. Decision; What changes because of the findings; Restriction remediation and retest. Author’s proposed operating framework. Adapt to the service and applicable jurisdiction; not an empirically validated standard."><figcaption>Figure 1. The audit committee assurance coverage record<small><a href="https://akholi.com/outsourcing-2026-agentic-ai-tier-1-banks/">Phil Hatch, proposed framework developed for this paper.</a></small></figcaption></figure>
<h2 id="section-4">Keep Legal and Assurance Conclusions Distinct</h2>
<p>A departure from a planned governance function is not automatically a legal violation. Counsel and relevant control functions should assess the facts against applicable requirements. Likewise, absence of a reported incident does not demonstrate effective control if the monitoring process could not detect one.</p>
<p>EU, UK, Swiss, US, and other banking and audit regimes differ. The committee should require management to identify the relevant statutory, supervisory, accounting, and contractual conclusions and who is qualified to make each. Do not combine them into an undefined statement that the service is compliant.</p>
<p>Secure access to the records necessary for bank and auditor challenge, including relevant downstream evidence. Protect confidential information through proportionate access controls. If a supplier restriction prevents a material conclusion, the limitation belongs in the committee decision rather than in an undisclosed operational footnote.</p>
<h2 id="section-5">Commission Work That Can Change Reliance</h2>
<p>A reasonable objection is that the committee cannot inspect operational detail for every agent. It should not. Management should prioritize material services and bring concise conclusions with a traceable evidence route. The committee’s role is to challenge coverage, unresolved exposure, independence, and the adequacy of the response.</p>
<p>Commission a targeted review where a material claim lacks evidence. Give it access, a defined question, an accountable owner, and a decision date. Require a clear recommendation on continued use, restricted scope, remediation, or replacement. Track closure through demonstrated correction rather than administrative completion.</p>
<p>The committee should leave the review able to explain why reliance is justified and where it remains conditional. The strongest assurance pack is not the largest. It is the one that connects material outsourced activity to credible evidence, explicit limitations, and a decision management can execute.</p>
<h2 id="section-6">Evidence and Source Note</h2>
<p>The study is a nonrepresentative cross-section of 850 vendor delivery-team <a href="https://akholi.com/outsourcing-2026-agentic-ai-tier-1-banks/introduction/">respondents</a> on 150 engagements serving Tier 1 financial institutions, collected during January–June 2026. Neither banks nor vendors corroborated the accounts. It establishes reported experience, not causation, legal breach, or market prevalence. The author-supplied version 1.8.2 is dated November 1, 2026 and is cited as a forthcoming manuscript consulted October 23, 2026.<sup id="ref-4"><a href="#note-4" aria-label="Note 4">4</a></sup></p>
<p>This is an analytical decision paper based on the supplied study and selected primary public sources checked through October 23, 2026. The original contribution is an audit-committee coverage record connecting material agent-service claims to evidence provenance, assurance limitations, and decisions about continued reliance. The proposed method has not been independently validated. Legal requirements depend on the entity, activity, jurisdiction, and effective provisions; supervisory observations, research, and professional commentary have distinct authority.</p>
<h2 id="notes">Notes</h2><ol class="akp-notes"><li id="note-1">Richard Jackson and John McLain, “AI Governance Has Entered Its Next Phase: Closing the Confidence Gap,” EY, September 15, 2026, US survey population and chapters 4–5, <a href="https://www.ey.com/en_us/insights/assurance/ai-governance-has-entered-its-next-phase-closing-the-confidence-gap">https://www.ey.com/en_us/insights/assurance/ai-governance-has-entered-its-next-phase-closing-the-confidence-gap</a>. <a href="#ref-1" aria-label="Return to note 1">↩</a></li><li id="note-2">Phil Hatch, <i>Agentic AI Outsourcing at Tier 1 Financial Institutions: Full Study Report</i>, version 1.8.2 (Akholi, forthcoming manuscript dated November 1, 2026), Part 5, “The Five Manual Alteration Methods” and “Disclosure of Manual Alteration,” table 5.8, <a href="https://doi.org/10.2139/ssrn.7164559">https://doi.org/10.2139/ssrn.7164559</a>. <a href="#ref-2" aria-label="Return to note 2">↩</a></li><li id="note-3">Bank for International Settlements, Financial Stability Institute, “Sound Management of Third-Party Risk—Executive Summary,” Bank for International Settlements, Financial Stability Institute, March 25, 2026, principles 1–9 and intended application, <a href="https://www.bis.org/publications/fsi-summary-sound-management-third-party-risk-executive-summary">https://www.bis.org/publications/fsi-summary-sound-management-third-party-risk-executive-summary</a>. <a href="#ref-3" aria-label="Return to note 3">↩</a></li><li id="note-4">Hatch, <i>Agentic AI Outsourcing</i>, Introduction, “Executive Summary” and “Evidentiary Basis and Its Limits”. <a href="#ref-4" aria-label="Return to note 4">↩</a></li></ol>
<h2 id="bibliography">Bibliography</h2><ul class="akp-bibliography"><li>Bank for International Settlements, Financial Stability Institute. “Sound Management of Third-Party Risk—Executive Summary.” Bank for International Settlements, Financial Stability Institute. March 25, 2026. <a href="https://www.bis.org/publications/fsi-summary-sound-management-third-party-risk-executive-summary">https://www.bis.org/publications/fsi-summary-sound-management-third-party-risk-executive-summary</a>.</li><li>Hatch, Phil. <i>Agentic AI Outsourcing at Tier 1 Financial Institutions: Full Study Report</i>. Version 1.8.2. Akholi. Forthcoming manuscript dated November 1, 2026. Author-supplied manuscript consulted October 23, 2026. <a href="https://doi.org/10.2139/ssrn.7164559">https://doi.org/10.2139/ssrn.7164559</a>.</li><li>Jackson, Richard, and John McLain. “AI Governance Has Entered Its Next Phase: Closing the Confidence Gap.” EY. September 15, 2026. <a href="https://www.ey.com/en_us/insights/assurance/ai-governance-has-entered-its-next-phase-closing-the-confidence-gap">https://www.ey.com/en_us/insights/assurance/ai-governance-has-entered-its-next-phase-closing-the-confidence-gap</a>.</li></ul>
