# Human Oversight Has a Capacity Limit

A Board Decision on Review That Can Operate

Author: Phil Hatch
Publisher: Akholi
Paper ID: AAO-033
Published: October 23, 2026
Language: en
Canonical: https://akholi.com/papers/human-oversight-has-a-capacity-limit/
Audience: Chief risk officer, COO and board risk committee

Boards should require evidence that the people assigned to oversee outsourced agents can perform the required review at the volume and speed of delivery. Naming a human reviewer does not establish an effective control.

<h2 id="section-1">Ask Whether the Review Can Be Performed</h2>
<p>The board should require management to demonstrate the capacity behind each material human-oversight commitment. The control depends on qualified people receiving useful evidence with enough time and authority to intervene. A diagram showing a person between the agent and the outcome is not proof that those conditions exist.</p>
<p>The <a href="https://akholi.com/outsourcing-2026-agentic-ai-tier-1-banks/part-2-five-failure-categories/">study</a> reports review capacity mismatched to agent output and routine approval at human review points.<sup id="ref-1"><a href="#note-1" aria-label="Note 1">1</a></sup> These are vendor-team accounts, not a verified count of failed bank controls. They justify an immediate management test of whether the organization’s own oversight design can operate under actual delivery conditions.</p>
<p>The issue is particularly acute when a provider can increase output faster than either firm can increase qualified review. A review obligation that worked during a small pilot may become nominal at production volume. The board should ask what changes when volume rises, exceptions cluster, or a reviewer is unavailable.</p>
<h2 id="section-2">Specify the Judgment the Person Must Make</h2>
<p>Management should distinguish approval before action, review of exceptions, sampling after action, and continuing professional collaboration. These serve different purposes and permit different exposure. Sampling after a consequential event cannot be described as a control that prevents that event.</p>
<p>Stanford’s selected enterprise cases describe oversight as a context-dependent <a href="https://digitaleconomy.stanford.edu/app/uploads/2026/03/EnterpriseAIPlaybook_PereiraGraylinBrynjolfsson.pdf">design choice, not simply a sign of immature automation.</a><sup id="ref-2"><a href="#note-2" aria-label="Note 2">2</a></sup> The board should therefore request a rationale tied to the consequence of error, required judgment, recoverability, and applicable obligations. It should not seek one automation percentage for all services.</p>
<p>For each review point, state what the person must inspect, what evidence is available, how long the task takes, and what happens when the person disagrees or cannot decide. A reviewer who can only accept an output, without access to its basis or authority to stop the action, is performing a different function from the one the board may assume.</p>
<h2 id="section-3">Test Capacity Under Representative Demand</h2>
<p>Figure 1 proposes a capacity decision record. Measure arrivals, review effort, available qualified time, backlog age, and escalation demand. Use representative difficult cases and peak conditions, including correlated failures. The purpose is a management decision about feasible coverage, not a statistical exercise for directors.</p>
<p>A hypothetical team receiving 600 cases that each require two minutes of review faces 20 hours of review work before breaks, investigation, or other duties. Two reviewers with six usable hours each cannot complete that obligation in the period. The arithmetic is illustrative; management must obtain the service’s actual workload and effort evidence.</p>
<p>Do not solve a capacity gap merely by shortening the permitted review time. Test whether the judgment remains reliable and whether unresolved cases accumulate. The provider’s assurance dashboard should distinguish completed review, deferred work, sampled work, and automatic approval so the buyer can see which control operated.</p>
<figure><img loading="lazy" src="https://akholi.com/wp-content/uploads/2026/10/033-f1.webp" width="1950" height="818" alt="The human oversight capacity decision. Judgment; What must the reviewer decide; Review purpose and required evidence. Demand; Can qualified time cover the work; Arrivals effort peaks and backlog. Authority; Can the person intervene in time; Tested restriction and escalation. Scale; When must the service slow or stop; Capacity trigger and funded response. Author’s proposed operating framework. Adapt to the service and applicable jurisdiction; not an empirically validated standard."><figcaption>Figure 1. The human oversight capacity decision<small><a href="https://akholi.com/outsourcing-2026-agentic-ai-tier-1-banks/">Phil Hatch, proposed framework developed for this paper.</a></small></figcaption></figure>
<h2 id="section-4">Choose a Feasible Oversight Design</h2>
<p>Management can narrow agent authority, reduce volume, improve evidence presentation, add qualified capacity, redesign the workflow, or change the role of human review. These choices have different cost and risk consequences. The decision should identify which error the review is intended to prevent and whether another control can perform that function more reliably.</p>
<p>BCG’s governance analysis emphasizes <a href="https://www.bcg.com/publications/2026/how-cios-govern-ai-agents-at-scale">runtime enforcement rather than relying solely on manual signoffs.</a><sup id="ref-3"><a href="#note-3" aria-label="Note 3">3</a></sup> Technical boundaries can reduce the work people must review, but they do not automatically replace professional or legally required decisions. Test the boundary and preserve human authority where the service requires it.</p>
<p>EU, UK, Swiss, and US obligations differ by sector and activity. Management should identify where a qualified person must make or review a decision and what evidence that person needs. A group staffing ratio cannot substitute for local professional, privacy, conduct, or safety requirements.</p>
<h2 id="section-5">Fund the Capacity Before Approving Scale</h2>
<p>An objection is that maintaining reviewers could consume the automation benefit. That may be true for a particular design and should appear in the business case. Management should then change the design or limit its scope, rather than approve a control that cannot be performed and count the unprovided work as a saving.</p>
<p>The committee should receive the oversight purpose, tested capacity, peak constraints, backlog limits, intervention authority, and action plan for any shortfall. Require a trigger that restricts the service when oversight demand exceeds safe capacity. Expansion should reopen the capacity decision before the additional work arrives.</p>
<p>Human oversight is a funded operating capability. The board should approve it on demonstrated judgment and throughput, with its limits visible. A named reviewer becomes a credible control only when the person can understand the case, make the required decision, and act before the consequence exceeds the approved boundary.</p>
<h2 id="section-6">Evidence and Source Note</h2>
<p>The study is a nonrepresentative cross-section of 850 vendor delivery-team <a href="https://akholi.com/outsourcing-2026-agentic-ai-tier-1-banks/introduction/">respondents</a> on 150 engagements serving Tier 1 financial institutions, collected during January–June 2026. Neither banks nor vendors corroborated the accounts. It establishes reported experience, not causation, legal breach, or market prevalence. Its application here is a mechanism to investigate, not an estimate of conditions in other industries. The author-supplied version 1.8.2 is dated November 1, 2026 and is cited as a forthcoming manuscript consulted October 23, 2026.<sup id="ref-4"><a href="#note-4" aria-label="Note 4">4</a></sup></p>
<p>This is an analytical decision paper based on the supplied study and selected primary public sources checked through October 23, 2026. The original contribution is an executive oversight capacity decision record linking required judgment, demonstrated workload, intervention authority, and limits on service expansion. The proposed method has not been independently validated. Legal requirements depend on the entity, activity, jurisdiction, and effective provisions; supervisory observations, research, and professional commentary have distinct authority.</p>
<h2 id="notes">Notes</h2><ol class="akp-notes"><li id="note-1">Phil Hatch, <i>Agentic AI Outsourcing at Tier 1 Financial Institutions: Full Study Report</i>, version 1.8.2 (Akholi, forthcoming manuscript dated November 1, 2026), Part 2, secs. 4.2–4.3, “Human Review Capacity Against Agent Output Volume” and “Routine Approval of Agent Output at Human Review Points”, <a href="https://doi.org/10.2139/ssrn.7164559">https://doi.org/10.2139/ssrn.7164559</a>. <a href="#ref-1" aria-label="Return to note 1">↩</a></li><li id="note-2">Elisa Pereira et al., <i>The Enterprise AI Playbook: Lessons from 51 Successful Deployments,</i> Stanford Digital Economy Lab, April 2026, methodology and chapters 1–3 and 8; purposive successful-case sample, <a href="https://digitaleconomy.stanford.edu/app/uploads/2026/03/EnterpriseAIPlaybook_PereiraGraylinBrynjolfsson.pdf">https://digitaleconomy.stanford.edu/app/uploads/2026/03/EnterpriseAIPlaybook_PereiraGraylinBrynjolfsson.pdf</a>. <a href="#ref-2" aria-label="Return to note 2">↩</a></li><li id="note-3">Shaheer Rizvi et al., “Enterprise AI Control Plane: The CIO’s Guide to Governing and Accelerating AI Agents,” Boston Consulting Group, August 14, 2026, “Technical Components of the EACP” and “Lessons Learned”, <a href="https://www.bcg.com/publications/2026/how-cios-govern-ai-agents-at-scale">https://www.bcg.com/publications/2026/how-cios-govern-ai-agents-at-scale</a>. <a href="#ref-3" aria-label="Return to note 3">↩</a></li><li id="note-4">Hatch, <i>Agentic AI Outsourcing</i>, Introduction, “Executive Summary” and “Evidentiary Basis and Its Limits”. <a href="#ref-4" aria-label="Return to note 4">↩</a></li></ol>
<h2 id="bibliography">Bibliography</h2><ul class="akp-bibliography"><li>Hatch, Phil. <i>Agentic AI Outsourcing at Tier 1 Financial Institutions: Full Study Report</i>. Version 1.8.2. Akholi. Forthcoming manuscript dated November 1, 2026. Author-supplied manuscript consulted October 23, 2026. <a href="https://doi.org/10.2139/ssrn.7164559">https://doi.org/10.2139/ssrn.7164559</a>.</li><li>Pereira, Elisa, Alvin Wang Graylin, and Erik Brynjolfsson. <i>The Enterprise AI Playbook: Lessons from 51 Successful Deployments.</i> Stanford Digital Economy Lab. April 2026. <a href="https://digitaleconomy.stanford.edu/app/uploads/2026/03/EnterpriseAIPlaybook_PereiraGraylinBrynjolfsson.pdf">https://digitaleconomy.stanford.edu/app/uploads/2026/03/EnterpriseAIPlaybook_PereiraGraylinBrynjolfsson.pdf</a>.</li><li>Rizvi, Shaheer, Zeeshan Shah, Sarvesh Singh, Nicolas Tanaka, Francois D’Agostini, and Jazz Tobaccowalla. “Enterprise AI Control Plane: The CIO’s Guide to Governing and Accelerating AI Agents.” Boston Consulting Group. August 14, 2026. <a href="https://www.bcg.com/publications/2026/how-cios-govern-ai-agents-at-scale">https://www.bcg.com/publications/2026/how-cios-govern-ai-agents-at-scale</a>.</li></ul>
