Study Data · Part 1 · Indicator Deep-Dive Analysis

Headcount

Indicator ENG:Headcount · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeNone, an engagement field
Question as askedHeadcount
Failure categoryNot one of the 100 rated indicators
Place in the surveyNot a survey item
Indicator classEngagement attribute
Indicator typeEngagement attribute, typed number
Response scaleA number, as typed or recorded
Answering base150 engagements
Non-answersNone, the value is recorded for every engagement
Written responses coded to the indicator33 responses from 33 respondents on 29 engagements (0 primary, 33 secondary)

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureFormnr95% CIp
Cancellation rateDescriptive contrast150 engagements0.12−0.05 to 0.270.159
Customer satisfactionClean estimate94 engagements0.02−0.18 to 0.220.851
Engagement indicator meanFull150 engagements−0.10−0.26 to 0.060.226
Intent to leaveRespondent level, clustered798 respondents0.09−0.07 to 0.240.289

Engagement headcount had a mean close to its median across the study set (mean 8.4, median 8.0, n = 150 engagements). The association with cancellation was equivalent to zero (TOST p 0.010). The association with customer satisfaction on active engagements was equivalent to zero (TOST p 0.003). The association with the engagement indicator mean was equivalent to zero (TOST p 0.005). The association with intent to leave was equivalent to zero (TOST p < 0.001). Headcount differed after Holm control by process family (Welch F 4.28, Holm p 0.022, omega squared 0.061) and by class of work (Welch F 12.32, Holm p 0.003, omega squared 0.070).

The indicator had 33 written responses coded to it, from 33 of 850 respondents on 29 of 150 engagements. Negative responses numbered 23 of the 33 scored responses (69.70%). The strongest negative score, −10, was carried by 6 of the 33 scored responses (18.18%). Every response was a secondary response.

Distribution of Recorded Values

Table 3. Distribution of recorded valuesTable
ValueEngagementsShare of engagements aCumulative share
3.0 to 4.332.00%2.00%
4.3 to 5.61812.00%14.00%
5.6 to 6.9128.00%22.00%
6.9 to 8.25033.33%55.33%
8.2 to 9.52214.67%70.00%
9.5 to 10.81711.33%81.33%
10.8 to 12.11912.67%94.00%
12.1 to 13.464.00%98.00%
13.4 to 14.721.33%99.33%
14.7 to 16.010.67%100.00%
Total150100.00%
Note: a Share of engagements (base 150).
Table 4. Recorded values, engagement level summaryTable
Engagement level summaryEngagementsMeanSDMinMedianMaxEngagements with a distressed valueShare of engagements distressed
Values as recorded1508.42.43.08.016.0Not applicableNot applicable

The value was recorded once per engagement, so every figure in this section counts out of 150 engagements. The mean was 8.4 and the median was 8.0, on 150 engagements.

Coverage and Origin of Written Responses

Figure 1. Written responses coded to the indicator, by the question answered and by written score (n = 33 responses)Exhibit
051015C210 (secondary)C202 (secondary)C177 (secondary)C055 (secondary)C198 (secondary)C029 (secondary)C114 (secondary)C030 (secondary)C156 (secondary)C135 (secondary)57Written responses−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: The indicator is an engagement field with no survey section of its own. Every written response coded to it therefore answered a question in a survey section and was counted as a secondary response, coded to the indicator because its content addressed it. Segments run from −10, strongly negative, in full amber at the left to +10, strongly positive, in the darkest gray at the right. Segments of 3 or more responses are labeled with their count where the drawn segment can hold the label. C135 asked: “Add any comments on your employer that the ratings in this section do not capture.” C156 asked: “Add any comments on the joint management of this engagement that the ratings in this section do not capture.” C030 asked: “What are the top 3 things that you love most about your job?” C114 asked: “Add any comments on the customer organization that the ratings in this section do not capture.” C029 asked: “What are your top 3 challenges that reduce your job satisfaction?” C198 asked: “Add any comments on the third-party ecosystem that the ratings in this section do not capture.” C055 asked: “How does the vendor manipulate performance reports and dashboards?” C177 asked: “Add any comments on the agentic AI tools that the ratings in this section do not capture.” C202 asked: “Why did you alter client provided data?” C210 asked: “Comment.”
Table 5. Written responses by originTable
OriginResponsesRespondentsEngagementsNegativeStrongest negative (−10)PositiveMean written score
Primary000a
Secondary33332923 of 33 (69.70%)6 of 33 (18.18%)6 of 33 (18.18%)−3.5
All responses33332923 of 33 (69.70%)6 of 33 (18.18%)6 of 33 (18.18%)−3.5
Note: a No scored responses.

All 33 responses were secondary responses. The secondary responses came from 33 respondents on 29 engagements, in answer to 10 questions (most often C135 with 14 responses, C156 with 5 responses, C030 with 3 responses and C114 with 3 responses). Among the Part 1 indicators with 30 or more scored responses, the secondary share of the indicator ranked 1 of 6 from the highest, tied with 4 other indicators. The median secondary share was 100.00% across the 6 indicators.

Distribution of Written Sentiment

Figure 2. Distribution of written sentiment (n = 33 scored responses)Exhibit
6 (18.18%)−10 Stronglynegative17 (51.52%)−5 Negative4 (12.12%)0 Neutral6 (18.18%)+5 Positive0 (0.00%)+10 Stronglypositive
Note: Column height is the share of all scored responses. Labels give the count and the share.
Table 6. Summary statistics of written sentimentTable
StatisticValueBasis
Mean written score−3.595% CI −4.9 to −1.9, cluster bootstrap by engagement, 10,000 draws, n = 33 responses
Median written score−5.0n = 33 responses
Negative responses23 of 33 (69.70%)95% CI 54.29% to 84.21% of 33 responses, cluster bootstrap by engagement
Strongest negative responses (−10)6 of 33 (18.18%)Statements of totality, constancy or serious harm
Positive responses6 of 33 (18.18%)+5 or +10
Net balance−51.52 percentage pointsShare positive minus share negative, base 33 responses
Respondent-level mean−3.5Mean of each respondent’s own mean written score, n = 33 respondents

The indicator has no good or bad end. Under the coding rulebook’s rule for such indicators, the written score records the effect each response states on the engagement or on the respondent. The engagement field is “ENG:Headcount.” The frequency, scope and consequence a response states set the strength of its score. A score of +10 marks a response that describes “this attribute of the engagement as helping the engagement at its best.” A score of −10 marks a response that describes “this attribute as harming the engagement at its worst . . . .”

Of the 33 scored responses, 23 (69.70%) were negative, 6 (18.18%) carried the strongest negative score and 6 (18.18%) were positive. The responses had a mean written score of −3.5 (95% CI −4.9 to −1.9, n = 33 responses on 29 engagements).

Descriptive Statistics by Segment

Table 7a. Descriptive statistics by segment, part 1 of 2Table
SegmentBaseAnsweredAnswer rateEngagementsMean95% CISD
Study set150150100.00% of 1501508.48.0 to 8.72.4
Outsourcing model
CXM4242100.00% of 42428.07.3 to 8.62.0
ITO4040100.00% of 40409.38.4 to 10.33.0
BPO3737100.00% of 37378.37.6 to 8.92.0
KPO3131100.00% of 31317.76.9 to 8.62.3
Institution type
Asset management2424100.00% of 24248.0†2.6
Wealth management and private banking2323100.00% of 23239.2†2.3
Investment banking (advisory and capital-markets origination)1919100.00% of 19198.3†2.5
Insurance (life, property and casualty, health)1414100.00% of 14148.7†1.9
Commercial and business banking1313100.00% of 13139.3†2.6
Payments and merchant acquiring (networks, acquiring, processing)1313100.00% of 13137.8†2.5
Credit card and payments issuing1212100.00% of 12129.1†2.4
Retail and consumer banking1212100.00% of 12128.9†1.8
Markets and trading (sales and trading, global markets)1111100.00% of 11117.5†1.7
Private equity and private capital999 of 99‡
Process family
Corporate and back-office functions4747100.00% of 47477.46.9 to 7.91.8
Technology engineering and operations3535100.00% of 35358.77.6 to 9.83.1
Client servicing and communications1616100.00% of 16169.3†1.7
Trade, settlement and reconciliation1515100.00% of 15157.8†2.2
Payments, cards and disputes1212100.00% of 12128.8†1.7
Credit, underwriting and suitability999 of 99‡
Regulatory, audit, tax and legal999 of 99‡
Financial crime and client onboarding777 of 77‡
Class of work
LOB Operational7676100.00% of 76769.08.5 to 9.52.2
Corporate Functional7474100.00% of 74747.77.1 to 8.22.5
Engagement status and lifecycle stage
Active, Build-Out3131100.00% of 31318.27.5 to 8.81.8
Active, Transition/Cut-Over4343100.00% of 43438.47.5 to 9.43.0
Active, Production2020100.00% of 20207.4†1.9
Canceled5656100.00% of 56568.78.1 to 9.32.4
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 7b. Descriptive statistics by segment, part 2 of 2Table
SegmentMinQ1MedianQ3MaxDistressed nDistressed %
Study set3.07.08.010.016.0Not applicableNot applicable
Outsourcing model
CXM3.07.08.09.012.0Not applicableNot applicable
ITO4.07.09.012.016.0Not applicableNot applicable
BPO3.07.08.010.011.0Not applicableNot applicable
KPO5.06.08.09.013.0Not applicableNot applicable
Institution type
Asset management5.06.08.09.016.0Not applicableNot applicable
Wealth management and private banking5.07.09.011.014.0Not applicableNot applicable
Investment banking (advisory and capital-markets origination)5.06.58.010.013.0Not applicableNot applicable
Insurance (life, property and casualty, health)6.07.39.09.813.0Not applicableNot applicable
Commercial and business banking5.08.09.011.014.0Not applicableNot applicable
Payments and merchant acquiring (networks, acquiring, processing)3.06.08.010.011.0Not applicableNot applicable
Credit card and payments issuing5.07.88.510.513.0Not applicableNot applicable
Retail and consumer banking7.07.89.09.313.0Not applicableNot applicable
Markets and trading (sales and trading, global markets)5.07.07.08.510.0Not applicableNot applicable
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functions5.06.07.08.011.0Not applicableNot applicable
Technology engineering and operations3.06.59.010.516.0Not applicableNot applicable
Client servicing and communications6.08.09.010.013.0Not applicableNot applicable
Trade, settlement and reconciliation3.07.08.09.511.0Not applicableNot applicable
Payments, cards and disputes6.08.08.510.012.0Not applicableNot applicable
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB Operational5.08.09.010.016.0Not applicableNot applicable
Corporate Functional3.06.07.09.014.0Not applicableNot applicable
Engagement status and lifecycle stage
Active, Build-Out5.07.08.09.012.0Not applicableNot applicable
Active, Transition/Cut-Over3.06.58.011.016.0Not applicableNot applicable
Active, Production4.06.07.08.312.0Not applicableNot applicable
Canceled3.07.09.010.014.0Not applicableNot applicable
Note: ‡ Base under 10. No statistic is reported.

Figures are engagement level. Means are on the scale as recorded. A level under 30 prints no interval and a level under 10 prints counts only.

Tests of Difference Between Segments

Table 8a. Tests of difference between segments, part 1 of 2Table
Segment familyWelch FdfpHolm pOmega squared90% CI
Outsourcing model2.463, 78.40.0690.2060.0450.006 to 0.123
Institution type1.278, 50.10.2790.2790.0110.000 to 0.089
Process family4.284, 39.90.0060.0220.0610.008 to 0.155
Class of work12.321, 145.5< 0.0010.0030.0700.022 to 0.152
Engagement status and lifecycle stage2.113, 66.70.1070.2140.0110.000 to 0.073
Table 8b. Tests of difference between segments, part 2 of 2Table
Segment familyKruskal-Wallis HpDistressed chi-squaredfpCramer’s VLevels left out
Outsourcing model7.970.047Not applicableNot applicableNone
Institution type9.740.284Not applicableNot applicablea
Process family12.860.012Not applicableNot applicableb
Class of work12.70< 0.001Not applicableNot applicableNone
Engagement status and lifecycle stage5.110.164Not applicableNot applicableNone
Note: a Private equity and private capital, n = 9. b Credit, underwriting and suitability, n = 9, Regulatory, audit, tax and legal, n = 9, Financial crime and client onboarding, n = 7.

Engagement families were tested on engagement means, and respondent role and vendor type were tested on respondents. A distressed p marked exact is a Fisher exact test for a two by two table, and one marked simulated is a Monte Carlo test run until its p is stable to the third decimal, both used where an expected count is under 5. Process family differed after Holm control (Welch F 4.28, Holm p 0.022, tested on engagement means). In Descriptive Statistics by Segment, Client servicing and communications had the highest mean, 9.3 (n = 16 engagements), and Corporate and back-office functions the lowest, 7.4 (n = 47 engagements). Class of work differed after Holm control (Welch F 12.32, Holm p 0.003, tested on engagement means). In Descriptive Statistics by Segment, LOB Operational had the highest mean, 9.0 (n = 76 engagements), and Corporate Functional the lowest, 7.7 (n = 74 engagements). No difference held after Holm control for outsourcing model, institution type and engagement status and lifecycle stage.

Written Sentiment by Segment

Figure 3. Written sentiment by engagement status and lifecycle stage, share of each group’s responsesExhibit
0%25%50%75%100%Canceled (n = 13)15.38%46.15%15.38%23.08%Active, Production (n = 1)1 of 1Active, Transition/Cut-Over (n = 12)75.00%16.67%Active, Build-Out (n = 7)2 of 72 of 72 of 71 of 7All responses (n = 33)18.18%51.52%12.12%18.18%−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Segments run from −10, strongly negative, in full amber at the left to +10, strongly positive, in the darkest gray at the right. Each bar is 100% of its group’s responses. Segments of 12% or more are labeled, as a share on groups of 10 responses or more and as a count on smaller groups.
Table 9. Written sentiment by segmentTable
SegmentResponsesRespondentsEngagementsMean written scoreNegativeStrongest negative (−10)
Engagement status and lifecycle stage
Active, Build-Out776‡4 of 72 of 7
Active, Transition/Cut-Over121211−3.810 of 12 (83.33%)1 of 12 (8.33%)
Active, Production111‡1 of 11 of 1
Canceled131311−2.78 of 13 (61.54%)2 of 13 (15.38%)
Respondent role
Individual Contributor262624−3.518 of 26 (69.23%)4 of 26 (15.38%)
Engagement Manager666‡5 of 62 of 6
Portfolio Director111‡0 of 10 of 1
Customer Management Executive000No responses
Note: ‡ Base under 10. No statistic is reported.

Scored responses came from 6 engagements in the Active, Build-Out group, 11 engagements in the Active, Transition/Cut-Over group, 1 engagement in the Active, Production group and 11 engagements in the Canceled group. A test of mean written scores across the groups, with each engagement counted once, showed no difference that reached significance at 0.05 (Kruskal-Wallis H 0.54, df 2, p = 0.765, n = 28 engagements). The test compared the Active, Build-Out group, the Active, Transition/Cut-Over group and the Canceled group. It left out the Active, Production group, which held fewer than two engagements. Groups under 10 responses are reported as counts only. Negative responses numbered 4 of 7 in the Active, Build-Out group and 1 of 1 in the Active, Production group.

Across respondent roles, no test was run, because fewer than two roles reached 30 scored responses. Roles under 10 responses are reported as counts only. Among engagement managers, negative responses numbered 5 of 6. Among portfolio directors, negative responses numbered 0 of 1.

Association with Cancellation Rate

The share of engagements canceled on the study date, measured at engagement level (base 150 engagements, 56 canceled). The association is a descriptive contrast, inflated because canceled engagements were rated after cancellation, and is not predictive.

Table 10a. Association with cancellation rate by segment, part 1 of 2Table
SegmentEngagementsCanceledCancellation ratePoint-biserial r95% CIpHolm p
Study set1505637.33% of 1500.12−0.05 to 0.270.1591.000
Outsourcing model
CXM421535.71% of 42−0.13−0.42 to 0.180.4011.000
ITO401537.50% of 400.18−0.14 to 0.460.2801.000
BPO371437.84% of 370.23−0.10 to 0.520.1631.000
KPO311238.71% of 310.21−0.15 to 0.530.2521.000
Institution type
Asset management241354.17% of 240.05†0.8161.000
Wealth management and private banking23834.78% of 230.18†0.4031.000
Investment banking (advisory and capital-markets origination)19947.37% of 190.01†0.9781.000
Insurance (life, property and casualty, health)14535.71% of 14−0.21†0.4821.000
Commercial and business banking13430.77% of 130.12†0.7001.000
Payments and merchant acquiring (networks, acquiring, processing)13323.08% of 13−0.10†0.7451.000
Credit card and payments issuing12541.67% of 120.71†0.0100.211
Retail and consumer banking12433.33% of 120.45†0.1431.000
Markets and trading (sales and trading, global markets)11327.27% of 11−0.05†0.8931.000
Private equity and private capital922 of 9‡
Process family
Corporate and back-office functions471940.43% of 470.27−0.02 to 0.520.0681.000
Technology engineering and operations351028.57% of 350.06−0.28 to 0.380.7371.000
Client servicing and communications16956.25% of 16−0.25†0.3511.000
Trade, settlement and reconciliation15853.33% of 150.29†0.2981.000
Payments, cards and disputes12216.67% of 120.32†0.3091.000
Credit, underwriting and suitability911 of 9‡
Regulatory, audit, tax and legal944 of 9‡
Financial crime and client onboarding733 of 7‡
Class of work
LOB Operational763039.47% of 760.04−0.18 to 0.270.7041.000
Corporate Functional742635.14% of 740.17−0.06 to 0.380.1531.000
Engagement status and lifecycle stage
Active, Build-Out3100.00% of 31Not computable, no variation in cancellation
Active, Transition/Cut-Over4300.00% of 43Not computable, no variation in cancellation
Active, Production2000.00% of 20Not computable, no variation in cancellation
Canceled5656100.00% of 56Not computable, no variation in cancellation
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 10b. Association with cancellation rate by segment, part 2 of 2Table
SegmentOdds ratio per point95% CIAUCRate, distressed engagementsRate, other engagementsFisher pTOST p
Study set1.100.96 to 1.270.58Not applicableNot applicableNot applicable0.010
Outsourcing model
CXM0.870.62 to 1.200.59Not applicableNot applicableNot applicable0.136
ITO1.130.91 to 1.410.63Not applicableNot applicableNot applicable0.210
BPO1.310.90 to 1.910.63Not applicableNot applicableNot applicable0.340
KPO1.220.87 to 1.710.63Not applicableNot applicableNot applicable0.310
Institution type
Asset management1.04† n = 240.62Not applicableNot applicableNot applicable0.117
Wealth management and private banking1.19† n = 230.61Not applicableNot applicableNot applicable0.289
Investment banking (advisory and capital-markets origination)1.01† n = 190.53Not applicableNot applicableNot applicable0.113
Insurance (life, property and casualty, health)0.78† n = 140.57Not applicableNot applicableNot applicable0.368
Commercial and business banking1.11† n = 130.53Not applicableNot applicableNot applicable0.273
Payments and merchant acquiring (networks, acquiring, processing)0.91† n = 130.60Not applicableNot applicableNot applicable0.254
Credit card and payments issuing2.95† n = 120.90Not applicableNot applicableNot applicable0.957
Retail and consumer banking1.87† n = 120.69Not applicableNot applicableNot applicable0.699
Markets and trading (sales and trading, global markets)0.94† n = 110.50Not applicableNot applicableNot applicable0.228
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functions1.380.97 to 1.970.64Not applicableNot applicableNot applicable0.411
Technology engineering and operations1.040.82 to 1.320.58Not applicableNot applicableNot applicable0.078
Client servicing and communications0.72† n = 160.59Not applicableNot applicableNot applicable0.422
Trade, settlement and reconciliation1.33† n = 150.66Not applicableNot applicableNot applicable0.482
Payments, cards and disputes1.74† n = 120.68Not applicableNot applicableNot applicable0.528
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB Operational1.040.84 to 1.290.54Not applicableNot applicableNot applicable0.012
Corporate Functional1.160.95 to 1.410.61Not applicableNot applicableNot applicable0.119
Engagement status and lifecycle stage
Active, Build-OutNot computable, no variation in cancellation
Active, Transition/Cut-OverNot computable, no variation in cancellation
Active, ProductionNot computable, no variation in cancellation
CanceledNot computable, no variation in cancellation
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was 0.12 (95% CI −0.05 to 0.27, Holm p 1.000, n = 150 engagements). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 20 tested segment levels, 0 held after Holm control.

Association with Customer Satisfaction

The satisfaction score recorded against each engagement on a 100-point scale. The primary estimate uses the 94 active engagements. A descriptive contrast uses all 150 engagements.

Table 11a. Association with customer satisfaction by segment, part 1 of 2Table
SegmentActive engagementsClean r95% CIpHolm pSpearman rhop
Study set940.02−0.18 to 0.220.8511.0000.000.975
Outsourcing model
CXM270.02†0.9231.0000.040.830
ITO250.01†0.9681.000−0.090.675
BPO230.10†0.6501.0000.070.763
KPO19−0.13†0.6071.000−0.120.613
Institution type
Asset management110.26†0.4411.0000.180.588
Wealth management and private banking150.01†0.9841.000−0.040.898
Investment banking (advisory and capital-markets origination)100.41†0.2351.0000.540.109
Insurance (life, property and casualty, health)9‡
Commercial and business banking9‡
Payments and merchant acquiring (networks, acquiring, processing)10−0.36†0.3091.000−0.630.051
Credit card and payments issuing7‡
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)8‡
Private equity and private capital7‡
Process family
Corporate and back-office functions28−0.01†0.9501.000−0.060.743
Technology engineering and operations250.06†0.7871.0000.000.993
Client servicing and communications7‡
Trade, settlement and reconciliation7‡
Payments, cards and disputes10−0.43†0.2171.000−0.260.463
Credit, underwriting and suitability8‡
Regulatory, audit, tax and legal5‡
Financial crime and client onboarding4‡
Class of work
LOB Operational460.12−0.18 to 0.400.4291.0000.090.545
Corporate Functional48−0.07−0.35 to 0.210.6171.000−0.090.526
Engagement status and lifecycle stage
Active, Build-Out310.06−0.30 to 0.410.7511.0000.100.582
Active, Transition/Cut-Over430.08−0.22 to 0.370.6031.0000.050.765
Active, Production20−0.14†0.5501.000−0.200.410
Canceled0a
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a No clean estimate, canceled engagements fall outside the active population.
Table 11b. Association with customer satisfaction by segment, part 2 of 2Table
SegmentSlope, points per rating point95% CIR squaredTOST pAll engagementsDescriptive rp
Study set0.09−0.90 to 1.090.000.003150−0.110.173
Outsourcing model
CXM0.13† n = 270.000.078420.120.445
ITO0.03† n = 250.000.07940−0.200.222
BPO0.49† n = 230.010.17537−0.190.273
KPO−0.77† n = 190.020.23231−0.250.181
Institution type
Asset management0.74† n = 110.070.45124−0.030.894
Wealth management and private banking0.02† n = 150.000.14623−0.190.385
Investment banking (advisory and capital-markets origination)1.75† n = 100.170.635190.100.678
Insurance (life, property and casualty, health)‡ n = 9
Commercial and business banking‡ n = 9
Payments and merchant acquiring (networks, acquiring, processing)−2.04† n = 100.130.56913−0.060.848
Credit card and payments issuing‡ n = 7
Retail and consumer banking‡ n = 8
Markets and trading (sales and trading, global markets)‡ n = 8
Private equity and private capital‡ n = 7
Process family
Corporate and back-office functions−0.10† n = 280.000.06947−0.260.079
Technology engineering and operations0.19† n = 250.000.11835−0.060.754
Client servicing and communications‡ n = 7
Trade, settlement and reconciliation‡ n = 7
Payments, cards and disputes−3.26† n = 100.180.65312−0.430.161
Credit, underwriting and suitability‡ n = 8
Regulatory, audit, tax and legal‡ n = 5
Financial crime and client onboarding‡ n = 4
Class of work
LOB Operational0.70−1.06 to 2.450.010.10776−0.020.860
Corporate Functional−0.32−1.60 to 0.960.010.05774−0.180.121
Engagement status and lifecycle stage
Active, Build-Out0.33−1.75 to 2.400.000.093310.060.751
Active, Transition/Cut-Over0.35−1.00 to 1.700.010.075430.080.603
Active, Production−0.90†0.020.24620−0.140.550
Canceledno clean estimate, canceled engagements fall outside the active population
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was 0.02 (95% CI −0.18 to 0.22, Holm p 1.000, n = 94 engagements). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 16 tested segment levels, 0 held after Holm control.

Association with the Engagement Indicator Mean

The mean of an engagement’s 100 indicator ratings, measured at engagement level (base 150 engagements). Where this indicator is one of the 100, the mean is recomputed without it.

Table 12a. Association with the engagement indicator mean by segment, part 1 of 2Table
SegmentEngagementsLeave-one-out r95% CIpHolm pSpearman rhop
Study set150−0.10−0.26 to 0.060.2261.000−0.120.157
Outsourcing model
CXM420.11−0.20 to 0.400.4971.0000.120.434
ITO40−0.23−0.51 to 0.090.1501.000−0.270.093
BPO37−0.05−0.37 to 0.280.7561.000−0.030.838
KPO31−0.24−0.55 to 0.130.1951.000−0.290.120
Institution type
Asset management240.10†0.6501.000−0.070.735
Wealth management and private banking23−0.27†0.2121.000−0.230.291
Investment banking (advisory and capital-markets origination)19−0.18†0.4581.000−0.250.309
Insurance (life, property and casualty, health)140.39†0.1741.0000.260.363
Commercial and business banking13−0.07†0.8091.000−0.050.864
Payments and merchant acquiring (networks, acquiring, processing)13−0.08†0.7951.000−0.120.705
Credit card and payments issuing12−0.62†0.0310.771−0.560.059
Retail and consumer banking12−0.34†0.2751.000−0.200.523
Markets and trading (sales and trading, global markets)110.04†0.9071.000−0.140.684
Private equity and private capital9‡
Process family
Corporate and back-office functions47−0.19−0.45 to 0.110.2091.000−0.210.156
Technology engineering and operations35−0.11−0.43 to 0.230.5111.000−0.160.360
Client servicing and communications160.18†0.5041.0000.110.695
Trade, settlement and reconciliation150.03†0.9141.000−0.070.818
Payments, cards and disputes12−0.42†0.1691.000−0.180.579
Credit, underwriting and suitability9‡
Regulatory, audit, tax and legal9‡
Financial crime and client onboarding7‡
Class of work
LOB Operational76−0.02−0.24 to 0.210.8701.000−0.030.766
Corporate Functional74−0.17−0.39 to 0.060.1421.000−0.180.118
Engagement status and lifecycle stage
Active, Build-Out310.15−0.21 to 0.480.4081.0000.170.348
Active, Transition/Cut-Over43−0.07−0.36 to 0.240.6571.000−0.110.472
Active, Production20−0.23†0.3211.000−0.250.283
Canceled560.06−0.21 to 0.320.6711.0000.080.546
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 12b. Association with the engagement indicator mean by segment, part 2 of 2Table
Segmentr with indicator includedChange in rSlope95% CIR squaredTOST pEquivalent
Study setNot a component−0.06−0.16 to 0.040.010.005Yes
Outsourcing model
CXMNot a component0.09−0.17 to 0.350.010.104No
ITONot a component−0.10−0.23 to 0.040.050.327No
BPONot a component−0.04−0.27 to 0.190.000.067No
KPONot a component−0.18−0.45 to 0.100.060.364No
Institution type
Asset managementNot a component0.06† n = 240.010.166No
Wealth management and private bankingNot a component−0.17† n = 230.070.443No
Investment banking (advisory and capital-markets origination)Not a component−0.08† n = 190.030.307No
Insurance (life, property and casualty, health)Not a component0.31† n = 140.150.626No
Commercial and business bankingNot a component−0.04† n = 130.010.229No
Payments and merchant acquiring (networks, acquiring, processing)Not a component−0.05† n = 130.010.234No
Credit card and payments issuingNot a component−0.33† n = 120.390.895No
Retail and consumer bankingNot a component−0.32† n = 120.120.557No
Markets and trading (sales and trading, global markets)Not a component0.04† n = 110.000.223No
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functionsNot a component−0.17−0.43 to 0.100.030.212No
Technology engineering and operationsNot a component−0.05−0.20 to 0.100.010.136No
Client servicing and communicationsNot a component0.17† n = 160.030.323No
Trade, settlement and reconciliationNot a component0.02† n = 150.000.167No
Payments, cards and disputesNot a component−0.33† n = 120.180.667No
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB OperationalNot a component−0.01−0.17 to 0.140.000.007Yes
Corporate FunctionalNot a component−0.10−0.24 to 0.040.030.127No
Engagement status and lifecycle stage
Active, Build-OutNot a component0.09−0.13 to 0.320.020.207No
Active, Transition/Cut-OverNot a component−0.03−0.16 to 0.100.000.065No
Active, ProductionNot a component−0.18† n = 200.050.385No
CanceledNot a component0.02−0.06 to 0.090.000.034Yes
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was −0.10 (95% CI −0.26 to 0.06, Holm p 1.000, n = 150 engagements). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 24 tested segment levels, 0 held after Holm control.

Association with Intent to Leave

The respondent’s stated likelihood of leaving the current job within 12 months, rated 1 to 10 (C019). Measured at respondent level on up to 798 respondents, with the engagement-level form reported alongside.

Table 13a. Association with intent to leave by segment, part 1 of 2Table
SegmentRespondentsr95% CICluster bootstrap 95% CIpHolm p
Study set7980.090.02 to 0.16−0.06 to 0.240.0140.282
Outsourcing model
CXM215−0.08−0.21 to 0.05−0.35 to 0.200.2391.000
ITO2330.07−0.06 to 0.19−0.24 to 0.380.3101.000
BPO1960.10−0.04 to 0.24−0.21 to 0.410.1441.000
KPO1540.250.09 to 0.39−0.13 to 0.560.0020.048
Institution type
Asset management122−0.08−0.25 to 0.10−0.49 to 0.530.3971.000
Wealth management and private banking1320.16−0.02 to 0.32−0.23 to 0.490.0761.000
Investment banking (advisory and capital-markets origination)98−0.10−0.29 to 0.10−0.49 to 0.400.3231.000
Insurance (life, property and casualty, health)71−0.22−0.44 to 0.01−0.64 to 0.350.0600.957
Commercial and business banking760.340.12 to 0.52−0.29 to 0.730.0030.062
Payments and merchant acquiring (networks, acquiring, processing)690.21−0.03 to 0.42−0.27 to 0.630.0861.000
Credit card and payments issuing700.630.47 to 0.760.21 to 0.86< 0.001< 0.001
Retail and consumer banking670.420.20 to 0.60−0.24 to 0.74< 0.0010.009
Markets and trading (sales and trading, global markets)55−0.22−0.46 to 0.05−0.56 to 0.310.1071.000
Private equity and private capital380.330.01 to 0.58§ n = 90.0460.774
Process family
Corporate and back-office functions2260.240.11 to 0.36−0.03 to 0.47< 0.0010.007
Technology engineering and operations194−0.01−0.15 to 0.13−0.31 to 0.310.8951.000
Client servicing and communications89−0.22−0.41 to −0.02−0.62 to 0.320.0360.641
Trade, settlement and reconciliation75−0.08−0.30 to 0.15−0.51 to 0.470.5141.000
Payments, cards and disputes700.380.16 to 0.57−0.26 to 0.830.0010.026
Credit, underwriting and suitability530.13−0.14 to 0.39§ n = 90.3441.000
Regulatory, audit, tax and legal490.320.04 to 0.55§ n = 90.0250.473
Financial crime and client onboarding420.590.35 to 0.76§ n = 7< 0.001< 0.001
Class of work
LOB Operational4240.01−0.09 to 0.10−0.21 to 0.250.8901.000
Corporate Functional3740.160.06 to 0.26−0.04 to 0.360.0020.038
Engagement status and lifecycle stage
Active, Build-Out166−0.10−0.25 to 0.06−0.40 to 0.230.2091.000
Active, Transition/Cut-Over237−0.03−0.16 to 0.10−0.28 to 0.220.6161.000
Active, Production950.360.18 to 0.530.02 to 0.64< 0.0010.007
Canceled300−0.06−0.17 to 0.06−0.16 to 0.050.3201.000
Note: § Too few engagements for a cluster bootstrap interval.
Table 13b. Association with intent to leave by segment, part 2 of 2Table
SegmentSpearman rhopShare at 7 or above, distressedShare at 7 or above, otherEngagementsEngagement level r95% CITOST p
Study set0.100.006Not applicableNot applicable1500.10−0.06 to 0.260.006
Outsourcing model
CXM−0.090.169Not applicableNot applicable42−0.10−0.39 to 0.210.097
ITO0.110.089Not applicableNot applicable400.08−0.24 to 0.380.084
BPO0.090.195Not applicableNot applicable370.14−0.19 to 0.450.166
KPO0.250.002Not applicableNot applicable310.29−0.07 to 0.580.477
Institution type
Asset management0.080.397Not applicableNot applicable240.05†0.117
Wealth management and private banking0.070.441Not applicableNot applicable230.22†0.358
Investment banking (advisory and capital-markets origination)−0.060.555Not applicableNot applicable19−0.08†0.184
Insurance (life, property and casualty, health)−0.150.205Not applicableNot applicable14−0.25†0.422
Commercial and business banking0.320.004Not applicableNot applicable130.28†0.472
Payments and merchant acquiring (networks, acquiring, processing)0.220.072Not applicableNot applicable130.15†0.310
Credit card and payments issuing0.58< 0.001Not applicableNot applicable120.68†0.943
Retail and consumer banking0.340.005Not applicableNot applicable120.41†0.653
Markets and trading (sales and trading, global markets)−0.170.210Not applicableNot applicable11−0.22†0.408
Private equity and private capital0.360.025Not applicableNot applicable9‡‡
Process family
Corporate and back-office functions0.24< 0.001Not applicableNot applicable470.25−0.04 to 0.500.364
Technology engineering and operations0.030.669Not applicableNot applicable35−0.02−0.35 to 0.320.049
Client servicing and communications−0.150.149Not applicableNot applicable16−0.22†0.380
Trade, settlement and reconciliation−0.060.600Not applicableNot applicable15−0.02†0.160
Payments, cards and disputes0.330.005Not applicableNot applicable120.47†0.727
Credit, underwriting and suitability0.060.688Not applicableNot applicable9‡‡
Regulatory, audit, tax and legal0.360.012Not applicableNot applicable9‡‡
Financial crime and client onboarding0.60< 0.001Not applicableNot applicable7‡‡
Class of work
LOB Operational0.030.514Not applicableNot applicable760.03−0.20 to 0.250.008
Corporate Functional0.170.001Not applicableNot applicable740.17−0.06 to 0.380.117
Engagement status and lifecycle stage
Active, Build-Out−0.150.048Not applicableNot applicable31−0.08−0.42 to 0.290.107
Active, Transition/Cut-Over−0.040.517Not applicableNot applicable43−0.06−0.35 to 0.240.058
Active, Production0.38< 0.001Not applicableNot applicable200.39†0.655
Canceled−0.060.321Not applicableNot applicable56−0.09−0.35 to 0.170.058
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was 0.09 (95% CI 0.02 to 0.16, Holm p 0.282, n = 798 respondents). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 28 tested segment levels, 8 held after Holm control.

Association of Written Sentiment with the Study Measures

Table 14. Written sentiment and the study measuresTable
ComparisonWith a negative responseWithout a negative responseTestStatisticp
Cancellation rate7 of 21 engagements (33.33%)49 of 129 engagements (37.98%)Fisher exact0.810
Customer satisfaction, active engagementsMean 62.79%, n = 14 engagementsMean 64.33%, n = 80 engagementsWelch t−0.450.659
Engagement mean written score and cancellationPoint-biserial rr = 0.19, n = 29 engagements0.332
Respondent mean written score and intent to leaveSpearman rhorho = 0.06, n = 31 respondents0.729

The cancellation and customer satisfaction contrasts compared engagements with a negative written response against all other engagements. The comparison group comprised 129 other engagements, of which 121 had no scored written response coded to the indicator and 8 had only scored responses that were not negative. The two contrasts therefore did not test written sentiment by themselves. Cancellation was recorded for 7 of the 21 engagements with a negative response (33.33%), against 49 of the 129 other engagements (37.98%). The difference did not reach significance at 0.05 (Fisher exact p = 0.810). Mean customer satisfaction was 62.79% on the 14 active engagements with a negative response, against 64.33% on the 80 other active engagements. The difference did not reach significance at 0.05 (Welch t −0.45, p = 0.659). The association of written sentiment itself with the study measures was tested by two correlations. The association of the engagement mean written score with cancellation did not reach significance at 0.05 (r = 0.19, p = 0.332, n = 29 engagements). The association of the respondent mean written score with intent to leave did not reach significance at 0.05 (rho = 0.06, p = 0.729, n = 31 respondents). None of the four outcome comparisons reached significance at 0.05. Both comparisons with cancellation were descriptive, because responses on canceled engagements were written after cancellation. Every comparison rested on a thin base, because fewer than 30 engagements had a scored written response.

Comparison of Associations Across the Four Measures

Table 15. Associations across the four measuresTable
MeasureFormUnitnr95% CIpEquivalent to zeroRank among the four
Cancellation rateDescriptive contrastEngagement1500.12−0.05 to 0.270.159Yes1
Customer satisfactionClean estimateEngagement940.02−0.18 to 0.220.851Yes4
Engagement indicator meanFullEngagement150−0.10−0.26 to 0.060.226Yes2
Intent to leaveRespondent level, clusteredRespondent7980.09−0.07 to 0.240.289Yes3
Table 16. Pairwise comparison of associationsTable
Pair comparedDifference in rSteiger zpHolm pReading
Cancellation rate and customer satisfaction0.00−0.130.8931.000Do not differ
Cancellation rate and engagement indicator mean−0.02−0.270.7911.000Do not differ
Cancellation rate and intent to leave−0.01−0.230.8151.000Do not differ
Customer satisfaction and engagement indicator mean−0.01−0.280.7801.000Do not differ
Customer satisfaction and intent to leave−0.01−0.220.8261.000Do not differ
Engagement indicator mean and intent to leave0.000.090.9291.000Do not differ

Pairs were compared on the engagement level form of every measure, each turned so that a higher value was the better outcome, on the 150 engagements where the indicator and all four measures existed. Of the 6 pairs, 0 differed after Holm control.

Clustering and Effective Sample Size

Not applicable. The field was recorded once per engagement, so every respondent in an engagement shared one value.

Equivalence Tests of Null Results

Table 17. Equivalence tests of null resultsTable
MeasurenrEquivalence boundTOST p, lowerTOST p, upperEquivalent to zeroAchieved powerMDE at power 0.80Detection floor for this n
Cancellation rate1500.12|r| < 0.30< 0.0010.010Yes0.960.230.23
Customer satisfaction940.02|r| < 0.30< 0.0010.003Yes0.840.290.23
Engagement indicator mean150−0.10|r| < 0.300.005< 0.001Yes0.960.230.23
Intent to leave7980.09|r| < 0.30< 0.001< 0.001Yes1.000.100.23

Tested null, equivalent to zero: cancellation rate, customer satisfaction, engagement indicator mean and intent to leave. No result was inconclusive. The detection floor column is the study floor at 150 engagements.

Robustness Checks

Table 18. Robustness checksTable
CheckMeasurePrimary rCheck r95% CIChangeConclusion holds
Rank correlation in place of PearsonCancellation rate0.120.13a0.02Yes
Rank correlation in place of PearsonCustomer satisfaction0.020.00a−0.02Yes
Rank correlation in place of PearsonEngagement indicator mean−0.10−0.12a−0.02Yes
Rank correlation in place of PearsonIntent to leave0.090.10a0.01No
Active engagements onlyEngagement indicator mean−0.10−0.05−0.25 to 0.160.05Yes
Active engagements onlyIntent to leave0.090.03−0.05 to 0.12−0.05Yes
Most influential engagement removed (largest Cook’s distance)Cancellation rate0.120.14−0.02 to 0.290.02Yes
Most influential engagement removed (largest Cook’s distance)Customer satisfaction0.020.05−0.15 to 0.250.03Yes
Most influential engagement removed (largest Cook’s distance)Engagement indicator mean−0.10−0.13−0.29 to 0.03−0.03Yes
Most influential engagement removed (largest Cook’s distance)Intent to leave0.090.130.06 to 0.200.04Yes
Engagements weighted by respondent countCancellation rate0.120.11a−0.01Yes
Engagements weighted by respondent countCustomer satisfaction0.020.03a0.01Yes
Engagements weighted by respondent countEngagement indicator mean−0.10−0.08a0.02Yes
Bootstrap of engagementsCancellation rate0.120.12−0.04 to 0.270.00Yes
Bootstrap of engagementsCustomer satisfaction0.020.02−0.18 to 0.210.00Yes
Bootstrap of engagementsEngagement indicator mean−0.10−0.10−0.25 to 0.060.00Yes
Bootstrap of engagementsIntent to leave0.090.09−0.07 to 0.240.00Yes
Thin-base segments removedCancellation rate0.120.11−0.11 to 0.32−0.01Yes
Thin-base segments removedCustomer satisfaction0.020.05−0.23 to 0.310.03Yes
Thin-base segments removedEngagement indicator mean−0.10−0.10−0.31 to 0.120.00Yes
Thin-base segments removedIntent to leave0.090.06−0.04 to 0.15−0.03Yes
Note: a No interval for this check.

Each change was computed before rounding, so it can differ by 0.01 from the difference of the two printed values.

Checks that did not hold: “Rank correlation in place of Pearson” on intent to leave. A check holds when its test lands on the same side of 0.05 as the primary test and, where the primary test is below 0.05, its r keeps the primary sign. Thin-base rule: engagements in any level under 30 engagements of outsourcing model or process family removed. Institution type is not used, because every one of its levels is under 30.

Measure Independence and Part-Whole Correction

Each of the four measures was computed from data this indicator does not contain, so each result is a finding rather than an arithmetic consequence.

Comparison with the Study Norm

Table 19. Comparison with the study normTable
MeasureThis indicator, oriented rStudy median, oriented rDeviationFisher zpHolm p
Cancellation rate−0.120.60−0.71−9.77< 0.001< 0.001
Customer satisfaction−0.110.72−0.83−12.35< 0.001< 0.001
Engagement indicator mean−0.100.84−0.94−15.87< 0.001< 0.001
Intent to leave−0.100.71−0.82−12.05< 0.001< 0.001
Spread of deviations0.22
VerdictDIVERGENT

Each deviation was computed before rounding, so it can differ by 0.01 from the difference of the two printed values.

The comparison ran on 150 engagements. The indicator departed from the study’s typical pattern on cancellation rate, customer satisfaction, engagement indicator mean and intent to leave.

Comparison of Written Sentiment with Indicators of the Four Parts

Figure 4. Share of negative written responses, indicators of the four Parts with 30 or more scored responses (n = 101 indicators)Exhibit
0%10%20%30%40%50%60%70%80%90%100%110%120%C044C052C053C128C209C205C203C199C211C159C132C152C105C098C126C148C108C122C116C021C096C149C112C173C097C113C139C201C109C157C101C172C158C213C095C094C138C187C100C106C127C195C111C186C176C110C143C144C175C207C102C196C145C103C133C124C125C020C115C130C189C168C182C164C049C178C123C141C188C147C179C137C160C120This indicator,69.70% of 33ENG:HeadcountC018C174C181C104C161C165C183C092C129C185C136C017C190C012C035C212C036C171C071ENG:Use CaseC200C080C206C014C069C084Median of the 101 indicators (dashed line)
Note: Each column is one indicator, ordered from the highest share of negative responses. The indicator is shown in amber. The dashed line marks the median share across the 101 indicators, 79.55%.

The peer set comprised 101 indicators of the four Parts with 30 or more scored responses. The indicator was within the peer set. Its share of negative responses ranked 75 of 101 from the highest. Its mean written score (−3.5, n = 33 responses) ranked 67 of 101 from the most negative. The peer median of the mean written score was −4.6 across the 101 indicators.

Co-Occurring Indicators and Themes

Figure 5. Other indicators and themes coded in the same written responses (n = 33 responses)Exhibit
Theme: Normalised into the process2 (6.06%)Theme: Workaround is a habit, not a control2 (6.06%)Theme: Schema or format changed without notice2 (6.06%)Theme: Detection only by failure2 (6.06%)Theme: Competence, pride or technicalachievement2 (6.06%)Theme: Pay2 (6.06%)C1093 (9.09%)C1483 (9.09%)Theme: Team or colleagues3 (9.09%)C0214 (12.12%)C0805 (15.15%)C1225 (15.15%)C1236 (18.18%)
Note: Gray bars are other indicators coded in the same responses. Amber bars are themes of the coding rulebook, which carry no score. Shares are of the 33 responses coded to the indicator. Every co-coded indicator and every theme at or above the fifth-highest count of its kind is shown, ties included. C040, the twin of the indicator under rule 6.6 of the coding rulebook, records the same fact and is not shown (coded in 33 of the 33 responses). C123: “Rate the adequacy of your employer’s investment in training its workforce.” C080: “My manager is effective.” C122: “Rate your employer’s current supply of qualified agentic AI talent against what its engagements need.” C021: “How likely are members of your current team to leave their jobs in the next 12 months?” C109: “Rate how quickly the customer responds when this engagement raises issues that need customer action.” C148: “Rate how well joint human review capacity keeps up with the volume of output the agents produce.” Emotional states coded in the same responses, as counts: tired 2, stressed 2, angry 1 and frustrated 1.

The indicator’s twin, C040, records the same fact under the coding rulebook’s twin rule. The twin was coded in all 33 responses coded to the indicator. The twin is left out of the counts that follow. The responses coded to the indicator were most often also coded to “Rate the adequacy of your employer’s investment in training its workforce” (C123, 6 responses). The second-highest count was shared by “My manager is effective” (C080, 5 responses) and “Rate your employer’s current supply of qualified agentic AI talent against what its engagements need” (C122, 5 responses). The most frequent theme of the coding rulebook in the same responses was “Team or colleagues” (3 responses).

Interpretation of the Data

Client servicing and communications engagements had the largest headcount (mean 9.3, n = 16 engagements), and Corporate and back-office functions engagements had the smallest (mean 7.4, n = 47 engagements). LOB Operational engagements were staffed larger (mean 9.0, n = 76 engagements) than Corporate Functional engagements (mean 7.7, n = 74 engagements). Headcount varied with the kind of work without any association with the four study measures.

The indicator is an engagement field, so the written responses were not set against a rating. Written responses were voluntary. They recorded what the respondents who wrote reported, and how common it was is measured by the recorded values.

Limitations

The evidence is reported experience: what the delivery team said about its own engagement, gathered in one cross-section. The figures showed associations, not causes. Indicators about the financial institution were reported at second hand by vendor staff. Cancellation is a descriptive contrast, because canceled engagements were rated after they ended.

Segment levels at anecdote strength were Private equity and private capital, Credit, underwriting and suitability, Regulatory, audit, tax and legal, and Financial crime and client onboarding (n = 9, n = 9, n = 9, n = 7). 20 of 21 checks held. The rank correlation on intent to leave did not hold.

Shares of written sentiment were shares of responses, not of the study set of respondents. The written score took five fixed values, so its mean and median were coarse. Responses clustered within engagements. Intervals for written sentiment used a bootstrap by engagement. Coding was performed by AI coders under a fixed rulebook. Agreement on whether a response was coded to the indicator rested on 1 response second-coded under rulebook 0.5, with the coders agreeing on 1 of 1. Agreement on the score rested on 3 responses second-scored under rulebook 0.6, with the scores agreeing in 3 of 3. These bases of second-coded responses are too small for an indicator-level alpha.

Definitions

Table 20. DefinitionsTable
TermDefinition
Response scaleAs recorded, shown in Table 1. The indicator is not a rating, so no distressed range is defined.
Answering baseThe engagements on which the value is recorded.
Non-answersNone. The value is recorded for every engagement.
Indicator classEngagement attribute: a property of the engagement rather than of the respondent.
Failure categoryOne of the five failure categories of the Study Taxonomy, section 3. Only the 100 rated indicators carry one, and the indicator is not among them.
Engagement indicator meanThe mean of an engagement’s 100 indicator ratings.
Written responseA coded written answer about the respondent’s own engagement. Non-answers and answers about another engagement are excluded.
Primary and secondaryThe indicator is an engagement field with no survey section of its own. Every written response coded to it therefore answered a question in a survey section and was counted as a secondary response, coded to the indicator because its content addressed it.
Written sentiment scaleFive fixed values of the coding rulebook: −10, −5, 0, +5, +10. The sign is the direction and the magnitude is the strength.
CodingResponses were coded under rulebook 0.5. Scores were added under rulebook 0.6 to every mark and every quote, with the score rulings of rulebook section 21. AI coders worked under a fixed rulebook. A sample of records was second-coded. Score agreement across all indicators was Krippendorff’s alpha 0.969 on the 0.5 scores and 0.930 on the scores added in 0.6.

Sources and Provenance

Table 21. Sources and provenanceTable
ItemValue
Study dataStudy Data.xlsx, Engagements sheet, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record ENG:Headcount, sha256 e405f65a43e37a6e
ComputedOctober 8, 2026, 01:38 UTC
TemplateIndicator Statistical Analysis Template, version 1.1 of 2026-10-06
Figures placed by script1,714 of 1,714
Study metadataStudy Meta.md, sections 10.4 and 10.4.1, coder agreement across all indicators
Coded written responsesQuotes Master.jsonl, sha256 27da38085e2b13fd. Quote Coding Rulebook, version 0.6 with section 21
Written-response computationqa_stats.py, sha256 74a61f3a96169da9. wfacts.py, sha256 b85fae20adf812a1. prose_gen.py, sha256 c277d2c752f8d88f. build_indicator.py, sha256 da3473bd56a4a7b9
Written-response recordsENG_Headcount.qa.json, sha256 d901fa567a63a65c. ENG_Headcount.wfacts.json, sha256 16704b1761146ab5. Prose ENG_Headcount.json, sha256 0cf487fbf6d4817c

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →