Study Data · Part 1 · Indicator Deep-Dive Analysis

How long ago did this specific engagement start, in months?

Indicator C035 · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeC035
Question as askedHow long ago did this specific engagement start, in months?
Failure categoryNot one of the 100 rated indicators
Place in the surveyEngagement Details > 2.2 Timeline and Status > Timeline
Indicator classEngagement attribute
Indicator typeTyped number
Response scaleA number, as typed or recorded
Answering base804 of 850 respondents, across 150 of 150 engagements
Non-answersI do not know 0, I prefer to not answer 0, blank 46
Engagements sheet twinAge of Engagement (Months)
Written responses coded to the indicator73 responses from 69 respondents on 48 engagements (0 primary, 73 secondary)

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureFormnr95% CIp
Cancellation rateDescriptive contrast150 engagements−0.08−0.24 to 0.080.327
Customer satisfactionClean estimate94 engagements0.09−0.11 to 0.290.374
Engagement indicator meanFull150 engagements0.12−0.04 to 0.280.142
Intent to leaveRespondent level, clustered756 respondents−0.09−0.26 to 0.080.303

Respondents reported a mean engagement age in months since the engagement started (mean 5.6, median 5.0, n = 804 respondents). The association with cancellation was equivalent to zero (TOST p 0.003). Customer satisfaction on active engagements showed the same tested null (TOST p 0.019). The association with the engagement indicator mean was also equivalent to zero (TOST p 0.011). Intent to leave among respondents returned a tested null as well (TOST p 0.005). Engagement age differed after Holm control by class of work (Welch F 9.44, Holm p 0.013, omega squared 0.053), by engagement status and lifecycle stage (Welch F 68.56, Holm p < 0.001, omega squared 0.399), and by vendor type (Welch F 10.49, Holm p < 0.001, omega squared 0.028).

The indicator had 73 written responses coded to it, from 69 of 850 respondents on 48 of 150 engagements. Negative responses numbered 22 of the 73 scored responses (30.14%). The strongest negative score, −10, was carried by 6 of the 73 scored responses (8.22%). Every response was a secondary response, written in answer to a question outside the indicator’s own survey section.

Distribution of Responses

Table 3. Distribution of responses, respondent levelTable
AnswerRespondentsShare of answered (base 804)Cumulative shareEngagements with at least oneShare of 150 engagementsDistressed
1.0 to 3.127834.58%34.58%5033.33%Not applicable
3.1 to 5.220625.62%60.20%3825.33%Not applicable
5.2 to 7.313216.42%76.62%2516.67%Not applicable
7.3 to 9.49511.82%88.43%1912.67%Not applicable
9.4 to 11.5445.47%93.91%85.33%Not applicable
11.5 to 13.650.62%94.53%10.67%Not applicable
13.6 to 15.7202.49%97.01%42.67%Not applicable
15.7 to 17.881.00%98.01%21.33%Not applicable
17.8 to 19.960.75%98.76%10.67%Not applicable
19.9 to 22.0101.24%100.00%21.33%Not applicable
I do not know0Not in baseNot in base00.00%Not applicable
I prefer to not answer0Not in baseNot in base00.00%Not applicable
Answered, total804100.00%150100.00%
Table 4. Distribution of responses, engagement levelTable
Engagement level summaryEngagementsMean of engagement meansSDMinMedianMaxEngagements with a distressed meanShare of engagements distressed
Engagement means, as recorded1505.73.91.05.022.0Not applicableNot applicable

The study set mean was 5.6 on 804 answering respondents, with a median of 5.0.

Coverage and Origin of Written Responses

Figure 1. Written responses coded to the indicator, by the question answered and by written score (n = 73 responses)Exhibit
05101520C177 (secondary)C216 (secondary)C208 (secondary)C202 (secondary)C204 (secondary)C135 (secondary)3C030 (secondary)33C210 (secondary)33C198 (secondary)36C114 (secondary)12C156 (secondary)412Written responses−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Primary responses were written in answer to a written-answer question in the indicator’s own survey section. Secondary responses were written in answer to a question outside that section and coded to the indicator because their content addressed it. Segments run from −10, strongly negative, in full amber at the left to +10, strongly positive, in the darkest gray at the right. Segments of 3 or more responses are labeled with their count where the drawn segment can hold the label. C156 asked: “Add any comments on the joint management of this engagement that the ratings in this section do not capture.” C114 asked: “Add any comments on the customer organization that the ratings in this section do not capture.” C198 asked: “Add any comments on the third-party ecosystem that the ratings in this section do not capture.” C210 asked: “Comment.” C030 asked: “What are the top 3 things that you love most about your job?” C135 asked: “Add any comments on your employer that the ratings in this section do not capture.” C204 asked: “Comment.” C202 asked: “Why did you alter client provided data?” C208 asked: “Why did you alter client processes?” C216 asked: “Comment.” C177 asked: “Add any comments on the agentic AI tools that the ratings in this section do not capture.”
Table 5. Written responses by originTable
OriginResponsesRespondentsEngagementsNegativeStrongest negative (−10)PositiveMean written score
Primary000a
Secondary73694822 of 73 (30.14%)6 of 73 (8.22%)6 of 73 (8.22%)−1.5
All responses73694822 of 73 (30.14%)6 of 73 (8.22%)6 of 73 (8.22%)−1.5
Note: a No scored responses.

All 73 responses were secondary responses. The secondary responses came from 69 respondents on 48 engagements, in answer to 11 questions outside the indicator’s own survey section (most often C156 with 17 responses, C114 with 15 responses and C198 with 11 responses). Among the Part 1 indicators with 30 or more scored responses, the secondary share of the indicator ranked 1 of 6 from the highest, tied with 4 other indicators. The median secondary share was 100.00% across the 6 indicators.

Distribution of Written Sentiment

Figure 2. Distribution of written sentiment (n = 73 scored responses)Exhibit
6 (8.22%)−10 Stronglynegative16 (21.92%)−5 Negative45 (61.64%)0 Neutral6 (8.22%)+5 Positive0 (0.00%)+10 Stronglypositive
Note: Column height is the share of all scored responses. Labels give the count and the share.
Table 6. Summary statistics of written sentimentTable
StatisticValueBasis
Mean written score−1.595% CI −2.5 to −0.6, cluster bootstrap by engagement, 10,000 draws, n = 73 responses
Median written score0.0n = 73 responses
Negative responses22 of 73 (30.14%)95% CI 19.44% to 42.03% of 73 responses, cluster bootstrap by engagement
Strongest negative responses (−10)6 of 73 (8.22%)Statements of totality, constancy or serious harm
Positive responses6 of 73 (8.22%)+5 or +10
Net balance−21.92 percentage pointsShare positive minus share negative, base 73 responses
Respondent-level mean−1.5Mean of each respondent’s own mean written score, n = 69 respondents

The indicator has no good or bad end. Under the coding rulebook’s rule for such indicators, the written score records the effect each response states on the engagement or on the respondent. The survey question is “How long ago did this specific engagement start, in months?” The frequency, scope and consequence a response states set the strength of its score. A score of +10 marks a response that describes “this attribute of the engagement as helping the engagement at its best.” A score of −10 marks a response that describes “this attribute as harming the engagement at its worst . . . .”

Of the 73 scored responses, 22 (30.14%) were negative, 6 (8.22%) carried the strongest negative score and 6 (8.22%) were positive. The responses had a mean written score of −1.5 (95% CI −2.5 to −0.6, n = 73 responses on 48 engagements).

Descriptive Statistics by Segment

Table 7a. Descriptive statistics by segment, part 1 of 2Table
SegmentBaseAnsweredAnswer rateEngagementsMean95% CISD
Study set85080494.59% of 8501505.65.3 to 5.93.8
Outsourcing model
CXM23222094.83% of 232425.44.9 to 6.04.3
ITO24423094.26% of 244405.44.9 to 5.94.1
BPO20919894.74% of 209375.95.5 to 6.32.8
KPO16515694.55% of 165315.75.1 to 6.33.8
Institution type
Asset management13212796.21% of 132246.65.8 to 7.34.4
Wealth management and private banking14012992.14% of 140235.04.5 to 5.42.4
Investment banking (advisory and capital-markets origination)1059994.29% of 105196.95.7 to 8.15.9
Insurance (life, property and casualty, health)787697.44% of 78145.04.3 to 5.73.1
Commercial and business banking827793.90% of 82135.14.4 to 5.72.8
Payments and merchant acquiring (networks, acquiring, processing)716794.37% of 71135.54.8 to 6.22.9
Credit card and payments issuing736690.41% of 73124.73.8 to 5.63.8
Retail and consumer banking737197.26% of 73126.05.1 to 6.93.9
Markets and trading (sales and trading, global markets)575698.25% of 57114.84.3 to 5.21.7
Private equity and private capital393692.31% of 3995.33.9 to 6.84.2
Process family
Corporate and back-office functions24823795.56% of 248475.24.8 to 5.52.8
Technology engineering and operations20419394.61% of 204354.64.2 to 5.13.2
Client servicing and communications948994.68% of 94167.46.4 to 8.55.1
Trade, settlement and reconciliation807593.75% of 80158.16.8 to 9.55.8
Payments, cards and disputes736690.41% of 73125.54.5 to 6.64.2
Credit, underwriting and suitability575392.98% of 5794.13.5 to 4.82.3
Regulatory, audit, tax and legal5151100.00% of 5195.14.5 to 5.72.1
Financial crime and client onboarding434093.02% of 4376.55.6 to 7.32.7
Class of work
LOB Operational45142594.24% of 451766.56.1 to 6.94.3
Corporate Functional39937994.99% of 399744.64.3 to 4.92.9
Engagement status and lifecycle stage
Active, Build-Out17516192.00% of 175312.72.6 to 2.80.9
Active, Transition/Cut-Over25024196.40% of 250435.75.5 to 5.81.3
Active, Production1039895.15% of 1032011.410.7 to 12.13.7
Canceled32230494.41% of 322565.24.7 to 5.64.1
Respondent role
Individual Contributor66762193.10% of 6671505.55.2 to 5.83.7
Engagement Manager150150100.00% of 1501505.75.1 to 6.33.9
Portfolio Director3131100.00% of 31316.04.5 to 7.54.1
Customer Management Executive222 of 22‡
Vendor type
IT services major31629894.30% of 316596.15.7 to 6.53.6
BPO specialist19818995.45% of 198374.84.4 to 5.22.7
Consulting firm11711094.02% of 117236.15.1 to 7.25.5
Boutique or specialist provider878091.95% of 87176.35.3 to 7.44.9
Pure-play agentic AI firm757296.00% of 75144.23.8 to 4.61.7
Not reported, recovered by engagement575596.49% of 57465.44.4 to 6.43.7
Note: ‡ Base under 10. No statistic is reported.
Table 7b. Descriptive statistics by segment, part 2 of 2Table
SegmentMinQ1MedianQ3MaxDistressed nDistressed %
Study set1.03.05.07.022.0Not applicableNot applicable
Outsourcing model
CXM1.03.04.06.019.0Not applicableNot applicable
ITO1.02.34.07.022.0Not applicableNot applicable
BPO1.04.06.08.014.0Not applicableNot applicable
KPO1.04.05.07.022.0Not applicableNot applicable
Institution type
Asset management1.03.06.09.019.0Not applicableNot applicable
Wealth management and private banking2.03.05.06.010.0Not applicableNot applicable
Investment banking (advisory and capital-markets origination)2.03.05.07.022.0Not applicableNot applicable
Insurance (life, property and casualty, health)1.03.04.08.011.0Not applicableNot applicable
Commercial and business banking1.03.04.08.010.0Not applicableNot applicable
Payments and merchant acquiring (networks, acquiring, processing)2.04.05.06.014.0Not applicableNot applicable
Credit card and payments issuing2.03.03.04.015.0Not applicableNot applicable
Retail and consumer banking2.03.04.09.014.0Not applicableNot applicable
Markets and trading (sales and trading, global markets)2.04.05.06.07.0Not applicableNot applicable
Private equity and private capital1.03.05.07.017.0Not applicableNot applicable
Process family
Corporate and back-office functions1.03.04.07.015.0Not applicableNot applicable
Technology engineering and operations1.03.03.06.017.0Not applicableNot applicable
Client servicing and communications2.03.07.010.019.0Not applicableNot applicable
Trade, settlement and reconciliation3.05.07.09.022.0Not applicableNot applicable
Payments, cards and disputes1.02.04.08.014.0Not applicableNot applicable
Credit, underwriting and suitability1.03.04.05.09.0Not applicableNot applicable
Regulatory, audit, tax and legal2.04.05.06.010.0Not applicableNot applicable
Financial crime and client onboarding2.05.06.09.010.0Not applicableNot applicable
Class of work
LOB Operational1.03.06.08.022.0Not applicableNot applicable
Corporate Functional1.03.04.06.017.0Not applicableNot applicable
Engagement status and lifecycle stage
Active, Build-Out1.02.03.03.04.0Not applicableNot applicable
Active, Transition/Cut-Over4.05.06.07.08.0Not applicableNot applicable
Active, Production8.09.010.014.022.0Not applicableNot applicable
Canceled1.02.04.07.022.0Not applicableNot applicable
Respondent role
Individual Contributor1.03.05.07.022.0Not applicableNot applicable
Engagement Manager1.03.05.07.022.0Not applicableNot applicable
Portfolio Director2.03.05.07.017.0Not applicableNot applicable
Customer Management Executive‡ n = 2
Vendor type
IT services major1.03.06.08.017.0Not applicableNot applicable
BPO specialist1.03.04.06.014.0Not applicableNot applicable
Consulting firm1.03.04.06.022.0Not applicableNot applicable
Boutique or specialist provider2.03.04.08.019.0Not applicableNot applicable
Pure-play agentic AI firm1.03.05.05.07.0Not applicableNot applicable
Not reported, recovered by engagement1.03.05.06.519.0Not applicableNot applicable
Note: ‡ Base under 10. No statistic is reported.

Figures are respondent level. Means are on the scale as recorded. A level under 30 prints no interval and a level under 10 prints counts only.

Tests of Difference Between Segments

Table 8a. Tests of difference between segments, part 1 of 2Table
Segment familyWelch FdfpHolm pOmega squared90% CI
Outsourcing model0.133, 78.60.9411.000−0.0180.000 to 0.000
Institution type0.678, 50.00.7191.000−0.0110.000 to 0.057
Process family1.804, 35.40.1510.6020.0620.009 to 0.157
Class of work9.441, 132.40.0030.0130.0530.013 to 0.129
Engagement status and lifecycle stage68.563, 60.4< 0.001< 0.0010.3990.304 to 0.487
Respondent role0.282, 74.50.7541.000−0.0020.000 to 0.005
Vendor type10.495, 241.9< 0.001< 0.0010.0280.012 to 0.052
Table 8b. Tests of difference between segments, part 2 of 2Table
Segment familyKruskal-Wallis HpDistressed chi-squaredfpCramer’s VLevels left out
Outsourcing model3.730.292Not applicableNot applicableNone
Institution type4.050.852Not applicableNot applicablea
Process family10.190.037Not applicableNot applicableb
Class of work8.650.003Not applicableNot applicableNone
Engagement status and lifecycle stage71.15< 0.001Not applicableNot applicableNone
Respondent role0.370.830Not applicableNot applicablec
Vendor type18.550.002Not applicableNot applicableNone
Note: a Private equity and private capital, n = 9. b Credit, underwriting and suitability, n = 9, Regulatory, audit, tax and legal, n = 9, Financial crime and client onboarding, n = 7. c Customer Management Executive, n = 2.

Engagement families were tested on engagement means, and respondent role and vendor type were tested on respondents. A distressed p marked exact is a Fisher exact test for a two by two table, and one marked simulated is a Monte Carlo test run until its p is stable to the third decimal, both used where an expected count is under 5. Class of work differed after Holm control (Welch F 9.44, Holm p 0.013, tested on engagement means). In Descriptive Statistics by Segment, LOB Operational had the highest mean, 6.5 (n = 425 respondents), and Corporate Functional the lowest, 4.6 (n = 379 respondents). Engagement status and lifecycle stage differed after Holm control (Welch F 68.56, Holm p < 0.001, tested on engagement means). In Descriptive Statistics by Segment, Active, Production had the highest mean, 11.4 (n = 98 respondents), and Active, Build-Out the lowest, 2.7 (n = 161 respondents). Vendor type differed after Holm control (Welch F 10.49, Holm p < 0.001, tested on respondents). In Descriptive Statistics by Segment, Boutique or specialist provider had the highest mean, 6.3 (n = 80 respondents), and Pure-play agentic AI firm the lowest, 4.2 (n = 72 respondents). No difference held after Holm control for outsourcing model, institution type, process family and respondent role.

Written Sentiment by Segment

Figure 3. Written sentiment by engagement status and lifecycle stage, share of each group’s responsesExhibit
0%25%50%75%100%Canceled (n = 31)16.13%25.81%54.84%Active, Production (n = 3)1 of 32 of 3Active, Transition/Cut-Over (n = 5)4 of 51 of 5Active, Build-Out (n = 34)79.41%All responses (n = 73)21.92%61.64%−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Segments run from −10, strongly negative, in full amber at the left to +10, strongly positive, in the darkest gray at the right. Each bar is 100% of its group’s responses. Segments of 12% or more are labeled, as a share on groups of 10 responses or more and as a count on smaller groups.
Table 9. Written sentiment by segmentTable
SegmentResponsesRespondentsEngagementsMean written scoreNegativeStrongest negative (−10)
Engagement status and lifecycle stage
Active, Build-Out343217−0.14 of 34 (11.76%)0 of 34 (0.00%)
Active, Transition/Cut-Over555‡4 of 50 of 5
Active, Production333‡1 of 31 of 3
Canceled312923−2.713 of 31 (41.94%)5 of 31 (16.13%)
Respondent role
Individual Contributor484534−1.917 of 48 (35.42%)6 of 48 (12.50%)
Engagement Manager201919−0.84 of 20 (20.00%)0 of 20 (0.00%)
Portfolio Director555‡1 of 50 of 5
Customer Management Executive000No responses
Note: ‡ Base under 10. No statistic is reported.

Scored responses came from 17 engagements in the Active, Build-Out group, 5 engagements in the Active, Transition/Cut-Over group, 3 engagements in the Active, Production group and 23 engagements in the Canceled group. A test of mean written scores across the groups, with each engagement counted once, showed a difference that reached significance at 0.05 (Kruskal-Wallis H 9.03, df 3, p = 0.029, n = 48 engagements). Of the two groups with 10 or more responses, the lower mean written score came from the Canceled group (−2.7, n = 31 responses). The higher came from the Active, Build-Out group (−0.1, n = 34 responses). Groups under 10 responses are reported as counts only. Negative responses numbered 4 of 5 in the Active, Transition/Cut-Over group and 1 of 3 in the Active, Production group.

Across respondent roles, no test was run, because fewer than two roles reached 30 scored responses. Roles under 10 responses are reported as counts only. Among portfolio directors, negative responses numbered 1 of 5.

Association with Cancellation Rate

The share of engagements canceled on the study date, measured at engagement level (base 150 engagements, 56 canceled). The association is a descriptive contrast, inflated because canceled engagements were rated after cancellation, and is not predictive.

Table 10a. Association with cancellation rate by segment, part 1 of 2Table
SegmentEngagementsCanceledCancellation ratePoint-biserial r95% CIpHolm p
Study set1505637.33% of 150−0.08−0.24 to 0.080.3271.000
Outsourcing model
CXM421535.71% of 42−0.09−0.39 to 0.220.5631.000
ITO401537.50% of 40−0.03−0.34 to 0.280.8501.000
BPO371437.84% of 37−0.15−0.45 to 0.180.3761.000
KPO311238.71% of 31−0.09−0.43 to 0.280.6481.000
Institution type
Asset management241354.17% of 24−0.18†0.3891.000
Wealth management and private banking23834.78% of 23−0.20†0.3711.000
Investment banking (advisory and capital-markets origination)19947.37% of 190.00†0.9971.000
Insurance (life, property and casualty, health)14535.71% of 140.33†0.2431.000
Commercial and business banking13430.77% of 130.28†0.3631.000
Payments and merchant acquiring (networks, acquiring, processing)13323.08% of 13−0.08†0.7951.000
Credit card and payments issuing12541.67% of 12−0.43†0.1621.000
Retail and consumer banking12433.33% of 12−0.12†0.7081.000
Markets and trading (sales and trading, global markets)11327.27% of 11−0.42†0.2031.000
Private equity and private capital922 of 9‡
Process family
Corporate and back-office functions471940.43% of 47−0.25−0.50 to 0.040.0881.000
Technology engineering and operations351028.57% of 35−0.24−0.53 to 0.100.1691.000
Client servicing and communications16956.25% of 160.07†0.7901.000
Trade, settlement and reconciliation15853.33% of 15−0.05†0.8601.000
Payments, cards and disputes12216.67% of 12−0.36†0.2531.000
Credit, underwriting and suitability911 of 9‡
Regulatory, audit, tax and legal944 of 9‡
Financial crime and client onboarding733 of 7‡
Class of work
LOB Operational763039.47% of 760.00−0.23 to 0.230.9981.000
Corporate Functional742635.14% of 74−0.24−0.45 to −0.020.0350.744
Engagement status and lifecycle stage
Active, Build-Out3100.00% of 31Not computable, no variation in cancellation
Active, Transition/Cut-Over4300.00% of 43Not computable, no variation in cancellation
Active, Production2000.00% of 20Not computable, no variation in cancellation
Canceled5656100.00% of 56Not computable, no variation in cancellation
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 10b. Association with cancellation rate by segment, part 2 of 2Table
SegmentOdds ratio per point95% CIAUCRate, distressed engagementsRate, other engagementsFisher pTOST p
Study set0.960.87 to 1.050.59Not applicableNot applicableNot applicable0.003
Outsourcing model
CXM0.950.81 to 1.120.66Not applicableNot applicableNot applicable0.087
ITO0.990.85 to 1.140.59Not applicableNot applicableNot applicable0.045
BPO0.890.70 to 1.140.59Not applicableNot applicableNot applicable0.178
KPO0.950.77 to 1.170.53Not applicableNot applicableNot applicable0.118
Institution type
Asset management0.92† n = 240.66Not applicableNot applicableNot applicable0.286
Wealth management and private banking0.84† n = 230.63Not applicableNot applicableNot applicable0.310
Investment banking (advisory and capital-markets origination)1.00† n = 190.51Not applicableNot applicableNot applicable0.109
Insurance (life, property and casualty, health)1.28† n = 140.68Not applicableNot applicableNot applicable0.550
Commercial and business banking1.24† n = 130.63Not applicableNot applicableNot applicable0.466
Payments and merchant acquiring (networks, acquiring, processing)0.93† n = 130.60Not applicableNot applicableNot applicable0.234
Credit card and payments issuing0.48† n = 120.76Not applicableNot applicableNot applicable0.676
Retail and consumer banking0.93† n = 120.52Not applicableNot applicableNot applicable0.287
Markets and trading (sales and trading, global markets)0.55† n = 110.69Not applicableNot applicableNot applicable0.647
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functions0.800.62 to 1.040.64Not applicableNot applicableNot applicable0.364
Technology engineering and operations0.800.58 to 1.110.68Not applicableNot applicableNot applicable0.352
Client servicing and communications1.03† n = 160.51Not applicableNot applicableNot applicable0.196
Trade, settlement and reconciliation0.98† n = 150.54Not applicableNot applicableNot applicable0.184
Payments, cards and disputes0.38† n = 120.85Not applicableNot applicableNot applicable0.578
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB Operational1.000.90 to 1.110.53Not applicableNot applicableNot applicable0.004
Corporate Functional0.800.64 to 0.990.65Not applicableNot applicableNot applicable0.308
Engagement status and lifecycle stage
Active, Build-OutNot computable, no variation in cancellation
Active, Transition/Cut-OverNot computable, no variation in cancellation
Active, ProductionNot computable, no variation in cancellation
CanceledNot computable, no variation in cancellation
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was −0.08 (95% CI −0.24 to 0.08, Holm p 1.000, n = 150 engagements). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 20 tested segment levels, 0 held after Holm control.

Association with Customer Satisfaction

The satisfaction score recorded against each engagement on a 100-point scale. The primary estimate uses the 94 active engagements. A descriptive contrast uses all 150 engagements.

Table 11a. Association with customer satisfaction by segment, part 1 of 2Table
SegmentActive engagementsClean r95% CIpHolm pSpearman rhop
Study set940.09−0.11 to 0.290.3741.0000.090.378
Outsourcing model
CXM270.45†0.0200.3370.420.031
ITO250.14†0.5041.0000.080.721
BPO23−0.02†0.9201.000−0.040.871
KPO19−0.30†0.2061.000−0.390.103
Institution type
Asset management110.33†0.3281.0000.300.377
Wealth management and private banking150.01†0.9591.0000.050.865
Investment banking (advisory and capital-markets origination)10−0.30†0.4021.000−0.260.468
Insurance (life, property and casualty, health)9‡
Commercial and business banking9‡
Payments and merchant acquiring (networks, acquiring, processing)100.47†0.1661.0000.230.530
Credit card and payments issuing7‡
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)8‡
Private equity and private capital7‡
Process family
Corporate and back-office functions28−0.05†0.8001.000−0.070.726
Technology engineering and operations250.21†0.3121.0000.210.325
Client servicing and communications7‡
Trade, settlement and reconciliation7‡
Payments, cards and disputes100.38†0.2811.0000.150.685
Credit, underwriting and suitability8‡
Regulatory, audit, tax and legal5‡
Financial crime and client onboarding4‡
Class of work
LOB Operational460.07−0.22 to 0.350.6431.0000.080.620
Corporate Functional480.14−0.15 to 0.410.3391.0000.110.439
Engagement status and lifecycle stage
Active, Build-Out31−0.12−0.45 to 0.250.5221.000−0.060.758
Active, Transition/Cut-Over430.04−0.26 to 0.340.7981.0000.050.757
Active, Production20−0.02†0.9411.0000.060.806
Canceled0a
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a No clean estimate, canceled engagements fall outside the active population.
Table 11b. Association with customer satisfaction by segment, part 2 of 2Table
SegmentSlope, points per rating point95% CIR squaredTOST pAll engagementsDescriptive rp
Study set0.29−0.35 to 0.930.010.0191500.100.237
Outsourcing model
CXM1.49† n = 270.200.797420.200.203
ITO0.39† n = 250.020.215400.040.802
BPO−0.08† n = 230.000.099370.150.391
KPO−0.86† n = 190.090.50631−0.020.901
Institution type
Asset management0.77† n = 110.110.532240.200.356
Wealth management and private banking0.06† n = 150.000.153230.160.464
Investment banking (advisory and capital-markets origination)−0.57† n = 100.090.49819−0.070.763
Insurance (life, property and casualty, health)‡ n = 9
Commercial and business banking‡ n = 9
Payments and merchant acquiring (networks, acquiring, processing)2.16† n = 100.230.708130.250.416
Credit card and payments issuing‡ n = 7
Retail and consumer banking‡ n = 8
Markets and trading (sales and trading, global markets)‡ n = 8
Private equity and private capital‡ n = 7
Process family
Corporate and back-office functions−0.21† n = 280.000.097470.230.125
Technology engineering and operations0.62† n = 250.040.327350.300.076
Client servicing and communications‡ n = 7
Trade, settlement and reconciliation‡ n = 7
Payments, cards and disputes0.92† n = 100.140.592120.470.120
Credit, underwriting and suitability‡ n = 8
Regulatory, audit, tax and legal‡ n = 5
Financial crime and client onboarding‡ n = 4
Class of work
LOB Operational0.23−0.75 to 1.200.000.058760.020.888
Corporate Functional0.44−0.48 to 1.360.020.130740.270.022
Engagement status and lifecycle stage
Active, Build-Out−1.25−5.20 to 2.700.010.15831−0.120.522
Active, Transition/Cut-Over0.40−2.73 to 3.540.000.044430.040.798
Active, Production−0.06†0.000.11420−0.020.941
Canceledno clean estimate, canceled engagements fall outside the active population
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was 0.09 (95% CI −0.11 to 0.29, Holm p 1.000, n = 94 engagements). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 16 tested segment levels, 0 held after Holm control.

Association with the Engagement Indicator Mean

The mean of an engagement’s 100 indicator ratings, measured at engagement level (base 150 engagements). Where this indicator is one of the 100, the mean is recomputed without it.

Table 12a. Association with the engagement indicator mean by segment, part 1 of 2Table
SegmentEngagementsLeave-one-out r95% CIpHolm pSpearman rhop
Study set1500.12−0.04 to 0.280.1421.0000.110.161
Outsourcing model
CXM420.18−0.13 to 0.460.2531.0000.250.113
ITO400.21−0.11 to 0.490.1881.0000.270.097
BPO370.05−0.28 to 0.370.7851.0000.030.880
KPO310.02−0.34 to 0.370.9331.000−0.090.639
Institution type
Asset management240.31†0.1381.0000.350.095
Wealth management and private banking230.15†0.4921.0000.110.629
Investment banking (advisory and capital-markets origination)190.35†0.1441.0000.290.222
Insurance (life, property and casualty, health)14−0.21†0.4791.000−0.200.492
Commercial and business banking13−0.33†0.2691.000−0.190.538
Payments and merchant acquiring (networks, acquiring, processing)130.26†0.3911.0000.030.914
Credit card and payments issuing120.10†0.7491.0000.360.252
Retail and consumer banking12−0.12†0.7161.000−0.260.419
Markets and trading (sales and trading, global markets)110.20†0.5501.0000.030.924
Private equity and private capital9‡
Process family
Corporate and back-office functions470.04−0.25 to 0.320.7841.0000.090.537
Technology engineering and operations350.29−0.05 to 0.570.0951.0000.350.039
Client servicing and communications160.16†0.5611.0000.150.582
Trade, settlement and reconciliation150.25†0.3641.0000.260.354
Payments, cards and disputes120.45†0.1441.0000.280.379
Credit, underwriting and suitability9‡
Regulatory, audit, tax and legal9‡
Financial crime and client onboarding7‡
Class of work
LOB Operational760.11−0.12 to 0.330.3471.0000.080.512
Corporate Functional740.17−0.06 to 0.380.1581.0000.180.122
Engagement status and lifecycle stage
Active, Build-Out310.05−0.31 to 0.390.8011.0000.050.774
Active, Transition/Cut-Over43−0.12−0.41 to 0.190.4371.000−0.110.478
Active, Production200.28†0.2341.0000.350.126
Canceled560.19−0.07 to 0.430.1531.000−0.010.940
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 12b. Association with the engagement indicator mean by segment, part 2 of 2Table
Segmentr with indicator includedChange in rSlope95% CIR squaredTOST pEquivalent
Study setNot a component0.05−0.02 to 0.110.010.011Yes
Outsourcing model
CXMNot a component0.07−0.05 to 0.190.030.213No
ITONot a component0.06−0.03 to 0.150.050.284No
BPONot a component0.02−0.14 to 0.180.000.063No
KPONot a component0.01−0.16 to 0.170.000.060No
Institution type
Asset managementNot a component0.11† n = 240.100.524No
Wealth management and private bankingNot a component0.09† n = 230.020.241No
Investment banking (advisory and capital-markets origination)Not a component0.06† n = 190.120.586No
Insurance (life, property and casualty, health)Not a component−0.10† n = 140.040.370No
Commercial and business bankingNot a component−0.17† n = 130.110.543No
Payments and merchant acquiring (networks, acquiring, processing)Not a component0.14† n = 130.070.445No
Credit card and payments issuingNot a component0.03† n = 120.010.269No
Retail and consumer bankingNot a component−0.05† n = 120.010.283No
Markets and trading (sales and trading, global markets)Not a component0.17† n = 110.040.384No
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functionsNot a component0.02−0.15 to 0.200.000.038Yes
Technology engineering and operationsNot a component0.11−0.02 to 0.240.080.467No
Client servicing and communicationsNot a component0.05† n = 160.020.293No
Trade, settlement and reconciliationNot a component0.06† n = 150.060.429No
Payments, cards and disputesNot a component0.13† n = 120.200.698No
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB OperationalNot a component0.04−0.04 to 0.110.010.044Yes
Corporate FunctionalNot a component0.08−0.03 to 0.190.030.116No
Engagement status and lifecycle stage
Active, Build-OutNot a component0.05−0.38 to 0.490.000.083No
Active, Transition/Cut-OverNot a component−0.12−0.41 to 0.180.010.118No
Active, ProductionNot a component0.10† n = 200.080.462No
CanceledNot a component0.03−0.01 to 0.070.040.204No
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was 0.12 (95% CI −0.04 to 0.28, Holm p 1.000, n = 150 engagements). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 24 tested segment levels, 0 held after Holm control.

Association with Intent to Leave

The respondent’s stated likelihood of leaving the current job within 12 months, rated 1 to 10 (C019). Measured at respondent level on up to 798 respondents, with the engagement-level form reported alongside.

Table 13a. Association with intent to leave by segment, part 1 of 2Table
SegmentRespondentsr95% CICluster bootstrap 95% CIpHolm p
Study set756−0.09−0.16 to −0.02−0.26 to 0.080.0130.409
Outsourcing model
CXM204−0.17−0.30 to −0.03−0.53 to 0.170.0140.412
ITO2190.11−0.02 to 0.24−0.21 to 0.360.1061.000
BPO187−0.18−0.32 to −0.04−0.46 to 0.130.0130.412
KPO146−0.17−0.32 to −0.01−0.43 to 0.280.0421.000
Institution type
Asset management118−0.24−0.40 to −0.06−0.69 to 0.190.0090.302
Wealth management and private banking122−0.15−0.32 to 0.03−0.53 to 0.260.1051.000
Investment banking (advisory and capital-markets origination)92−0.02−0.23 to 0.18−0.50 to 0.480.8311.000
Insurance (life, property and casualty, health)690.06−0.18 to 0.29−0.56 to 0.540.6451.000
Commercial and business banking720.290.06 to 0.49−0.30 to 0.730.0130.412
Payments and merchant acquiring (networks, acquiring, processing)65−0.17−0.40 to 0.08−0.67 to 0.640.1811.000
Credit card and payments issuing63−0.16−0.40 to 0.09−0.57 to 0.200.1981.000
Retail and consumer banking66−0.07−0.31 to 0.17−0.65 to 0.500.5511.000
Markets and trading (sales and trading, global markets)54−0.19−0.44 to 0.08−0.72 to 0.640.1601.000
Private equity and private capital35−0.65−0.81 to −0.40§ n = 9< 0.001< 0.001
Process family
Corporate and back-office functions215−0.22−0.35 to −0.09−0.43 to −0.010.0010.036
Technology engineering and operations183−0.03−0.17 to 0.12−0.30 to 0.230.7051.000
Client servicing and communications84−0.06−0.27 to 0.15−0.60 to 0.480.5781.000
Trade, settlement and reconciliation72−0.09−0.32 to 0.14−0.63 to 0.490.4511.000
Payments, cards and disputes64−0.30−0.51 to −0.05−0.66 to 0.310.0170.451
Credit, underwriting and suitability50−0.22−0.47 to 0.06§ n = 90.1181.000
Regulatory, audit, tax and legal49−0.48−0.67 to −0.22§ n = 9< 0.0010.020
Financial crime and client onboarding39−0.18−0.47 to 0.14§ n = 70.2671.000
Class of work
LOB Operational402−0.06−0.16 to 0.04−0.30 to 0.190.2241.000
Corporate Functional354−0.18−0.28 to −0.07−0.36 to 0.00< 0.0010.031
Engagement status and lifecycle stage
Active, Build-Out1530.06−0.10 to 0.22−0.23 to 0.330.4341.000
Active, Transition/Cut-Over2290.00−0.13 to 0.13−0.22 to 0.230.9811.000
Active, Production91−0.26−0.44 to −0.06−0.55 to 0.090.0130.412
Canceled2830.10−0.02 to 0.21−0.05 to 0.210.0991.000
Respondent role
Individual Contributor574−0.10−0.18 to −0.02−0.27 to 0.070.0150.416
Engagement Manager150−0.06−0.22 to 0.10−0.24 to 0.110.4391.000
Portfolio Director310.02−0.33 to 0.37−0.29 to 0.340.9001.000
Customer Management Executive1‡
Vendor type
IT services major285−0.08−0.20 to 0.04−0.31 to 0.160.1731.000
BPO specialist175−0.25−0.38 to −0.10−0.57 to 0.13< 0.0010.031
Consulting firm102−0.04−0.24 to 0.15−0.46 to 0.400.6621.000
Boutique or specialist provider73−0.10−0.33 to 0.13−0.66 to 0.480.3781.000
Pure-play agentic AI firm70−0.01−0.24 to 0.23−0.52 to 0.480.9571.000
Not reported, recovered by engagement510.06−0.22 to 0.33−0.28 to 0.370.6541.000
Note: § Too few engagements for a cluster bootstrap interval. ‡ Base under 10. No statistic is reported.
Table 13b. Association with intent to leave by segment, part 2 of 2Table
SegmentSpearman rhopShare at 7 or above, distressedShare at 7 or above, otherEngagementsEngagement level r95% CITOST p
Study set−0.12< 0.001Not applicableNot applicable150−0.09−0.24 to 0.070.004
Outsourcing model
CXM−0.30< 0.001Not applicableNot applicable42−0.18−0.46 to 0.130.207
ITO0.030.672Not applicableNot applicable400.13−0.19 to 0.420.136
BPO−0.180.013Not applicableNot applicable37−0.18−0.47 to 0.160.221
KPO0.000.976Not applicableNot applicable31−0.17−0.49 to 0.200.228
Institution type
Asset management−0.260.004Not applicableNot applicable24−0.26†0.428
Wealth management and private banking−0.210.019Not applicableNot applicable23−0.13†0.210
Investment banking (advisory and capital-markets origination)0.040.724Not applicableNot applicable190.04†0.139
Insurance (life, property and casualty, health)0.100.416Not applicableNot applicable140.08†0.226
Commercial and business banking0.210.073Not applicableNot applicable130.33†0.544
Payments and merchant acquiring (networks, acquiring, processing)0.030.832Not applicableNot applicable13−0.22†0.394
Credit card and payments issuing−0.190.134Not applicableNot applicable12−0.13†0.291
Retail and consumer banking0.020.900Not applicableNot applicable12−0.06†0.230
Markets and trading (sales and trading, global markets)−0.130.359Not applicableNot applicable11−0.25†0.440
Private equity and private capital−0.83< 0.001Not applicableNot applicable9‡‡
Process family
Corporate and back-office functions−0.28< 0.001Not applicableNot applicable47−0.18−0.44 to 0.110.196
Technology engineering and operations−0.050.521Not applicableNot applicable35−0.06−0.39 to 0.280.082
Client servicing and communications−0.010.927Not applicableNot applicable16−0.04†0.168
Trade, settlement and reconciliation−0.010.932Not applicableNot applicable15−0.08†0.210
Payments, cards and disputes−0.270.030Not applicableNot applicable12−0.34†0.557
Credit, underwriting and suitability−0.300.036Not applicableNot applicable9‡‡
Regulatory, audit, tax and legal−0.370.010Not applicableNot applicable9‡‡
Financial crime and client onboarding−0.050.768Not applicableNot applicable7‡‡
Class of work
LOB Operational−0.060.249Not applicableNot applicable76−0.04−0.26 to 0.190.011
Corporate Functional−0.19< 0.001Not applicableNot applicable74−0.19−0.40 to 0.040.171
Engagement status and lifecycle stage
Active, Build-Out0.050.546Not applicableNot applicable310.09−0.28 to 0.430.120
Active, Transition/Cut-Over0.000.999Not applicableNot applicable430.00−0.30 to 0.300.026
Active, Production−0.230.031Not applicableNot applicable20−0.26†0.436
Canceled0.060.288Not applicableNot applicable560.22−0.04 to 0.460.269
Respondent role
Individual Contributor−0.130.002Not applicableNot applicable150−0.11−0.26 to 0.060.007
Engagement Manager−0.090.272Not applicableNot applicable150−0.06−0.22 to 0.100.001
Portfolio Director−0.010.970Not applicableNot applicable310.02−0.33 to 0.370.065
Customer Management Executive‡ n = 1
Vendor type
IT services major−0.090.139Not applicableNot applicable59−0.08−0.33 to 0.180.041
BPO specialist−0.190.013Not applicableNot applicable37−0.28−0.55 to 0.050.448
Consulting firm−0.090.343Not applicableNot applicable230.02†0.098
Boutique or specialist provider−0.130.262Not applicableNot applicable17−0.04†0.154
Pure-play agentic AI firm−0.060.637Not applicableNot applicable140.09†0.230
Not reported, recovered by engagement−0.080.588Not applicableNot applicable430.12−0.19 to 0.400.114
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was −0.09 (95% CI −0.16 to −0.02, Holm p 0.409, n = 756 respondents). The association did not hold after Holm control. Equivalence Tests of Null Results found it equivalent to zero inside the bound. Of the 37 tested segment levels, 5 held after Holm control.

Association of Written Sentiment with the Study Measures

Table 14. Written sentiment and the study measuresTable
ComparisonWith a negative responseWithout a negative responseTestStatisticp
Cancellation rate11 of 19 engagements (57.89%)45 of 131 engagements (34.35%)Fisher exact0.073
Customer satisfaction, active engagements8 engagementsMean 64.69%, n = 86 engagements‡
Engagement mean written score and cancellationPoint-biserial rr = −0.23, n = 48 engagements0.112
Respondent mean written score and intent to leaveSpearman rhorho = −0.33, n = 65 respondents0.008
Note: ‡ Base under 10. No statistic is reported.

The cancellation contrast compared engagements with a negative written response against all other engagements. The comparison group comprised 131 other engagements, of which 102 had no scored written response coded to the indicator and 29 had only scored responses that were not negative. The contrast therefore did not test written sentiment by itself. Cancellation was recorded for 11 of the 19 engagements with a negative response (57.89%), against 45 of the 131 other engagements (34.35%). The difference did not reach significance at 0.05 (Fisher exact p = 0.073). The customer satisfaction contrast was not computed, because only 8 active engagements had a negative response, fewer than 10. The association of written sentiment itself with the study measures was tested by two correlations. The association of the engagement mean written score with cancellation did not reach significance at 0.05 (r = −0.23, p = 0.112, n = 48 engagements). The association of the respondent mean written score with intent to leave reached significance at 0.05 (rho = −0.33, p = 0.008, n = 65 respondents). Of the three outcome comparisons, one reached significance at 0.05: the correlation of the respondent mean written score with intent to leave. Both comparisons with cancellation were descriptive, because responses on canceled engagements were written after cancellation.

Comparison of Associations Across the Four Measures

Table 15. Associations across the four measuresTable
MeasureFormUnitnr95% CIpEquivalent to zeroRank among the four
Cancellation rateDescriptive contrastEngagement150−0.08−0.24 to 0.080.327Yes4
Customer satisfactionClean estimateEngagement940.09−0.11 to 0.290.374Yes2
Engagement indicator meanFullEngagement1500.12−0.04 to 0.280.142Yes1
Intent to leaveRespondent level, clusteredRespondent756−0.09−0.26 to 0.080.303Yes3
Table 16. Pairwise comparison of associationsTable
Pair comparedDifference in rSteiger zpHolm pReading
Cancellation rate and customer satisfaction−0.02−0.570.5671.000Do not differ
Cancellation rate and engagement indicator mean−0.04−0.650.5161.000Do not differ
Cancellation rate and intent to leave−0.01−0.180.8561.000Do not differ
Customer satisfaction and engagement indicator mean−0.02−0.530.5981.000Do not differ
Customer satisfaction and intent to leave0.010.190.8491.000Do not differ
Engagement indicator mean and intent to leave0.030.650.5151.000Do not differ

Pairs were compared on the engagement level form of every measure, each turned so that a higher value was the better outcome, on the 150 engagements where the indicator and all four measures existed. Of the 6 pairs, 0 differed after Holm control.

Clustering and Effective Sample Size

Table 17. Clustering and effective sample sizeTable
StatisticValueReading
Clusters (engagements)150Engagements with at least one answer.
Mean respondents per engagement5.4Answers per engagement with at least one answer.
ICC(1)1.00Share of variance between engagements.
Design effect5.361 plus (mean cluster size minus 1) times ICC.
Nominal respondent n804Respondents who answered.
Effective n150Nominal n divided by the design effect.
Cluster bootstrap appliedYesApplied to every respondent level CI where the ICC is 0.05 or above.

Clustering reduced the 804 respondent answers to about 150 independent answers. Respondent level intervals therefore used the cluster bootstrap, and respondent level tests on intent to leave used cluster-robust errors.

Equivalence Tests of Null Results

Table 18. Equivalence tests of null resultsTable
MeasurenrEquivalence boundTOST p, lowerTOST p, upperEquivalent to zeroAchieved powerMDE at power 0.80Detection floor for this n
Cancellation rate150−0.08|r| < 0.300.003< 0.001Yes0.960.230.23
Customer satisfaction940.09|r| < 0.30< 0.0010.019Yes0.840.290.23
Engagement indicator mean1500.12|r| < 0.30< 0.0010.011Yes0.960.230.23
Intent to leave756, effective 141−0.09|r| < 0.300.005< 0.001Yes0.950.230.23

Tested null, equivalent to zero: cancellation rate, customer satisfaction, engagement indicator mean and intent to leave. No result was inconclusive. The detection floor column is the study floor at 150 engagements. Intent to leave was tested on its effective n.

Robustness Checks

Table 19. Robustness checksTable
CheckMeasurePrimary rCheck r95% CIChangeConclusion holds
Rank correlation in place of PearsonCancellation rate−0.08−0.15a−0.07Yes
Rank correlation in place of PearsonCustomer satisfaction0.090.09a0.00Yes
Rank correlation in place of PearsonEngagement indicator mean0.120.11a−0.01Yes
Rank correlation in place of PearsonIntent to leave−0.09−0.12a−0.03No
Non-answers excluded, then imputed at the engagement meanIntent to leave−0.09−0.08a0.01Yes
Active engagements onlyEngagement indicator mean0.120.06−0.14 to 0.26−0.06Yes
Active engagements onlyIntent to leave−0.09−0.07−0.16 to 0.020.02Yes
Most influential engagement removed (largest Cook’s distance)Cancellation rate−0.08−0.13−0.28 to 0.04−0.04Yes
Most influential engagement removed (largest Cook’s distance)Customer satisfaction0.090.18−0.03 to 0.370.09Yes
Most influential engagement removed (largest Cook’s distance)Engagement indicator mean0.120.08−0.08 to 0.24−0.04Yes
Most influential engagement removed (largest Cook’s distance)Intent to leave−0.09−0.13−0.20 to −0.06−0.04Yes
Engagements weighted by respondent countCancellation rate−0.08−0.08a0.00Yes
Engagements weighted by respondent countCustomer satisfaction0.090.08a−0.01Yes
Engagements weighted by respondent countEngagement indicator mean0.120.11a−0.01Yes
Bootstrap of engagementsCancellation rate−0.08−0.08−0.25 to 0.080.00Yes
Bootstrap of engagementsCustomer satisfaction0.090.10−0.13 to 0.330.00Yes
Bootstrap of engagementsEngagement indicator mean0.120.12−0.02 to 0.270.00Yes
Bootstrap of engagementsIntent to leave−0.09−0.09−0.26 to 0.080.00Yes
Thin-base segments removedCancellation rate−0.08−0.23−0.42 to −0.01−0.15No
Thin-base segments removedCustomer satisfaction0.090.07−0.20 to 0.34−0.02Yes
Thin-base segments removedEngagement indicator mean0.120.13−0.09 to 0.340.01Yes
Thin-base segments removedIntent to leave−0.09−0.12−0.22 to −0.02−0.03Yes
Note: a No interval for this check.

Each change was computed before rounding, so it can differ by 0.01 from the difference of the two printed values.

Checks that did not hold: “Rank correlation in place of Pearson” on intent to leave and “Thin-base segments removed” on cancellation rate. A check holds when its test lands on the same side of 0.05 as the primary test and, where the primary test is below 0.05, its r keeps the primary sign. Thin-base rule: engagements in any level under 30 engagements of outsourcing model or process family removed. Institution type is not used, because every one of its levels is under 30.

Measure Independence and Part-Whole Correction

Each of the four measures was computed from data this indicator does not contain, so each result is a finding rather than an arithmetic consequence.

Comparison with the Study Norm

Table 20. Comparison with the study normTable
MeasureThis indicator, oriented rStudy median, oriented rDeviationFisher zpHolm p
Cancellation rate0.080.60−0.52−7.38< 0.001< 0.001
Customer satisfaction0.100.72−0.62−9.81< 0.001< 0.001
Engagement indicator mean0.120.84−0.72−13.19< 0.001< 0.001
Intent to leave0.090.71−0.62−9.70< 0.001< 0.001
Spread of deviations0.20
VerdictDIVERGENT

Each deviation was computed before rounding, so it can differ by 0.01 from the difference of the two printed values.

The comparison ran on 150 engagements. The indicator departed from the study’s typical pattern on cancellation rate, customer satisfaction, engagement indicator mean and intent to leave.

Comparison of Written Sentiment with Indicators of the Four Parts

Figure 4. Share of negative written responses, indicators of the four Parts with 30 or more scored responses (n = 101 indicators)Exhibit
0%10%20%30%40%50%60%70%80%90%100%110%120%C044C052C053C128C209C205C203C199C211C159C132C152C105C098C126C148C108C122C116C021C096C149C112C173C097C113C139C201C109C157C101C172C158C213C095C094C138C187C100C106C127C195C111C186C176C110C143C144C175C207C102C196C145C103C133C124C125C020C115C130C189C168C182C164C049C178C123C141C188C147C179C137C160C120C040C018C174C181C104C161C165C183C092C129C185C136C017C190C012C035, 30.14% of 73C035C212C036C171C071ENG:Use CaseC200C080C206C014C069C084Median of the 101 indicators (dashed line)
Note: Each column is one indicator, ordered from the highest share of negative responses. The indicator is shown in amber. The dashed line marks the median share across the 101 indicators, 79.55%.

The peer set comprised 101 indicators of the four Parts with 30 or more scored responses. The indicator was within the peer set. Its share of negative responses ranked 90 of 101 from the highest. Its mean written score (−1.5, n = 73 responses) ranked 88 of 101 from the most negative. The peer median of the mean written score was −4.6 across the 101 indicators.

Co-Occurring Indicators and Themes

Figure 5. Other indicators and themes coded in the same written responses (n = 73 responses)Exhibit
Theme: Stated periodic rate6 (8.22%)Theme: Positive with an embedded negative6 (8.22%)C1369 (12.33%)ENG:Is Canceled?9 (12.33%)Theme: Raised it, nothing came back9 (12.33%)C09410 (13.70%)Theme: Told vendor-side management11 (15.07%)C10912 (16.44%)Theme: The scale or question does not fit13 (17.81%)Theme: Insufficient exposure to rate14 (19.18%)C03622 (30.14%)
Note: Gray bars are other indicators coded in the same responses. Amber bars are themes of the coding rulebook, which carry no score. Shares are of the 73 responses coded to the indicator. Every co-coded indicator and every theme at or above the fifth-highest count of its kind is shown, ties included. ENG:Age of Engagement (Months), the twin of the indicator under rule 6.6 of the coding rulebook, records the same fact and is not shown (coded in 73 of the 73 responses). C036: “What stage is the engagement in?” C109: “Rate how quickly the customer responds when this engagement raises issues that need customer action.” C094: “Rate the quality of the customer’s data across the systems this engagement depends on.” C136: “Rate how effectively the customer and vendor jointly manage this engagement now that agents perform part of the work.” “ENG:Is Canceled?” is a field of the Engagements sheet. Emotional states coded in the same responses, as counts: calm or fine 6, tired 3, stressed 3 and frustrated 2.

The indicator’s twin, ENG:Age of Engagement (Months), records the same fact under the coding rulebook’s twin rule. The twin was coded in all 73 responses coded to the indicator. The twin is left out of the counts that follow. The responses coded to the indicator were most often also coded to “What stage is the engagement in?” (C036, 22 responses). The second most frequent co-coded indicator was “Rate how quickly the customer responds when this engagement raises issues that need customer action” (C109, 12 responses). The most frequent theme of the coding rulebook in the same responses was “Insufficient exposure to rate” (14 responses).

Interpretation of the Data

Engagement age was highest at Active, Production (mean 11.4, n = 98 respondents) and lowest at Active, Build-Out (mean 2.7, n = 161 respondents). LOB Operational respondents reported older engagements (mean 6.5, n = 425 respondents) than Corporate Functional respondents (mean 4.6, n = 379 respondents). Engagement age tracked lifecycle stage and class of work without any association with the four study measures.

The indicator is a survey question that is not a rating, so the written responses were not set against a rating. Written responses were voluntary. They recorded what the respondents who wrote reported, and how common it was is measured by the answers.

Limitations

The evidence is reported experience: what the delivery team said about its own engagement, gathered in one cross-section. The figures showed associations, not causes. Indicators about the financial institution were reported at second hand by vendor staff. Cancellation is a descriptive contrast, because canceled engagements were rated after they ended.

Tests across respondent role and vendor type were run at respondent level and treated respondents as independent. The section Clustering and Effective Sample Size states whether, and by how much, clustering within engagements reduced the information in respondent level figures.

20 of 22 checks held. The rank correlation on intent to leave and the thin-base check on cancellation did not hold. Answers matched within engagements, so the item carried about one independent answer per engagement (ICC 1.00, 804 answers worth about 150 independent answers).

Shares of written sentiment were shares of responses, not of the study set of respondents. The written score took five fixed values, so its mean and median were coarse. Responses clustered within engagements. Intervals for written sentiment used a bootstrap by engagement. Coding was performed by AI coders under a fixed rulebook. Agreement on whether a response was coded to the indicator rested on 5 responses second-coded under rulebook 0.5, with the coders agreeing on 3 of 5. Agreement on the score rested on 6 responses second-scored under rulebook 0.6, with the scores agreeing in 4 of 6. These bases of second-coded responses are too small for an indicator-level alpha.

Definitions

Table 21. DefinitionsTable
TermDefinition
Response scaleAs recorded, shown in Table 1. The indicator is not a rating, so no distressed range is defined.
Answering baseRespondents who entered a value.
Non-answers“I do not know” and “I prefer to not answer” are counted separately and are excluded from the mean.
Indicator classEngagement attribute: a property of the engagement rather than of the respondent.
Failure categoryOne of the five failure categories of the Study Taxonomy, section 3. Only the 100 rated indicators carry one, and the indicator is not among them.
Engagement indicator meanThe mean of an engagement’s 100 indicator ratings.
Written responseA coded written answer about the respondent’s own engagement. Non-answers and answers about another engagement are excluded.
Primary and secondaryPrimary responses were written in answer to a written-answer question in the indicator’s own survey section. Secondary responses were written in answer to a question outside that section and coded to the indicator because their content addressed it.
Written sentiment scaleFive fixed values of the coding rulebook: −10, −5, 0, +5, +10. The sign is the direction and the magnitude is the strength.
CodingResponses were coded under rulebook 0.5. Scores were added under rulebook 0.6 to every mark and every quote, with the score rulings of rulebook section 21. AI coders worked under a fixed rulebook. A sample of records was second-coded. Score agreement across all indicators was Krippendorff’s alpha 0.969 on the 0.5 scores and 0.930 on the scores added in 0.6.

Sources and Provenance

Table 22. Sources and provenanceTable
ItemValue
Study dataStudy Data.xlsx, Data sheet, column C035, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record C035, sha256 e405f65a43e37a6e
ComputedOctober 8, 2026, 01:38 UTC
TemplateIndicator Statistical Analysis Template, version 1.1 of 2026-10-06
Figures placed by script2,053 of 2,053
Study metadataStudy Meta.md, sections 10.4 and 10.4.1, coder agreement across all indicators
Coded written responsesQuotes Master.jsonl, sha256 27da38085e2b13fd. Quote Coding Rulebook, version 0.6 with section 21
Written-response computationqa_stats.py, sha256 74a61f3a96169da9. wfacts.py, sha256 b85fae20adf812a1. prose_gen.py, sha256 c277d2c752f8d88f. build_indicator.py, sha256 da3473bd56a4a7b9
Written-response recordsC035.qa.json, sha256 7ea16924e653b51c. C035.wfacts.json, sha256 fe2bb8e70fda69bf. Prose C035.json, sha256 504021d6d9e41ab6

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →