Study Data · Part 5 · Indicator Deep-Dive Analysis

My greater team regularly alters client provided data

Indicator C203 · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeC203
Question as askedMy greater team regularly alters client provided data.
Failure categoryNot one of the 100 rated indicators
Place in the surveyChallenge Deep Dive > 5.6 Alterations > Client Data
Indicator classRespondent level
Indicator typeDirectional, DIR
Response scale1 to 10, with no good or bad end
Answering base773 of 850 respondents, across 150 of 150 engagements
Non-answersI do not know 29, I prefer to not answer 19, blank 29
Written responses addressing the indicator84 responses from 78 respondents on 55 engagements (84 primary, 0 secondary)

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureFormnr95% CIp
Cancellation rateDescriptive contrast150 engagements0.700.60 to 0.77< 0.001
Customer satisfactionClean estimate94 engagements−0.65−0.76 to −0.52< 0.001
Engagement indicator meanFull150 engagements−0.84−0.88 to −0.79< 0.001
Intent to leaveRespondent level, clustered722 respondents0.660.61 to 0.71< 0.001

The statement is rated from 1 to 10 with no good or bad end. The mean rating was 5.4 and the median 5.0 (n = 773 respondents). The rating was associated with all four study measures. Higher ratings came with more cancellation (r = 0.70, 95% CI 0.60 to 0.77, p < 0.001, n = 150 engagements), lower customer satisfaction among active engagements (r = −0.65, 95% CI −0.76 to −0.52, p < 0.001, n = 94 engagements), a lower engagement indicator mean (r = −0.84, 95% CI −0.88 to −0.79, p < 0.001, n = 150 engagements) and higher intent to leave (r = 0.66, cluster bootstrap 95% CI 0.61 to 0.71, p < 0.001 with standard errors clustered by engagement, n = 722 respondents). After Holm correction, ratings differed by engagement status and lifecycle stage (Welch F 52.01, Holm p < 0.001, omega squared 0.484) and respondent role (Welch F 134.69, Holm p < 0.001, omega squared 0.121).

Of the 84 written responses, 83 were negative. The respondents who answered C202 described data that the team cleaned every cycle and that arrived in error again the next, and those who answered C204 described the alteration of the financial institution's data as routine, known to the team lead, seldom logged and seldom reported to the financial institution. The single positive response described a data exception step agreed with the financial institution's platform owner before any correction was applied.

Distribution of Ratings

Table 3. Distribution of ratings, respondent levelTable
AnswerRespondentsShare of answered (base 773)Cumulative shareEngagements with at least oneShare of 150 engagementsDistressed
120.26%0.26%21.33%Not applicable
2577.37%7.63%3422.67%Not applicable
311514.88%22.51%5637.33%Not applicable
410012.94%35.45%7550.00%Not applicable
514618.89%54.33%8456.00%Not applicable
610813.97%68.31%7449.33%Not applicable
79011.64%79.95%5939.33%Not applicable
810914.10%94.05%6342.00%Not applicable
9435.56%99.61%3422.67%Not applicable
1030.39%100.00%32.00%Not applicable
I do not know29Not in baseNot in base2919.33%Not applicable
I prefer to not answer19Not in baseNot in base1912.67%Not applicable
Answered, total773100.00%150100.00%
Table 4. Distribution of ratings, engagement levelTable
Engagement level summaryEngagementsMean of engagement meansSDMinMedianMaxEngagements with a distressed meanShare of engagements distressed
Engagement means, as recorded1505.41.61.85.48.9Not applicableNot applicable

The scale has no good or bad end, so no distressed range applies.

Coverage and Origin of Written Responses

Figure 1. Written responses addressing the indicator, by question answered and written score (n = 84 responses)Exhibit
017.0834.1651.2468.32C204 (primary)60C202 (primary)20C210 (primary)C208 (primary)−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is one survey question. C204 and C202 and C210 and C208 are the written-answer questions of the indicator's survey section, so their responses are primary. The responses to every other question are secondary. Segments wide enough to hold a label carry their count. C204 asked: “Comment” C202 asked: “Why did you alter client provided data?” C210 asked: “Comment” C208 asked: “Why did you alter client processes?”
Table 5. Written responses by originTable
OriginResponsesRespondentsEngagementsNegativeStrongest negative (−10)PositiveMean written score
Primary84785583 of 84 (98.81%)82 of 84 (97.62%)1 of 84 (1.19%)−9.8
Secondary000000None
All responses84785583 of 84 (98.81%)82 of 84 (97.62%)1 of 84 (1.19%)−9.8

The primary responses numbered 84, written in answer to C204, C202, C210 and C208, the written-answer questions of the indicator's survey section. No response from any other question addressed the indicator, so every response was primary.

In 19 of the 20 responses to C202, respondents said the data arrived dirty or in error again after the team had cleaned it, and most added that they fixed it themselves before it was loaded. Access appeared in 15 responses across all questions: credentials that expired, requests that sat for weeks, or a platform closed to the team, so the data could not be corrected at its source.

The 61 responses to C204 described how often and how openly the team altered the data. Words of frequency, such as every cycle, most weeks or seven out of ten, appeared in 81 responses across all questions. The team lead or manager appeared as someone who knew or was told in 22 responses to C204. In 27 responses, respondents said that nothing changed upstream, that nobody signed off the workaround or that a raised problem went nowhere. Respondents said the fixes were not logged, reported or flagged in 15 responses, and that the financial institution was not told, or that no one outside the team knew, in 9. Three responses said the financial institution had been told in writing or already knew that the team filled gaps in its data.

The themes most often marked were “Occurs every cycle or most days” (74 responses), “Told vendor-side management” (24) and “Raised it, nothing came back” (13).

Distribution of Written Sentiment

Figure 2. Distribution of written sentiment (n = 84 responses)Exhibit
0%25%50%75%100%−10 Strongly negative82 (97.62%)−5 Negative1 (1.19%)0 Neutral0 (0.00%)+5 Positive1 (1.19%)+10 Strongly positive0 (0.00%)Share of responses
Note: Column height is the share of the 84 responses. Labels give the count and the share.
Table 6. Summary statistics of written sentimentTable
StatisticValueBasis
Mean written score−9.895% CI −10.0 to −9.3, cluster bootstrap by engagement, 10,000 draws, n = 84 responses
Median written score−10.0n = 84 responses
Negative responses83 of 84 (98.81%)95% CI 96.15% to 100.00% of 84 responses, cluster bootstrap by engagement
Strongest negative responses (−10)82 of 84 (97.62%)Statements of totality, constancy or serious harm
Positive responses1 of 84 (1.19%)+5 or +10
Net balance−97.62 percentage pointsShare positive minus share negative, base 84 responses
Respondent-level mean−9.7Mean of each respondent's own mean written score, n = 78 respondents

Of the 84 responses, 83 (98.81%, 95% CI 96.15% to 100.00%) were negative and 82 (97.62%) carried the strongest negative score of −10. Positive responses numbered 1 (1.19%), and no response was neutral. The mean written score was −9.8 (95% CI −10.0 to −9.3, n = 84 responses), and the median was −10.0.

Correspondence Between Ratings and Written Sentiment

Figure 3. Written score against the respondent's rating of the indicator (n = 83 responses with a rating)Exhibit
012345678910-10-50510Written sentiment scoreRating112112329511
Note: Each marker is one combination of written score and rating, and its area is proportional to the number of responses at that combination. The written score runs from −10 at the left to +10 at the right. The rating of agreement rises from the lowest at the bottom to the highest at the top, with no good or bad end. Of the 84 responses, 1 had no rating and are not shown.

Of the 84 responses, 83 came from respondents who also rated the indicator. Among them, the written score fell with the rating (Spearman rho −0.25, 95% CI −0.40 to −0.15, p = 0.023, n = 83 responses). Respondents who agreed more strongly wrote more negatively.

Rating Profile of Respondents Providing Written Responses

Figure 4. Distribution of ratings, respondents who wrote about the indicator and respondents who did notExhibit
0%25%50%75%100%12345678910Respondents who wrote and gave a rating (n = 77)Respondents who did not write and gave a rating (n = 696)
Note: The columns of each group sum to the whole of that group: 77 respondents who wrote about the indicator and gave a rating, and 696 who gave a rating without writing about it.

Respondents who wrote about the indicator and gave a rating numbered 77, with a mean rating of 6.9. The 696 respondents who rated the indicator without writing about it had a mean of 5.2. The difference, 1.7 (95% CI 1.4 to 2.1), excluded zero.

Descriptive Statistics by Segment

Table 7a. Descriptive statistics by segment, part 1 of 2Table
SegmentBaseAnsweredAnswer rateEngagementsMean95% CISD
Study set85077390.94% of 8501505.45.2 to 5.52.0
Outsourcing model
CXM23221190.95% of 232425.04.7 to 5.32.1
ITO24421387.30% of 244405.35.1 to 5.61.9
BPO20919693.78% of 209375.65.3 to 5.92.0
KPO16515392.73% of 165315.75.3 to 6.02.2
Institution type
Asset management13212191.67% of 132245.95.6 to 6.31.8
Wealth management and private banking14012992.14% of 140235.14.8 to 5.52.0
Investment banking (advisory and capital-markets origination)1059287.62% of 105195.75.3 to 6.22.2
Insurance (life, property and casualty, health)787089.74% of 78145.04.5 to 5.52.0
Commercial and business banking827287.80% of 82135.34.9 to 5.81.8
Payments and merchant acquiring (networks, acquiring, processing)716287.32% of 71135.24.6 to 5.72.3
Credit card and payments issuing736994.52% of 73125.85.3 to 6.32.1
Retail and consumer banking736690.41% of 73124.94.4 to 5.31.9
Markets and trading (sales and trading, global markets)575392.98% of 57115.04.5 to 5.62.0
Private equity and private capital3939100.00% of 3995.34.5 to 6.02.2
Process family
Corporate and back-office functions24823092.74% of 248475.55.2 to 5.82.1
Technology engineering and operations20418590.69% of 204355.24.9 to 5.42.0
Client servicing and communications948489.36% of 94165.55.0 to 5.92.1
Trade, settlement and reconciliation807188.75% of 80155.85.4 to 6.31.9
Payments, cards and disputes736690.41% of 73124.74.3 to 5.21.9
Credit, underwriting and suitability575494.74% of 5795.14.6 to 5.72.0
Regulatory, audit, tax and legal514690.20% of 5195.54.9 to 6.22.2
Financial crime and client onboarding433786.05% of 4376.15.5 to 6.71.8
Class of work
LOB Operational45140990.69% of 451765.45.2 to 5.62.0
Corporate Functional39936491.23% of 399745.45.1 to 5.62.1
Engagement status and lifecycle stage
Active, Build-Out17516192.00% of 175314.74.4 to 4.91.5
Active, Transition/Cut-Over25023292.80% of 250434.54.2 to 4.71.8
Active, Production1039390.29% of 103204.23.9 to 4.61.7
Canceled32228789.13% of 322566.96.7 to 7.11.7
Respondent role
Individual Contributor66762293.25% of 6671505.75.5 to 5.92.0
Engagement Manager15013187.33% of 1501314.34.0 to 4.51.5
Portfolio Director312064.52% of 31202.5†0.9
Customer Management Executive200 of 20‡
Vendor type
IT services major31627988.29% of 316595.14.9 to 5.31.9
BPO specialist19818291.92% of 198375.85.5 to 6.12.1
Consulting firm11710892.31% of 117235.45.0 to 5.82.1
Boutique or specialist provider877788.51% of 87165.34.8 to 5.72.0
Pure-play agentic AI firm757194.67% of 75145.34.8 to 5.82.1
Not reported, recovered by engagement575698.25% of 57475.75.2 to 6.21.9
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 7b. Descriptive statistics by segment, part 2 of 2Table
SegmentMinQ1MedianQ3MaxDistressed nDistressed %
Study set1.04.05.07.010.0Not applicableNot applicable
Outsourcing model
CXM2.03.05.07.09.0Not applicableNot applicable
ITO2.04.05.07.010.0Not applicableNot applicable
BPO2.04.05.07.010.0Not applicableNot applicable
KPO1.04.06.07.010.0Not applicableNot applicable
Institution type
Asset management2.05.06.08.09.0Not applicableNot applicable
Wealth management and private banking1.04.05.06.09.0Not applicableNot applicable
Investment banking (advisory and capital-markets origination)2.04.05.08.010.0Not applicableNot applicable
Insurance (life, property and casualty, health)2.04.05.06.09.0Not applicableNot applicable
Commercial and business banking2.04.05.07.09.0Not applicableNot applicable
Payments and merchant acquiring (networks, acquiring, processing)2.03.05.07.010.0Not applicableNot applicable
Credit card and payments issuing2.04.06.08.010.0Not applicableNot applicable
Retail and consumer banking2.03.05.06.09.0Not applicableNot applicable
Markets and trading (sales and trading, global markets)3.03.05.06.09.0Not applicableNot applicable
Private equity and private capital2.03.05.07.59.0Not applicableNot applicable
Process family
Corporate and back-office functions2.04.05.07.010.0Not applicableNot applicable
Technology engineering and operations2.03.05.07.010.0Not applicableNot applicable
Client servicing and communications2.04.06.07.09.0Not applicableNot applicable
Trade, settlement and reconciliation2.04.06.08.09.0Not applicableNot applicable
Payments, cards and disputes2.03.05.06.09.0Not applicableNot applicable
Credit, underwriting and suitability1.03.35.07.09.0Not applicableNot applicable
Regulatory, audit, tax and legal1.04.06.07.09.0Not applicableNot applicable
Financial crime and client onboarding2.05.06.08.09.0Not applicableNot applicable
Class of work
LOB Operational1.04.05.07.010.0Not applicableNot applicable
Corporate Functional1.04.05.07.010.0Not applicableNot applicable
Engagement status and lifecycle stage
Active, Build-Out2.03.05.06.09.0Not applicableNot applicable
Active, Transition/Cut-Over1.03.04.06.09.0Not applicableNot applicable
Active, Production1.03.04.05.09.0Not applicableNot applicable
Canceled2.06.07.08.010.0Not applicableNot applicable
Respondent role
Individual Contributor1.04.06.07.010.0Not applicableNot applicable
Engagement Manager2.03.04.05.08.0Not applicableNot applicable
Portfolio Director2.02.02.02.35.0Not applicableNot applicable
Customer Management Executive‡ n = 0
Vendor type
IT services major1.04.05.06.09.0Not applicableNot applicable
BPO specialist2.04.06.08.010.0Not applicableNot applicable
Consulting firm1.04.05.07.010.0Not applicableNot applicable
Boutique or specialist provider2.04.05.07.09.0Not applicableNot applicable
Pure-play agentic AI firm2.03.55.07.010.0Not applicableNot applicable
Not reported, recovered by engagement2.04.06.07.08.0Not applicableNot applicable
Note: ‡ Base under 10. No statistic is reported.

Every figure in the segment tables is at respondent level. Segments with fewer than 30 respondents carry no interval. Segments with fewer than 10 report counts only.

Tests of Difference Between Segments

Table 8a. Tests of difference between segments, part 1 of 2Table
Segment familyWelch FdfpHolm pOmega squared90% CI
Outsourcing model0.903, 78.60.4451.000−0.0020.000 to 0.051
Institution type0.828, 49.10.5881.000−0.0120.000 to 0.055
Process family1.054, 39.90.3941.0000.0000.000 to 0.069
Class of work0.001, 147.20.9731.000−0.0070.000 to 0.000
Engagement status and lifecycle stage52.013, 60.6< 0.001< 0.0010.4840.394 to 0.563
Respondent role134.692, 57.3< 0.001< 0.0010.1210.088 to 0.158
Vendor type2.745, 234.40.0200.1000.0120.002 to 0.030
Table 8b. Tests of difference between segments, part 2 of 2Table
Segment familyKruskal-Wallis HpDistressed chi-squaredfpCramer's VLevels excluded
Outsourcing model2.470.481Not applicableNot applicableNot applicableNot applicableNone
Institution type6.630.577Not applicableNot applicableNot applicableNot applicablePrivate equity and private capital, n = 9
Process family3.980.409Not applicableNot applicableNot applicableNot applicableCredit, underwriting and suitability, n = 9, Regulatory, audit, tax and legal, n = 9, Financial crime and client onboarding, n = 7
Class of work0.020.894Not applicableNot applicableNot applicableNot applicableNone
Engagement status and lifecycle stage75.82< 0.001Not applicableNot applicableNot applicableNot applicableNone
Respondent role96.06< 0.001Not applicableNot applicableNot applicableNot applicableCustomer Management Executive, n = 0
Vendor type13.110.022Not applicableNot applicableNot applicableNot applicableNone

Segment families recorded at engagement level were tested on engagement means. Respondent role and vendor type were tested on respondents. After Holm correction, ratings differed by engagement status and lifecycle stage (Welch F 52.01, Holm p < 0.001, omega squared 0.484). Canceled engagements rated highest (mean 6.9, n = 287 respondents) and active engagements in Production lowest (mean 4.2, n = 93 respondents). Ratings also differed by respondent role (Welch F 134.69, Holm p < 0.001, omega squared 0.121). Individual contributors rated highest (mean 5.7, n = 622 respondents) and portfolio directors lowest (mean 2.5, n = 20 respondents). Outsourcing model, institution type, process family, class of work and vendor type showed no difference.

Written Sentiment by Segment

Figure 5. Written sentiment by engagement status and lifecycle stage, share of each group's responsesExhibit
0%25%50%75%100%All responses (n = 84)97.6%Active, Build-Out (n = 11)90.9%9.1%Active, Transition/Cut-Over (n = 17)94.1%Active, Production (n = 8)8 of 8Canceled (n = 48)100.0%−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is the whole of its group's responses, divided by written score from −10 at the left to +10 at the right. Segments large enough to hold a label carry their share.
Table 9. Written sentiment by segmentTable
SegmentResponsesRespondentsEngagementsMean written scoreNegativeStrongest negative (−10)
Engagement status and lifecycle stage
Active, Build-Out1199−9.511 of 11 (100.00%)10 of 11 (90.91%)
Active, Transition/Cut-Over171713−9.116 of 17 (94.12%)16 of 17 (94.12%)
Active, Production876‡8 of 88 of 8
Canceled484527−10.048 of 48 (100.00%)48 of 48 (100.00%)
Respondent role
Individual Contributor736749−9.973 of 73 (100.00%)72 of 73 (98.63%)
Engagement Manager101010−10.010 of 10 (100.00%)10 of 10 (100.00%)
Portfolio Director111‡0 of 10 of 1
Customer Management Executive000No responses
Note: ‡ Base under 10. No statistic is reported.

Written sentiment did not differ by engagement status and lifecycle stage across the 55 engagements with a written response (Kruskal-Wallis H 3.20, df 3, p = 0.362). Of the groups with 10 or more responses, responses from canceled engagements were the most negative (mean −10.0, 48 responses) and responses from active engagements in Transition/Cut-Over the least negative (mean −9.1, 17 responses). Responses from active engagements in Production (8) are reported as counts only.

No test across respondent roles was run, because fewer than two roles had 30 or more written responses. Individual contributors wrote 73 responses, engagement managers 10 and portfolio directors 1.

Association with Cancellation Rate

Cancellation rate is the share of engagements canceled by the study date, measured at engagement level (150 engagements, 56 canceled). Canceled engagements were rated after cancellation. The association is therefore a descriptive contrast and not a forecast of cancellation.

Table 10a. Association with cancellation rate by segment, part 1 of 2Table
SegmentEngagementsCanceledCancellation ratePoint-biserial r95% CIpHolm p
Study set1505637.33% of 1500.700.60 to 0.77< 0.001< 0.001
Outsourcing model
CXM421535.71% of 420.740.56 to 0.85< 0.001< 0.001
ITO401537.50% of 400.630.40 to 0.79< 0.001< 0.001
BPO371437.84% of 370.760.58 to 0.87< 0.001< 0.001
KPO311238.71% of 310.670.41 to 0.83< 0.001< 0.001
Institution type
Asset management241354.17% of 240.77†< 0.001< 0.001
Wealth management and private banking23834.78% of 230.70†< 0.0010.002
Investment banking (advisory and capital-markets origination)19947.37% of 190.56†0.0120.044
Insurance (life, property and casualty, health)14535.71% of 140.70†0.0050.027
Commercial and business banking13430.77% of 130.51†0.0760.146
Payments and merchant acquiring (networks, acquiring, processing)13323.08% of 130.80†0.0010.009
Credit card and payments issuing12541.67% of 120.81†0.0010.010
Retail and consumer banking12433.33% of 120.91†< 0.001< 0.001
Markets and trading (sales and trading, global markets)11327.27% of 110.80†0.0030.019
Private equity and private capital922 of 9‡
Process family
Corporate and back-office functions471940.43% of 470.720.55 to 0.83< 0.001< 0.001
Technology engineering and operations351028.57% of 350.780.60 to 0.88< 0.001< 0.001
Client servicing and communications16956.25% of 160.62†0.0110.044
Trade, settlement and reconciliation15853.33% of 150.48†0.0730.146
Payments, cards and disputes12216.67% of 120.80†0.0020.011
Credit, underwriting and suitability911 of 9‡
Regulatory, audit, tax and legal944 of 9‡
Financial crime and client onboarding733 of 7‡
Class of work
LOB Operational763039.47% of 760.630.47 to 0.75< 0.001< 0.001
Corporate Functional742635.14% of 740.770.66 to 0.85< 0.001< 0.001
Engagement status and lifecycle stage
Active, Build-Out3100.00% of 31a
Active, Transition/Cut-Over4300.00% of 43a
Active, Production2000.00% of 20a
Canceled5656100.00% of 56a
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a Not tested: no variation in cancellation.
Table 10b. Association with cancellation rate by segment, part 2 of 2Table
SegmentOdds ratio per point95% CIAUCRate, distressed engagementsRate, other engagementsFisher pTOST p
Study set5.233.13 to 8.720.92Not applicableNot applicableNot applicable1.000
Outsourcing model
CXM7.822.27 to 26.960.95Not applicableNot applicableNot applicable1.000
ITO3.771.67 to 8.520.87Not applicableNot applicableNot applicable0.996
BPO6.662.17 to 20.460.93Not applicableNot applicableNot applicable1.000
KPO5.311.58 to 17.860.92Not applicableNot applicableNot applicable0.996
Institution type
Asset management14.46† n = 240.95Not applicableNot applicableNot applicable0.999
Wealth management and private banking6.30† n = 230.94Not applicableNot applicableNot applicable0.994
Investment banking (advisory and capital-markets origination)2.44† n = 190.80Not applicableNot applicableNot applicable0.907
Insurance (life, property and casualty, health)20.38† n = 140.93Not applicableNot applicableNot applicable0.968
Commercial and business banking3.17† n = 130.78Not applicableNot applicableNot applicable0.787
Payments and merchant acquiring (networks, acquiring, processing)5.79† n = 131.00Not applicableNot applicableNot applicable0.994
Credit card and payments issuing7.24† n = 121.00Not applicableNot applicableNot applicable0.994
Retail and consumer banking6.25† n = 121.00Not applicableNot applicableNot applicable1.000
Markets and trading (sales and trading, global markets)4.50† n = 111.00Not applicableNot applicableNot applicable0.987
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functions4.292.01 to 9.150.92Not applicableNot applicableNot applicable1.000
Technology engineering and operations7,831.20a0.99Not applicableNot applicableNot applicable1.000
Client servicing and communications3.77† n = 160.83Not applicableNot applicableNot applicable0.931
Trade, settlement and reconciliation1.99† n = 150.76Not applicableNot applicableNot applicable0.765
Payments, cards and disputes5.43† n = 121.00Not applicableNot applicableNot applicable0.992
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB Operational3.732.08 to 6.680.88Not applicableNot applicableNot applicable1.000
Corporate Functional10.043.30 to 30.510.96Not applicableNot applicableNot applicable1.000
Engagement status and lifecycle stage
Active, Build-Outb
Active, Transition/Cut-Overb
Active, Productionb
Canceledb
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a Not estimable: too few events in one group. b Not tested: no variation in cancellation.

Across the study set, higher ratings came with more cancellation (r = 0.70, 95% CI 0.60 to 0.77, Holm p < 0.001, n = 150 engagements). The association held after Holm correction in eighteen of the 20 segment levels tested.

Association with Customer Satisfaction

Customer satisfaction is the percentage recorded against each engagement. The primary estimate uses the 94 active engagements. A descriptive contrast uses all 150 engagements.

Table 11a. Association with customer satisfaction by segment, part 1 of 2Table
SegmentActive engagementsClean r95% CIpHolm pSpearman rhop
Study set94−0.65−0.76 to −0.52< 0.001< 0.001−0.63< 0.001
Outsourcing model
CXM27−0.74†< 0.001< 0.001−0.72< 0.001
ITO25−0.56†0.0030.027−0.610.001
BPO23−0.68†< 0.0010.004−0.620.001
KPO19−0.66†0.0020.021−0.590.008
Institution type
Asset management11−0.82†0.0020.021−0.88< 0.001
Wealth management and private banking15−0.58†0.0250.054−0.480.068
Investment banking (advisory and capital-markets origination)10−0.37†0.2880.288−0.470.173
Insurance (life, property and casualty, health)9‡
Commercial and business banking9‡
Payments and merchant acquiring (networks, acquiring, processing)10−0.77†0.0100.039−0.730.017
Credit card and payments issuing7‡
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)8‡
Private equity and private capital7‡
Process family
Corporate and back-office functions28−0.65†< 0.0010.002−0.580.001
Technology engineering and operations25−0.56†0.0040.027−0.63< 0.001
Client servicing and communications7‡
Trade, settlement and reconciliation7‡
Payments, cards and disputes10−0.72†0.0180.054−0.610.061
Credit, underwriting and suitability8‡
Regulatory, audit, tax and legal5‡
Financial crime and client onboarding4‡
Class of work
LOB Operational46−0.73−0.84 to −0.56< 0.001< 0.001−0.69< 0.001
Corporate Functional48−0.54−0.72 to −0.31< 0.001< 0.001−0.53< 0.001
Engagement status and lifecycle stage
Active, Build-Out31−0.50−0.73 to −0.180.0040.027−0.530.002
Active, Transition/Cut-Over43−0.73−0.85 to −0.55< 0.001< 0.001−0.71< 0.001
Active, Production20−0.59†0.0060.029−0.590.006
Canceled0a
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a Not tested: canceled engagements fall outside the active population.
Table 11b. Association with customer satisfaction by segment, part 2 of 2Table
SegmentSlope, points per rating point95% CIR squaredTOST pAll engagementsDescriptive rp
Study set−6.09−7.55 to −4.630.431.000150−0.79< 0.001
Outsourcing model
CXM−7.48† n = 270.550.99942−0.85< 0.001
ITO−4.99† n = 250.320.93840−0.70< 0.001
BPO−6.84† n = 230.470.99137−0.84< 0.001
KPO−5.56† n = 190.430.97331−0.79< 0.001
Institution type
Asset management−7.02† n = 110.670.99124−0.83< 0.001
Wealth management and private banking−4.24† n = 150.330.88523−0.77< 0.001
Investment banking (advisory and capital-markets origination)−4.57† n = 100.140.58619−0.590.008
Insurance (life, property and casualty, health)‡ n = 9
Commercial and business banking‡ n = 9
Payments and merchant acquiring (networks, acquiring, processing)−8.22† n = 100.590.96813−0.92< 0.001
Credit card and payments issuing‡ n = 7
Retail and consumer banking‡ n = 8
Markets and trading (sales and trading, global markets)‡ n = 8
Private equity and private capital‡ n = 7
Process family
Corporate and back-office functions−6.37† n = 280.420.99047−0.81< 0.001
Technology engineering and operations−5.48† n = 250.310.93235−0.85< 0.001
Client servicing and communications‡ n = 7
Trade, settlement and reconciliation‡ n = 7
Payments, cards and disputes−8.55† n = 100.520.94612−0.91< 0.001
Credit, underwriting and suitability‡ n = 8
Regulatory, audit, tax and legal‡ n = 5
Financial crime and client onboarding‡ n = 4
Class of work
LOB Operational−6.91−8.89 to −4.930.531.00076−0.76< 0.001
Corporate Functional−4.95−7.22 to −2.670.290.97774−0.83< 0.001
Engagement status and lifecycle stage
Active, Build-Out−5.51−9.10 to −1.930.250.90331−0.500.004
Active, Transition/Cut-Over−6.90−8.93 to −4.870.531.00043−0.73< 0.001
Active, Production−4.87†0.350.93820−0.590.006
Canceleda
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a Not tested: canceled engagements fall outside the active population.

Across the active engagements, higher ratings came with lower customer satisfaction (r = −0.65, 95% CI −0.76 to −0.52, Holm p < 0.001, n = 94 engagements). The association held after Holm correction in thirteen of the 16 segment levels tested.

Association with the Engagement Indicator Mean

The engagement indicator mean is the mean of an engagement's ratings across the rated indicators, measured at engagement level (150 engagements). The indicator does not enter the mean.

Table 12a. Association with the engagement indicator mean by segment, part 1 of 2Table
SegmentEngagementsLeave-one-out r95% CIpHolm pSpearman rhop
Study set150−0.84−0.88 to −0.79< 0.001< 0.001−0.85< 0.001
Outsourcing model
CXM42−0.87−0.93 to −0.77< 0.001< 0.001−0.87< 0.001
ITO40−0.77−0.87 to −0.60< 0.001< 0.001−0.76< 0.001
BPO37−0.84−0.91 to −0.70< 0.001< 0.001−0.83< 0.001
KPO31−0.89−0.95 to −0.79< 0.001< 0.001−0.89< 0.001
Institution type
Asset management24−0.85†< 0.001< 0.001−0.77< 0.001
Wealth management and private banking23−0.91†< 0.001< 0.001−0.91< 0.001
Investment banking (advisory and capital-markets origination)19−0.79†< 0.001< 0.001−0.83< 0.001
Insurance (life, property and casualty, health)14−0.93†< 0.001< 0.001−0.90< 0.001
Commercial and business banking13−0.92†< 0.001< 0.001−0.81< 0.001
Payments and merchant acquiring (networks, acquiring, processing)13−0.83†< 0.0010.003−0.84< 0.001
Credit card and payments issuing12−0.70†0.0120.012−0.790.002
Retail and consumer banking12−0.81†0.0010.003−0.710.010
Markets and trading (sales and trading, global markets)11−0.96†< 0.001< 0.001−0.89< 0.001
Private equity and private capital9‡
Process family
Corporate and back-office functions47−0.81−0.89 to −0.68< 0.001< 0.001−0.84< 0.001
Technology engineering and operations35−0.82−0.90 to −0.66< 0.001< 0.001−0.84< 0.001
Client servicing and communications16−0.90†< 0.001< 0.001−0.88< 0.001
Trade, settlement and reconciliation15−0.79†< 0.0010.003−0.77< 0.001
Payments, cards and disputes12−0.86†< 0.0010.002−0.700.011
Credit, underwriting and suitability9‡
Regulatory, audit, tax and legal9‡
Financial crime and client onboarding7‡
Class of work
LOB Operational76−0.88−0.92 to −0.81< 0.001< 0.001−0.87< 0.001
Corporate Functional74−0.81−0.88 to −0.72< 0.001< 0.001−0.82< 0.001
Engagement status and lifecycle stage
Active, Build-Out31−0.59−0.78 to −0.30< 0.0010.003−0.550.001
Active, Transition/Cut-Over43−0.83−0.90 to −0.70< 0.001< 0.001−0.79< 0.001
Active, Production20−0.70†< 0.0010.003−0.640.002
Canceled56−0.58−0.73 to −0.38< 0.001< 0.001−0.59< 0.001
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 12b. Association with the engagement indicator mean by segment, part 2 of 2Table
Segmentr with indicator includedChange in rSlope95% CIR squaredTOST pEquivalent
Study setNot a component−0.77−0.84 to −0.690.711.000No
Outsourcing model
CXMNot a component−0.84−0.99 to −0.690.751.000No
ITONot a component−0.65−0.82 to −0.470.591.000No
BPONot a component−0.71−0.87 to −0.550.701.000No
KPONot a component−0.84−1.00 to −0.680.801.000No
Institution type
Asset managementNot a component−0.94† n = 240.721.000No
Wealth management and private bankingNot a component−0.85† n = 230.831.000No
Investment banking (advisory and capital-markets origination)Not a component−0.50† n = 190.620.999No
Insurance (life, property and casualty, health)Not a component−0.88† n = 140.861.000No
Commercial and business bankingNot a component−0.92† n = 130.841.000No
Payments and merchant acquiring (networks, acquiring, processing)Not a component−0.68† n = 130.680.997No
Credit card and payments issuingNot a component−0.56† n = 120.490.951No
Retail and consumer bankingNot a component−0.83† n = 120.660.993No
Markets and trading (sales and trading, global markets)Not a component−0.90† n = 110.931.000No
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functionsNot a component−0.75−0.91 to −0.590.661.000No
Technology engineering and operationsNot a component−0.70−0.87 to −0.520.661.000No
Client servicing and communicationsNot a component−0.95† n = 160.821.000No
Trade, settlement and reconciliationNot a component−0.65† n = 150.630.996No
Payments, cards and disputesNot a component−0.77† n = 120.740.999No
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB OperationalNot a component−0.83−0.93 to −0.720.771.000No
Corporate FunctionalNot a component−0.71−0.83 to −0.590.661.000No
Engagement status and lifecycle stage
Active, Build-OutNot a component−0.71−1.08 to −0.340.350.973No
Active, Transition/Cut-OverNot a component−0.74−0.90 to −0.580.681.000No
Active, ProductionNot a component−0.68† n = 200.490.989No
CanceledNot a component−0.35−0.49 to −0.220.340.995No
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

Higher ratings came with a lower engagement indicator mean (r = −0.84, 95% CI −0.88 to −0.79, Holm p < 0.001, n = 150 engagements). The association held after Holm correction in twenty-four of the 24 segment levels tested.

Association with Intent to Leave

Intent to leave is the answer to C019, “How likely are you to leave your current job in the next 12 months?”, rated 1 to 10. It is measured at respondent level on up to 798 respondents, with the engagement-level form reported alongside.

Table 13a. Association with intent to leave by segment, part 1 of 2Table
SegmentRespondentsr95% CICluster bootstrap 95% CIpHolm p
Study set7220.660.62 to 0.700.61 to 0.71< 0.001< 0.001
Outsourcing model
CXM1940.710.63 to 0.770.61 to 0.78< 0.001< 0.001
ITO2030.580.48 to 0.660.45 to 0.67< 0.001< 0.001
BPO1830.700.62 to 0.770.60 to 0.78< 0.001< 0.001
KPO1420.660.55 to 0.740.52 to 0.77< 0.001< 0.001
Institution type
Asset management1110.650.53 to 0.750.43 to 0.78< 0.001< 0.001
Wealth management and private banking1210.640.53 to 0.740.48 to 0.77< 0.001< 0.001
Investment banking (advisory and capital-markets origination)860.540.37 to 0.680.29 to 0.73< 0.001< 0.001
Insurance (life, property and casualty, health)630.750.62 to 0.840.60 to 0.83< 0.001< 0.001
Commercial and business banking660.600.42 to 0.740.39 to 0.76< 0.001< 0.001
Payments and merchant acquiring (networks, acquiring, processing)600.740.59 to 0.830.55 to 0.85< 0.001< 0.001
Credit card and payments issuing660.580.40 to 0.720.40 to 0.73< 0.001< 0.001
Retail and consumer banking600.740.60 to 0.840.51 to 0.86< 0.001< 0.001
Markets and trading (sales and trading, global markets)510.790.65 to 0.870.66 to 0.85< 0.001< 0.001
Private equity and private capital380.650.42 to 0.80§ n = 9< 0.001< 0.001
Process family
Corporate and back-office functions2080.670.58 to 0.740.58 to 0.75< 0.001< 0.001
Technology engineering and operations1750.640.54 to 0.720.54 to 0.72< 0.001< 0.001
Client servicing and communications790.580.41 to 0.710.20 to 0.75< 0.001< 0.001
Trade, settlement and reconciliation670.590.41 to 0.730.20 to 0.79< 0.001< 0.001
Payments, cards and disputes630.720.58 to 0.820.48 to 0.86< 0.001< 0.001
Credit, underwriting and suitability500.640.44 to 0.78§ n = 9< 0.001< 0.001
Regulatory, audit, tax and legal440.820.69 to 0.90§ n = 9< 0.001< 0.001
Financial crime and client onboarding360.700.48 to 0.84§ n = 7< 0.001< 0.001
Class of work
LOB Operational3830.650.59 to 0.710.57 to 0.72< 0.001< 0.001
Corporate Functional3390.670.61 to 0.730.60 to 0.74< 0.001< 0.001
Engagement status and lifecycle stage
Active, Build-Out1520.580.46 to 0.680.46 to 0.69< 0.001< 0.001
Active, Transition/Cut-Over2190.590.50 to 0.670.46 to 0.70< 0.001< 0.001
Active, Production850.430.24 to 0.590.20 to 0.62< 0.001< 0.001
Canceled2660.03−0.09 to 0.15−0.08 to 0.160.5800.580
Respondent role
Individual Contributor5710.700.65 to 0.740.64 to 0.74< 0.001< 0.001
Engagement Manager1310.630.51 to 0.720.53 to 0.71< 0.001< 0.001
Portfolio Director200.50††0.0240.048
Customer Management Executive0‡
Vendor type
IT services major2650.620.54 to 0.690.53 to 0.71< 0.001< 0.001
BPO specialist1670.700.62 to 0.770.59 to 0.79< 0.001< 0.001
Consulting firm1010.600.46 to 0.710.40 to 0.75< 0.001< 0.001
Boutique or specialist provider690.710.57 to 0.810.60 to 0.79< 0.001< 0.001
Pure-play agentic AI firm680.770.64 to 0.850.64 to 0.82< 0.001< 0.001
Not reported, recovered by engagement520.560.34 to 0.730.33 to 0.75< 0.001< 0.001
Note: § Too few engagements for a cluster bootstrap interval. † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 13b. Association with intent to leave by segment, part 2 of 2Table
SegmentSpearman rhopShare at 7 or above, distressedShare at 7 or above, otherEngagementsEngagement level r95% CITOST p
Study set0.66< 0.001Not applicableNot applicable1500.760.68 to 0.821.000
Outsourcing model
CXM0.71< 0.001Not applicableNot applicable420.840.73 to 0.911.000
ITO0.57< 0.001Not applicableNot applicable400.630.39 to 0.790.995
BPO0.71< 0.001Not applicableNot applicable370.800.65 to 0.891.000
KPO0.65< 0.001Not applicableNot applicable310.770.57 to 0.881.000
Institution type
Asset management0.60< 0.001Not applicableNot applicable240.85†1.000
Wealth management and private banking0.66< 0.001Not applicableNot applicable230.77†0.999
Investment banking (advisory and capital-markets origination)0.51< 0.001Not applicableNot applicable190.51†0.846
Insurance (life, property and casualty, health)0.72< 0.001Not applicableNot applicable140.89†1.000
Commercial and business banking0.60< 0.001Not applicableNot applicable130.66†0.938
Payments and merchant acquiring (networks, acquiring, processing)0.74< 0.001Not applicableNot applicable130.86†0.999
Credit card and payments issuing0.62< 0.001Not applicableNot applicable120.73†0.968
Retail and consumer banking0.74< 0.001Not applicableNot applicable120.83†0.996
Markets and trading (sales and trading, global markets)0.76< 0.001Not applicableNot applicable110.93†1.000
Private equity and private capital0.65< 0.001Not applicableNot applicable9‡‡
Process family
Corporate and back-office functions0.68< 0.001Not applicableNot applicable470.750.59 to 0.851.000
Technology engineering and operations0.65< 0.001Not applicableNot applicable350.760.57 to 0.871.000
Client servicing and communications0.49< 0.001Not applicableNot applicable160.77†0.994
Trade, settlement and reconciliation0.54< 0.001Not applicableNot applicable150.61†0.914
Payments, cards and disputes0.69< 0.001Not applicableNot applicable120.85†0.997
Credit, underwriting and suitability0.63< 0.001Not applicableNot applicable9‡‡
Regulatory, audit, tax and legal0.79< 0.001Not applicableNot applicable9‡‡
Financial crime and client onboarding0.73< 0.001Not applicableNot applicable7‡‡
Class of work
LOB Operational0.63< 0.001Not applicableNot applicable760.740.62 to 0.831.000
Corporate Functional0.69< 0.001Not applicableNot applicable740.780.66 to 0.851.000
Engagement status and lifecycle stage
Active, Build-Out0.56< 0.001Not applicableNot applicable310.660.41 to 0.820.995
Active, Transition/Cut-Over0.57< 0.001Not applicableNot applicable430.630.40 to 0.780.997
Active, Production0.43< 0.001Not applicableNot applicable200.46†0.777
Canceled0.050.436Not applicableNot applicable56−0.20−0.44 to 0.060.225
Respondent role
Individual Contributor0.70< 0.001Not applicableNot applicable1500.760.68 to 0.821.000
Engagement Manager0.63< 0.001Not applicableNot applicable1310.630.51 to 0.721.000
Portfolio Director0.440.053Not applicableNot applicable200.50†0.841
Customer Management Executive‡ n = 0
Vendor type
IT services major0.62< 0.001Not applicableNot applicable590.740.60 to 0.841.000
BPO specialist0.70< 0.001Not applicableNot applicable370.800.64 to 0.891.000
Consulting firm0.62< 0.001Not applicableNot applicable230.57†0.937
Boutique or specialist provider0.72< 0.001Not applicableNot applicable160.87†1.000
Pure-play agentic AI firm0.76< 0.001Not applicableNot applicable140.90†1.000
Not reported, recovered by engagement0.58< 0.001Not applicableNot applicable440.580.34 to 0.750.988
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

Respondents who gave higher ratings reported higher intent to leave (r = 0.66, 95% CI 0.62 to 0.70, Holm p < 0.001, n = 722 respondents). The association held after Holm correction in thirty-six of the 37 segment levels tested.

Association of Written Sentiment with the Study Measures

Table 14. Written sentiment and the study measuresTable
ComparisonWith a negative responseWithout a negative responseTestStatisticnp
Cancellation rate, engagements27 of 55 (49.09%)29 of 95 (30.53%)Fisher exact1500.035
Customer satisfaction, active engagements59.32%, n = 2866.12%, n = 66Welch t−2.71940.009
Engagement mean written score and cancellation, engagementsPoint-biserial r−0.19550.172
Respondent mean written score and intent to leave, respondentsSpearman rho−0.07710.549

Two comparisons set the engagements with at least one negative response against all other engagements. Of the 95 other engagements, 95 had no written response addressing the indicator. These two comparisons therefore do not isolate written sentiment. Of the 55 engagements with a negative response, 27 (49.09%) were canceled, against 29 of the 95 other engagements (30.53%). The difference reached significance (Fisher exact p = 0.035). Customer satisfaction among active engagements differed between the two groups (mean 59.32% on 28 engagements against 66.12% on 66, Welch t −2.71, p = 0.009).

Two correlations test written sentiment directly. Across the 55 engagements with a written response, the engagement mean written score was not associated with cancellation (point-biserial r −0.19, p = 0.172). Across 71 respondents, the respondent mean written score was not associated with intent to leave (Spearman rho −0.07, p = 0.549). Of the four comparisons, two reached significance at 0.05.

Comparison of Associations Across the Four Measures

Table 15. Associations across the four measuresTable
MeasureFormUnitnr95% CIpEquivalent to zeroRank among the four
Cancellation rateDescriptive contrastEngagement1500.700.60 to 0.77< 0.001No2
Customer satisfactionClean estimateEngagement94−0.65−0.76 to −0.52< 0.001No4
Engagement indicator meanFullEngagement150−0.84−0.88 to −0.79< 0.001No1
Intent to leaveRespondent level, clusteredRespondent7220.660.61 to 0.71< 0.001No3
Table 16. Pairwise comparison of associationsTable
Pair comparedDifference in rSteiger zpHolm pReading
Cancellation rate and customer satisfaction0.094.99< 0.001< 0.001Differed
Cancellation rate and engagement indicator mean0.154.33< 0.001< 0.001Differed
Cancellation rate and intent to leave0.051.580.1140.159Did not differ
Customer satisfaction and engagement indicator mean0.052.270.0230.069Did not differ
Customer satisfaction and intent to leave−0.04−1.750.0800.159Did not differ
Engagement indicator mean and intent to leave−0.09−3.62< 0.0010.001Differed

The four associations were compared in pairs on their engagement-level forms, each oriented so that a higher value is the better outcome, across the 150 engagements with all four measures. After Holm correction, three of the six pairs differed. The association with the engagement indicator mean was the strongest and the association with customer satisfaction the weakest.

Clustering and Effective Sample Size

Table 17. Clustering and effective sample sizeTable
StatisticValueReading
Clusters (engagements)150Engagements with one or more answers.
Mean respondents per engagement5.2Answers per engagement, among engagements with one or more answers.
ICC(1)0.54Share of the variance that lies between engagements.
Design effect3.23One plus the product of the ICC and the mean cluster size less one.
Nominal respondent n773Respondents who answered.
Effective n239Nominal n divided by the design effect.
Cluster bootstrap appliedYesApplied to every respondent-level interval where the ICC is 0.05 or above.

Answers clustered within engagements (ICC 0.54). Clustering reduced the 773 respondent answers to the equivalent of about 239 independent answers. Respondent-level intervals therefore used the cluster bootstrap. Respondent-level tests of intent to leave used standard errors that allow for clustering by engagement.

Equivalence Tests of Null Results

Table 18. Equivalence tests of null resultsTable
MeasurenrEquivalence boundTOST p, lowerTOST p, upperEquivalent to zeroAchieved powerMDE at power 0.80Detection floor for this n
Cancellation rate1500.70|r| < 0.30< 0.0011.000No0.960.230.23
Customer satisfaction94−0.65|r| < 0.301.000< 0.001No0.840.290.23
Engagement indicator mean150−0.84|r| < 0.301.000< 0.001No0.960.230.23
Intent to leave722, effective 2230.66|r| < 0.30< 0.0011.000No1.000.190.23

No association was equivalent to zero. Each of the four differed from zero. The detection floor shown is the study floor at 150 engagements. Intent to leave was tested on its effective sample size.

Robustness Checks

Table 19. Robustness checksTable
CheckMeasurePrimary rCheck r95% CIChangeConclusion holds
Rank correlation in place of PearsonCancellation rate0.700.71a0.01Yes
Rank correlation in place of PearsonCustomer satisfaction−0.65−0.63a0.03Yes
Rank correlation in place of PearsonEngagement indicator mean−0.84−0.85a−0.01Yes
Rank correlation in place of PearsonIntent to leave0.660.66a0.00Yes
Non-answers excluded, then imputed at the engagement meanIntent to leave0.660.66a−0.01Yes
Active engagements onlyEngagement indicator mean−0.84−0.73−0.81 to −0.620.12Yes
Active engagements onlyIntent to leave0.660.550.48 to 0.61−0.11Yes
Most influential engagement removed (largest Cook's distance)Cancellation rate0.700.720.63 to 0.790.02Yes
Most influential engagement removed (largest Cook's distance)Customer satisfaction−0.65−0.67−0.77 to −0.53−0.01Yes
Most influential engagement removed (largest Cook's distance)Engagement indicator mean−0.84−0.85−0.89 to −0.80−0.01Yes
Most influential engagement removed (largest Cook's distance)Intent to leave0.660.670.63 to 0.710.01Yes
Engagements weighted by respondent countCancellation rate0.700.70a0.00Yes
Engagements weighted by respondent countCustomer satisfaction−0.65−0.65a0.00Yes
Engagements weighted by respondent countEngagement indicator mean−0.84−0.83a0.01Yes
Bootstrap of engagementsCancellation rate0.700.700.61 to 0.780.00Yes
Bootstrap of engagementsCustomer satisfaction−0.65−0.65−0.76 to −0.520.00Yes
Bootstrap of engagementsEngagement indicator mean−0.84−0.84−0.89 to −0.790.00Yes
Bootstrap of engagementsIntent to leave0.660.660.61 to 0.710.00Yes
Thin-base segments removedCancellation rate0.700.750.63 to 0.830.05Yes
Thin-base segments removedCustomer satisfaction−0.65−0.61−0.76 to −0.410.04Yes
Thin-base segments removedEngagement indicator mean−0.84−0.82−0.88 to −0.730.03Yes
Thin-base segments removedIntent to leave0.660.660.59 to 0.71−0.01Yes
Note: a No interval for this check.

Each change was computed before rounding and may differ by 0.01 from the difference between the two printed values.

All 22 checks held. A check holds when its test falls on the same side of 0.05 as the primary test. Where the primary test falls below 0.05, the check must also keep the sign of the primary correlation. The thin-base check removes the engagements in any level of outsourcing model or process family with fewer than 30 engagements. Institution type is not used for that check, because every one of its levels has fewer than 30 engagements.

Measure Independence and Part-Whole Correction

Each of the four measures was computed from data the indicator does not contain. Each result is therefore a finding and not an arithmetic consequence.

Comparison with the Study Norm

Table 20. Comparison with the study normTable
MeasureThe indicator, oriented rStudy median, oriented rDeviationFisher zpHolm p
Cancellation rate−0.700.60−1.30−18.82< 0.001< 0.001
Customer satisfaction−0.790.72−1.51−24.00< 0.001< 0.001
Engagement indicator mean−0.840.84−1.68−29.64< 0.001< 0.001
Intent to leave−0.750.71−1.46−22.61< 0.001< 0.001
Spread of deviations0.39
VerdictDivergent

Each deviation was computed before rounding and may differ by 0.01 from the difference between the two printed values.

The comparison covered 150 engagements. The indicator departed from the study's typical pattern on all four measures. Its association was weaker than the norm on cancellation, customer satisfaction, the engagement indicator mean and intent to leave.

Comparison of Written Sentiment with Other Part 5 Indicators

Figure 6. Share of negative written responses, Part 5 indicators with 30 or more written responses (n = 13 indicators)Exhibit
0%25%50%75%100%C052C053C209C205C203C199C211C201C213C207C212C200C206Share of negative responsesMedian of the 13 indicators
Note: Each column is one indicator, ordered from the highest share of negative responses. The indicator is the amber column. The dashed line marks the median share, 98.03%.

Among the 13 Part 5 indicators with 30 or more written responses, the indicator's share of negative responses, 98.81%, ranked 5th from the highest, against a median of 98.03%. Its mean written score, −9.8, ranked 1st from the most negative, against a median of −6.3.

Co-Occurring Indicators and Themes

Figure 7. Other indicators and themes in the same written responses (n = 84 responses)Exhibit
020.7241.4462.1682.88C19974 (88.10%)Theme: Occurs every cycle or most days74 (88.10%)C09445 (53.57%)C20026 (30.95%)Theme: Told vendor-side management24 (28.57%)C20114 (16.67%)Theme: Raised it, nothing came back13 (15.48%)C10812 (14.29%)Theme: Stated periodic rate11 (13.10%)Theme: Normalised into the process8 (9.52%)Other indicatorsThemes
Note: Themes carry no score. Labels give the count and the share of the 84 responses. The figure shows each indicator and each theme among the five most frequent of its kind, with every tie at the cut. C199: “I have altered client-provided data” C094: “Rate the quality of the customer's data across the systems this engagement depends on.” C200: “I discussed the data alteration with internal management” C201: “I or my management discussed data alteration with the client” C108: “Rate the customer's ability to provision the system access and identities that AI agents require.” Emotional states in the same responses, as counts: resigned 8, tired 6, frustrated 2, calm or fine 2, stressed 2, proud 1.

The indicator most often present in the same responses was C199, “I have altered client-provided data”, in 74 of the 84 responses (88.10%). C094, “Rate the quality of the customer's data across the systems this engagement depends on.” (45 responses), C200, “I discussed the data alteration with internal management” (26 responses), C201, “I or my management discussed data alteration with the client” (14 responses) and C108, “Rate the customer's ability to provision the system access and identities that AI agents require.” (12 responses) followed.

The most frequent theme was “Occurs every cycle or most days”, in 74 responses (88.10%). The second was “Told vendor-side management”, in 24 responses.

Interpretation of the Data

Stronger agreement that the wider team regularly alters the data provided by the financial institution came with more cancellation, lower customer satisfaction among active engagements, a lower engagement indicator mean and higher intent to leave, and every association held under each of the 22 robustness checks. Respondents on canceled engagements rated the statement well above those on the three active stages (mean 6.9, n = 287 respondents).

The written evidence describes the alteration of data as the team's routine answer to source data that arrived in error every cycle and could not be corrected at its source. The team lead usually knew, the fixes were seldom recorded, and the financial institution was seldom told. The associations do not establish that the alterations produced the outcomes. The written responses describe them as one response to the same gaps in data readiness and access that the Part 5 ratings record.

Limitations

The evidence is the reported experience of the vendor's delivery teams, collected in a single cross-section. The associations reported here are not causal.

Tests by respondent role and by vendor type treated respondents as independent. The section on clustering reports how far clustering within engagements reduced the information in respondent-level figures.

Shares of written sentiment are shares of responses and not of the study set of respondents. The written score takes five fixed values, so its mean and median are coarse. Responses clustered within engagements (84 responses on 55 engagements). Intervals for written sentiment therefore used a bootstrap by engagement.

The written responses are counted by sets of words stated in each rule. A response that described a practice in other words is not counted, so each count is a floor.

Definitions

Table 21. DefinitionsTable
TermDefinition
Response scaleA rating from 1 to 10 of agreement with the statement, with no good or bad end. No distressed range applies.
Answering baseRespondents who gave a rating from 1 to 10.
Non-answers“I do not know” and “I prefer to not answer” are counted separately and excluded from the mean.
Indicator classRespondent level: a value recorded for each respondent and computed across the respondents who answered.
Failure categoryThe five failure categories of the Study Taxonomy apply only to the rated indicators. The indicator is not a rated indicator and carries none.
Engagement indicator meanThe mean of an engagement's ratings across the rated indicators. The indicator does not enter it.
Written responseA written answer about the respondent's own engagement that addresses the indicator. Non-answers and answers about another engagement are excluded.
Primary and secondaryA primary response answered the written-answer question of the indicator's survey section. A secondary response answered a question in another section and addressed the indicator in its content.
Written sentiment scoreEach written response carries one of five scores: −10, −5, neutral, +5 or +10. The sign records whether the response described the state of the indicator as harmful or helpful to the engagement. The magnitude records its strength. A score of −10 marks a statement of totality, constancy or serious harm.
Cluster bootstrapAn interval computed by resampling engagements rather than responses, so that the responses from one engagement stay together.

Sources and Provenance

Table 22. Sources and provenanceTable
SourceValue
Study dataStudy Data.xlsx, Data sheet, column C203, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record C203, sha256 1ae50a3637fc9370
ComputedOctober 13, 2026, 04:57 UTC
TemplateIndicator Template v2, version 2.0 of 10 October 2026
Figures placed by script2,650
Written responsesQuotes Master.jsonl, sha256 27da38085e2b13fd
Written sentiment scoresQuote Coding Rulebook, version 0.6, with section 21
Written-response computationqa_stats.py, sha256 74a61f3a96169da9. wfacts.py, sha256 b85fae20adf812a1. build_indicator.py, sha256 a97ad6e74627e11e
Written-response recordsC203.qa.json, sha256 b29db592ab056ce3. C203.wfacts.json, sha256 dba9da1ff27dc228. Hand-written text handcraft/C203.json, sha256 649792394ce65039

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →