Study Data · Part 5 · Indicator Deep-Dive Analysis

I discussed the data alteration with internal management

Indicator C200 · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeC200
Question as askedI discussed the data alteration with internal management
Failure categoryNot one of the 100 rated indicators
Place in the surveyChallenge Deep Dive > 5.6 Alterations > Client Data
Indicator classRespondent level
Indicator typeYes or no
Response scaleLevels: Yes, No
Answering base401 of 850 respondents gave one of the listed answers. 409 answered, counting I do not know and I prefer to not answer, across 127 of 150 engagements
Non-answersI do not know 0, I prefer to not answer 8, blank 441
Written responses addressing the indicator210 responses from 204 respondents on 101 engagements (210 primary, 0 secondary)

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureEffect sizenValuep
Cancellation rateOmega squared, 0 or 1 flag113 engagements0.0320.032
Customer satisfactionNot tested: fewer than two levels of 10 or more engagements
Engagement indicator meanOmega squared113 engagements0.0290.014
Intent to leaveOmega squared113 engagements0.0480.003

Of the 401 respondents who answered, 292 (72.82%) answered True and 109 (27.18%) answered False. At engagement level, the answer was associated with cancellation, the engagement indicator mean and intent to leave. Engagements whose respondents most often said they had discussed the data alteration with internal management were canceled less often (39.77% of 88 engagements against 64.00% of 25), recorded a higher engagement indicator mean and had lower intent to leave among their respondents. The association with customer satisfaction was not tested, because fewer than two answers were assigned to at least ten engagements.

The share answering True did not differ by any segment family after Holm correction.

Of the 210 written responses, 172 were positive and 37 negative. The positive responses, nearly all under C204, said the respondent had told the team lead or manager, and some added that the financial institution was not told. Most negative responses came from respondents who had told no one, or no one above them.

Distribution of Responses

Table 3. Distribution of responses, respondent levelTable
AnswerRespondentsShare of answered (base 401)Cumulative shareEngagements with at least oneShare of 150 engagementsDistressed
Yes29272.82%72.82%11274.67%Not applicable
No10927.18%100.00%5436.00%Not applicable
I prefer to not answer8Not in baseNot in base85.33%Not applicable
Answered, total401100.00%12684.00%

Of the 401 respondents who answered, 292 (72.82%) answered True and 109 (27.18%) answered False. The non-answers were I prefer to not answer (8). Each engagement was assigned the answer given by the largest number of its respondents. True was the assigned answer on 88 engagements and False on 25, “I prefer to not answer” on 1, and 36 engagements were tied or unanswered and carry no assigned answer.

Coverage and Origin of Written Responses

Figure 1. Written responses addressing the indicator, by question answered and written score (n = 210 responses)Exhibit
054.88109.76164.64219.52C204 (primary)3113426C202 (primary)C210 (primary)C208 (primary)−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is one survey question. C204, C202, C210 and C208 are the written-answer questions of the indicator's survey section, so their responses are primary. The responses to every other question are secondary. Segments wide enough to hold a label carry their count. C204 asked: “Comment” C202 asked: “Why did you alter client provided data?” C210 asked: “Comment” C208 asked: “Why did you alter client processes?”
Table 4. Written responses by originTable
OriginResponsesRespondentsEngagementsNegativeStrongest negative (−10)PositiveMean written score
Primary21020410137 of 210 (17.62%)32 of 210 (15.24%)172 of 210 (81.90%)3.1
Secondary000000None
All responses21020410137 of 210 (17.62%)32 of 210 (15.24%)172 of 210 (81.90%)3.1

The primary responses numbered 210, written in answer to C204, C202, C210 and C208, the written-answer questions of the indicator's survey section. No response from any other question addressed the indicator, so every response was primary.

The 196 responses to C204 described how the alteration was handled within the vendor. In 150, the respondent said they told the team lead, manager or team, or that the lead or manager already knew. Respondents placed the alteration at a frequency, such as every cycle, most weeks or seven out of ten, in 143 responses, and said that telling the lead changed nothing at the financial institution in 27.

Across all questions, respondents said the financial institution was not told in 41 responses. Two responses said the financial institution had been told directly or in writing. In 34 of the 37 negative responses, the respondent said they had told no one, or no one above them, of the alteration, several because raising it had changed nothing before, and one because the respondent was new to the team.

Distribution of Written Sentiment

Figure 2. Distribution of written sentiment (n = 210 responses)Exhibit
0%25%50%75%100%−10 Strongly negative32 (15.24%)−5 Negative5 (2.38%)0 Neutral1 (0.48%)+5 Positive144 (68.57%)+10 Strongly positive28 (13.33%)Share of responses
Note: Column height is the share of the 210 responses. Labels give the count and the share.
Table 5. Summary statistics of written sentimentTable
StatisticValueBasis
Mean written score3.195% CI 2.2 to 3.9, cluster bootstrap by engagement, 10,000 draws, n = 210 responses
Median written score5.0n = 210 responses
Negative responses37 of 210 (17.62%)95% CI 12.38% to 23.30% of 210 responses, cluster bootstrap by engagement
Strongest negative responses (−10)32 of 210 (15.24%)Statements of totality, constancy or serious harm
Positive responses172 of 210 (81.90%)+5 or +10
Net balance64.29 percentage pointsShare positive minus share negative, base 210 responses
Respondent-level mean3.1Mean of each respondent's own mean written score, n = 204 respondents

Of the 210 responses, 37 (17.62%, 95% CI 12.38% to 23.30%) were negative and 32 (15.24%) carried the strongest negative score of −10. Positive responses numbered 172 (81.90%), and 1 was neutral. The mean written score was 3.1 (95% CI 2.2 to 3.9, n = 210 responses), and the median was 5.0.

Descriptive Statistics by Segment

Table 6. Descriptive statistics by segmentTable
SegmentBaseAnsweredAnswer rateEngagementsYes, shareNo, share
Study set85040147.18% of 85012772.82%27.18%
Outsourcing model
CXM23211850.86% of 2323475.42%24.58%
ITO2449739.75% of 2443260.82%39.18%
BPO20910047.85% of 2093381.00%19.00%
KPO1658652.12% of 1652873.26%26.74%
Institution type
Asset management1326952.27% of 1322278.26%21.74%
Wealth management and private banking1405841.43% of 1401965.52%34.48%
Investment banking (advisory and capital-markets origination)1055754.29% of 1051863.16%36.84%
Insurance (life, property and casualty, health)783747.44% of 781378.38%21.62%
Commercial and business banking824150.00% of 821063.41%36.59%
Payments and merchant acquiring (networks, acquiring, processing)712839.44% of 711067.86%32.14%
Credit card and payments issuing733852.05% of 731178.95%21.05%
Retail and consumer banking733142.47% of 73977.42%22.58%
Markets and trading (sales and trading, global markets)572747.37% of 571088.89%11.11%
Private equity and private capital391538.46% of 39580.00%20.00%
Process family
Corporate and back-office functions24813353.63% of 2484280.45%19.55%
Technology engineering and operations2048039.22% of 2042771.25%28.75%
Client servicing and communications945053.19% of 941460.00%40.00%
Trade, settlement and reconciliation803948.75% of 801474.36%25.64%
Payments, cards and disputes732331.51% of 731069.57%30.43%
Credit, underwriting and suitability572543.86% of 57776.00%24.00%
Regulatory, audit, tax and legal512243.14% of 51768.18%31.82%
Financial crime and client onboarding432967.44% of 43665.52%34.48%
Class of work
LOB Operational45120645.68% of 4516366.50%33.50%
Corporate Functional39919548.87% of 3996479.49%20.51%
Engagement status and lifecycle stage
Active, Build-Out1756939.43% of 1752884.06%15.94%
Active, Transition/Cut-Over2508835.20% of 2503379.55%20.45%
Active, Production1033433.01% of 1031176.47%23.53%
Canceled32221065.22% of 3225565.71%34.29%
Respondent role
Individual Contributor66739859.67% of 66712772.61%27.39%
Engagement Manager15032.00% of 150330
Portfolio Director3100.00% of 31000
Customer Management Executive200 of 2000
Vendor type
IT services major31612740.19% of 3164864.57%35.43%
BPO specialist19810854.55% of 1983178.70%21.30%
Consulting firm1175647.86% of 1172171.43%28.57%
Boutique or specialist provider874045.98% of 871680.00%20.00%
Pure-play agentic AI firm753040.00% of 751176.67%23.33%
Not reported, recovered by engagement574070.18% of 573275.00%25.00%

Each share is computed on the respondents who answered in that row. Rows with fewer than 10 respondents report counts only.

Tests of Difference Between Segments

Table 7. Tests of difference between segmentsTable
Segment familyUnitChi-squaredfpHolm pCramer's VTest for pLevels excluded
Outsourcing modelEngagement4.4330.2190.6150.20chi-squareNone
Institution typeEngagement1.6040.8340.8340.15Monte Carlo, simulatedb
Process familyEngagement5.1830.1540.6150.25Monte Carlo, simulatedc
Class of workEngagement3.9610.0470.2800.19chi-squareNone
Engagement status and lifecycle stageEngagement5.2820.0710.3560.23chi-squareActive, Production, n = 9
Respondent roleRespondentaEngagement Manager, n = 3, Portfolio Director, n = 0, Customer Management Executive, n = 0
Vendor typeRespondent7.6850.1750.6150.14chi-squareNone
Note: a Not tested: fewer than two levels of 10 or more engagements. b Levels excluded: Commercial and business banking, n = 8, Payments and merchant acquiring (networks, acquiring, processing), n = 9, Retail and consumer banking, n = 8, Markets and trading (sales and trading, global markets), n = 9, Private equity and private capital, n = 5. c Levels excluded: Payments, cards and disputes, n = 9, Credit, underwriting and suitability, n = 5, Regulatory, audit, tax and legal, n = 7, Financial crime and client onboarding, n = 6.

Segment families recorded at engagement level were tested on engagements, and respondent role and vendor type on respondents. The share answering True did not differ by any segment family after Holm correction.

Written Sentiment by Segment

Figure 3. Written sentiment by engagement status and lifecycle stage, share of each group's responsesExhibit
0%25%50%75%100%All responses (n = 210)15.2%68.6%13.3%Active, Build-Out (n = 40)10.0%72.5%17.5%Active, Transition/Cut-Over (n = 46)10.9%73.9%15.2%Active, Production (n = 16)12.5%62.5%18.8%Canceled (n = 108)20.4%65.7%10.2%−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is the whole of its group's responses, divided by written score from −10 at the left to +10 at the right. Segments large enough to hold a label carry their share.
Table 8. Written sentiment by segmentTable
SegmentResponsesRespondentsEngagementsMean written scoreNegativeStrongest negative (−10)
Engagement status and lifecycle stage
Active, Build-Out4040224.44 of 40 (10.00%)4 of 40 (10.00%)
Active, Transition/Cut-Over4644254.15 of 46 (10.87%)5 of 46 (10.87%)
Active, Production161573.83 of 16 (18.75%)1 of 16 (6.25%)
Canceled108105472.125 of 108 (23.15%)22 of 108 (20.37%)
Respondent role
Individual Contributor2052001013.137 of 205 (18.05%)32 of 205 (15.61%)
Engagement Manager544‡0 of 50 of 5
Portfolio Director000No responses
Customer Management Executive000No responses
Note: ‡ Base under 10. No statistic is reported.

Written sentiment did not differ by engagement status and lifecycle stage across the 101 engagements with a written response (Kruskal-Wallis H 6.83, df 3, p = 0.078). Of the groups with 10 or more responses, responses from canceled engagements were the most negative (mean 2.1, 108 responses) and responses from active engagements in Build-Out the least negative (mean 4.4, 40 responses).

No test across respondent roles was run, because fewer than two roles had 30 or more written responses. Individual contributors wrote 205 responses, engagement managers 5.

Association with Cancellation Rate

Cancellation rate is the share of engagements canceled by the study date, measured at engagement level (150 engagements, 56 canceled). Canceled engagements were rated after cancellation. The association is therefore a descriptive contrast and not a forecast of cancellation. Each test compares the engagements by their assigned answer, within the study set and within each segment.

Table 9. Association with cancellation rate by answer levelTable
Answer levelEngagementsCanceledCancellation rate
Yes883539.77%
No251664.00%
I prefer to not answer11‡
Note: ‡ Base under 10. No statistic is reported.
Table 10. Association with cancellation rate, tests across answer levels by segmentTable
SegmentEngagementsChi-squaredfpHolm pCramer's VTest for p
Study set1134.6110.0320.0930.20chi-square
Outsourcing model
CXM29a
ITO315.2310.0310.0930.41Fisher exact
BPO30a
KPO24a
Institution type
Asset management22a
Wealth management and private banking16a
Investment banking (advisory and capital-markets origination)14a
Insurance (life, property and casualty, health)12a
Commercial and business banking8‡
Payments and merchant acquiring (networks, acquiring, processing)9‡
Credit card and payments issuing11a
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)9‡
Private equity and private capital5‡
Process family
Corporate and back-office functions35a
Technology engineering and operations25a
Client servicing and communications14a
Trade, settlement and reconciliation13a
Payments, cards and disputes9‡
Credit, underwriting and suitability5‡
Regulatory, audit, tax and legal7‡
Financial crime and client onboarding6‡
Class of work
LOB Operational574.4710.0350.0930.28chi-square
Corporate Functional56a
Engagement status and lifecycle stage
Active, Build-Outb
Active, Transition/Cut-Overb
Active, Productionb
Canceledb
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements. b Not tested: no variation in cancellation.

Of the engagements whose respondents most often answered True, 35 of 88 (39.77%) were canceled, against 16 of 25 (64.00%) of those whose respondents most often answered False (chi-square 4.61, p = 0.032, Cramer's V 0.20, n = 113 engagements). The difference reached significance and held after Holm correction in 0 of the 2 segment levels tested.

Association with Customer Satisfaction

Customer satisfaction is the percentage recorded against each engagement. The primary estimate uses the 94 active engagements.

Table 11. Association with customer satisfaction by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes5362.910.5
No9‡
I prefer to not answer0No engagements
Note: ‡ Base under 10. No statistic is reported.
Table 12. Association with customer satisfaction, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set62a
Outsourcing model
CXM15a
ITO17a
BPO17a
KPO13a
Institution type
Asset management9‡
Wealth management and private banking9‡
Investment banking (advisory and capital-markets origination)6‡
Insurance (life, property and casualty, health)7‡
Commercial and business banking5‡
Payments and merchant acquiring (networks, acquiring, processing)6‡
Credit card and payments issuing6‡
Retail and consumer banking4‡
Markets and trading (sales and trading, global markets)7‡
Private equity and private capital3‡
Process family
Corporate and back-office functions19a
Technology engineering and operations15a
Client servicing and communications5‡
Trade, settlement and reconciliation5‡
Payments, cards and disputes7‡
Credit, underwriting and suitability4‡
Regulatory, audit, tax and legal4‡
Financial crime and client onboarding3‡
Class of work
LOB Operational29a
Corporate Functional33a
Engagement status and lifecycle stage
Active, Build-Out24a
Active, Transition/Cut-Over29a
Active, Production9‡
Canceledb
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements. b Not tested: canceled engagements fall outside the active population.

Among active engagements, customer satisfaction was 62.9% (n = 53 engagements) where respondents most often answered True and 57.0% (n = 9 engagements) where respondents most often answered False. No test was computed, because fewer than two answers were assigned to at least ten engagements.

Association with the Engagement Indicator Mean

The engagement indicator mean is the mean of an engagement's ratings across the rated indicators, measured at engagement level. The indicator is not a rated indicator and does not enter the mean.

Table 13. Association with the engagement indicator mean by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes883.81.3
No253.20.9
I prefer to not answer1‡
Note: ‡ Base under 10. No statistic is reported.
Table 14. Association with the engagement indicator mean, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set1136.491, 55.90.0140.0410.0290.001 to 0.110
Outsourcing model
CXM29a
ITO313.221, 27.50.0840.1670.0490.000 to 0.257
BPO30a
KPO24a
Institution type
Asset management22a
Wealth management and private banking16a
Investment banking (advisory and capital-markets origination)14a
Insurance (life, property and casualty, health)12a
Commercial and business banking8‡
Payments and merchant acquiring (networks, acquiring, processing)9‡
Credit card and payments issuing11a
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)9‡
Private equity and private capital5‡
Process family
Corporate and back-office functions35a
Technology engineering and operations25a
Client servicing and communications14a
Trade, settlement and reconciliation13a
Payments, cards and disputes9‡
Credit, underwriting and suitability5‡
Regulatory, audit, tax and legal7‡
Financial crime and client onboarding6‡
Class of work
LOB Operational578.831, 45.20.0050.0190.0860.011 to 0.236
Corporate Functional56a
Engagement status and lifecycle stage
Active, Build-Out24a
Active, Transition/Cut-Over29a
Active, Production9‡
Canceled513.121, 22.80.0910.1670.0540.000 to 0.207
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements.

The engagement indicator mean was 3.8 (n = 88 engagements) on engagements whose respondents most often answered True and 3.2 (n = 25 engagements) on those whose respondents most often answered False (Welch F 6.49, p = 0.014, omega squared 0.029, n = 113 engagements). The difference reached significance and held after Holm correction in 1 of the 3 segment levels tested.

Association with Intent to Leave

Intent to leave is the answer to C019, “How likely are you to leave your current job in the next 12 months?”, rated 1 to 10 by up to 798 respondents. For the indicator, the comparison uses the mean intent to leave of each engagement.

Table 15. Association with intent to leave by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes886.92.4
No258.21.7
I prefer to not answer1‡
Note: ‡ Base under 10. No statistic is reported.
Table 16. Association with intent to leave, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set1139.591, 52.80.0030.0120.0480.007 to 0.138
Outsourcing model
CXM29a
ITO317.521, 27.40.0110.0250.1400.015 to 0.359
BPO30a
KPO24a
Institution type
Asset management22a
Wealth management and private banking16a
Investment banking (advisory and capital-markets origination)14a
Insurance (life, property and casualty, health)12a
Commercial and business banking8‡
Payments and merchant acquiring (networks, acquiring, processing)9‡
Credit card and payments issuing11a
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)9‡
Private equity and private capital5‡
Process family
Corporate and back-office functions35a
Technology engineering and operations25a
Client servicing and communications14a
Trade, settlement and reconciliation13a
Payments, cards and disputes9‡
Credit, underwriting and suitability5‡
Regulatory, audit, tax and legal7‡
Financial crime and client onboarding6‡
Class of work
LOB Operational577.741, 40.00.0080.0250.0830.010 to 0.233
Corporate Functional56a
Engagement status and lifecycle stage
Active, Build-Out24a
Active, Transition/Cut-Over29a
Active, Production9‡
Canceled511.471, 22.10.2370.2370.0170.000 to 0.153
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements.

The engagement mean of intent to leave was 6.9 (n = 88 engagements) on engagements whose respondents most often answered True and 8.2 (n = 25 engagements) on those whose respondents most often answered False (Welch F 9.59, p = 0.003, omega squared 0.048, n = 113 engagements). The difference reached significance and held after Holm correction in 2 of the 3 segment levels tested.

Association of Written Sentiment with the Study Measures

Table 17. Written sentiment and the study measuresTable
ComparisonWith a negative responseWithout a negative responseTestStatisticnp
Cancellation rate, engagements21 of 32 (65.63%)35 of 118 (29.66%)Fisher exact150< 0.001
Customer satisfaction, active engagements53.09%, n = 1165.55%, n = 83Welch t−5.6994< 0.001
Engagement mean written score and cancellation, engagementsPoint-biserial r−0.191010.060
Respondent mean written score and intent to leave, respondentsSpearman rho−0.141820.057

Two comparisons set the engagements with at least one negative response against all other engagements. Of the 118 other engagements, 49 had no written response addressing the indicator. These two comparisons therefore do not isolate written sentiment. Of the 32 engagements with a negative response, 21 (65.63%) were canceled, against 35 of the 118 other engagements (29.66%). The difference reached significance (Fisher exact p < 0.001). Customer satisfaction among active engagements differed between the two groups (mean 53.09% on 11 engagements against 65.55% on 83, Welch t −5.69, p < 0.001).

Two correlations test written sentiment directly. Across the 101 engagements with a written response, the engagement mean written score was not associated with cancellation (point-biserial r −0.19, p = 0.060). Across 182 respondents, the respondent mean written score was not associated with intent to leave (Spearman rho −0.14, p = 0.057). Of the four comparisons, two reached significance at 0.05.

Comparison of Associations Across the Four Measures

Table 18. Associations across the four measuresTable
MeasureEffect sizenValuepEquivalent to zeroRank among the four
Cancellation rateOmega squared, 0 or 1 flag1130.0320.032No2
Customer satisfactionNot tested: fewer than two levels of 10 or more engagements
Engagement indicator meanOmega squared1130.0290.014No3
Intent to leaveOmega squared1130.0480.003No1

Steiger's z compares two correlations. A categorical indicator yields an effect size across its levels and not a correlation, so the pairs of measures were not compared by test. On omega squared, the association was strongest with intent to leave (0.048) and weakest with the engagement indicator mean (0.029). The association with customer satisfaction was not tested and has no effect size.

Clustering and Effective Sample Size

Table 19. Clustering and effective sample sizeTable
StatisticValueReading
Clusters (engagements)127Engagements with one or more answers.
Mean respondents per engagement3.2Answers per engagement, among engagements with one or more answers.
ICC(1)0.40Share of the variance that lies between engagements.
Design effect1.88One plus the product of the ICC and the mean cluster size less one.
Nominal respondent n409Every answer, with “I do not know” and “I prefer to not answer” counted as levels, as in the plurality rule.
Effective n218Nominal n divided by the design effect.
Cluster bootstrap appliedYesApplied to every respondent-level interval where the ICC is 0.05 or above.

Answers clustered within engagements (ICC 0.40). Clustering reduced the 409 respondent answers to the equivalent of about 218 independent answers. Respondent-level intervals therefore used the cluster bootstrap. Respondent-level tests used standard errors that allow for clustering by engagement.

Equivalence Tests of Null Results

Table 20. Equivalence tests of null resultsTable
MeasurenOmega squaredEquivalence boundEquivalence pEquivalent to zeroAchieved powerMDE at power 0.80
Cancellation rate1130.032Omega squared < 0.0900.123No0.910.066
Customer satisfactiona
Engagement indicator mean1130.029Omega squared < 0.0900.104No0.910.066
Intent to leave1130.048Omega squared < 0.0900.229No0.910.066
Note: a Not tested: fewer than two levels of 10 or more engagements.

No association tested was equivalent to zero. The equivalence bound is an omega squared of 0.090, the study's threshold for a negligible association expressed as variance explained.

Robustness Checks

Table 21. Robustness checksTable
CheckMeasurePrimary pCheck pCheck statisticConclusion holds
Kruskal-Wallis in place of Welch FCustomer satisfactionNot computedNot computedNot computedNot computed
Kruskal-Wallis in place of Welch FEngagement indicator mean0.0140.0583.59No
Kruskal-Wallis in place of Welch FIntent to leave0.0030.0334.54Yes
Active engagements onlyEngagement indicator mean0.014Not computedNot computedNot computed
Active engagements onlyIntent to leave0.003Not computedNot computedNot computed
Respondent level, cluster-robust Wald F by engagementCancellation rate0.0320.0165.91Yes
Respondent level, cluster-robust Wald F by engagementCustomer satisfactionNot computed< 0.00112.17Not computed
Respondent level, cluster-robust Wald F by engagementEngagement indicator mean0.014< 0.00129.60Yes
Respondent level, cluster-robust Wald F by engagementIntent to leave0.003< 0.00120.05Yes

Four of the five checks computed held. Four checks were not computed, because the primary test or the check had too few engagements in a level: the Kruskal-Wallis check for customer satisfaction, the check on active engagements alone for the engagement indicator mean, the check on active engagements alone for intent to leave and the respondent-level clustered check for customer satisfaction. A check holds when its test falls on the same side of 0.05 as the primary test. The checks replace Welch's F with a Kruskal-Wallis test, repeat the tests on active engagements alone, and repeat them at respondent level with a Wald F clustered by engagement.

One check failed. The Kruskal-Wallis check for the engagement indicator mean gave p = 0.058, against p = 0.014 for the primary test.

Measure Independence and Part-Whole Correction

Each of the four measures was computed from data the indicator does not contain. Each result is therefore a finding and not an arithmetic consequence.

Comparison with the Study Norm

A categorical indicator has no signed correlation with the study measures and therefore no profile against the study norm. The comparison by answer appears in the four association sections.

Comparison of Written Sentiment with Other Part 5 Indicators

Figure 4. Share of negative written responses, Part 5 indicators with 30 or more written responses (n = 13 indicators)Exhibit
0%25%50%75%100%C052C053C209C205C203C199C211C201C213C207C212C200C206Share of negative responsesMedian of the 13 indicators
Note: Each column is one indicator, ordered from the highest share of negative responses. The indicator is the amber column. The dashed line marks the median share, 98.03%.

Among the 13 Part 5 indicators with 30 or more written responses, the indicator's share of negative responses, 17.62%, ranked 12th from the highest, against a median of 98.03%. Its mean written score, 3.1, ranked 12th from the most negative, against a median of −6.3.

Co-Occurring Indicators and Themes

Figure 5. Other indicators and themes in the same written responses (n = 210 responses)Exhibit
049.5699.12148.68198.24Theme: Told vendor-side management177 (84.29%)C199128 (60.95%)Theme: Occurs every cycle or most days101 (48.10%)C20184 (40.00%)C09471 (33.81%)Theme: Financial institution was nottold60 (28.57%)Theme: Raised it, nothing came back42 (20.00%)Theme: Stated periodic rate33 (15.71%)C20326 (12.38%)C10919 (9.05%)C10819 (9.05%)Other indicatorsThemes
Note: Themes carry no score. Labels give the count and the share of the 210 responses. The figure shows each indicator and each theme among the five most frequent of its kind, with every tie at the cut. C199: “I have altered client-provided data” C201: “I or my management discussed data alteration with the client” C094: “Rate the quality of the customer's data across the systems this engagement depends on.” C203: “My greater team regularly alters client provided data.” C108: “Rate the customer's ability to provision the system access and identities that AI agents require.” C109: “Rate how quickly the customer responds when this engagement raises issues that need customer action.” Emotional states in the same responses, as counts: resigned 31, calm or fine 18, tired 11, frustrated 9, stressed 2, proud 1.

The indicator most often present in the same responses was C199, “I have altered client-provided data”, in 128 of the 210 responses (60.95%). C201, “I or my management discussed data alteration with the client” (84 responses), C094, “Rate the quality of the customer's data across the systems this engagement depends on.” (71 responses), C203, “My greater team regularly alters client provided data.” (26 responses) and C108, “Rate the customer's ability to provision the system access and identities that AI agents require.” (19 responses) followed.

The most frequent theme was “Told vendor-side management”, in 177 responses (84.29%). The second was “Occurs every cycle or most days”, in 101 responses.

Interpretation of the Data

Of the respondents who answered, 72.82% said they had discussed the data alteration with internal management. Engagements whose respondents most often said so were canceled less often, recorded a higher engagement indicator mean and reported lower intent to leave than those whose respondents most often said they had not. The association with customer satisfaction was not tested. The association with the engagement indicator mean did not hold under the Kruskal-Wallis check.

The written evidence describes disclosure that stopped inside the vendor. Respondents who discussed the alteration told the team lead or manager, and few responses said the financial institution had been told. Respondents who told no one described the same alterations made in silence. The associations do not establish that internal disclosure produced the outcomes.

Limitations

The evidence is the reported experience of the vendor's delivery teams, collected in a single cross-section. The associations reported here are not causal. The answer is the respondent's own report of an alteration and not a record of it.

Each engagement carries the answer given by the largest number of its respondents, and tied engagements are excluded from the engagement-level tests.

Shares of written sentiment are shares of responses and not of the study set of respondents. The written score takes five fixed values, so its mean and median are coarse. Responses clustered within engagements (210 responses on 101 engagements). Intervals for written sentiment therefore used a bootstrap by engagement.

The written responses are counted by sets of words stated in each rule. A response that described a practice in other words is not counted, so each count is a floor.

Only 25 engagements were assigned the answer False, so the comparisons rest on a small group.

Definitions

Table 22. DefinitionsTable
TermDefinition
Response scaleThe answer is True or False to the statement shown in the indicator specification. The indicator is not a rating. No distressed range applies.
Answering baseRespondents who answered True or False.
Non-answers“I do not know” and “I prefer to not answer” are counted separately. They are excluded from the answering base and from the shares.
Indicator classRespondent level: a report of the respondent's own action. Each engagement also carries the answer given by the largest number of its respondents, for the engagement-level tests.
Failure categoryThe five failure categories of the Study Taxonomy apply only to the rated indicators. The indicator carries none.
Engagement indicator meanThe mean of an engagement's ratings across the rated indicators. The indicator does not enter it.
Written responseA written answer about the respondent's own engagement that addresses the indicator. Non-answers and answers about another engagement are excluded.
Primary and secondaryA primary response answered the written-answer question of the indicator's survey section. A secondary response answered a question in another section and addressed the indicator in its content.
Written sentiment scoreEach written response carries one of five scores: −10, −5, neutral, +5 or +10. The sign records whether the response described the state of the indicator as harmful or helpful to the engagement. The magnitude records its strength. A score of −10 marks a statement of totality, constancy or serious harm.
Cluster bootstrapAn interval computed by resampling engagements rather than responses, so that the responses from one engagement stay together.

Sources and Provenance

Table 23. Sources and provenanceTable
SourceValue
Study dataStudy Data.xlsx, Data sheet, column C200, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record C200, sha256 1ae50a3637fc9370
ComputedOctober 13, 2026, 04:57 UTC
TemplateIndicator Template v2, version 2.0 of 10 October 2026
Figures placed by script953
Written responsesQuotes Master.jsonl, sha256 27da38085e2b13fd
Written sentiment scoresQuote Coding Rulebook, version 0.6, with section 21
Written-response computationqa_stats.py, sha256 74a61f3a96169da9. wfacts.py, sha256 b85fae20adf812a1. build_indicator.py, sha256 c7b10c57927ea734
Written-response recordsC200.qa.json, sha256 8162ae153330282f. C200.wfacts.json, sha256 b0a29f7db9363c6c. Hand-written text handcraft/C200.json, sha256 01a81c59267d711f

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →