Study Data · Part 5 · Indicator Deep-Dive Analysis

I have altered client-provided data

Indicator C199 · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeC199
Question as askedI have altered client-provided data
Failure categoryNot one of the 100 rated indicators
Place in the surveyChallenge Deep Dive > 5.6 Alterations > Client Data
Indicator classRespondent level
Indicator typeYes or no
Response scaleLevels: Yes, No
Answering base839 of 850 respondents gave one of the listed answers. 845 answered, counting I do not know and I prefer to not answer, across 150 of 150 engagements
Non-answersI do not know 1, I prefer to not answer 5, blank 5
Written responses addressing the indicator578 responses from 378 respondents on 128 engagements (548 primary, 30 secondary)

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureEffect sizenValuep
Cancellation rateOmega squared, 0 or 1 flag135 engagements0.269< 0.001
Customer satisfactionOmega squared82 engagements0.176< 0.001
Engagement indicator meanOmega squared135 engagements0.415< 0.001
Intent to leaveOmega squared135 engagements0.293< 0.001

Of the 839 respondents who answered, 421 (50.18%) answered True and 418 (49.82%) answered False. At engagement level, the answer was associated with all four study measures. Engagements whose respondents most often said they had altered data provided by the financial institution were canceled more often (61.84% of 76 engagements against 10.17% of 59), and recorded lower customer satisfaction among active engagements, a lower engagement indicator mean and higher intent to leave.

After Holm correction, the share answering True differed by engagement status and lifecycle stage (chi-square 37.31, Holm p < 0.001, Cramer's V 0.53): the share answering True was highest among respondents on canceled engagements (69.62%, n = 316 respondents) and lowest among respondents on active engagements in Transition/Cut-Over (36.59%, n = 246 respondents). It also differed by respondent role (chi-square 215.77, Holm p < 0.001, Cramer's V 0.51): the share answering True was highest among individual contributors (63.43%, n = 659 respondents) and lowest among portfolio directors (0.00%, n = 30 respondents). It also differed by vendor type (chi-square 19.90, Holm p = 0.007, Cramer's V 0.15): the share answering True was highest among respondents at vendors of the type “BPO specialist” (55.33%, n = 197 respondents) and lowest among respondents at vendors of the type “Pure-play agentic AI firm” (42.67%, n = 75 respondents). Outsourcing model, institution type, process family and class of work showed no difference.

The 578 written responses came from 378 respondents on 128 engagements, and 571 were negative. The respondents who answered C202, on why they altered the data, described data from the financial institution that arrived unusable, every cycle and after earlier cleaning, and access too limited to correct it at source. The respondents who commented under C204 described the alteration as routine and largely out of the financial institution's sight.

Distribution of Responses

Table 3. Distribution of responses, respondent levelTable
AnswerRespondentsShare of answered (base 839)Cumulative shareEngagements with at least oneShare of 150 engagementsDistressed
Yes42150.18%50.18%12784.67%Not applicable
No41849.82%100.00%14798.00%Not applicable
I do not know1Not in baseNot in base10.67%Not applicable
I prefer to not answer5Not in baseNot in base42.67%Not applicable
Answered, total839100.00%150100.00%

Of the 839 respondents who answered, 421 (50.18%) answered True and 418 (49.82%) answered False. The non-answers were I do not know (1) and I prefer to not answer (5). Each engagement was assigned the answer given by the largest number of its respondents. True was the assigned answer on 76 engagements and False on 59, and 15 engagements were tied and carry no assigned answer.

Coverage and Origin of Written Responses

Figure 1. Written responses addressing the indicator, by question answered and written score (n = 578 responses)Exhibit
078.68157.36236.04314.72C202 (primary)100179C204 (primary)128115C208 (primary)C210 (primary)C214 (primary)C114 (secondary)C198 (secondary)−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is one survey question. C202 and C204 and C208 and C210 and C214 are the written-answer questions of the indicator's survey section, so their responses are primary. The responses to every other question are secondary. Segments wide enough to hold a label carry their count. C202 asked: “Why did you alter client provided data?” C204 asked: “Comment” C208 asked: “Why did you alter client processes?” C210 asked: “Comment” C214 asked: “Why did you alter AI outputs?” C114 asked: “Add any comments on the customer organization that the ratings in this section do not capture.” C198 asked: “Add any comments on the third-party ecosystem that the ratings in this section do not capture.”
Table 4. Written responses by originTable
OriginResponsesRespondentsEngagementsNegativeStrongest negative (−10)PositiveMean written score
Primary548362123542 of 548 (98.91%)235 of 548 (42.88%)5 of 548 (0.91%)−7.0
Secondary30302629 of 30 (96.67%)11 of 30 (36.67%)1 of 30 (3.33%)−6.5
All responses578378128571 of 578 (98.79%)246 of 578 (42.56%)6 of 578 (1.04%)−7.0

The primary responses numbered 548, written in answer to C202, C204, C208, C210 and C214, the written-answer questions of the indicator's survey section. The remaining 30 responses, 5.19% of the total, were secondary and came from 2 other questions. That secondary share ranked 2nd from the highest among the 13 Part 5 indicators with 30 or more written responses, against a median of 2.00%. Respondents who wrote both a primary and a secondary response numbered 14. Negative responses made up 98.91% of primary responses (542 of 548) and 96.67% of secondary responses (29 of 30).

The 281 responses to C202 gave the reasons for altering the data. Across 94 responses, respondents named access: a legacy platform with no way in for an agent, a security team that would not approve a connection, read-only or expired credentials, or data copied off the display because no export existed. Respondents named missing, blank or dropped rows and values in 48 responses, a format or layout that changed between deliveries in 42, data that did not match between systems or a field that meant different things in different feeds in 44, and data that arrived dirty again after the team had cleaned it in 41. Reference data years out of date appeared in 33 responses and duplicate records in 28. Several added that decisions came after the deadline they were needed for, or that the AI tool gave a different result on each run.

The 247 responses to C204 described how the alteration was handled. Respondents placed it every day, cycle, week or file, or on most cases, in 161 responses. Respondents said the alteration was not reported, logged or raised, or was done quietly, in 78 responses, and that the financial institution was not told, or that they did not know whether it was, in 38. The team lead or manager appeared in 88, most often as someone who knew and could not change the source. Five responses across the indicator said the financial institution had been told or had asked for the corrections. Several respondents said they had become quick at spotting a bad file, and several said the work had worn them down.

Twelve responses described a private sheet, list, mapping file or tracker kept by the respondent to correct the data before each run. The responses to C208, C210 and C214 described altering the financial institution's processes or AI outputs as well as data, often because no one would make a decision in time.

Distribution of Written Sentiment

Figure 2. Distribution of written sentiment (n = 578 responses)Exhibit
0%25%50%75%100%−10 Strongly negative246 (42.56%)−5 Negative325 (56.23%)0 Neutral1 (0.17%)+5 Positive6 (1.04%)+10 Strongly positive0 (0.00%)Share of responses
Note: Column height is the share of the 578 responses. Labels give the count and the share.
Table 5. Summary statistics of written sentimentTable
StatisticValueBasis
Mean written score−7.095% CI −7.2 to −6.8, cluster bootstrap by engagement, 10,000 draws, n = 578 responses
Median written score−5.0n = 578 responses
Negative responses571 of 578 (98.79%)95% CI 97.86% to 99.62% of 578 responses, cluster bootstrap by engagement
Strongest negative responses (−10)246 of 578 (42.56%)Statements of totality, constancy or serious harm
Positive responses6 of 578 (1.04%)+5 or +10
Net balance−97.75 percentage pointsShare positive minus share negative, base 578 responses
Respondent-level mean−7.0Mean of each respondent's own mean written score, n = 378 respondents

Of the 578 responses, 571 (98.79%, 95% CI 97.86% to 99.62%) were negative and 246 (42.56%) carried the strongest negative score of −10. Positive responses numbered 6 (1.04%), and 1 was neutral. The mean written score was −7.0 (95% CI −7.2 to −6.8, n = 578 responses), and the median was −5.0.

Descriptive Statistics by Segment

Table 6. Descriptive statistics by segmentTable
SegmentBaseAnsweredAnswer rateEngagementsYes, shareNo, share
Study set85083998.71% of 85015050.18%49.82%
Outsourcing model
CXM23223099.14% of 2324252.61%47.39%
ITO24423897.54% of 2444044.96%55.04%
BPO20920799.04% of 2093751.21%48.79%
KPO16516499.39% of 1653153.05%46.95%
Institution type
Asset management132132100.00% of 1322453.79%46.21%
Wealth management and private banking14013596.43% of 1402345.93%54.07%
Investment banking (advisory and capital-markets origination)10510499.05% of 1051955.77%44.23%
Insurance (life, property and casualty, health)787697.44% of 781450.00%50.00%
Commercial and business banking828198.78% of 821353.09%46.91%
Payments and merchant acquiring (networks, acquiring, processing)717098.59% of 711344.29%55.71%
Credit card and payments issuing7373100.00% of 731256.16%43.84%
Retail and consumer banking737298.63% of 731245.83%54.17%
Markets and trading (sales and trading, global markets)5757100.00% of 571149.12%50.88%
Private equity and private capital3939100.00% of 39941.03%58.97%
Process family
Corporate and back-office functions24824699.19% of 2484756.10%43.90%
Technology engineering and operations204204100.00% of 2043542.65%57.35%
Client servicing and communications949398.94% of 941655.91%44.09%
Trade, settlement and reconciliation807998.75% of 801549.37%50.63%
Payments, cards and disputes737298.63% of 731238.89%61.11%
Credit, underwriting and suitability5757100.00% of 57945.61%54.39%
Regulatory, audit, tax and legal514690.20% of 51947.83%52.17%
Financial crime and client onboarding434297.67% of 43769.05%30.95%
Class of work
LOB Operational45144298.00% of 4517649.32%50.68%
Corporate Functional39939799.50% of 3997451.13%48.87%
Engagement status and lifecycle stage
Active, Build-Out175175100.00% of 1753141.71%58.29%
Active, Transition/Cut-Over25024698.40% of 2504336.59%63.41%
Active, Production10310299.03% of 1032037.25%62.75%
Canceled32231698.14% of 3225669.62%30.38%
Respondent role
Individual Contributor66765998.80% of 66715063.43%36.57%
Engagement Manager150150100.00% of 1501502.00%98.00%
Portfolio Director313096.77% of 31310.00%100.00%
Customer Management Executive200 of 2000
Vendor type
IT services major31630997.78% of 3165944.34%55.66%
BPO specialist19819799.49% of 1983755.33%44.67%
Consulting firm11711598.29% of 1172350.43%49.57%
Boutique or specialist provider8787100.00% of 871750.57%49.43%
Pure-play agentic AI firm7575100.00% of 751442.67%57.33%
Not reported, recovered by engagement575698.25% of 574773.21%26.79%

Each share is computed on the respondents who answered in that row. Rows with fewer than 10 respondents report counts only.

Tests of Difference Between Segments

Table 7. Tests of difference between segmentsTable
Segment familyUnitChi-squaredfpHolm pCramer's VTest for pLevels excluded
Outsourcing modelEngagement2.5730.4631.0000.14chi-squareNone
Institution typeEngagement6.0380.6601.0000.22Monte Carlo, simulatedPrivate equity and private capital, n = 9
Process familyEngagement6.2840.1820.7290.23Monte Carlo, simulatedCredit, underwriting and suitability, n = 7, Regulatory, audit, tax and legal, n = 7, Financial crime and client onboarding, n = 7
Class of workEngagement0.6310.4291.0000.07chi-squareNone
Engagement status and lifecycle stageEngagement37.313< 0.001< 0.0010.53chi-squareNone
Respondent roleRespondent215.772< 0.001< 0.0010.51chi-squareCustomer Management Executive, n = 0
Vendor typeRespondent19.9050.0010.0070.15chi-squareNone

Segment families recorded at engagement level were tested on engagements, and respondent role and vendor type on respondents. After Holm correction, the share answering True differed by engagement status and lifecycle stage (chi-square 37.31, Holm p < 0.001, Cramer's V 0.53): the share answering True was highest among respondents on canceled engagements (69.62%, n = 316 respondents) and lowest among respondents on active engagements in Transition/Cut-Over (36.59%, n = 246 respondents). It also differed by respondent role (chi-square 215.77, Holm p < 0.001, Cramer's V 0.51): the share answering True was highest among individual contributors (63.43%, n = 659 respondents) and lowest among portfolio directors (0.00%, n = 30 respondents). It also differed by vendor type (chi-square 19.90, Holm p = 0.007, Cramer's V 0.15): the share answering True was highest among respondents at vendors of the type “BPO specialist” (55.33%, n = 197 respondents) and lowest among respondents at vendors of the type “Pure-play agentic AI firm” (42.67%, n = 75 respondents). Outsourcing model, institution type, process family and class of work showed no difference.

Written Sentiment by Segment

Figure 3. Written sentiment by engagement status and lifecycle stage, share of each group's responsesExhibit
0%25%50%75%100%All responses (n = 578)42.6%56.2%Active, Build-Out (n = 93)39.8%58.1%Active, Transition/Cut-Over (n = 125)38.4%59.2%Active, Production (n = 55)34.5%65.5%Canceled (n = 305)46.6%52.8%−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is the whole of its group's responses, divided by written score from −10 at the left to +10 at the right. Segments large enough to hold a label carry their share.
Table 8. Written sentiment by segmentTable
SegmentResponsesRespondentsEngagementsMean written scoreNegativeStrongest negative (−10)
Engagement status and lifecycle stage
Active, Build-Out936627−6.891 of 93 (97.85%)37 of 93 (39.78%)
Active, Transition/Cut-Over1258033−6.7122 of 125 (97.60%)48 of 125 (38.40%)
Active, Production553413−6.755 of 55 (100.00%)19 of 55 (34.55%)
Canceled30519855−7.3303 of 305 (99.34%)142 of 305 (46.56%)
Respondent role
Individual Contributor561362127−7.0555 of 561 (98.93%)235 of 561 (41.89%)
Engagement Manager161515−8.416 of 16 (100.00%)11 of 16 (68.75%)
Portfolio Director111‡0 of 10 of 1
Customer Management Executive000No responses
Note: ‡ Base under 10. No statistic is reported.

Written sentiment did not differ by engagement status and lifecycle stage across the 128 engagements with a written response (Kruskal-Wallis H 6.50, df 3, p = 0.090). Of the groups with 10 or more responses, responses from canceled engagements were the most negative (mean −7.3, 305 responses) and responses from active engagements in Transition/Cut-Over the least negative (mean −6.7, 125 responses).

No test across respondent roles was run, because fewer than two roles had 30 or more written responses. Individual contributors wrote 561 responses, engagement managers 16 and portfolio directors 1.

Association with Cancellation Rate

Cancellation rate is the share of engagements canceled by the study date, measured at engagement level (150 engagements, 56 canceled). Canceled engagements were rated after cancellation. The association is therefore a descriptive contrast and not a forecast of cancellation. Each test compares the engagements by their assigned answer, within the study set and within each segment.

Table 9. Association with cancellation rate by answer levelTable
Answer levelEngagementsCanceledCancellation rate
Yes764761.84%
No59610.17%
I do not know0No engagements
I prefer to not answer0No engagements
Table 10. Association with cancellation rate, tests across answer levels by segmentTable
SegmentEngagementsChi-squaredfpHolm pCramer's VTest for p
Study set13537.191< 0.001< 0.0010.52chi-square
Outsourcing model
CXM3713.711< 0.0010.0010.61chi-square
ITO399.5510.0020.0080.49chi-square
BPO338.9710.0030.0080.52chi-square
KPO265.8510.0160.0310.47chi-square
Institution type
Asset management22a
Wealth management and private banking221.4710.3780.3780.26Fisher exact
Investment banking (advisory and capital-markets origination)17a
Insurance (life, property and casualty, health)12a
Commercial and business banking11a
Payments and merchant acquiring (networks, acquiring, processing)11a
Credit card and payments issuing11a
Retail and consumer banking10a
Markets and trading (sales and trading, global markets)10a
Private equity and private capital9‡
Process family
Corporate and back-office functions4311.551< 0.0010.0030.52chi-square
Technology engineering and operations3415.941< 0.001< 0.0010.68Fisher exact
Client servicing and communications14a
Trade, settlement and reconciliation13a
Payments, cards and disputes10a
Credit, underwriting and suitability7‡
Regulatory, audit, tax and legal7‡
Financial crime and client onboarding7‡
Class of work
LOB Operational6812.551< 0.0010.0020.43chi-square
Corporate Functional6726.921< 0.001< 0.0010.63chi-square
Engagement status and lifecycle stage
Active, Build-Outb
Active, Transition/Cut-Overb
Active, Productionb
Canceledb
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements. b Not tested: no variation in cancellation.

Of the engagements whose respondents most often answered True, 47 of 76 (61.84%) were canceled, against 6 of 59 (10.17%) of those whose respondents most often answered False (chi-square 37.19, p < 0.001, Cramer's V 0.52, n = 135 engagements). The difference reached significance and held after Holm correction in 8 of the 9 segment levels tested.

Association with Customer Satisfaction

Customer satisfaction is the percentage recorded against each engagement. The primary estimate uses the 94 active engagements.

Table 11. Association with customer satisfaction by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes2957.410.9
No5367.810.2
I do not know0No engagements
I prefer to not answer0No engagements
Table 12. Association with customer satisfaction, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set8217.741, 54.5< 0.001< 0.0010.1760.073 to 0.307
Outsourcing model
CXM23a
ITO24a
BPO19a
KPO16a
Institution type
Asset management11a
Wealth management and private banking14a
Investment banking (advisory and capital-markets origination)8‡
Insurance (life, property and casualty, health)7‡
Commercial and business banking7‡
Payments and merchant acquiring (networks, acquiring, processing)9‡
Credit card and payments issuing6‡
Retail and consumer banking6‡
Markets and trading (sales and trading, global markets)7‡
Private equity and private capital7‡
Process family
Corporate and back-office functions248.331, 15.80.0110.0210.251†
Technology engineering and operations24a
Client servicing and communications6‡
Trade, settlement and reconciliation6‡
Payments, cards and disputes8‡
Credit, underwriting and suitability6‡
Regulatory, audit, tax and legal4‡
Financial crime and client onboarding4‡
Class of work
LOB Operational407.571, 26.00.0110.0210.1440.026 to 0.335
Corporate Functional4210.511, 24.90.0030.0130.2030.060 to 0.388
Engagement status and lifecycle stage
Active, Build-Out26a
Active, Transition/Cut-Over3810.581, 21.00.0040.0130.2220.067 to 0.415
Active, Production18a
Canceledb
Note: ‡ Base under 10. No statistic is reported. † Base under 30. No interval is reported. a Not tested: fewer than two levels of 10 or more engagements. b Not tested: canceled engagements fall outside the active population.

Among active engagements, customer satisfaction had a mean of 57.4% (n = 29 engagements) where respondents most often answered True and 67.8% (n = 53 engagements) where they most often answered False (Welch F 17.74, p < 0.001, omega squared 0.176, n = 82 engagements). The difference reached significance and held after Holm correction in 4 of the 4 segment levels tested.

Association with the Engagement Indicator Mean

The engagement indicator mean is the mean of an engagement's ratings across the rated indicators, measured at engagement level. The indicator is not a rated indicator and does not enter the mean.

Table 13. Association with the engagement indicator mean by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes763.11.1
No595.11.2
I do not know0No engagements
I prefer to not answer0No engagements
Table 14. Association with the engagement indicator mean, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set13593.601, 115.9< 0.001< 0.0010.4150.316 to 0.505
Outsourcing model
CXM3746.401, 25.8< 0.001< 0.0010.5610.382 to 0.689
ITO3923.721, 36.9< 0.001< 0.0010.3680.183 to 0.537
BPO3314.031, 25.7< 0.0010.0020.2670.087 to 0.468
KPO2620.141, 21.7< 0.001< 0.0010.424†
Institution type
Asset management22a
Wealth management and private banking2210.901, 19.90.0040.0040.298†
Investment banking (advisory and capital-markets origination)17a
Insurance (life, property and casualty, health)12a
Commercial and business banking11a
Payments and merchant acquiring (networks, acquiring, processing)11a
Credit card and payments issuing11a
Retail and consumer banking10a
Markets and trading (sales and trading, global markets)10a
Private equity and private capital9‡
Process family
Corporate and back-office functions4326.671, 23.4< 0.001< 0.0010.3930.215 to 0.550
Technology engineering and operations3426.591, 30.4< 0.001< 0.0010.4330.231 to 0.598
Client servicing and communications14a
Trade, settlement and reconciliation13a
Payments, cards and disputes10a
Credit, underwriting and suitability7‡
Regulatory, audit, tax and legal7‡
Financial crime and client onboarding7‡
Class of work
LOB Operational6845.531, 57.3< 0.001< 0.0010.4040.263 to 0.530
Corporate Functional6750.281, 58.5< 0.001< 0.0010.4170.275 to 0.542
Engagement status and lifecycle stage
Active, Build-Out26a
Active, Transition/Cut-Over3817.071, 23.4< 0.0010.0010.3040.125 to 0.487
Active, Production18a
Canceled53a
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements.

The engagement indicator mean was 3.1 (n = 76 engagements) on engagements whose respondents most often answered True and 5.1 (n = 59 engagements) on those whose respondents most often answered False (Welch F 93.60, p < 0.001, omega squared 0.415, n = 135 engagements). The difference reached significance and held after Holm correction in 10 of the 10 segment levels tested.

Association with Intent to Leave

Intent to leave is the answer to C019, “How likely are you to leave your current job in the next 12 months?”, rated 1 to 10 by up to 798 respondents. For the indicator, the comparison uses the mean intent to leave of each engagement.

Table 15. Association with intent to leave by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes768.01.9
No595.42.1
I do not know0No engagements
I prefer to not answer0No engagements
Table 16. Association with intent to leave, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set13555.341, 116.7< 0.001< 0.0010.2930.196 to 0.393
Outsourcing model
CXM3740.971, 33.1< 0.001< 0.0010.4850.295 to 0.632
ITO3914.411, 29.9< 0.0010.0030.2500.087 to 0.438
BPO339.271, 22.50.0060.0230.2030.047 to 0.412
KPO267.581, 24.00.0110.0320.202†
Institution type
Asset management22a
Wealth management and private banking223.911, 18.70.0630.0630.105†
Investment banking (advisory and capital-markets origination)17a
Insurance (life, property and casualty, health)12a
Commercial and business banking11a
Payments and merchant acquiring (networks, acquiring, processing)11a
Credit card and payments issuing11a
Retail and consumer banking10a
Markets and trading (sales and trading, global markets)10a
Private equity and private capital9‡
Process family
Corporate and back-office functions4319.481, 28.4< 0.001< 0.0010.2840.119 to 0.459
Technology engineering and operations3430.051, 31.3< 0.001< 0.0010.4520.251 to 0.613
Client servicing and communications14a
Trade, settlement and reconciliation13a
Payments, cards and disputes10a
Credit, underwriting and suitability7‡
Regulatory, audit, tax and legal7‡
Financial crime and client onboarding7‡
Class of work
LOB Operational6817.781, 58.4< 0.001< 0.0010.2030.085 to 0.348
Corporate Functional6748.141, 61.1< 0.001< 0.0010.3990.257 to 0.526
Engagement status and lifecycle stage
Active, Build-Out26a
Active, Transition/Cut-Over387.871, 21.20.0110.0320.1690.036 to 0.366
Active, Production18a
Canceled53a
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements.

The engagement mean of intent to leave was 8.0 (n = 76 engagements) on engagements whose respondents most often answered True and 5.4 (n = 59 engagements) on those whose respondents most often answered False (Welch F 55.34, p < 0.001, omega squared 0.293, n = 135 engagements). The difference reached significance and held after Holm correction in 9 of the 10 segment levels tested.

Association of Written Sentiment with the Study Measures

Table 17. Written sentiment and the study measuresTable
ComparisonWith a negative responseWithout a negative responseTestStatisticnp
Cancellation rate, engagements55 of 128 (42.97%)1 of 22 (4.55%)Fisher exact150< 0.001
Customer satisfaction, active engagements61.89%, n = 7371.76%, n = 21Welch t−3.8394< 0.001
Engagement mean written score and cancellation, engagementsPoint-biserial r−0.201280.024
Respondent mean written score and intent to leave, respondentsSpearman rho−0.18346< 0.001

Two comparisons set the engagements with at least one negative response against all other engagements. Of the 22 other engagements, 22 had no written response addressing the indicator. These two comparisons therefore do not isolate written sentiment. Of the 128 engagements with a negative response, 55 (42.97%) were canceled, against 1 of the 22 other engagements (4.55%). The difference reached significance (Fisher exact p < 0.001). Customer satisfaction among active engagements differed between the two groups (mean 61.89% on 73 engagements against 71.76% on 21, Welch t −3.83, p < 0.001).

Two correlations test written sentiment directly. Across the 128 engagements with a written response, a more negative engagement mean written score came with cancellation (point-biserial r −0.20, p = 0.024). Across 346 respondents, a more negative respondent mean written score came with higher intent to leave (Spearman rho −0.18, p < 0.001). Of the four comparisons, all reached significance at 0.05.

Comparison of Associations Across the Four Measures

Table 18. Associations across the four measuresTable
MeasureEffect sizenValuepEquivalent to zeroRank among the four
Cancellation rateOmega squared, 0 or 1 flag1350.269< 0.001No3
Customer satisfactionOmega squared820.176< 0.001No4
Engagement indicator meanOmega squared1350.415< 0.001No1
Intent to leaveOmega squared1350.293< 0.001No2

Steiger's z compares two correlations. A categorical indicator yields an effect size across its levels and not a correlation, so the pairs of measures were not compared by test. On omega squared, the association was strongest with the engagement indicator mean (0.415) and weakest with customer satisfaction (0.176).

Clustering and Effective Sample Size

Table 19. Clustering and effective sample sizeTable
StatisticValueReading
Clusters (engagements)150Engagements with one or more answers.
Mean respondents per engagement5.6Answers per engagement, among engagements with one or more answers.
ICC(1)0.20Share of the variance that lies between engagements.
Design effect1.95One plus the product of the ICC and the mean cluster size less one.
Nominal respondent n845Every answer, with “I do not know” and “I prefer to not answer” counted as levels, as in the plurality rule.
Effective n434Nominal n divided by the design effect.
Cluster bootstrap appliedYesApplied to every respondent-level interval where the ICC is 0.05 or above.

Answers clustered within engagements (ICC 0.20). Clustering reduced the 845 respondent answers to the equivalent of about 434 independent answers. Respondent-level intervals therefore used the cluster bootstrap. Respondent-level tests used standard errors that allow for clustering by engagement.

Equivalence Tests of Null Results

Table 20. Equivalence tests of null resultsTable
MeasurenOmega squaredEquivalence boundEquivalence pEquivalent to zeroAchieved powerMDE at power 0.80
Cancellation rate1350.269Omega squared < 0.0900.999No0.950.056
Customer satisfaction820.176Omega squared < 0.0900.913No0.800.089
Engagement indicator mean1350.415Omega squared < 0.0901.000No0.950.056
Intent to leave1350.293Omega squared < 0.0901.000No0.950.056

No association was equivalent to zero. Each of the four differed from zero. The equivalence bound is an omega squared of 0.090, the study's threshold for a negligible association expressed as variance explained.

Robustness Checks

Table 21. Robustness checksTable
CheckMeasurePrimary pCheck pCheck statisticConclusion holds
Kruskal-Wallis in place of Welch FCustomer satisfaction< 0.001< 0.00115.03Yes
Kruskal-Wallis in place of Welch FEngagement indicator mean< 0.001< 0.00157.41Yes
Kruskal-Wallis in place of Welch FIntent to leave< 0.001< 0.00136.94Yes
Active engagements onlyEngagement indicator mean< 0.001< 0.00126.78Yes
Active engagements onlyIntent to leave< 0.0010.0068.21Yes
Respondent level, cluster-robust Wald F by engagementCancellation rate< 0.001< 0.00159.49Yes
Respondent level, cluster-robust Wald F by engagementCustomer satisfaction< 0.001< 0.00175.04Yes
Respondent level, cluster-robust Wald F by engagementEngagement indicator mean< 0.001< 0.001204.26Yes
Respondent level, cluster-robust Wald F by engagementIntent to leave< 0.001< 0.00187.34Yes

All nine checks held. A check holds when its test falls on the same side of 0.05 as the primary test. The checks replace Welch's F with a Kruskal-Wallis test, repeat the tests on active engagements alone, and repeat them at respondent level with a Wald F clustered by engagement.

Measure Independence and Part-Whole Correction

Each of the four measures was computed from data the indicator does not contain. Each result is therefore a finding and not an arithmetic consequence.

Comparison with the Study Norm

A categorical indicator has no signed correlation with the study measures and therefore no profile against the study norm. The comparison by answer appears in the four association sections.

Comparison of Written Sentiment with Other Part 5 Indicators

Figure 4. Share of negative written responses, Part 5 indicators with 30 or more written responses (n = 13 indicators)Exhibit
0%25%50%75%100%C052C053C209C205C203C199C211C201C213C207C212C200C206Share of negative responsesMedian of the 13 indicators
Note: Each column is one indicator, ordered from the highest share of negative responses. The indicator is the amber column. The dashed line marks the median share, 98.03%.

Among the 13 Part 5 indicators with 30 or more written responses, the indicator's share of negative responses, 98.79%, ranked 6th from the highest, against a median of 98.03%. Its mean written score, −7.0, ranked 5th from the most negative, against a median of −6.3.

Co-Occurring Indicators and Themes

Figure 5. Other indicators and themes in the same written responses (n = 578 responses)Exhibit
095.48190.96286.44381.92C094341 (59.00%)Theme: Occurs every cycle or most days215 (37.20%)C200128 (22.15%)Theme: Told vendor-side management102 (17.65%)C10892 (15.92%)C09688 (15.22%)C20374 (12.80%)C20174 (12.80%)Theme: Raised it, nothing came back57 (9.86%)Theme: Raising it is futile ordiscouraged42 (7.27%)Theme: Financial institution was nottold41 (7.09%)Other indicatorsThemes
Note: Themes carry no score. Labels give the count and the share of the 578 responses. The figure shows each indicator and each theme among the five most frequent of its kind, with every tie at the cut. C094: “Rate the quality of the customer's data across the systems this engagement depends on.” C200: “I discussed the data alteration with internal management” C108: “Rate the customer's ability to provision the system access and identities that AI agents require.” C096: “Rate how well the customer's data is normalized, with consistent formats and definitions across source systems.” C201: “I or my management discussed data alteration with the client” C203: “My greater team regularly alters client provided data.” Emotional states in the same responses, as counts: resigned 51, frustrated 37, tired 30, calm or fine 21, stressed 9, angry 1, proud 1.

The indicator most often present in the same responses was C094, “Rate the quality of the customer's data across the systems this engagement depends on.”, in 341 of the 578 responses (59.00%). C200, “I discussed the data alteration with internal management” (128 responses), C108, “Rate the customer's ability to provision the system access and identities that AI agents require.” (92 responses), C096, “Rate how well the customer's data is normalized, with consistent formats and definitions across source systems.” (88 responses) and C201, “I or my management discussed data alteration with the client” (74 responses) followed.

The most frequent theme was “Occurs every cycle or most days”, in 215 responses (37.20%). The second was “Told vendor-side management”, in 102 responses.

Interpretation of the Data

Half of the respondents who answered said they had altered data provided by the financial institution. Engagements whose respondents most often said so were canceled more often, recorded lower customer satisfaction and a lower engagement indicator mean, and their respondents reported higher intent to leave. Every association held under each of the robustness checks. The answer was given more often by individual contributors and on canceled engagements.

The written evidence describes alteration as routine work forced by the state of the data and the lack of access to its source, done every cycle and mostly kept within the team. Respondents rarely said the financial institution had been told. The associations do not establish that alteration produced the outcomes. The written responses describe alteration as one response to the same data and access problems that the other Part 5 indicators record.

Limitations

The evidence is the reported experience of the vendor's delivery teams, collected in a single cross-section. The associations reported here are not causal. The answer is the respondent's own report of an alteration and not a record of it.

Each engagement carries the answer given by the largest number of its respondents, and tied engagements are excluded from the engagement-level tests.

Shares of written sentiment are shares of responses and not of the study set of respondents. The written score takes five fixed values, so its mean and median are coarse. Responses clustered within engagements (578 responses on 128 engagements). Intervals for written sentiment therefore used a bootstrap by engagement.

The written responses are counted by sets of words stated in each rule. A response that described a reason in other words is not counted, so each count is a floor.

Definitions

Table 22. DefinitionsTable
TermDefinition
Response scaleThe answer is True or False to the statement shown in the indicator specification. The indicator is not a rating. No distressed range applies.
Answering baseRespondents who answered True or False.
Non-answers“I do not know” and “I prefer to not answer” are counted separately. They are excluded from the answering base and from the shares.
Indicator classRespondent level: a report of the respondent's own action. Each engagement also carries the answer given by the largest number of its respondents, for the engagement-level tests.
Failure categoryThe five failure categories of the Study Taxonomy apply only to the rated indicators. The indicator carries none.
Engagement indicator meanThe mean of an engagement's ratings across the rated indicators. The indicator does not enter it.
Written responseA written answer about the respondent's own engagement that addresses the indicator. Non-answers and answers about another engagement are excluded.
Primary and secondaryA primary response answered the written-answer question of the indicator's survey section. A secondary response answered a question in another section and addressed the indicator in its content.
Written sentiment scoreEach written response carries one of five scores: −10, −5, neutral, +5 or +10. The sign records whether the response described the state of the indicator as harmful or helpful to the engagement. The magnitude records its strength. A score of −10 marks a statement of totality, constancy or serious harm.
Cluster bootstrapAn interval computed by resampling engagements rather than responses, so that the responses from one engagement stay together.

Sources and Provenance

Table 23. Sources and provenanceTable
SourceValue
Study dataStudy Data.xlsx, Data sheet, column C199, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record C199, sha256 1ae50a3637fc9370
ComputedOctober 13, 2026, 04:57 UTC
TemplateIndicator Template v2, version 2.0 of 10 October 2026
Figures placed by script1,243
Written responsesQuotes Master.jsonl, sha256 27da38085e2b13fd
Written sentiment scoresQuote Coding Rulebook, version 0.6, with section 21
Written-response computationqa_stats.py, sha256 74a61f3a96169da9. wfacts.py, sha256 b85fae20adf812a1. build_indicator.py, sha256 a97ad6e74627e11e
Written-response recordsC199.qa.json, sha256 b0720089bdf8d123. C199.wfacts.json, sha256 3dca51e8f990452c. Hand-written text handcraft/C199.json, sha256 9a38dc1c200a8acf

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →