Study Data · Part 5 · Indicator Deep-Dive Analysis

I or my management discussed process alteration with the client

Indicator C207 · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeC207
Question as askedI or my management discussed process alteration with the client
Failure categoryNot one of the 100 rated indicators
Place in the surveyChallenge Deep Dive > 5.6 Alterations > Client Processes
Indicator classRespondent level
Indicator typeYes or no
Response scaleLevels: Yes, No
Answering base414 of 850 respondents gave one of the listed answers. 473 answered, counting I do not know and I prefer to not answer, across 131 of 150 engagements
Non-answersI do not know 37, I prefer to not answer 22, blank 377
Written responses addressing the indicator124 responses from 114 respondents on 68 engagements (123 primary, 1 secondary)

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureEffect sizenValuep
Cancellation rateNot tested: fewer than two levels of 10 or more engagements
Customer satisfactionNot tested: fewer than two levels of 10 or more engagements
Engagement indicator meanNot tested: fewer than two levels of 10 or more engagements
Intent to leaveNot tested: fewer than two levels of 10 or more engagements

Of the 414 respondents who answered, 9 (2.17%) answered True and 405 (97.83%) answered False. No association with the study measures was tested, because fewer than two answers were assigned to at least ten engagements.

The share answering True did not differ by any segment family after Holm correction.

Of the 124 written responses, 99 were negative. At least 57 of the 99 negative responses said the financial institution was not told, or that the alteration stayed within the vendor team. Twelve responses said the financial institution had been told or already knew, and four described changes signed off by the financial institution before they were applied.

Distribution of Responses

Table 3. Distribution of responses, respondent levelTable
AnswerRespondentsShare of answered (base 414)Cumulative shareEngagements with at least oneShare of 150 engagementsDistressed
Yes92.17%2.17%96.00%Not applicable
No40597.83%100.00%12784.67%Not applicable
I do not know37Not in baseNot in base1510.00%Not applicable
I prefer to not answer22Not in baseNot in base1812.00%Not applicable
Answered, total414100.00%12885.33%

Of the 414 respondents who answered, 9 (2.17%) answered True and 405 (97.83%) answered False. The non-answers were I do not know (37) and I prefer to not answer (22). Each engagement was assigned the answer given by the largest number of its respondents. No engagement was assigned True, and False was the assigned answer on 116 engagements, “I do not know” on 7, “I prefer to not answer” on 1, and 26 engagements were tied or unanswered and carry no assigned answer.

Coverage and Origin of Written Responses

Figure 1. Written responses addressing the indicator, by question answered and written score (n = 124 responses)Exhibit
029.9659.9289.88119.84C210 (primary)6723C208 (primary)C204 (primary)C156 (secondary)−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is one survey question. C210, C208 and C204 are the written-answer questions of the indicator's survey section, so their responses are primary. The responses to every other question are secondary. Segments wide enough to hold a label carry their count. C210 asked: “Comment” C208 asked: “Why did you alter client processes?” C204 asked: “Comment” C156 asked: “Add any comments on the joint management of this engagement that the ratings in this section do not capture.”
Table 4. Written responses by originTable
OriginResponsesRespondentsEngagementsNegativeStrongest negative (−10)PositiveMean written score
Primary1231136798 of 123 (79.67%)73 of 123 (59.35%)15 of 123 (12.20%)−6.2
Secondary1111 of 10 of 10 of 1‡
All responses1241146899 of 124 (79.84%)73 of 124 (58.87%)15 of 124 (12.10%)−6.2
Note: ‡ Base under 10. No statistic is reported.

The primary responses numbered 123, written in answer to C210, C208 and C204, the written-answer questions of the indicator's survey section. The remaining 1 responses, 0.81% of the total, were secondary and came from 1 other questions. That secondary share ranked 10th from the highest among the 13 Part 5 indicators with 30 or more written responses, against a median of 2.00%. Respondents who wrote both a primary and a secondary response numbered 0. Negative responses made up 79.67% of primary responses (98 of 123) and 1 of the 1 secondary responses.

In 57 of the 99 negative responses, the respondent said the financial institution was not told, or that the alteration stayed within the team. In 53, the team lead or manager was told or knew. Several respondents said the financial institution saw only the finished, clean version of the work.

Twelve responses said the financial institution had been told directly, had been looped in as the team built its own steps, or already knew that the team made process calls on its behalf. Four positive responses described every change routed through a joint forum or a formal review and signed off by the financial institution before it was applied. Nine responses said the respondent did not know whether the financial institution was told.

Distribution of Written Sentiment

Figure 2. Distribution of written sentiment (n = 124 responses)Exhibit
0%25%50%75%100%−10 Strongly negative73 (58.87%)−5 Negative26 (20.97%)0 Neutral10 (8.06%)+5 Positive11 (8.87%)+10 Strongly positive4 (3.23%)Share of responses
Note: Column height is the share of the 124 responses. Labels give the count and the share.
Table 5. Summary statistics of written sentimentTable
StatisticValueBasis
Mean written score−6.295% CI −7.3 to −5.0, cluster bootstrap by engagement, 10,000 draws, n = 124 responses
Median written score−10.0n = 124 responses
Negative responses99 of 124 (79.84%)95% CI 70.48% to 87.97% of 124 responses, cluster bootstrap by engagement
Strongest negative responses (−10)73 of 124 (58.87%)Statements of totality, constancy or serious harm
Positive responses15 of 124 (12.10%)+5 or +10
Net balance−67.74 percentage pointsShare positive minus share negative, base 124 responses
Respondent-level mean−6.3Mean of each respondent's own mean written score, n = 114 respondents

Of the 124 responses, 99 (79.84%, 95% CI 70.48% to 87.97%) were negative and 73 (58.87%) carried the strongest negative score of −10. Positive responses numbered 15 (12.10%), and 10 were neutral. The mean written score was −6.2 (95% CI −7.3 to −5.0, n = 124 responses), and the median was −10.0.

Descriptive Statistics by Segment

Table 6. Descriptive statistics by segmentTable
SegmentBaseAnsweredAnswer rateEngagementsYes, shareNo, share
Study set85041448.71% of 8501312.17%97.83%
Outsourcing model
CXM23210746.12% of 232361.87%98.13%
ITO24411848.36% of 244330.85%99.15%
BPO20911052.63% of 209362.73%97.27%
KPO1657947.88% of 165263.80%96.20%
Institution type
Asset management1325642.42% of 132193.57%96.43%
Wealth management and private banking1407654.29% of 140191.32%98.68%
Investment banking (advisory and capital-markets origination)1057066.67% of 105194.29%95.71%
Insurance (life, property and casualty, health)783241.03% of 78113.13%96.88%
Commercial and business banking823441.46% of 82110.00%100.00%
Payments and merchant acquiring (networks, acquiring, processing)713346.48% of 71110.00%100.00%
Credit card and payments issuing733649.32% of 73110.00%100.00%
Retail and consumer banking733446.58% of 73122.94%97.06%
Markets and trading (sales and trading, global markets)572849.12% of 57100.00%100.00%
Private equity and private capital391538.46% of 3986.67%93.33%
Process family
Corporate and back-office functions24811044.35% of 248404.55%95.45%
Technology engineering and operations20410250.00% of 204290.98%99.02%
Client servicing and communications944952.13% of 94140.00%100.00%
Trade, settlement and reconciliation804353.75% of 80152.33%97.67%
Payments, cards and disputes733750.68% of 73110.00%100.00%
Credit, underwriting and suitability572645.61% of 5770.00%100.00%
Regulatory, audit, tax and legal512752.94% of 5183.70%96.30%
Financial crime and client onboarding432046.51% of 4375.00%95.00%
Class of work
LOB Operational45121948.56% of 451671.83%98.17%
Corporate Functional39919548.87% of 399642.56%97.44%
Engagement status and lifecycle stage
Active, Build-Out1757241.14% of 175260.00%100.00%
Active, Transition/Cut-Over25011345.20% of 250351.77%98.23%
Active, Production1033836.89% of 103160.00%100.00%
Canceled32219159.32% of 322543.66%96.34%
Respondent role
Individual Contributor66740560.72% of 6671310.00%100.00%
Engagement Manager15096.00% of 150990
Portfolio Director3100.00% of 31000
Customer Management Executive200 of 2000
Vendor type
IT services major31614846.84% of 316490.00%100.00%
BPO specialist19810452.53% of 198363.85%96.15%
Consulting firm1175244.44% of 117181.92%98.08%
Boutique or specialist provider874248.28% of 87154.76%95.24%
Pure-play agentic AI firm753344.00% of 75116.06%93.94%
Not reported, recovered by engagement573561.40% of 57340.00%100.00%

Each share is computed on the respondents who answered in that row. Rows with fewer than 10 respondents report counts only.

Tests of Difference Between Segments

Table 7. Tests of difference between segmentsTable
Segment familyUnitChi-squaredfpHolm pCramer's VTest for pLevels excluded
Outsourcing modelEngagementaNone
Institution typeEngagementbc
Process familyEngagementbCredit, underwriting and suitability, n = 7, Regulatory, audit, tax and legal, n = 7, Financial crime and client onboarding, n = 5
Class of workEngagementaNone
Engagement status and lifecycle stageEngagementaNone
Respondent roleRespondentbEngagement Manager, n = 9, Portfolio Director, n = 0, Customer Management Executive, n = 0
Vendor typeRespondent9.1250.1060.1060.15Monte Carlo, simulatedNone
Note: a Not tested: fewer than two levels on one side of the table. b Not tested: fewer than two levels of 10 or more engagements. c Levels excluded: Insurance (life, property and casualty, health), n = 9, Commercial and business banking, n = 7, Markets and trading (sales and trading, global markets), n = 8, Private equity and private capital, n = 7.

Segment families recorded at engagement level were tested on engagements, and respondent role and vendor type on respondents. The share answering True did not differ by any segment family after Holm correction.

Written Sentiment by Segment

Figure 3. Written sentiment by engagement status and lifecycle stage, share of each group's responsesExhibit
0%25%50%75%100%All responses (n = 124)58.9%21.0%8.9%Active, Build-Out (n = 13)46.2%30.8%15.4%Active, Transition/Cut-Over (n = 31)58.1%29.0%Active, Production (n = 11)63.6%27.3%9.1%Canceled (n = 69)60.9%14.5%11.6%−10 Strongly negative−5 Negative0 Neutral+5 Positive+10 Strongly positive
Note: Each bar is the whole of its group's responses, divided by written score from −10 at the left to +10 at the right. Segments large enough to hold a label carry their share.
Table 8. Written sentiment by segmentTable
SegmentResponsesRespondentsEngagementsMean written scoreNegativeStrongest negative (−10)
Engagement status and lifecycle stage
Active, Build-Out13139−5.410 of 13 (76.92%)6 of 13 (46.15%)
Active, Transition/Cut-Over312716−6.627 of 31 (87.10%)18 of 31 (58.06%)
Active, Production11118−7.310 of 11 (90.91%)7 of 11 (63.64%)
Canceled696335−5.952 of 69 (75.36%)42 of 69 (60.87%)
Respondent role
Individual Contributor11210463−7.296 of 112 (85.71%)72 of 112 (64.29%)
Engagement Manager755‡2 of 71 of 7
Portfolio Director555‡1 of 50 of 5
Customer Management Executive000No responses
Note: ‡ Base under 10. No statistic is reported.

Written sentiment did not differ by engagement status and lifecycle stage across the 68 engagements with a written response (Kruskal-Wallis H 0.56, df 3, p = 0.906). Of the groups with 10 or more responses, responses from active engagements in Production were the most negative (mean −7.3, 11 responses) and responses from active engagements in Build-Out the least negative (mean −5.4, 13 responses).

No test across respondent roles was run, because fewer than two roles had 30 or more written responses. Individual contributors wrote 112 responses, engagement managers 7 and portfolio directors 5.

Association with Cancellation Rate

Cancellation rate is the share of engagements canceled by the study date, measured at engagement level (150 engagements, 56 canceled). Canceled engagements were rated after cancellation. The association is therefore a descriptive contrast and not a forecast of cancellation. Each test compares the engagements by their assigned answer, within the study set and within each segment.

Table 9. Association with cancellation rate by answer levelTable
Answer levelEngagementsCanceledCancellation rate
Yes0No engagements
No1164740.52%
I do not know74‡
I prefer to not answer11‡
Note: ‡ Base under 10. No statistic is reported.
Table 10. Association with cancellation rate, tests across answer levels by segmentTable
SegmentEngagementsChi-squaredfpHolm pCramer's VTest for p
Study set124a
Outsourcing model
CXM33a
ITO32a
BPO34a
KPO25a
Institution type
Asset management18a
Wealth management and private banking18a
Investment banking (advisory and capital-markets origination)19a
Insurance (life, property and casualty, health)10a
Commercial and business banking10a
Payments and merchant acquiring (networks, acquiring, processing)11a
Credit card and payments issuing11a
Retail and consumer banking11a
Markets and trading (sales and trading, global markets)9‡
Private equity and private capital7‡
Process family
Corporate and back-office functions38a
Technology engineering and operations28a
Client servicing and communications12a
Trade, settlement and reconciliation14a
Payments, cards and disputes11a
Credit, underwriting and suitability7‡
Regulatory, audit, tax and legal8‡
Financial crime and client onboarding6‡
Class of work
LOB Operational62a
Corporate Functional62a
Engagement status and lifecycle stage
Active, Build-Outb
Active, Transition/Cut-Overb
Active, Productionb
Canceledb
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements. b Not tested: no variation in cancellation.

Of the engagements assigned False, 47 of 116 were canceled. No test was computed, because fewer than two answers were assigned to at least ten engagements.

Association with Customer Satisfaction

Customer satisfaction is the percentage recorded against each engagement. The primary estimate uses the 94 active engagements.

Table 11. Association with customer satisfaction by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes0No engagements
No6961.010.5
I do not know3‡
I prefer to not answer0No engagements
Note: ‡ Base under 10. No statistic is reported.
Table 12. Association with customer satisfaction, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set72a
Outsourcing model
CXM18a
ITO19a
BPO21a
KPO14a
Institution type
Asset management6‡
Wealth management and private banking12a
Investment banking (advisory and capital-markets origination)10a
Insurance (life, property and casualty, health)5‡
Commercial and business banking6‡
Payments and merchant acquiring (networks, acquiring, processing)8‡
Credit card and payments issuing6‡
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)6‡
Private equity and private capital5‡
Process family
Corporate and back-office functions20a
Technology engineering and operations19a
Client servicing and communications3‡
Trade, settlement and reconciliation7‡
Payments, cards and disputes9‡
Credit, underwriting and suitability6‡
Regulatory, audit, tax and legal5‡
Financial crime and client onboarding3‡
Class of work
LOB Operational36a
Corporate Functional36a
Engagement status and lifecycle stage
Active, Build-Out25a
Active, Transition/Cut-Over32a
Active, Production15a
Canceledb
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements. b Not tested: canceled engagements fall outside the active population.

Among active engagements, customer satisfaction was 61.0% (n = 69 engagements) where respondents most often answered False. No test was computed, because fewer than two answers were assigned to at least ten engagements.

Association with the Engagement Indicator Mean

The engagement indicator mean is the mean of an engagement's ratings across the rated indicators, measured at engagement level. The indicator is not a rated indicator and does not enter the mean.

Table 13. Association with the engagement indicator mean by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes0No engagements
No1163.81.3
I do not know7‡
I prefer to not answer1‡
Note: ‡ Base under 10. No statistic is reported.
Table 14. Association with the engagement indicator mean, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set124a
Outsourcing model
CXM33a
ITO32a
BPO34a
KPO25a
Institution type
Asset management18a
Wealth management and private banking18a
Investment banking (advisory and capital-markets origination)19a
Insurance (life, property and casualty, health)10a
Commercial and business banking10a
Payments and merchant acquiring (networks, acquiring, processing)11a
Credit card and payments issuing11a
Retail and consumer banking11a
Markets and trading (sales and trading, global markets)9‡
Private equity and private capital7‡
Process family
Corporate and back-office functions38a
Technology engineering and operations28a
Client servicing and communications12a
Trade, settlement and reconciliation14a
Payments, cards and disputes11a
Credit, underwriting and suitability7‡
Regulatory, audit, tax and legal8‡
Financial crime and client onboarding6‡
Class of work
LOB Operational62a
Corporate Functional62a
Engagement status and lifecycle stage
Active, Build-Out25a
Active, Transition/Cut-Over32a
Active, Production15a
Canceled52a
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements.

The engagement indicator mean was 3.8 (n = 116 engagements) where respondents most often answered False. No test was computed, because fewer than two answers were assigned to at least ten engagements.

Association with Intent to Leave

Intent to leave is the answer to C019, “How likely are you to leave your current job in the next 12 months?”, rated 1 to 10 by up to 798 respondents. For the indicator, the comparison uses the mean intent to leave of each engagement.

Table 15. Association with intent to leave by answer levelTable
Answer levelEngagementsMean of the measureSD
Yes0No engagements
No1167.12.2
I do not know7‡
I prefer to not answer1‡
Note: ‡ Base under 10. No statistic is reported.
Table 16. Association with intent to leave, tests across answer levels by segmentTable
SegmentEngagementsWelch FdfpHolm pOmega squared90% CI
Study set124a
Outsourcing model
CXM33a
ITO32a
BPO34a
KPO25a
Institution type
Asset management18a
Wealth management and private banking18a
Investment banking (advisory and capital-markets origination)19a
Insurance (life, property and casualty, health)10a
Commercial and business banking10a
Payments and merchant acquiring (networks, acquiring, processing)11a
Credit card and payments issuing11a
Retail and consumer banking11a
Markets and trading (sales and trading, global markets)9‡
Private equity and private capital7‡
Process family
Corporate and back-office functions38a
Technology engineering and operations28a
Client servicing and communications12a
Trade, settlement and reconciliation14a
Payments, cards and disputes11a
Credit, underwriting and suitability7‡
Regulatory, audit, tax and legal8‡
Financial crime and client onboarding6‡
Class of work
LOB Operational62a
Corporate Functional62a
Engagement status and lifecycle stage
Active, Build-Out25a
Active, Transition/Cut-Over32a
Active, Production15a
Canceled52a
Note: ‡ Base under 10. No statistic is reported. a Not tested: fewer than two levels of 10 or more engagements.

The engagement mean of intent to leave was 7.1 (n = 116 engagements) where respondents most often answered False. No test was computed, because fewer than two answers were assigned to at least ten engagements.

Association of Written Sentiment with the Study Measures

Table 17. Written sentiment and the study measuresTable
ComparisonWith a negative responseWithout a negative responseTestStatisticnp
Cancellation rate, engagements28 of 58 (48.28%)28 of 92 (30.43%)Fisher exact1500.037
Customer satisfaction, active engagements60.90%, n = 3065.59%, n = 64Welch t−2.0094< 0.050
Engagement mean written score and cancellation, engagementsPoint-biserial r0.07680.565
Respondent mean written score and intent to leave, respondentsSpearman rho0.001040.975

Two comparisons set the engagements with at least one negative response against all other engagements. Of the 92 other engagements, 82 had no written response addressing the indicator. These two comparisons therefore do not isolate written sentiment. Of the 58 engagements with a negative response, 28 (48.28%) were canceled, against 28 of the 92 other engagements (30.43%). The difference reached significance (Fisher exact p = 0.037). Customer satisfaction among active engagements differed between the two groups (mean 60.90% on 30 engagements against 65.59% on 64, Welch t −2.00, p < 0.050).

Two correlations test written sentiment directly. Across the 68 engagements with a written response, the engagement mean written score was not associated with cancellation (point-biserial r 0.07, p = 0.565). Across 104 respondents, the respondent mean written score was not associated with intent to leave (Spearman rho 0.00, p = 0.975). Of the four comparisons, two reached significance at 0.05.

Comparison of Associations Across the Four Measures

Table 18. Associations across the four measuresTable
MeasureEffect sizenValuepEquivalent to zeroRank among the four
Cancellation rateNot tested: fewer than two levels of 10 or more engagements
Customer satisfactionNot tested: fewer than two levels of 10 or more engagements
Engagement indicator meanNot tested: fewer than two levels of 10 or more engagements
Intent to leaveNot tested: fewer than two levels of 10 or more engagements

Fewer than two associations were tested, so no comparison across the measures applies.

Clustering and Effective Sample Size

Table 19. Clustering and effective sample sizeTable
StatisticValueReading
Clusters (engagements)131Engagements with one or more answers.
Mean respondents per engagement3.6Answers per engagement, among engagements with one or more answers.
ICC(1)0.38Share of the variance that lies between engagements.
Design effect2.00One plus the product of the ICC and the mean cluster size less one.
Nominal respondent n473Every answer, with “I do not know” and “I prefer to not answer” counted as levels, as in the plurality rule.
Effective n237Nominal n divided by the design effect.
Cluster bootstrap appliedYesApplied to every respondent-level interval where the ICC is 0.05 or above.

Answers clustered within engagements (ICC 0.38). Clustering reduced the 473 respondent answers to the equivalent of about 237 independent answers. Respondent-level intervals therefore used the cluster bootstrap. Respondent-level tests used standard errors that allow for clustering by engagement.

Equivalence Tests of Null Results

Table 20. Equivalence tests of null resultsTable
MeasurenOmega squaredEquivalence boundEquivalence pEquivalent to zeroAchieved powerMDE at power 0.80
Cancellation ratea
Customer satisfactiona
Engagement indicator meana
Intent to leavea
Note: a Not tested: fewer than two levels of 10 or more engagements.

No association was tested, so no equivalence test applies. The equivalence bound is an omega squared of 0.090, the study's threshold for a negligible association expressed as variance explained.

Robustness Checks

Table 21. Robustness checksTable
CheckMeasurePrimary pCheck pCheck statisticConclusion holds
Kruskal-Wallis in place of Welch FCustomer satisfactionNot computedNot computedNot computedNot computed
Kruskal-Wallis in place of Welch FEngagement indicator meanNot computedNot computedNot computedNot computed
Kruskal-Wallis in place of Welch FIntent to leaveNot computedNot computedNot computedNot computed
Active engagements onlyEngagement indicator meanNot computedNot computedNot computedNot computed
Active engagements onlyIntent to leaveNot computedNot computedNot computedNot computed
Respondent level, cluster-robust Wald F by engagementCancellation rateNot computed0.0215.47Not computed
Respondent level, cluster-robust Wald F by engagementCustomer satisfactionNot computed< 0.00116.19Not computed
Respondent level, cluster-robust Wald F by engagementEngagement indicator meanNot computed< 0.00127.38Not computed
Respondent level, cluster-robust Wald F by engagementIntent to leaveNot computed< 0.00116.19Not computed

No robustness check could be computed, because no primary test was computed.

Measure Independence and Part-Whole Correction

Each of the four measures was computed from data the indicator does not contain. Each result is therefore a finding and not an arithmetic consequence.

Comparison with the Study Norm

A categorical indicator has no signed correlation with the study measures and therefore no profile against the study norm. The comparison by answer appears in the four association sections.

Comparison of Written Sentiment with Other Part 5 Indicators

Figure 4. Share of negative written responses, Part 5 indicators with 30 or more written responses (n = 13 indicators)Exhibit
0%25%50%75%100%C052C053C209C205C203C199C211C201C213C207C212C200C206Share of negative responsesMedian of the 13 indicators
Note: Each column is one indicator, ordered from the highest share of negative responses. The indicator is the amber column. The dashed line marks the median share, 98.03%.

Among the 13 Part 5 indicators with 30 or more written responses, the indicator's share of negative responses, 79.84%, ranked 10th from the highest, against a median of 98.03%. Its mean written score, −6.2, ranked 9th from the most negative, against a median of −6.3.

Co-Occurring Indicators and Themes

Figure 5. Other indicators and themes in the same written responses (n = 124 responses)Exhibit
026.3252.6478.96105.28C20694 (75.81%)Theme: Told vendor-side management80 (64.52%)C20578 (62.90%)Theme: Financial institution was nottold76 (61.29%)Theme: Occurs every cycle or most days35 (28.23%)C20927 (21.77%)Theme: Stated periodic rate27 (21.77%)Theme: Financial institution was told19 (15.32%)C10918 (14.52%)C10012 (9.68%)Other indicatorsThemes
Note: Themes carry no score. Labels give the count and the share of the 124 responses. The figure shows each indicator and each theme among the five most frequent of its kind, with every tie at the cut. C206: “I discussed the process alteration with internal management” C205: “I have altered client processes” C209: “My greater team regularly alters client processes.” C109: “Rate how quickly the customer responds when this engagement raises issues that need customer action.” C100: “Rate how completely the customer's processes are mapped and documented to the depth agentic AI requires.” Emotional states in the same responses, as counts: resigned 13, tired 11, calm or fine 7, stressed 4, frustrated 1.

The indicator most often present in the same responses was C206, “I discussed the process alteration with internal management”, in 94 of the 124 responses (75.81%). C205, “I have altered client processes” (78 responses), C209, “My greater team regularly alters client processes.” (27 responses), C109, “Rate how quickly the customer responds when this engagement raises issues that need customer action.” (18 responses) and C100, “Rate how completely the customer's processes are mapped and documented to the depth agentic AI requires.” (12 responses) followed.

The most frequent theme was “Told vendor-side management”, in 80 responses (64.52%). The second was “Financial institution was not told”, in 76 responses.

Interpretation of the Data

Of the respondents who answered, 2.17% said they or their management had discussed the process alteration with the financial institution (nine of 414). No engagement was assigned the answer True, so no association with the study measures could be tested.

The written evidence matches the answers. Respondents described processes altered as routine work, discussed within the vendor team and with the team lead, and seldom raised with the financial institution. The exceptions describe a financial institution told after the fact, or a joint forum that signed off each change before it was applied.

Limitations

The evidence is the reported experience of the vendor's delivery teams, collected in a single cross-section. The associations reported here are not causal. The answer is the respondent's own report of an alteration and not a record of it.

Each engagement carries the answer given by the largest number of its respondents, and tied engagements are excluded from the engagement-level tests.

Shares of written sentiment are shares of responses and not of the study set of respondents. The written score takes five fixed values, so its mean and median are coarse. Responses clustered within engagements (124 responses on 68 engagements). Intervals for written sentiment therefore used a bootstrap by engagement.

The written responses are counted by sets of words stated in each rule. A response that described a practice in other words is not counted, so each count is a floor.

With nine respondents answering True, the indicator supports a description of how rarely the process alteration was discussed and no comparison by answer.

Definitions

Table 22. DefinitionsTable
TermDefinition
Response scaleThe answer is True or False to the statement shown in the indicator specification. The indicator is not a rating. No distressed range applies.
Answering baseRespondents who answered True or False.
Non-answers“I do not know” and “I prefer to not answer” are counted separately. They are excluded from the answering base and from the shares.
Indicator classRespondent level: a report of the respondent's own action. Each engagement also carries the answer given by the largest number of its respondents, for the engagement-level tests.
Failure categoryThe five failure categories of the Study Taxonomy apply only to the rated indicators. The indicator carries none.
Engagement indicator meanThe mean of an engagement's ratings across the rated indicators. The indicator does not enter it.
Written responseA written answer about the respondent's own engagement that addresses the indicator. Non-answers and answers about another engagement are excluded.
Primary and secondaryA primary response answered the written-answer question of the indicator's survey section. A secondary response answered a question in another section and addressed the indicator in its content.
Written sentiment scoreEach written response carries one of five scores: −10, −5, neutral, +5 or +10. The sign records whether the response described the state of the indicator as harmful or helpful to the engagement. The magnitude records its strength. A score of −10 marks a statement of totality, constancy or serious harm.
Cluster bootstrapAn interval computed by resampling engagements rather than responses, so that the responses from one engagement stay together.

Sources and Provenance

Table 23. Sources and provenanceTable
SourceValue
Study dataStudy Data.xlsx, Data sheet, column C207, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record C207, sha256 1ae50a3637fc9370
ComputedOctober 13, 2026, 04:57 UTC
TemplateIndicator Template v2, version 2.0 of 10 October 2026
Figures placed by script781
Written responsesQuotes Master.jsonl, sha256 27da38085e2b13fd
Written sentiment scoresQuote Coding Rulebook, version 0.6, with section 21
Written-response computationqa_stats.py, sha256 74a61f3a96169da9. wfacts.py, sha256 b85fae20adf812a1. build_indicator.py, sha256 c7b10c57927ea734
Written-response recordsC207.qa.json, sha256 dca5a9edbb2b8113. C207.wfacts.json, sha256 1d1dab0d93309509. Hand-written text handcraft/C207.json, sha256 ea6815b2e9f491ca

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →