Study Data · Part 1 · Indicator Deep-Dive Analysis

Is Canceled?

Indicator MEASURE:cancellation · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeNone, a study measure
Question as askedIs Canceled?
Failure categoryNot one of the 100 rated indicators
Place in the surveyNot a survey item
Indicator classEngagement attribute
Indicator typeStudy measure
Response scaleCanceled or not, on the study date
Answering base150 engagements
Non-answersNone, the value is recorded for every engagement
Identity with a study measureCancellation rate

Summary of Findings

Table 2. Key results: association of the indicator with the four study measuresTable
MeasureFormnr95% CIp
Cancellation rateIdentity with this measure, not tested
Customer satisfactionClean estimate94 engagementsNot computable, constant indicator or measure
Engagement indicator meanFull150 engagements−0.72−0.79 to −0.63< 0.001
Intent to leaveRespondent level, clustered798 respondents0.760.70 to 0.81< 0.001

The cancellation flag recorded a study set mean (mean 0.4, median 0.0, n = 150 engagements). This block is cancellation itself, so its cancellation cell was an identity by construction (r = 1.00). The clean estimate for customer satisfaction could not be computed, because it ran inside active engagements and no active engagement was canceled. Canceled engagements carried a lower engagement indicator mean (r = −0.72, 95% CI −0.79 to −0.63, p < 0.001, n = 150 engagements). Respondents on canceled engagements reported higher intent to leave (r = 0.76, cluster bootstrap 95% CI 0.70 to 0.81, p < 0.001, n = 798 respondents). Cancellation did not differ after Holm control by outsourcing model, institution type, process family, or class of work (Holm p 0.449 or higher in every family).

Distribution of Recorded Values

Table 3. Distribution of recorded valuesTable
ValueEngagementsShare of engagements aCumulative share
No9462.67%Not applicable, two values
Yes5637.33%Not applicable, two values
Total150100.00%
Note: a Share of engagements (base 150).
Table 4. Recorded values, engagement level summaryTable
Engagement level summaryEngagementsMeanSDMinMedianMaxEngagements with a distressed valueShare of engagements distressed
Values as recorded1500.40.50.00.01.0Not applicableNot applicable

The value was recorded once per engagement, so every figure in this section counts out of 150 engagements. The mean was 0.4 and the median was 0.0, on 150 engagements.

Descriptive Statistics by Segment

Table 5a. Descriptive statistics by segment, part 1 of 2Table
SegmentBaseAnsweredAnswer rateEngagementsMean95% CISD
Study set150150100.00% of 1501500.40.3 to 0.50.5
Outsourcing model
CXM4242100.00% of 42420.40.2 to 0.50.5
ITO4040100.00% of 40400.40.2 to 0.50.5
BPO3737100.00% of 37370.40.2 to 0.50.5
KPO3131100.00% of 31310.40.2 to 0.60.5
Institution type
Asset management2424100.00% of 24240.5†0.5
Wealth management and private banking2323100.00% of 23230.3†0.5
Investment banking (advisory and capital-markets origination)1919100.00% of 19190.5†0.5
Insurance (life, property and casualty, health)1414100.00% of 14140.4†0.5
Commercial and business banking1313100.00% of 13130.3†0.5
Payments and merchant acquiring (networks, acquiring, processing)1313100.00% of 13130.2†0.4
Credit card and payments issuing1212100.00% of 12120.4†0.5
Retail and consumer banking1212100.00% of 12120.3†0.5
Markets and trading (sales and trading, global markets)1111100.00% of 11110.3†0.5
Private equity and private capital999 of 99‡
Process family
Corporate and back-office functions4747100.00% of 47470.40.3 to 0.50.5
Technology engineering and operations3535100.00% of 35350.30.1 to 0.40.5
Client servicing and communications1616100.00% of 16160.6†0.5
Trade, settlement and reconciliation1515100.00% of 15150.5†0.5
Payments, cards and disputes1212100.00% of 12120.2†0.4
Credit, underwriting and suitability999 of 99‡
Regulatory, audit, tax and legal999 of 99‡
Financial crime and client onboarding777 of 77‡
Class of work
LOB Operational7676100.00% of 76760.40.3 to 0.50.5
Corporate Functional7474100.00% of 74740.40.2 to 0.50.5
Engagement status and lifecycle stage
Active, Build-OutIdentity, the segment is this indicator
Active, Transition/Cut-OverIdentity, the segment is this indicator
Active, ProductionIdentity, the segment is this indicator
CanceledIdentity, the segment is this indicator
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 5b. Descriptive statistics by segment, part 2 of 2Table
SegmentMinQ1MedianQ3MaxDistressed nDistressed %
Study set0.00.00.01.01.0Not applicableNot applicable
Outsourcing model
CXM0.00.00.01.01.0Not applicableNot applicable
ITO0.00.00.01.01.0Not applicableNot applicable
BPO0.00.00.01.01.0Not applicableNot applicable
KPO0.00.00.01.01.0Not applicableNot applicable
Institution type
Asset management0.00.01.01.01.0Not applicableNot applicable
Wealth management and private banking0.00.00.01.01.0Not applicableNot applicable
Investment banking (advisory and capital-markets origination)0.00.00.01.01.0Not applicableNot applicable
Insurance (life, property and casualty, health)0.00.00.01.01.0Not applicableNot applicable
Commercial and business banking0.00.00.01.01.0Not applicableNot applicable
Payments and merchant acquiring (networks, acquiring, processing)0.00.00.00.01.0Not applicableNot applicable
Credit card and payments issuing0.00.00.01.01.0Not applicableNot applicable
Retail and consumer banking0.00.00.01.01.0Not applicableNot applicable
Markets and trading (sales and trading, global markets)0.00.00.00.51.0Not applicableNot applicable
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functions0.00.00.01.01.0Not applicableNot applicable
Technology engineering and operations0.00.00.01.01.0Not applicableNot applicable
Client servicing and communications0.00.01.01.01.0Not applicableNot applicable
Trade, settlement and reconciliation0.00.01.01.01.0Not applicableNot applicable
Payments, cards and disputes0.00.00.00.01.0Not applicableNot applicable
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB Operational0.00.00.01.01.0Not applicableNot applicable
Corporate Functional0.00.00.01.01.0Not applicableNot applicable
Engagement status and lifecycle stage
Active, Build-OutIdentity, the segment is this indicator
Active, Transition/Cut-OverIdentity, the segment is this indicator
Active, ProductionIdentity, the segment is this indicator
CanceledIdentity, the segment is this indicator
Note: ‡ Base under 10. No statistic is reported.

Figures are engagement level. Means are on the scale as recorded. A level under 30 prints no interval and a level under 10 prints counts only.

Tests of Difference Between Segments

Table 6a. Tests of difference between segments, part 1 of 2Table
Segment familyWelch FdfpHolm pOmega squared90% CI
Outsourcing model0.023, 79.00.9951.000−0.0200.000 to 0.000
Institution type0.658, 49.50.7291.000−0.0170.000 to 0.045
Process family2.014, 39.80.1120.4490.0280.000 to 0.112
Class of work0.301, 148.00.5861.000−0.0050.000 to 0.030
Engagement status and lifecycle stageIdentity, the segment is this indicator
Table 6b. Tests of difference between segments, part 2 of 2Table
Segment familyKruskal-Wallis HpDistressed chi-squaredfpCramer’s VLevels left out
Outsourcing model0.080.995Not applicableNot applicableNone
Institution type5.670.684Not applicableNot applicablea
Process family7.420.115Not applicableNot applicableb
Class of work0.300.584Not applicableNot applicableNone
Engagement status and lifecycle stageIdentity, the segment is this indicator
Note: a Private equity and private capital, n = 9. b Credit, underwriting and suitability, n = 9, Regulatory, audit, tax and legal, n = 9, Financial crime and client onboarding, n = 7.

Engagement families were tested on engagement means, and respondent role and vendor type were tested on respondents. A distressed p marked exact is a Fisher exact test for a two by two table, and one marked simulated is a Monte Carlo test run until its p is stable to the third decimal, both used where an expected count is under 5. No difference held after Holm control for outsourcing model, institution type, process family and class of work.

Association with Cancellation Rate

The share of engagements canceled on the study date, measured at engagement level (base 150 engagements, 56 canceled). The association is a descriptive contrast, inflated because canceled engagements were rated after cancellation, and is not predictive.

This block is the measure itself, so its association with the measure is an identity, 1.00 by construction, in every segment, and not a finding.

Association with Customer Satisfaction

The satisfaction score recorded against each engagement on a 100-point scale. The primary estimate uses the 94 active engagements. A descriptive contrast uses all 150 engagements.

Table 7a. Association with customer satisfaction by segment, part 1 of 2Table
SegmentActive engagementsClean r95% CIpHolm pSpearman rhop
Study set94a
Outsourcing model
CXM27a
ITO25a
BPO23a
KPO19a
Institution type
Asset management11a
Wealth management and private banking15a
Investment banking (advisory and capital-markets origination)10a
Insurance (life, property and casualty, health)9‡
Commercial and business banking9‡
Payments and merchant acquiring (networks, acquiring, processing)10a
Credit card and payments issuing7‡
Retail and consumer banking8‡
Markets and trading (sales and trading, global markets)8‡
Private equity and private capital7‡
Process family
Corporate and back-office functions28a
Technology engineering and operations25a
Client servicing and communications7‡
Trade, settlement and reconciliation7‡
Payments, cards and disputes10a
Credit, underwriting and suitability8‡
Regulatory, audit, tax and legal5‡
Financial crime and client onboarding4‡
Class of work
LOB Operational46a
Corporate Functional48a
Engagement status and lifecycle stage
Active, Build-Out31a
Active, Transition/Cut-Over43a
Active, Production20a
Canceled0b
Note: ‡ Base under 10. No statistic is reported. a Not computable, the indicator or the measure is constant in this row. b No clean estimate, canceled engagements fall outside the active population.
Table 7b. Association with customer satisfaction by segment, part 2 of 2Table
SegmentSlope, points per rating point95% CIR squaredTOST pAll engagementsDescriptive rp
Study setNot computable, the indicator or the measure is constant in this row
Outsourcing model
CXMNot computable, the indicator or the measure is constant in this row
ITONot computable, the indicator or the measure is constant in this row
BPONot computable, the indicator or the measure is constant in this row
KPONot computable, the indicator or the measure is constant in this row
Institution type
Asset managementNot computable, the indicator or the measure is constant in this row
Wealth management and private bankingNot computable, the indicator or the measure is constant in this row
Investment banking (advisory and capital-markets origination)Not computable, the indicator or the measure is constant in this row
Insurance (life, property and casualty, health)‡ n = 9
Commercial and business banking‡ n = 9
Payments and merchant acquiring (networks, acquiring, processing)Not computable, the indicator or the measure is constant in this row
Credit card and payments issuing‡ n = 7
Retail and consumer banking‡ n = 8
Markets and trading (sales and trading, global markets)‡ n = 8
Private equity and private capital‡ n = 7
Process family
Corporate and back-office functionsNot computable, the indicator or the measure is constant in this row
Technology engineering and operationsNot computable, the indicator or the measure is constant in this row
Client servicing and communications‡ n = 7
Trade, settlement and reconciliation‡ n = 7
Payments, cards and disputesNot computable, the indicator or the measure is constant in this row
Credit, underwriting and suitability‡ n = 8
Regulatory, audit, tax and legal‡ n = 5
Financial crime and client onboarding‡ n = 4
Class of work
LOB OperationalNot computable, the indicator or the measure is constant in this row
Corporate FunctionalNot computable, the indicator or the measure is constant in this row
Engagement status and lifecycle stage
Active, Build-OutNot computable, the indicator or the measure is constant in this row
Active, Transition/Cut-OverNot computable, the indicator or the measure is constant in this row
Active, ProductionNot computable, the indicator or the measure is constant in this row
Canceledno clean estimate, canceled engagements fall outside the active population
Note: ‡ Base under 10. No statistic is reported.

The study set association could not be computed: one side is constant across the paired values.

Association with the Engagement Indicator Mean

The mean of an engagement’s 100 indicator ratings, measured at engagement level (base 150 engagements). Where this indicator is one of the 100, the mean is recomputed without it.

Table 8a. Association with the engagement indicator mean by segment, part 1 of 2Table
SegmentEngagementsLeave-one-out r95% CIpHolm pSpearman rhop
Study set150−0.72−0.79 to −0.63< 0.001< 0.001−0.75< 0.001
Outsourcing model
CXM42−0.71−0.83 to −0.52< 0.001< 0.001−0.74< 0.001
ITO40−0.71−0.84 to −0.51< 0.001< 0.001−0.73< 0.001
BPO37−0.80−0.89 to −0.64< 0.001< 0.001−0.81< 0.001
KPO31−0.71−0.85 to −0.48< 0.001< 0.001−0.73< 0.001
Institution type
Asset management24−0.82†< 0.001< 0.001−0.85< 0.001
Wealth management and private banking23−0.72†< 0.0010.001−0.73< 0.001
Investment banking (advisory and capital-markets origination)19−0.70†< 0.0010.006−0.71< 0.001
Insurance (life, property and casualty, health)14−0.81†< 0.0010.004−0.80< 0.001
Commercial and business banking13−0.64†0.0190.058−0.710.006
Payments and merchant acquiring (networks, acquiring, processing)13−0.56†0.0470.058−0.630.020
Credit card and payments issuing12−0.77†0.0030.014−0.86< 0.001
Retail and consumer banking12−0.88†< 0.0010.002−0.820.001
Markets and trading (sales and trading, global markets)11−0.80†0.0030.014−0.770.005
Private equity and private capital9‡
Process family
Corporate and back-office functions47−0.73−0.84 to −0.56< 0.001< 0.001−0.75< 0.001
Technology engineering and operations35−0.71−0.84 to −0.50< 0.001< 0.001−0.75< 0.001
Client servicing and communications16−0.73†0.0010.009−0.610.011
Trade, settlement and reconciliation15−0.73†0.0020.012−0.740.002
Payments, cards and disputes12−0.66†0.0200.058−0.650.023
Credit, underwriting and suitability9‡
Regulatory, audit, tax and legal9‡
Financial crime and client onboarding7‡
Class of work
LOB Operational76−0.69−0.79 to −0.54< 0.001< 0.001−0.71< 0.001
Corporate Functional74−0.76−0.84 to −0.64< 0.001< 0.001−0.78< 0.001
Engagement status and lifecycle stage
Active, Build-Out31Not computable, the indicator or the measure is constant in this row
Active, Transition/Cut-Over43Not computable, the indicator or the measure is constant in this row
Active, Production20Not computable, the indicator or the measure is constant in this row
Canceled56Not computable, the indicator or the measure is constant in this row
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.
Table 8b. Association with the engagement indicator mean by segment, part 2 of 2Table
Segmentr with indicator includedChange in rSlope95% CIR squaredTOST pEquivalent
Study setNot a component−2.19−2.54 to −1.850.521.000No
Outsourcing model
CXMNot a component−2.40−3.16 to −1.640.501.000No
ITONot a component−1.85−2.45 to −1.240.501.000No
BPONot a component−2.16−2.72 to −1.610.641.000No
KPONot a component−2.38−3.26 to −1.490.510.999No
Institution type
Asset managementNot a component−2.53† n = 240.681.000No
Wealth management and private bankingNot a component−2.22† n = 230.520.997No
Investment banking (advisory and capital-markets origination)Not a component−1.50† n = 190.490.988No
Insurance (life, property and casualty, health)Not a component−2.52† n = 140.650.996No
Commercial and business bankingNot a component−1.93† n = 130.410.919No
Payments and merchant acquiring (networks, acquiring, processing)Not a component−2.09† n = 130.310.845No
Credit card and payments issuingNot a component−1.89† n = 120.590.984No
Retail and consumer bankingNot a component−2.93† n = 120.770.999No
Markets and trading (sales and trading, global markets)Not a component−2.61† n = 110.650.988No
Private equity and private capital‡ n = 9
Process family
Corporate and back-office functionsNot a component−2.34−3.00 to −1.690.531.000No
Technology engineering and operationsNot a component−2.07−2.80 to −1.350.511.000No
Client servicing and communicationsNot a component−2.34† n = 160.530.987No
Trade, settlement and reconciliationNot a component−1.92† n = 150.530.984No
Payments, cards and disputesNot a component−2.23† n = 120.430.924No
Credit, underwriting and suitability‡ n = 9
Regulatory, audit, tax and legal‡ n = 9
Financial crime and client onboarding‡ n = 7
Class of work
LOB OperationalNot a component−2.09−2.61 to −1.580.471.000No
Corporate FunctionalNot a component−2.31−2.77 to −1.840.581.000No
Engagement status and lifecycle stage
Active, Build-OutNot computable, the indicator or the measure is constant in this row
Active, Transition/Cut-OverNot computable, the indicator or the measure is constant in this row
Active, ProductionNot computable, the indicator or the measure is constant in this row
CanceledNot computable, the indicator or the measure is constant in this row
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was −0.72 (95% CI −0.79 to −0.63, Holm p < 0.001, n = 150 engagements). Of the 20 tested segment levels, 17 held after Holm control.

Association with Intent to Leave

The respondent’s stated likelihood of leaving the current job within 12 months, rated 1 to 10 (C019). Measured at respondent level on up to 798 respondents, with the engagement-level form reported alongside.

Table 9a. Association with intent to leave by segment, part 1 of 2Table
SegmentRespondentsr95% CICluster bootstrap 95% CIpHolm p
Study set7980.760.73 to 0.790.70 to 0.81< 0.001< 0.001
Outsourcing model
CXM2150.830.79 to 0.870.76 to 0.88< 0.001< 0.001
ITO2330.710.64 to 0.770.59 to 0.82< 0.001< 0.001
BPO1960.760.69 to 0.810.63 to 0.86< 0.001< 0.001
KPO1540.720.64 to 0.790.57 to 0.85< 0.001< 0.001
Institution type
Asset management1220.850.79 to 0.890.78 to 0.91< 0.001< 0.001
Wealth management and private banking1320.800.73 to 0.860.68 to 0.88< 0.001< 0.001
Investment banking (advisory and capital-markets origination)980.820.74 to 0.870.71 to 0.89< 0.001< 0.001
Insurance (life, property and casualty, health)710.730.60 to 0.820.50 to 0.89< 0.001< 0.001
Commercial and business banking760.720.59 to 0.810.40 to 0.91< 0.001< 0.001
Payments and merchant acquiring (networks, acquiring, processing)690.550.36 to 0.700.28 to 0.84< 0.001< 0.001
Credit card and payments issuing700.860.78 to 0.910.73 to 0.92< 0.001< 0.001
Retail and consumer banking670.830.73 to 0.890.62 to 0.91< 0.001< 0.001
Markets and trading (sales and trading, global markets)550.730.58 to 0.840.47 to 0.92< 0.001< 0.001
Private equity and private capital380.510.23 to 0.71a0.0010.001
Process family
Corporate and back-office functions2260.770.71 to 0.820.68 to 0.85< 0.001< 0.001
Technology engineering and operations1940.720.64 to 0.780.57 to 0.81< 0.001< 0.001
Client servicing and communications890.870.80 to 0.910.80 to 0.92< 0.001< 0.001
Trade, settlement and reconciliation750.860.79 to 0.910.76 to 0.94< 0.001< 0.001
Payments, cards and disputes700.630.47 to 0.75a< 0.001< 0.001
Credit, underwriting and suitability530.530.30 to 0.70a< 0.001< 0.001
Regulatory, audit, tax and legal490.700.52 to 0.82§ n = 9< 0.001< 0.001
Financial crime and client onboarding420.750.57 to 0.86§ n = 7< 0.001< 0.001
Class of work
LOB Operational4240.750.70 to 0.790.66 to 0.83< 0.001< 0.001
Corporate Functional3740.770.72 to 0.810.70 to 0.82< 0.001< 0.001
Engagement status and lifecycle stage
Active, Build-OutIdentity, the segment is this indicator
Active, Transition/Cut-OverIdentity, the segment is this indicator
Active, ProductionIdentity, the segment is this indicator
CanceledIdentity, the segment is this indicator
Note: § Too few engagements for a cluster bootstrap interval. a Not computable, under 90% of resamples valid.
Table 9b. Association with intent to leave by segment, part 2 of 2Table
SegmentSpearman rhopShare at 7 or above, distressedShare at 7 or above, otherEngagementsEngagement level r95% CITOST p
Study set0.78< 0.001Not applicableNot applicable1500.800.74 to 0.851.000
Outsourcing model
CXM0.83< 0.001Not applicableNot applicable420.890.81 to 0.941.000
ITO0.75< 0.001Not applicableNot applicable400.750.57 to 0.861.000
BPO0.77< 0.001Not applicableNot applicable370.790.62 to 0.891.000
KPO0.74< 0.001Not applicableNot applicable310.780.59 to 0.891.000
Institution type
Asset management0.86< 0.001Not applicableNot applicable240.88†1.000
Wealth management and private banking0.81< 0.001Not applicableNot applicable230.85†1.000
Investment banking (advisory and capital-markets origination)0.83< 0.001Not applicableNot applicable190.89†1.000
Insurance (life, property and casualty, health)0.76< 0.001Not applicableNot applicable140.78†0.992
Commercial and business banking0.71< 0.001Not applicableNot applicable130.79†0.991
Payments and merchant acquiring (networks, acquiring, processing)0.56< 0.001Not applicableNot applicable130.63†0.912
Credit card and payments issuing0.86< 0.001Not applicableNot applicable120.89†1.000
Retail and consumer banking0.83< 0.001Not applicableNot applicable120.88†0.999
Markets and trading (sales and trading, global markets)0.72< 0.001Not applicableNot applicable110.84†0.995
Private equity and private capital0.57< 0.001Not applicableNot applicable9‡‡
Process family
Corporate and back-office functions0.80< 0.001Not applicableNot applicable470.810.68 to 0.891.000
Technology engineering and operations0.74< 0.001Not applicableNot applicable350.760.57 to 0.871.000
Client servicing and communications0.87< 0.001Not applicableNot applicable160.91†1.000
Trade, settlement and reconciliation0.85< 0.001Not applicableNot applicable150.89†1.000
Payments, cards and disputes0.57< 0.001Not applicableNot applicable120.67†0.937
Credit, underwriting and suitability0.51< 0.001Not applicableNot applicable9‡‡
Regulatory, audit, tax and legal0.72< 0.001Not applicableNot applicable9‡‡
Financial crime and client onboarding0.75< 0.001Not applicableNot applicable7‡‡
Class of work
LOB Operational0.75< 0.001Not applicableNot applicable760.790.69 to 0.871.000
Corporate Functional0.80< 0.001Not applicableNot applicable740.810.72 to 0.881.000
Engagement status and lifecycle stage
Active, Build-OutIdentity, the segment is this indicator
Active, Transition/Cut-OverIdentity, the segment is this indicator
Active, ProductionIdentity, the segment is this indicator
CanceledIdentity, the segment is this indicator
Note: † Base under 30. No interval is reported. ‡ Base under 10. No statistic is reported.

The study set r was 0.76 (95% CI 0.73 to 0.79, Holm p < 0.001, n = 798 respondents). Of the 24 tested segment levels, 24 held after Holm control.

Comparison of Associations Across the Four Measures

Table 10. Associations across the four measuresTable
MeasureFormUnitnr95% CIpEquivalent to zeroRank among the four
Cancellation rateIdentity, 1.00 by construction, the block is this measure
Customer satisfactionClean estimateEngagement94Not computable, the indicator or the measure is constant in this row
Engagement indicator meanFullEngagement150−0.72−0.79 to −0.63< 0.001No2
Intent to leaveRespondent level, clusteredRespondent7980.760.70 to 0.81< 0.001No1
Table 11. Pairwise comparison of associationsTable
Pair comparedDifference in rSteiger zpHolm pReading
Cancellation rate and customer satisfactionIdentity, not compared
Cancellation rate and engagement indicator meanIdentity, not compared
Cancellation rate and intent to leaveIdentity, not compared
Customer satisfaction and engagement indicator mean−0.22−11.19< 0.001< 0.001Differ
Customer satisfaction and intent to leave−0.14−8.90< 0.001< 0.001Differ
Engagement indicator mean and intent to leave0.082.900.0040.004Differ

Pairs were compared on the engagement level form of every measure, each turned so that a higher value was the better outcome, on the 150 engagements where the indicator and all four measures existed. Of the 3 pairs, 3 differed after Holm control.

Clustering and Effective Sample Size

Not applicable. The field was recorded once per engagement, so every respondent in an engagement shared one value.

Equivalence Tests of Null Results

Table 12. Equivalence tests of null resultsTable
MeasurenrEquivalence boundTOST p, lowerTOST p, upperEquivalent to zeroAchieved powerMDE at power 0.80Detection floor for this n
Cancellation rateIdentity, not a finding
Customer satisfactionNot computable, the indicator or the measure is constant in this row
Engagement indicator mean150−0.72|r| < 0.301.000< 0.001No0.960.230.23
Intent to leave7980.76|r| < 0.30< 0.0011.000No1.000.100.23

No measure showed a tested null. No result was inconclusive. The detection floor column is the study floor at 150 engagements.

Robustness Checks

Table 13. Robustness checksTable
CheckMeasurePrimary rCheck r95% CIChangeConclusion holds
Rank correlation in place of PearsonEngagement indicator mean−0.72−0.75a−0.03Yes
Rank correlation in place of PearsonIntent to leave0.760.78a0.02Yes
Active engagements onlyEngagement indicator mean−0.72baNot computable
Active engagements onlyIntent to leave0.76baNot computable
Most influential engagement removed (largest Cook’s distance)Engagement indicator mean−0.72−0.73−0.80 to −0.65−0.01Yes
Most influential engagement removed (largest Cook’s distance)Intent to leave0.760.770.74 to 0.800.01Yes
Engagements weighted by respondent countEngagement indicator mean−0.72−0.72a0.00Yes
Bootstrap of engagementsEngagement indicator mean−0.72−0.72−0.78 to −0.650.00Yes
Bootstrap of engagementsIntent to leave0.760.760.70 to 0.810.00Yes
Thin-base segments removedEngagement indicator mean−0.72−0.73−0.82 to −0.61−0.01Yes
Thin-base segments removedIntent to leave0.760.750.71 to 0.79−0.01Yes
Note: a No interval for this check. b Not computable.

Each change was computed before rounding, so it can differ by 0.01 from the difference of the two printed values.

Rows for cancellation rate are left out because this indicator is that measure (V15-R21). Every computable check held. 2 checks could not be computed, as the table shows. A check holds when its test lands on the same side of 0.05 as the primary test and, where the primary test is below 0.05, its r keeps the primary sign. Thin-base rule: engagements in any level under 30 engagements of outsourcing model or process family removed. Institution type is not used, because every one of its levels is under 30.

Measure Independence and Part-Whole Correction

The measure against itself is 1 by construction and is not a finding. The other three were computed from other data.

Comparison with the Study Norm

Not applicable. A measure has no profile against itself.

Interpretation of the Data

Every robustness check that could be computed held on this measure (9 of 11 checks, 2 not computable). Cancellation came with a lower engagement indicator mean (r = −0.72, 95% CI −0.79 to −0.63, p < 0.001, n = 150 engagements) and higher intent to leave (r = 0.76, cluster bootstrap 95% CI 0.70 to 0.81, p < 0.001, n = 798 respondents).

Limitations

The evidence is reported experience: what the delivery team said about its own engagement, gathered in one cross-section. The figures showed associations, not causes. Indicators about the financial institution were reported at second hand by vendor staff. Cancellation is a descriptive contrast, because canceled engagements were rated after they ended.

Segment levels at anecdote strength were Private equity and private capital, Credit, underwriting and suitability, Regulatory, audit, tax and legal, and Financial crime and client onboarding (n = 9, n = 9, n = 9, n = 7). Part of the robustness checks could not be computed on this measure (9 of 11 checks, 2 not computable).

Definitions

Table 14. DefinitionsTable
TermDefinition
Response scaleAs recorded, shown in Table 1. The indicator is not a rating, so no distressed range is defined.
Answering baseThe engagements on which the value is recorded.
Non-answersNone. The value is recorded for every engagement.
Indicator classEngagement attribute: a property of the engagement rather than of the respondent.
Failure categoryOne of the five failure categories of the Study Taxonomy, section 3. Only the 100 rated indicators carry one, and the indicator is not among them.
Engagement indicator meanThe mean of an engagement’s 100 indicator ratings.

Sources and Provenance

Table 15. Sources and provenanceTable
ItemValue
Study dataStudy Data.xlsx, Engagements sheet, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record MEASURE:cancellation, sha256 e405f65a43e37a6e
ComputedOctober 8, 2026, 01:38 UTC
TemplateIndicator Statistical Analysis Template, version 1.1 of 2026-10-06
Figures placed by script973 of 973

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →