What is the annual contract value of this engagement, in USD?
Indicator C046 · By Phil Hatch · Akholi · October 9, 2026
On this page
19 sectionsIndicator Specification
| Field | Value |
|---|---|
| Indicator code | C046 |
| Question as asked | What is the annual contract value of this engagement, in USD? |
| Failure category | Not one of the 100 rated indicators |
| Place in the survey | Engagement Details > 2.4 Commercial Structure > Contract |
| Indicator class | Perceived fact |
| Indicator type | Categorical |
| Response scale | Levels: Under $1 million, $1 million to under $5 million, $5 million to under $10 million, $10 million to under $25 million |
| Answering base | 248 of 850 respondents gave one of the listed answers. 601 answered, counting I do not know and I prefer to not answer, across 150 of 150 engagements |
| Non-answers | I do not know 353, I prefer to not answer 0, blank 249 |
Summary of Findings
| Measure | Effect size | n | Value | p |
|---|---|---|---|---|
| Cancellation rate | Omega squared, 0 or 1 flag | 31 engagements | −0.006 | 0.433 |
| Customer satisfaction | Omega squared | 23 engagements | −0.023 | 0.519 |
| Engagement indicator mean | Omega squared | 31 engagements | −0.032 | 0.863 |
| Intent to leave | Omega squared | 31 engagements | −0.025 | 0.621 |
Respondents most often placed annual contract value in the second value band (106 of 248 respondents, 42.74%) or the third (102 of 248 respondents, 41.13%), and the lowest band was the least common answer (13 of 248 respondents, 5.24%). Cancellation was lower in the third band (18.75% canceled, n = 16 engagements) than in the second band (33.33% canceled, n = 15 engagements), with no difference in a test of those two bands (chi-square 0.86, p 0.433, Cramer’s V 0.17, n = 31 engagements). Customer satisfaction on active engagements was higher in the second band (mean 66.4, n = 10 engagements) than in the third band (mean 62.8, n = 13 engagements), with no difference under test (Welch F 0.44, p 0.519, omega squared −0.023, n = 23 engagements). The engagement indicator mean was close in the third band (mean 4.4, n = 16 engagements) and the second band (mean 4.3, n = 15 engagements), with no difference under test (Welch F 0.03, p 0.863, omega squared −0.032, n = 31 engagements). Intent to leave was lowest in the third band (mean 6.0, n = 16 engagements), with no difference under test (Welch F 0.25, p 0.621, omega squared −0.025, n = 31 engagements). No segment family differed in the answer mix after Holm control (Holm p 0.218 or higher in every family).
Distribution of Responses
| Answer | Respondents | Share of answered (base 248) | Cumulative share | Engagements with at least one | Share of 150 engagements | Distressed |
|---|---|---|---|---|---|---|
| Under $1 million | 13 | 5.24% | 5.24% | 7 | 4.67% | Not applicable |
| $1 million to under $5 million | 106 | 42.74% | 47.98% | 58 | 38.67% | Not applicable |
| $5 million to under $10 million | 102 | 41.13% | 89.11% | 54 | 36.00% | Not applicable |
| $10 million to under $25 million | 27 | 10.89% | 100.00% | 11 | 7.33% | Not applicable |
| I do not know | 353 | Not in base | Not in base | 144 | 96.00% | Not applicable |
| Answered, total | 248 | 100.00% | 130 | 86.67% |
A categorical answer has no engagement mean. Each engagement took its respondents’ plurality answer, and tied engagements were left out. An answer was assigned to 114 of 150 engagements.
Distressed is not applicable, because the answer has no good or bad end on a scale.
Descriptive Statistics by Segment
| Segment | Base | Answered | Answer rate | Engagements | Under $1 million, share | $1 million to under $5 million, share | $5 million to under $10 million, share | $10 million to under $25 million, share |
|---|---|---|---|---|---|---|---|---|
| Study set | 850 | 248 | 29.18% of 850 | 150 | 5.24% | 42.74% | 41.13% | 10.89% |
| Outsourcing model | ||||||||
| CXM | 232 | 66 | 28.45% of 232 | 42 | 9.09% | 36.36% | 46.97% | 7.58% |
| ITO | 244 | 70 | 28.69% of 244 | 40 | 2.86% | 35.71% | 42.86% | 18.57% |
| BPO | 209 | 65 | 31.10% of 209 | 37 | 4.62% | 44.62% | 40.00% | 10.77% |
| KPO | 165 | 47 | 28.48% of 165 | 31 | 4.26% | 59.57% | 31.91% | 4.26% |
| Institution type | ||||||||
| Asset management | 132 | 35 | 26.52% of 132 | 24 | 5.71% | 45.71% | 45.71% | 2.86% |
| Wealth management and private banking | 140 | 42 | 30.00% of 140 | 23 | 0.00% | 30.95% | 52.38% | 16.67% |
| Investment banking (advisory and capital-markets origination) | 105 | 31 | 29.52% of 105 | 19 | 3.23% | 61.29% | 25.81% | 9.68% |
| Insurance (life, property and casualty, health) | 78 | 22 | 28.21% of 78 | 14 | 0.00% | 40.91% | 54.55% | 4.55% |
| Commercial and business banking | 82 | 29 | 35.37% of 82 | 13 | 0.00% | 51.72% | 37.93% | 10.34% |
| Payments and merchant acquiring (networks, acquiring, processing) | 71 | 21 | 29.58% of 71 | 13 | 19.05% | 33.33% | 19.05% | 28.57% |
| Credit card and payments issuing | 73 | 26 | 35.62% of 73 | 12 | 0.00% | 15.38% | 61.54% | 23.08% |
| Retail and consumer banking | 73 | 15 | 20.55% of 73 | 12 | 0.00% | 46.67% | 53.33% | 0.00% |
| Markets and trading (sales and trading, global markets) | 57 | 15 | 26.32% of 57 | 11 | 0.00% | 86.67% | 13.33% | 0.00% |
| Private equity and private capital | 39 | 12 | 30.77% of 39 | 9 | 50.00% | 25.00% | 25.00% | 0.00% |
| Process family | ||||||||
| Corporate and back-office functions | 248 | 73 | 29.44% of 248 | 47 | 10.96% | 54.79% | 30.14% | 4.11% |
| Technology engineering and operations | 204 | 57 | 27.94% of 204 | 35 | 3.51% | 36.84% | 45.61% | 14.04% |
| Client servicing and communications | 94 | 22 | 23.40% of 94 | 16 | 0.00% | 40.91% | 54.55% | 4.55% |
| Trade, settlement and reconciliation | 80 | 25 | 31.25% of 80 | 15 | 4.00% | 72.00% | 24.00% | 0.00% |
| Payments, cards and disputes | 73 | 25 | 34.25% of 73 | 12 | 0.00% | 24.00% | 60.00% | 16.00% |
| Credit, underwriting and suitability | 57 | 13 | 22.81% of 57 | 9 | 0.00% | 46.15% | 53.85% | 0.00% |
| Regulatory, audit, tax and legal | 51 | 20 | 39.22% of 51 | 9 | 10.00% | 20.00% | 35.00% | 35.00% |
| Financial crime and client onboarding | 43 | 13 | 30.23% of 43 | 7 | 0.00% | 15.38% | 53.85% | 30.77% |
| Class of work | ||||||||
| LOB Operational | 451 | 131 | 29.05% of 451 | 76 | 4.58% | 39.69% | 43.51% | 12.21% |
| Corporate Functional | 399 | 117 | 29.32% of 399 | 74 | 5.98% | 46.15% | 38.46% | 9.40% |
| Engagement status and lifecycle stage | ||||||||
| Active, Build-Out | 175 | 56 | 32.00% of 175 | 31 | 1.79% | 55.36% | 39.29% | 3.57% |
| Active, Transition/Cut-Over | 250 | 84 | 33.60% of 250 | 43 | 13.10% | 26.19% | 46.43% | 14.29% |
| Active, Production | 103 | 18 | 17.48% of 103 | 20 | 0.00% | 55.56% | 44.44% | 0.00% |
| Canceled | 322 | 90 | 27.95% of 322 | 56 | 1.11% | 47.78% | 36.67% | 14.44% |
| Respondent role | ||||||||
| Individual Contributor | 667 | 152 | 22.79% of 667 | 147 | 2.63% | 46.05% | 38.82% | 12.50% |
| Engagement Manager | 150 | 64 | 42.67% of 150 | 150 | 9.38% | 43.75% | 42.19% | 4.69% |
| Portfolio Director | 31 | 30 | 96.77% of 31 | 30 | 10.00% | 23.33% | 50.00% | 16.67% |
| Customer Management Executive | 2 | 2 | 2 of 2 | 2 | 0 | 1 | 1 | 0 |
| Vendor type | ||||||||
| IT services major | 316 | 86 | 27.22% of 316 | 59 | 4.65% | 33.72% | 46.51% | 15.12% |
| BPO specialist | 198 | 64 | 32.32% of 198 | 37 | 10.94% | 39.06% | 42.19% | 7.81% |
| Consulting firm | 117 | 35 | 29.91% of 117 | 23 | 0.00% | 54.29% | 40.00% | 5.71% |
| Boutique or specialist provider | 87 | 26 | 29.89% of 87 | 17 | 7.69% | 50.00% | 42.31% | 0.00% |
| Pure-play agentic AI firm | 75 | 22 | 29.33% of 75 | 14 | 0.00% | 63.64% | 22.73% | 13.64% |
| Not reported, recovered by engagement | 57 | 15 | 26.32% of 57 | 32 | 0.00% | 40.00% | 33.33% | 26.67% |
Shares are of the answered respondents in each row, which is the base beside them. A row under 10 prints counts in place of shares.
Tests of Difference Between Segments
| Segment family | Unit | Chi-square | df | p | Holm p | Cramer’s V | Test for p | Levels left out |
|---|---|---|---|---|---|---|---|---|
| Outsourcing model | Engagement | 4.92 | 6 | 0.593 | 1.000 | 0.27 | Monte Carlo, simulated | a |
| Institution type | Engagement | b | c | |||||
| Process family | Engagement | b | d | |||||
| Class of work | Engagement | 2.24 | 3 | 0.577 | 1.000 | 0.25 | Monte Carlo, simulated | None |
| Engagement status and lifecycle stage | Engagement | 9.03 | 6 | 0.171 | 0.513 | 0.36 | Monte Carlo, simulated | e |
| Respondent role | Respondent | 12.67 | 6 | 0.047 | 0.218 | 0.16 | Monte Carlo, simulated | f |
| Vendor type | Respondent | 25.53 | 15 | 0.044 | 0.218 | 0.19 | Monte Carlo, simulated | None |
Engagement families were tested on engagement answers, and respondent role and vendor type were tested on respondents. No difference held after Holm control for outsourcing model, class of work, engagement status and lifecycle stage, respondent role and vendor type.
Association with Cancellation Rate
The share of engagements canceled on the study date, measured at engagement level (base 150 engagements, 56 canceled). The association is a descriptive contrast, inflated because canceled engagements were rated after cancellation, and is not predictive.
The measure by the engagement’s assigned answer.
| Answer level | Engagements | Canceled | Cancellation rate |
|---|---|---|---|
| Under $1 million | 3 | 0 | ‡ |
| $1 million to under $5 million | 15 | 5 | 33.33% |
| $5 million to under $10 million | 16 | 3 | 18.75% |
| $10 million to under $25 million | 3 | 2 | ‡ |
| I do not know | 77 | 30 | 38.96% |
The test across answer levels, in the study set and inside each segment. Levels under 10 engagements were left out of each test.
| Segment | Engagements | Chi-square | df | p | Holm p | Cramer’s V | Test for p |
|---|---|---|---|---|---|---|---|
| Study set | 31 | 0.86 | 1 | 0.433 | 0.433 | 0.17 | Fisher exact |
| Outsourcing model | |||||||
| CXM | Fewer than two answer levels with at least 10 engagements | ||||||
| ITO | Fewer than two answer levels with at least 10 engagements | ||||||
| BPO | Fewer than two answer levels with at least 10 engagements | ||||||
| KPO | Fewer than two answer levels with at least 10 engagements | ||||||
| Institution type | |||||||
| Asset management | Fewer than two answer levels with at least 10 engagements | ||||||
| Wealth management and private banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Investment banking (advisory and capital-markets origination) | Fewer than two answer levels with at least 10 engagements | ||||||
| Insurance (life, property and casualty, health) | Fewer than two answer levels with at least 10 engagements | ||||||
| Commercial and business banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Payments and merchant acquiring (networks, acquiring, processing) | Fewer than two answer levels with at least 10 engagements | ||||||
| Credit card and payments issuing | 8 | ‡ | |||||
| Retail and consumer banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Markets and trading (sales and trading, global markets) | 7 | ‡ | |||||
| Private equity and private capital | 7 | ‡ | |||||
| Process family | |||||||
| Corporate and back-office functions | Fewer than two answer levels with at least 10 engagements | ||||||
| Technology engineering and operations | Fewer than two answer levels with at least 10 engagements | ||||||
| Client servicing and communications | Fewer than two answer levels with at least 10 engagements | ||||||
| Trade, settlement and reconciliation | Fewer than two answer levels with at least 10 engagements | ||||||
| Payments, cards and disputes | Fewer than two answer levels with at least 10 engagements | ||||||
| Credit, underwriting and suitability | 7 | ‡ | |||||
| Regulatory, audit, tax and legal | 6 | ‡ | |||||
| Financial crime and client onboarding | 7 | ‡ | |||||
| Class of work | |||||||
| LOB Operational | Fewer than two answer levels with at least 10 engagements | ||||||
| Corporate Functional | Fewer than two answer levels with at least 10 engagements | ||||||
| Engagement status and lifecycle stage | |||||||
| Active, Build-Out | Not computable, no variation in cancellation | ||||||
| Active, Transition/Cut-Over | Not computable, no variation in cancellation | ||||||
| Active, Production | Not computable, no variation in cancellation | ||||||
| Canceled | Not computable, no variation in cancellation |
Cancellation in the study set did not differ across answer levels (Fisher exact, chi-square 0.86, p 0.433, n = 31 engagements).
Association with Customer Satisfaction
The satisfaction score recorded against each engagement on a 100-point scale. The primary estimate uses the 94 active engagements. A descriptive contrast uses all 150 engagements.
The measure by the engagement’s assigned answer.
| Answer level | Engagements | Mean of the measure | SD |
|---|---|---|---|
| Under $1 million | 3 | ‡ | |
| $1 million to under $5 million | 10 | 66.4 | 14.8 |
| $5 million to under $10 million | 13 | 62.8 | 9.5 |
| $10 million to under $25 million | 1 | ‡ | |
| I do not know | 47 | 64.2 | 11.4 |
The test across answer levels, in the study set and inside each segment. Levels under 10 engagements were left out of each test.
| Segment | Engagements | Welch F | df | p | Holm p | Omega squared | 90% CI |
|---|---|---|---|---|---|---|---|
| Study set | 23 | 0.44 | 1, 14.5 | 0.519 | 0.519 | −0.023 | † |
| Outsourcing model | |||||||
| CXM | Fewer than two answer levels with at least 10 engagements | ||||||
| ITO | Fewer than two answer levels with at least 10 engagements | ||||||
| BPO | Fewer than two answer levels with at least 10 engagements | ||||||
| KPO | Fewer than two answer levels with at least 10 engagements | ||||||
| Institution type | |||||||
| Asset management | Fewer than two answer levels with at least 10 engagements | ||||||
| Wealth management and private banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Investment banking (advisory and capital-markets origination) | 7 | ‡ | |||||
| Insurance (life, property and casualty, health) | 7 | ‡ | |||||
| Commercial and business banking | 7 | ‡ | |||||
| Payments and merchant acquiring (networks, acquiring, processing) | 9 | ‡ | |||||
| Credit card and payments issuing | 5 | ‡ | |||||
| Retail and consumer banking | 7 | ‡ | |||||
| Markets and trading (sales and trading, global markets) | 5 | ‡ | |||||
| Private equity and private capital | 5 | ‡ | |||||
| Process family | |||||||
| Corporate and back-office functions | Fewer than two answer levels with at least 10 engagements | ||||||
| Technology engineering and operations | Fewer than two answer levels with at least 10 engagements | ||||||
| Client servicing and communications | 7 | ‡ | |||||
| Trade, settlement and reconciliation | 5 | ‡ | |||||
| Payments, cards and disputes | 9 | ‡ | |||||
| Credit, underwriting and suitability | 6 | ‡ | |||||
| Regulatory, audit, tax and legal | 3 | ‡ | |||||
| Financial crime and client onboarding | 4 | ‡ | |||||
| Class of work | |||||||
| LOB Operational | Fewer than two answer levels with at least 10 engagements | ||||||
| Corporate Functional | Fewer than two answer levels with at least 10 engagements | ||||||
| Engagement status and lifecycle stage | |||||||
| Active, Build-Out | Fewer than two answer levels with at least 10 engagements | ||||||
| Active, Transition/Cut-Over | Fewer than two answer levels with at least 10 engagements | ||||||
| Active, Production | Fewer than two answer levels with at least 10 engagements | ||||||
| Canceled | no clean estimate, canceled engagements fall outside the active population |
The measure in the study set did not differ across answer levels (Welch F 0.44, p 0.519, n = 23 engagements). The clean estimate ran inside active engagements only.
Association with the Engagement Indicator Mean
The mean of an engagement’s 100 indicator ratings, measured at engagement level (base 150 engagements). Where this indicator is one of the 100, the mean is recomputed without it.
The measure by the engagement’s assigned answer.
| Answer level | Engagements | Mean of the measure | SD |
|---|---|---|---|
| Under $1 million | 3 | ‡ | |
| $1 million to under $5 million | 15 | 4.3 | 1.9 |
| $5 million to under $10 million | 16 | 4.4 | 1.1 |
| $10 million to under $25 million | 3 | ‡ | |
| I do not know | 77 | 4.0 | 1.5 |
The test across answer levels, in the study set and inside each segment. Levels under 10 engagements were left out of each test.
| Segment | Engagements | Welch F | df | p | Holm p | Omega squared | 90% CI |
|---|---|---|---|---|---|---|---|
| Study set | 31 | 0.03 | 1, 21.8 | 0.863 | 0.863 | −0.032 | 0.000 to 0.063 |
| Outsourcing model | |||||||
| CXM | Fewer than two answer levels with at least 10 engagements | ||||||
| ITO | Fewer than two answer levels with at least 10 engagements | ||||||
| BPO | Fewer than two answer levels with at least 10 engagements | ||||||
| KPO | Fewer than two answer levels with at least 10 engagements | ||||||
| Institution type | |||||||
| Asset management | Fewer than two answer levels with at least 10 engagements | ||||||
| Wealth management and private banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Investment banking (advisory and capital-markets origination) | Fewer than two answer levels with at least 10 engagements | ||||||
| Insurance (life, property and casualty, health) | Fewer than two answer levels with at least 10 engagements | ||||||
| Commercial and business banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Payments and merchant acquiring (networks, acquiring, processing) | Fewer than two answer levels with at least 10 engagements | ||||||
| Credit card and payments issuing | 8 | ‡ | |||||
| Retail and consumer banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Markets and trading (sales and trading, global markets) | 7 | ‡ | |||||
| Private equity and private capital | 7 | ‡ | |||||
| Process family | |||||||
| Corporate and back-office functions | Fewer than two answer levels with at least 10 engagements | ||||||
| Technology engineering and operations | Fewer than two answer levels with at least 10 engagements | ||||||
| Client servicing and communications | Fewer than two answer levels with at least 10 engagements | ||||||
| Trade, settlement and reconciliation | Fewer than two answer levels with at least 10 engagements | ||||||
| Payments, cards and disputes | Fewer than two answer levels with at least 10 engagements | ||||||
| Credit, underwriting and suitability | 7 | ‡ | |||||
| Regulatory, audit, tax and legal | 6 | ‡ | |||||
| Financial crime and client onboarding | 7 | ‡ | |||||
| Class of work | |||||||
| LOB Operational | Fewer than two answer levels with at least 10 engagements | ||||||
| Corporate Functional | Fewer than two answer levels with at least 10 engagements | ||||||
| Engagement status and lifecycle stage | |||||||
| Active, Build-Out | Fewer than two answer levels with at least 10 engagements | ||||||
| Active, Transition/Cut-Over | Fewer than two answer levels with at least 10 engagements | ||||||
| Active, Production | Fewer than two answer levels with at least 10 engagements | ||||||
| Canceled | Fewer than two answer levels with at least 10 engagements |
The measure in the study set did not differ across answer levels (Welch F 0.03, p 0.863, n = 31 engagements).
Association with Intent to Leave
The respondent’s stated likelihood of leaving the current job within 12 months, rated 1 to 10 (C019). Measured at respondent level on up to 798 respondents, with the engagement-level form reported alongside.
The measure by the engagement’s assigned answer.
| Answer level | Engagements | Mean of the measure | SD |
|---|---|---|---|
| Under $1 million | 3 | ‡ | |
| $1 million to under $5 million | 15 | 6.5 | 2.8 |
| $5 million to under $10 million | 16 | 6.0 | 2.3 |
| $10 million to under $25 million | 3 | ‡ | |
| I do not know | 77 | 6.8 | 2.3 |
The test across answer levels, in the study set and inside each segment. Levels under 10 engagements were left out of each test.
| Segment | Engagements | Welch F | df | p | Holm p | Omega squared | 90% CI |
|---|---|---|---|---|---|---|---|
| Study set | 31 | 0.25 | 1, 27.3 | 0.621 | 0.621 | −0.025 | 0.000 to 0.125 |
| Outsourcing model | |||||||
| CXM | Fewer than two answer levels with at least 10 engagements | ||||||
| ITO | Fewer than two answer levels with at least 10 engagements | ||||||
| BPO | Fewer than two answer levels with at least 10 engagements | ||||||
| KPO | Fewer than two answer levels with at least 10 engagements | ||||||
| Institution type | |||||||
| Asset management | Fewer than two answer levels with at least 10 engagements | ||||||
| Wealth management and private banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Investment banking (advisory and capital-markets origination) | Fewer than two answer levels with at least 10 engagements | ||||||
| Insurance (life, property and casualty, health) | Fewer than two answer levels with at least 10 engagements | ||||||
| Commercial and business banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Payments and merchant acquiring (networks, acquiring, processing) | Fewer than two answer levels with at least 10 engagements | ||||||
| Credit card and payments issuing | 8 | ‡ | |||||
| Retail and consumer banking | Fewer than two answer levels with at least 10 engagements | ||||||
| Markets and trading (sales and trading, global markets) | 7 | ‡ | |||||
| Private equity and private capital | 7 | ‡ | |||||
| Process family | |||||||
| Corporate and back-office functions | Fewer than two answer levels with at least 10 engagements | ||||||
| Technology engineering and operations | Fewer than two answer levels with at least 10 engagements | ||||||
| Client servicing and communications | Fewer than two answer levels with at least 10 engagements | ||||||
| Trade, settlement and reconciliation | Fewer than two answer levels with at least 10 engagements | ||||||
| Payments, cards and disputes | Fewer than two answer levels with at least 10 engagements | ||||||
| Credit, underwriting and suitability | 7 | ‡ | |||||
| Regulatory, audit, tax and legal | 6 | ‡ | |||||
| Financial crime and client onboarding | 7 | ‡ | |||||
| Class of work | |||||||
| LOB Operational | Fewer than two answer levels with at least 10 engagements | ||||||
| Corporate Functional | Fewer than two answer levels with at least 10 engagements | ||||||
| Engagement status and lifecycle stage | |||||||
| Active, Build-Out | Fewer than two answer levels with at least 10 engagements | ||||||
| Active, Transition/Cut-Over | Fewer than two answer levels with at least 10 engagements | ||||||
| Active, Production | Fewer than two answer levels with at least 10 engagements | ||||||
| Canceled | Fewer than two answer levels with at least 10 engagements |
The measure in the study set did not differ across answer levels (Welch F 0.25, p 0.621, n = 31 engagements).
Comparison of Associations Across the Four Measures
| Measure | Effect size | n | Value | p | Equivalent to zero | Rank among the four |
|---|---|---|---|---|---|---|
| Cancellation rate | Omega squared, 0 or 1 flag | 31 | −0.006 | 0.433 | No | 1 |
| Customer satisfaction | Omega squared | 23 | −0.023 | 0.519 | No | 2 |
| Engagement indicator mean | Omega squared | 31 | −0.032 | 0.863 | Yes | 4 |
| Intent to leave | Omega squared | 31 | −0.025 | 0.621 | No | 3 |
Steiger’s z compares two correlations, and a categorical answer yields an effect size across levels rather than a correlation, so the pairs are not tested.
Clustering and Effective Sample Size
| Statistic | Value | Reading |
|---|---|---|
| Clusters (engagements) | 150 | Engagements with at least one answer. |
| Mean respondents per engagement | 4.0 | Answers per engagement with at least one answer. |
| ICC(1) | 0.07 | Share of variance between engagements. |
| Design effect | 1.21 | 1 plus (mean cluster size minus 1) times ICC. |
| Nominal respondent n | 601 | Every answer, with I do not know and I prefer to not answer counted as levels, as the plurality rule counts them. |
| Effective n | 498 | Nominal n divided by the design effect. |
| Cluster bootstrap applied | Yes | Applied to every respondent level CI where the ICC is 0.05 or above. |
Clustering reduced the 601 respondent answers to about 498 independent answers. Respondent level intervals therefore used the cluster bootstrap, and respondent level tests on intent to leave used cluster-robust errors.
Equivalence Tests of Null Results
| Measure | n | Omega squared | Equivalence bound | Equivalence p | Equivalent to zero | Achieved power | MDE at power 0.80 |
|---|---|---|---|---|---|---|---|
| Cancellation rate | 31 | −0.006 | Omega squared < 0.090 | 0.195 | No | 0.39 | 0.213 |
| Customer satisfaction | 23 | −0.023 | Omega squared < 0.090 | 0.194 | No | 0.30 | 0.273 |
| Engagement indicator mean | 31 | −0.032 | Omega squared < 0.090 | 0.031 | Yes | 0.39 | 0.213 |
| Intent to leave | 31 | −0.025 | Omega squared < 0.090 | 0.093 | No | 0.39 | 0.213 |
The bound is the ruled |r| < 0.30 expressed as variance explained (V15-R22). Equivalent to zero: engagement indicator mean.
Robustness Checks
| Check | Measure | Primary p | Check p | Check statistic | Conclusion holds |
|---|---|---|---|---|---|
| Kruskal-Wallis in place of Welch F | Customer satisfaction | 0.519 | 0.438 | 0.60 | Yes |
| Kruskal-Wallis in place of Welch F | Engagement indicator mean | 0.863 | 0.813 | 0.06 | Yes |
| Kruskal-Wallis in place of Welch F | Intent to leave | 0.621 | 0.540 | 0.38 | Yes |
| Active engagements only | Engagement indicator mean | 0.863 | 0.466 | 0.57 | Yes |
| Active engagements only | Intent to leave | 0.621 | 0.850 | 0.04 | Yes |
| Respondent level, cluster-robust Wald F by engagement | Cancellation rate | 0.433 | 0.012 | 3.82 | No |
| Respondent level, cluster-robust Wald F by engagement | Customer satisfaction | 0.519 | 0.117 | 2.00 | Yes |
| Respondent level, cluster-robust Wald F by engagement | Engagement indicator mean | 0.863 | 0.080 | 2.31 | Yes |
| Respondent level, cluster-robust Wald F by engagement | Intent to leave | 0.621 | 0.678 | 0.51 | Yes |
Checks that did not hold: “Respondent level, cluster-robust Wald F by engagement” on cancellation rate. A check holds when its test lands on the same side of 0.05 as the primary test.
Measure Independence and Part-Whole Correction
Each of the four measures was computed from data this indicator does not contain, so each result is a finding rather than an arithmetic consequence.
Comparison with the Study Norm
Not applicable. A categorical item has no signed correlation, so it has no profile. Its per-level means carry the comparison.
Interpretation of the Data
The third value band showed the lowest cancellation (18.75% canceled, n = 16 engagements) and the lowest intent to leave (mean 6.0, n = 16 engagements) of the bands tested. Engagements whose plurality answer was I do not know, which were left out of the tests, had a higher cancellation share than either tested band (38.96% canceled, n = 77 engagements). Most robustness checks run on this item held (8 of 9 checks). No gap between the tested bands held under test.
Limitations
The evidence is reported experience: what the delivery team said about its own engagement, gathered in one cross-section. The figures showed associations, not causes. Indicators about the financial institution were reported at second hand by vendor staff. Cancellation is a descriptive contrast, because canceled engagements were rated after they ended.
Tests across respondent role and vendor type were run at respondent level and treated respondents as independent. The section Clustering and Effective Sample Size states whether, and by how much, clustering within engagements reduced the information in respondent level figures.
Each measure test left out the lowest band, the top band, and the I do not know answers (n = 3, n = 3, n = 77 engagements), so the tests compared the two middle bands on a small base of engagements (chi-square 0.86, p 0.433, Cramer’s V 0.17, n = 31 engagements). Engagements took their value band from the plurality of respondent answers, which left some engagements unassigned (114 of 150 engagements).
Definitions
| Term | Definition |
|---|---|
| Response scale | As recorded, shown in Table 1. The indicator is not a rating, so no distressed range is defined. |
| Answering base | Respondents who gave one of the listed answers. |
| Non-answers | “I do not know” and “I prefer to not answer” are counted separately and are excluded from the answering base and the shares. |
| Indicator class | Perceived fact: a state of the engagement as the respondent perceives it, so “I do not know” is counted and reported as an answer. |
| Failure category | One of the five failure categories of the Study Taxonomy, section 3. Only the 100 rated indicators carry one, and the indicator is not among them. |
| Engagement indicator mean | The mean of an engagement’s 100 indicator ratings. |
Sources and Provenance
| Item | Value |
|---|---|
| Study data | Study Data.xlsx, Data sheet, column C046, sha256 219eba0457274d04 |
| Statistics engine | compute_statistics.py, sha256 738319eef764602b |
| Statistics record | Computed Statistics.json, record C046, sha256 e405f65a43e37a6e |
| Computed | October 8, 2026, 01:38 UTC |
| Template | Indicator Statistical Analysis Template, version 1.1 of 2026-10-06 |
| Figures placed by script | 659 of 659 |
