Study Data · Part 1 · Indicator Deep-Dive Analysis

Shared structure across the four study measures: cancellation, customer satisfaction, engagement indicator mean, intent to leave

Indicator ANALYSIS:four_measures · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeNone, a derived analysis
Question as askedShared structure across the four study measures: cancellation, customer satisfaction, engagement indicator mean, intent to leave
Failure categoryNot one of the 100 rated indicators
Place in the surveyNot a survey item
Indicator classDerived from other indicators
Indicator typeDerived analysis
Response scaleNot applicable, a derived analysis
Answering baseAs stated in Analysis Results
Non-answersNot applicable

Summary of Findings

The four study measures moved together across the engagements studied (n = 150 engagements). The first principal component carried most of their shared variance (first component share 0.88). Cancellation and customer satisfaction formed the strongest pair (r = −0.94, 95% CI −0.96 to −0.92), and cancellation and the engagement indicator mean formed the weakest (r = −0.72, 95% CI −0.79 to −0.63). Cancellation rose with intent to leave (r = 0.80, 95% CI 0.74 to 0.85), and customer satisfaction fell as intent to leave rose (r = −0.90, 95% CI −0.92 to −0.86). The engagement indicator mean rose with customer satisfaction (r = 0.85, 95% CI 0.80 to 0.89) and fell as intent to leave rose (r = −0.84, 95% CI −0.88 to −0.78). Customer satisfaction loaded most heavily on the first component (0.98), and the engagement indicator mean loaded least heavily (0.91).

Analysis Results

The figures in this section were computed for the study and placed by code from the statistics record.

Table 2. Analysis resultsTable
ItemValue
Unit of analysisEngagement
n150
Range of the six absolute r0.72 to 0.94

Pairs of measures.

Table 3a. Analysis results: pairs of measures, part 1 of 2Table
MeasuresnrR squared95% CI
Cancellation rate and customer satisfaction150−0.940.88−0.96 to −0.92
Cancellation rate and engagement indicator mean150−0.720.52−0.79 to −0.63
Cancellation rate and intent to leave1500.800.650.74 to 0.85
Customer satisfaction and engagement indicator mean1500.850.730.80 to 0.89
Customer satisfaction and intent to leave150−0.900.80−0.92 to −0.86
Engagement indicator mean and intent to leave150−0.840.70−0.88 to −0.78
Table 3b. Analysis results: pairs of measures, part 2 of 2Table
MeasurestdfpTOST pEquivalent to zeroPower at the observed effectSmallest detectable r (MDE)
Cancellation rate and customer satisfaction−33.23148< 0.0011.000No1.000.23
Cancellation rate and engagement indicator mean−12.67148< 0.0011.000No1.000.23
Cancellation rate and intent to leave16.43148< 0.0011.000No1.000.23
Customer satisfaction and engagement indicator mean19.94148< 0.0011.000No1.000.23
Customer satisfaction and intent to leave−24.71148< 0.0011.000No1.000.23
Engagement indicator mean and intent to leave−18.63148< 0.0011.000No1.000.23

Principal components of the four measures.

Table 4. Analysis results: principal components of the four measuresTable
ItemValue
Eigenvalues3.53, 0.30, 0.14, 0.03
First component share of variance explained0.88

Principal components of the four measures, loadings on the first component.

Table 5. Analysis results: principal components of the four measures, loadings on the first componentTable
ItemValue
Cancellation rate−0.92
Customer satisfaction0.98
Engagement indicator mean0.91
Intent to leave−0.94

Distribution of Recorded Values

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the response distribution of each input.

Descriptive Statistics by Segment

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the segment breakdown of each input.

Tests of Difference Between Segments

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the tests across segments for each input.

Association with Cancellation Rate

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Association with Customer Satisfaction

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Association with the Engagement Indicator Mean

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Association with Intent to Leave

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Comparison of Associations Across the Four Measures

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s comparison across the four measures.

Clustering and Effective Sample Size

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the clustering of each input.

Equivalence Tests of Null Results

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s equivalence test.

Robustness Checks

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s robustness checks.

Measure Independence and Part-Whole Correction

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s identity check.

Comparison with the Study Norm

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s profile.

Interpretation of the Data

The four measures behaved largely as one shared reading of each engagement in this study set (first component share 0.88). Cancellation and customer satisfaction shared the most variance of any pair (R squared 0.88). The engagement indicator mean and cancellation shared the least (R squared 0.52).

Limitations

The evidence is reported experience: what the delivery team said about its own engagement, gathered in one cross-section. The figures showed associations, not causes. Indicators about the financial institution were reported at second hand by vendor staff. Cancellation is a descriptive contrast, because canceled engagements were rated after they ended.

No limit applied beyond the standing limits of this block.

Definitions

Table 6. DefinitionsTable
TermDefinition
Indicator classDerived from other indicators: computed by the study from other recorded fields, as Analysis Results sets out.
Failure categoryOne of the five failure categories of the Study Taxonomy, section 3. Only the 100 rated indicators carry one, and the indicator is not among them.
DirectionEach result is read in the direction of the measure it reports.
Engagement indicator meanThe mean of an engagement’s 100 indicator ratings.

Sources and Provenance

Table 7. Sources and provenanceTable
ItemValue
Study dataStudy Data.xlsx, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record ANALYSIS:four_measures, sha256 e405f65a43e37a6e
ComputedOctober 8, 2026, 01:38 UTC
TemplateIndicator Statistical Analysis Template, version 1.1 of 2026-10-06
Figures placed by script102 of 102

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →