Study Data · Part 1 · Indicator Deep-Dive Analysis

Indicator associations net of the engagement indicator mean: 100 component indicators against three measures

Indicator ANALYSIS:net_associations · By Phil Hatch · Akholi · October 9, 2026

Indicator Specification

Table 1. Indicator specificationTable
FieldValue
Indicator codeNone, a derived analysis
Question as askedIndicator associations net of the engagement indicator mean: 100 component indicators against three measures
Failure categoryNot one of the 100 rated indicators
Place in the surveyNot a survey item
Indicator classDerived from other indicators
Indicator typeDerived analysis
Response scaleNot applicable, a derived analysis
Answering baseAs stated in Analysis Results
Non-answersNot applicable

Summary of Findings

The analysis tested each component indicator against cancellation, customer satisfaction, and intent to leave, net of the leave-one-out engagement indicator mean, in 300 tests. Each test was a partial correlation computed at engagement level. Benjamini-Hochberg control applied across all tests at once, as the Rule row in Analysis Results states. Tests with p below the nominal threshold before correction numbered 33 of 300. Tests surviving Benjamini-Hochberg control numbered 0 of 300.

Analysis Results

The figures in this section were computed for the study and placed by code from the statistics record.

Table 2. Analysis resultsTable
ItemValue
Unit of analysisEngagement
Rulea
Tests run300
Tests with p below 0.05 before correction33
Tests that survive Benjamini-Hochberg correction0
Note: a Partial correlation of each component with each measure, net of the leave-one-out engagement indicator mean, Benjamini-Hochberg at 0.05 across all tests.

Partial correlation of each component with each measure.

Table 3. Analysis results: partial correlation of each component with each measureTable
IndicatorMeasurenPartial rtdfpBenjamini-Hochberg qSurvives Benjamini-Hochberg
C094Cancellation rate150−0.06−0.691470.4910.834No
C094Customer satisfaction1500.111.321470.1880.609No
C094Intent to leave150−0.06−0.741470.4570.834No
C095Cancellation rate150−0.01−0.111470.9090.967No
C095Customer satisfaction1500.070.811470.4180.824No
C095Intent to leave150−0.04−0.511470.6120.874No
C096Cancellation rate150−0.04−0.461470.6480.884No
C096Customer satisfaction1500.101.221470.2230.668No
C096Intent to leave150−0.08−0.961470.3360.743No
C097Cancellation rate150−0.02−0.291470.7750.915No
C097Customer satisfaction1500.091.081470.2830.707No
C097Intent to leave150−0.11−1.381470.1700.587No
C098Cancellation rate1500.040.531470.5950.874No
C098Customer satisfaction1500.010.071470.9440.979No
C098Intent to leave1500.030.391470.6980.902No
C099Cancellation rate1500.020.241470.8100.915No
C099Customer satisfaction1500.040.491470.6270.874No
C099Intent to leave1500.050.581470.5620.874No
C100Cancellation rate1500.050.561470.5790.874No
C100Customer satisfaction1500.000.041470.9680.984No
C100Intent to leave1500.070.801470.4230.824No
C101Cancellation rate1500.030.391470.6970.902No
C101Customer satisfaction1500.040.541470.5880.874No
C101Intent to leave1500.091.091470.2760.705No
C102Cancellation rate1500.040.521470.6030.874No
C102Customer satisfaction1500.020.241470.8100.915No
C102Intent to leave1500.060.671470.5010.839No
C103Cancellation rate1500.080.921470.3600.777No
C103Customer satisfaction150−0.03−0.411470.6800.902No
C103Intent to leave1500.091.051470.2940.711No
C104Cancellation rate150−0.01−0.071470.9410.979No
C104Customer satisfaction1500.060.761470.4470.834No
C104Intent to leave150−0.01−0.181470.8580.948No
C105Cancellation rate1500.080.981470.3270.739No
C105Customer satisfaction150−0.04−0.441470.6610.893No
C105Intent to leave1500.111.391470.1660.587No
C106Cancellation rate1500.020.261470.7980.915No
C106Customer satisfaction1500.030.391470.6970.902No
C106Intent to leave1500.141.661470.0990.513No
C107Cancellation rate1500.020.261470.7950.915No
C107Customer satisfaction1500.020.271470.7850.915No
C107Intent to leave1500.050.621470.5390.874No
C108Cancellation rate1500.010.101470.9230.968No
C108Customer satisfaction1500.040.481470.6290.874No
C108Intent to leave1500.050.671470.5050.842No
C109Cancellation rate1500.010.181470.8590.948No
C109Customer satisfaction1500.070.851470.3970.811No
C109Intent to leave1500.080.961470.3370.743No
C110Cancellation rate1500.040.481470.6290.874No
C110Customer satisfaction1500.020.291470.7740.915No
C110Intent to leave1500.040.431470.6680.895No
C111Cancellation rate1500.070.841470.4020.815No
C111Customer satisfaction1500.010.151470.8820.954No
C111Intent to leave1500.060.721470.4760.834No
C112Cancellation rate1500.040.511470.6120.874No
C112Customer satisfaction1500.010.151470.8830.954No
C112Intent to leave1500.070.791470.4290.824No
C113Cancellation rate1500.040.531470.5950.874No
C113Customer satisfaction1500.020.271470.7900.915No
C113Intent to leave1500.070.901470.3690.785No
C115Cancellation rate1500.101.271470.2050.634No
C115Customer satisfaction150−0.09−1.061470.2900.709No
C115Intent to leave1500.141.731470.0870.508No
C116Cancellation rate1500.091.121470.2650.697No
C116Customer satisfaction150−0.12−1.501470.1370.570No
C116Intent to leave1500.141.681470.0950.508No
C117Cancellation rate1500.141.711470.0900.508No
C117Customer satisfaction150−0.16−1.921470.0570.449No
C117Intent to leave1500.202.521470.0130.401No
C118Cancellation rate1500.060.781470.4370.824No
C118Customer satisfaction150−0.05−0.621470.5390.874No
C118Intent to leave1500.151.801470.0740.502No
C119Cancellation rate1500.182.231470.0270.419No
C119Customer satisfaction150−0.15−1.861470.0650.478No
C119Intent to leave1500.131.601470.1130.549No
C120Cancellation rate1500.141.741470.0850.508No
C120Customer satisfaction150−0.13−1.591470.1140.549No
C120Intent to leave1500.182.201470.0290.419No
C121Cancellation rate1500.172.101470.0370.431No
C121Customer satisfaction150−0.18−2.231470.0280.419No
C121Intent to leave1500.212.641470.0090.401No
C122Cancellation rate1500.121.441470.1520.582No
C122Customer satisfaction150−0.13−1.551470.1230.551No
C122Intent to leave1500.161.921470.0560.449No
C123Cancellation rate1500.141.731470.0850.508No
C123Customer satisfaction150−0.14−1.731470.0850.508No
C123Intent to leave1500.182.231470.0270.419No
C124Cancellation rate1500.101.181470.2410.675No
C124Customer satisfaction150−0.08−1.021470.3080.711No
C124Intent to leave1500.162.031470.0440.431No
C125Cancellation rate1500.151.791470.0750.502No
C125Customer satisfaction150−0.16−1.941470.0540.449No
C125Intent to leave1500.243.001470.0030.323No
C126Cancellation rate1500.091.091470.2770.705No
C126Customer satisfaction150−0.08−0.951470.3460.757No
C126Intent to leave1500.162.031470.0450.431No
C127Cancellation rate1500.141.691470.0940.508No
C127Customer satisfaction150−0.14−1.741470.0830.508No
C127Intent to leave1500.192.341470.0210.419No
C128Cancellation rate1500.202.501470.0140.401No
C128Customer satisfaction150−0.19−2.391470.0180.419No
C128Intent to leave1500.242.991470.0030.323No
C129Cancellation rate1500.151.811470.0730.502No
C129Customer satisfaction150−0.16−2.001470.0470.439No
C129Intent to leave1500.212.621470.0100.401No
C130Cancellation rate1500.121.481470.1400.577No
C130Customer satisfaction150−0.15−1.851470.0670.478No
C130Intent to leave1500.151.891470.0600.463No
C131Cancellation rate1500.151.851470.0660.478No
C131Customer satisfaction150−0.17−2.031470.0440.431No
C131Intent to leave1500.253.161470.0020.323No
C132Cancellation rate1500.192.331470.0210.419No
C132Customer satisfaction150−0.17−2.141470.0340.431No
C132Intent to leave1500.212.671470.0090.401No
C133Cancellation rate1500.121.471470.1440.582No
C133Customer satisfaction150−0.13−1.541470.1270.559No
C133Intent to leave1500.172.031470.0440.431No
C134Cancellation rate1500.182.231470.0270.419No
C134Customer satisfaction150−0.18−2.211470.0290.419No
C134Intent to leave1500.212.661470.0090.401No
C136Cancellation rate150−0.02−0.231470.8170.918No
C136Customer satisfaction1500.020.251470.8040.915No
C136Intent to leave150−0.11−1.301470.1960.618No
C137Cancellation rate150−0.04−0.491470.6260.874No
C137Customer satisfaction1500.010.121470.9020.963No
C137Intent to leave150−0.13−1.621470.1070.534No
C138Cancellation rate150−0.10−1.241470.2170.665No
C138Customer satisfaction1500.091.041470.3010.711No
C138Intent to leave150−0.20−2.471470.0150.401No
C139Cancellation rate150−0.05−0.571470.5680.874No
C139Customer satisfaction1500.000.021470.9860.992No
C139Intent to leave150−0.10−1.201470.2340.668No
C140Cancellation rate150−0.03−0.321470.7520.915No
C140Customer satisfaction1500.020.191470.8470.941No
C140Intent to leave150−0.12−1.421470.1580.582No
C141Cancellation rate150−0.01−0.081470.9380.979No
C141Customer satisfaction150−0.01−0.161470.8730.952No
C141Intent to leave150−0.13−1.571470.1190.551No
C142Cancellation rate150−0.02−0.291470.7700.915No
C142Customer satisfaction1500.000.031470.9770.987No
C142Intent to leave150−0.10−1.231470.2200.668No
C143Cancellation rate150−0.03−0.391470.6950.902No
C143Customer satisfaction1500.00−0.061470.9540.981No
C143Intent to leave150−0.12−1.501470.1360.570No
C144Cancellation rate150−0.03−0.381470.7040.904No
C144Customer satisfaction1500.000.011470.9950.998No
C144Intent to leave150−0.11−1.361470.1750.591No
C145Cancellation rate150−0.05−0.561470.5780.874No
C145Customer satisfaction1500.020.301470.7660.915No
C145Intent to leave150−0.09−1.101470.2710.702No
C146Cancellation rate150−0.04−0.501470.6150.874No
C146Customer satisfaction1500.010.161470.8720.952No
C146Intent to leave150−0.12−1.451470.1490.582No
C147Cancellation rate150−0.03−0.361470.7200.905No
C147Customer satisfaction1500.020.271470.7870.915No
C147Intent to leave150−0.10−1.201470.2330.668No
C148Cancellation rate150−0.08−0.981470.3270.739No
C148Customer satisfaction1500.060.791470.4310.824No
C148Intent to leave150−0.15−1.781470.0770.503No
C149Cancellation rate150−0.07−0.801470.4230.824No
C149Customer satisfaction1500.060.691470.4890.834No
C149Intent to leave150−0.17−2.041470.0440.431No
C150Cancellation rate1500.00−0.041470.9710.985No
C150Customer satisfaction150−0.03−0.351470.7300.913No
C150Intent to leave150−0.09−1.131470.2590.697No
C151Cancellation rate1500.020.241470.8090.915No
C151Customer satisfaction150−0.02−0.271470.7860.915No
C151Intent to leave150−0.05−0.571470.5720.874No
C152Cancellation rate1500.000.001470.9980.998No
C152Customer satisfaction150−0.03−0.381470.7050.904No
C152Intent to leave150−0.06−0.741470.4610.834No
C153Cancellation rate150−0.06−0.711470.4810.834No
C153Customer satisfaction1500.030.411470.6840.902No
C153Intent to leave150−0.13−1.561470.1210.551No
C154Cancellation rate150−0.06−0.701470.4850.834No
C154Customer satisfaction1500.030.341470.7360.914No
C154Intent to leave150−0.10−1.201470.2330.668No
C155Cancellation rate150−0.01−0.131470.8950.962No
C155Customer satisfaction150−0.02−0.291470.7690.915No
C155Intent to leave150−0.07−0.851470.3970.811No
C157Cancellation rate150−0.12−1.511470.1330.570No
C157Customer satisfaction1500.091.151470.2530.697No
C157Intent to leave150−0.08−0.911470.3630.778No
C158Cancellation rate150−0.08−0.981470.3310.741No
C158Customer satisfaction1500.091.121470.2620.697No
C158Intent to leave150−0.07−0.891470.3770.790No
C159Cancellation rate150−0.06−0.731470.4690.834No
C159Customer satisfaction1500.040.521470.6060.874No
C159Intent to leave1500.010.131470.8990.963No
C160Cancellation rate150−0.12−1.431470.1550.582No
C160Customer satisfaction1500.131.581470.1150.549No
C160Intent to leave150−0.17−2.111470.0360.431No
C161Cancellation rate150−0.09−1.041470.3020.711No
C161Customer satisfaction1500.050.611470.5420.874No
C161Intent to leave150−0.09−1.131470.2620.697No
C162Cancellation rate150−0.09−1.131470.2610.697No
C162Customer satisfaction1500.081.031470.3060.711No
C162Intent to leave150−0.07−0.791470.4290.824No
C163Cancellation rate1500.010.101470.9220.968No
C163Customer satisfaction1500.000.051470.9570.981No
C163Intent to leave150−0.05−0.581470.5640.874No
C164Cancellation rate150−0.11−1.401470.1640.587No
C164Customer satisfaction1500.131.561470.1210.551No
C164Intent to leave150−0.07−0.881470.3790.790No
C165Cancellation rate150−0.11−1.311470.1920.614No
C165Customer satisfaction1500.111.321470.1890.609No
C165Intent to leave150−0.17−2.051470.0420.431No
C166Cancellation rate150−0.16−1.941470.0540.449No
C166Customer satisfaction1500.141.681470.0950.508No
C166Intent to leave150−0.13−1.651470.1010.515No
C167Cancellation rate150−0.06−0.691470.4900.834No
C167Customer satisfaction1500.060.721470.4730.834No
C167Intent to leave150−0.03−0.311470.7540.915No
C168Cancellation rate150−0.12−1.421470.1590.582No
C168Customer satisfaction1500.121.431470.1560.582No
C168Intent to leave150−0.10−1.161470.2490.690No
C169Cancellation rate150−0.11−1.381470.1700.587No
C169Customer satisfaction1500.101.201470.2340.668No
C169Intent to leave150−0.07−0.871470.3860.799No
C170Cancellation rate150−0.10−1.281470.2040.634No
C170Customer satisfaction1500.111.321470.1880.609No
C170Intent to leave150−0.12−1.421470.1590.582No
C171Cancellation rate150−0.20−2.521470.0130.401No
C171Customer satisfaction1500.192.341470.0210.419No
C171Intent to leave150−0.18−2.161470.0320.431No
C172Cancellation rate150−0.10−1.211470.2280.668No
C172Customer satisfaction1500.081.021470.3070.711No
C172Intent to leave150−0.05−0.601470.5490.874No
C173Cancellation rate150−0.04−0.511470.6090.874No
C173Customer satisfaction1500.040.461470.6450.883No
C173Intent to leave150−0.07−0.801470.4240.824No
C174Cancellation rate150−0.14−1.671470.0980.513No
C174Customer satisfaction1500.141.681470.0950.508No
C174Intent to leave150−0.16−1.991470.0480.439No
C175Cancellation rate150−0.11−1.361470.1750.591No
C175Customer satisfaction1500.121.431470.1560.582No
C175Intent to leave150−0.09−1.111470.2670.697No
C176Cancellation rate150−0.11−1.341470.1830.609No
C176Customer satisfaction1500.121.511470.1340.570No
C176Intent to leave150−0.11−1.381470.1700.587No
C178Cancellation rate150−0.01−0.101470.9210.968No
C178Customer satisfaction150−0.03−0.361470.7210.905No
C178Intent to leave150−0.03−0.371470.7110.904No
C179Cancellation rate150−0.04−0.471470.6360.879No
C179Customer satisfaction1500.040.511470.6080.874No
C179Intent to leave150−0.07−0.831470.4080.821No
C180Cancellation rate150−0.07−0.891470.3720.787No
C180Customer satisfaction1500.040.471470.6420.883No
C180Intent to leave150−0.02−0.241470.8120.915No
C181Cancellation rate150−0.09−1.081470.2830.707No
C181Customer satisfaction1500.081.001470.3200.733No
C181Intent to leave150−0.16−1.941470.0540.449No
C182Cancellation rate150−0.06−0.721470.4740.834No
C182Customer satisfaction1500.050.641470.5250.865No
C182Intent to leave150−0.06−0.791470.4320.824No
C183Cancellation rate150−0.01−0.161470.8730.952No
C183Customer satisfaction150−0.01−0.101470.9190.968No
C183Intent to leave150−0.06−0.721470.4750.834No
C184Cancellation rate150−0.06−0.691470.4900.834No
C184Customer satisfaction1500.040.431470.6670.895No
C184Intent to leave150−0.06−0.741470.4590.834No
C185Cancellation rate150−0.02−0.271470.7870.915No
C185Customer satisfaction1500.050.601470.5500.874No
C185Intent to leave150−0.03−0.341470.7370.914No
C186Cancellation rate1500.030.361470.7200.905No
C186Customer satisfaction150−0.03−0.331470.7420.915No
C186Intent to leave1500.010.071470.9460.979No
C187Cancellation rate150−0.08−0.941470.3480.757No
C187Customer satisfaction1500.050.571470.5710.874No
C187Intent to leave150−0.03−0.411470.6810.902No
C188Cancellation rate150−0.05−0.571470.5680.874No
C188Customer satisfaction1500.050.621470.5360.874No
C188Intent to leave150−0.05−0.551470.5810.874No
C189Cancellation rate150−0.06−0.691470.4880.834No
C189Customer satisfaction1500.050.561470.5760.874No
C189Intent to leave150−0.03−0.371470.7090.904No
C190Cancellation rate150−0.03−0.401470.6870.902No
C190Customer satisfaction1500.040.511470.6100.874No
C190Intent to leave150−0.06−0.681470.4950.834No
C191Cancellation rate150−0.10−1.191470.2370.670No
C191Customer satisfaction1500.050.551470.5860.874No
C191Intent to leave150−0.09−1.071470.2860.709No
C192Cancellation rate150−0.02−0.241470.8090.915No
C192Customer satisfaction1500.020.251470.8030.915No
C192Intent to leave150−0.04−0.521470.6060.874No
C193Cancellation rate150−0.06−0.691470.4940.834No
C193Customer satisfaction1500.020.211470.8340.933No
C193Intent to leave1500.00−0.051470.9610.981No
C194Cancellation rate150−0.06−0.781470.4350.824No
C194Customer satisfaction1500.060.701470.4860.834No
C194Intent to leave150−0.08−1.031470.3070.711No
C195Cancellation rate1500.000.051470.9600.981No
C195Customer satisfaction150−0.01−0.151470.8840.954No
C195Intent to leave1500.040.491470.6260.874No
C196Cancellation rate150−0.02−0.261470.7970.915No
C196Customer satisfaction1500.040.441470.6570.892No
C196Intent to leave150−0.09−1.061470.2910.709No
C197Cancellation rate150−0.02−0.201470.8450.941No
C197Customer satisfaction1500.020.261470.7960.915No
C197Intent to leave150−0.05−0.641470.5250.865No

Distribution of Responses

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the response distribution of each input.

Descriptive Statistics by Segment

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the segment breakdown of each input.

Tests of Difference Between Segments

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the tests across segments for each input.

Association with Cancellation Rate

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Association with Customer Satisfaction

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Association with the Engagement Indicator Mean

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Association with Intent to Leave

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s association with this measure.

Comparison of Associations Across the Four Measures

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s comparison across the four measures.

Clustering and Effective Sample Size

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry the clustering of each input.

Equivalence Tests of Null Results

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s equivalence test.

Robustness Checks

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s robustness checks.

Measure Independence and Part-Whole Correction

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s identity check.

Comparison with the Study Norm

This block is a derived analysis. Its own results are in Analysis Results. The blocks of its input indicators carry each input’s profile.

Interpretation of the Data

No single component indicator carried an association of its own with cancellation, customer satisfaction, or intent to leave once the engagement indicator mean was held constant. The 33 tests below the nominal threshold fell away under correction for the number of tests run.

Limitations

The evidence is reported experience: what the delivery team said about its own engagement, gathered in one cross-section. The figures showed associations, not causes. Indicators about the financial institution were reported at second hand by vendor staff. Cancellation is a descriptive contrast, because canceled engagements were rated after they ended.

No limit applied beyond the standing limits of this block.

Definitions

Table 4. DefinitionsTable
TermDefinition
Indicator classDerived from other indicators: computed by the study from other recorded fields, as Analysis Results sets out.
Failure categoryOne of the five failure categories of the Study Taxonomy, section 3. Only the 100 rated indicators carry one, and the indicator is not among them.
DirectionEach result is read in the direction of the measure it reports.
Engagement indicator meanThe mean of an engagement’s 100 indicator ratings.

Sources and Provenance

Table 5. Sources and provenanceTable
ItemValue
Study dataStudy Data.xlsx, sha256 219eba0457274d04
Statistics enginecompute_statistics.py, sha256 738319eef764602b
Statistics recordComputed Statistics.json, record ANALYSIS:net_associations, sha256 e405f65a43e37a6e
ComputedOctober 8, 2026, 01:38 UTC
TemplateIndicator Statistical Analysis Template, version 1.1 of 2026-10-06
Figures placed by script1,809 of 1,809

Continue the report

Executive summary →
Overview

Executive Summary

Four findings from 150 engagements

Read →
Introduction

Introduction

Scope, evidence, and how the report is organized

Read →
Part 1

Engagement Outcomes

Poor results on every measure, and what separates them

Read →
Part 2

The Five Failure Categories

Where failure concentrates, category by category

Read →
Part 3

Governance, Oversight, and Control

Controls that existed in name only

Read →
Part 4

The Delivery Workforce

Early in their careers, dissatisfied, and many intending to leave

Read →
Part 5

Manual Alteration

How the delivery team altered the work to sustain it

Read →
Part 6

Executive Action Plan

Seven immediate actions and a first-year plan

Read →
Appendices

Appendices

Definitions, indicator inventory, method, and disclosures

Read →
Data

Study Data

Deep-dive analyses of the study indicators, published in stages

Read →