The three alteration questions by respondent role: C199, C205, C211 by C005
Indicator ANALYSIS:alterations_by_role · By Phil Hatch · Akholi · October 9, 2026
On this page
20 sectionsIndicator Specification
| Field | Value |
|---|---|
| Indicator code | None, a derived analysis |
| Question as asked | The three alteration questions by respondent role: C199, C205, C211 by C005 |
| Failure category | Not one of the 100 rated indicators |
| Place in the survey | Not a survey item |
| Indicator class | Derived from other indicators |
| Indicator type | Derived analysis |
| Response scale | Not applicable, a derived analysis |
| Answering base | As stated in Analysis Results |
| Non-answers | Not applicable |
Summary of Findings
Three Part 5 questions asked respondents whether they had altered data provided by the financial institution (C199), the financial institution's processes (C205) and AI outputs (C211). Saying True was almost entirely confined to individual contributors. Among engagement managers the share saying True was 6.08% or lower on each question, and no portfolio director said True to any of the three. The difference between roles reached significance on all three questions.
For C199, on data provided by the financial institution, 63.43% of individual contributors said True (n = 659), against 2.00% of engagement managers (n = 150) and 0.00% of portfolio directors (n = 30). The role difference gave chi-square 215.77 on two degrees of freedom, p < 0.001, n = 839 respondents.
For C205, on the financial institution's processes, 72.66% of individual contributors said True (n = 662), against 6.08% of engagement managers (n = 148) and 0.00% of portfolio directors (n = 31). The role difference gave chi-square 265.42 on two degrees of freedom, p < 0.001, n = 841 respondents.
For C211, on AI outputs, 42.46% of individual contributors said True (n = 650), against 1.36% of engagement managers (n = 147) and 0.00% of portfolio directors (n = 31). The role difference gave chi-square 107.09 on two degrees of freedom, p < 0.001, n = 828 respondents.
Analysis Results
The first table gives the base. The second gives the answers by role for each question, with the share saying True computed on the respondents who answered True or False. The third gives the test of the difference between roles.
| Result | Value |
|---|---|
| Unit of analysis | Respondent |
| Questions | C199, C205 and C211 |
| Roles tested | Individual contributor, engagement manager, portfolio director |
| Role not in the test | Customer Management Executive, no True or False answer |
| Respondents answering True or False, C199 | 839 |
| Respondents answering True or False, C205 | 841 |
| Respondents answering True or False, C211 | 828 |
| Question | Role | True | False | Answered True or False | Share True | I do not know | Prefer not to answer |
|---|---|---|---|---|---|---|---|
| C199 | Individual contributor | 418 | 241 | 659 | 63.43% | 1 | 4 |
| C199 | Engagement manager | 3 | 147 | 150 | 2.00% | 0 | 0 |
| C199 | Portfolio director | 0 | 30 | 30 | 0.00% | 0 | 1 |
| C199 | Customer Management Executive | 0 | 0 | 0 | Not computed | 0 | 0 |
| C199 | All roles | 421 | 418 | 839 | 50.18% | 1 | 5 |
| C205 | Individual contributor | 481 | 181 | 662 | 72.66% | 0 | 4 |
| C205 | Engagement manager | 9 | 139 | 148 | 6.08% | 0 | 2 |
| C205 | Portfolio director | 0 | 31 | 31 | 0.00% | 0 | 0 |
| C205 | Customer Management Executive | 0 | 0 | 0 | Not computed | 0 | 0 |
| C205 | All roles | 490 | 351 | 841 | 58.26% | 0 | 6 |
| C211 | Individual contributor | 276 | 374 | 650 | 42.46% | 2 | 14 |
| C211 | Engagement manager | 2 | 145 | 147 | 1.36% | 0 | 2 |
| C211 | Portfolio director | 0 | 31 | 31 | 0.00% | 0 | 0 |
| C211 | Customer Management Executive | 0 | 0 | 0 | Not computed | 0 | 0 |
| C211 | All roles | 278 | 550 | 828 | 33.57% | 2 | 16 |
| Question | Chi-square | df | p | n | Role not in the test | Its respondents | Its True or False answers |
|---|---|---|---|---|---|---|---|
| C199 | 215.77 | 2 | < 0.001 | 839 | Customer Management Executive | 2 | 0 |
| C205 | 265.42 | 2 | < 0.001 | 841 | Customer Management Executive | 2 | 0 |
| C211 | 107.09 | 2 | < 0.001 | 828 | Customer Management Executive | 2 | 0 |
Distribution of Responses
Across all roles, 50.18% of the 839 respondents who answered True or False said True for C199, 58.26% of 841 for C205 and 33.57% of 828 for C211. The full distribution of each question, with its non-answers, is reported in the file of that indicator.
Descriptive Statistics by Segment
The analysis is itself a breakdown by respondent role, given in full in the second table. It was not broken down by any other segment.
Tests of Difference Between Segments
Each question was tested for a difference between individual contributors, engagement managers and portfolio directors by a chi-square test on the respondents who answered True or False. The respondents holding the role of Customer Management Executive gave no True or False answer to any of the three questions, so they appear as counts and are not in the test. All three tests reached significance.
Association with Cancellation Rate
Cancellation was not part of this analysis. The association of each question with cancellation is reported in the file of that indicator.
Association with Customer Satisfaction
Customer satisfaction was not part of this analysis. The association of each question with customer satisfaction is reported in the file of that indicator.
Association with the Engagement Indicator Mean
The engagement indicator mean was not part of this analysis.
Association with Intent to Leave
Intent to leave was not part of this analysis.
Comparison of Associations Across the Four Measures
The analysis concerns respondent role alone, so no comparison across the four measures applies.
Clustering and Effective Sample Size
The tests treat respondents as independent. Respondents on the same engagement share conditions, so the p-values are somewhat smaller than a test clustered by engagement would give. No clustered test was computed, so the p-values are approximate.
Equivalence Tests of Null Results
No equivalence test was computed, because every test found a difference.
Robustness Checks
No robustness checks were computed for this analysis.
Measure Independence and Part-Whole Correction
Respondent role and the three questions are separate fields, and neither enters the other. No part-whole correction applies.
Comparison with the Study Norm
A derived analysis has no profile against the study norm, so no comparison applies.
Interpretation of the Data
The alteration of data, processes and AI outputs was reported by the respondents who do the hands-on work. Individual contributors said True far more often than engagement managers, and portfolio directors never did. The pattern fits work done at the level where the data, the process and the output are handled, and it also fits a reluctance among managers to report alterations made under their oversight. The analysis cannot separate the two readings.
Limitations
The evidence is the reported experience of the vendor's delivery teams, collected in a single cross-section. The association reported here is not causal.
The questions ask whether the respondent personally altered data, processes or outputs. A manager who knew of alterations made by the team would answer False, so the role difference measures who made the alterations, not who knew.
The tests treat respondents as independent and were not clustered by engagement.
Definitions
| Term | Definition |
|---|---|
| Share True | The respondents who answered True, divided by those who answered True or False. |
| Chi-square test | A test of whether the share answering True differs between roles more than chance would allow. |
| Individual contributor | A respondent who delivers the work directly, without managing others on the engagement. |
Sources and Provenance
| Source | Value |
|---|---|
| Study data | Study Data.xlsx, sha256 219eba0457274d04 |
| Statistics engine | compute_statistics.py, sha256 738319eef764602b |
| Statistics record | Computed Statistics.json, record ANALYSIS:alterations_by_role, sha256 1ae50a3637fc9370 |
| Computed | October 13, 2026, 04:57 UTC |
| Template | Indicator Template v2, version 2.0 of 10 October 2026 |
| Figures placed by script | 172 |
