A Non-Compensatory Multimetric Framework for Technology Assessment in Regulated Environments (OpenAlex (recherche mondiale))

Summary

• The Non-Compensatory Multimetric Framework (NCMF) is validated on 2 real technology initiatives of a leading insurance group [p.1].p.1
• In Monte-Carlo simulations with 10 000 parameter draws, standard MCDA methods incorrectly rank the rejected initiative first in 96.6–100 % of draws [p.2].p.2
• The proposed NCMF framework reproduces both documented organizational authorization outcomes in 100 % of parameter draws [p.2].p.2
• Component-level risk analysis localizes 87.9 % of the authorized initiative's residual technical risk in a single backend component [p.2].p.2
• The authorized initiative (Pilot B) achieved an Integrated Systems Maturity Index of 7.82 and a Criticality-Weighted Risk Index of 54.6 [p.21].p.21
• Component C1 (Backend App Server) accounts for 48.0 of Pilot B's total 54.6 CWRI technical risk score [p.21].p.21
• The assessment pipeline runs with an algorithmic time complexity of O(mn2) and scales to architectures with thousands of components [p.2].p.2

Key insights

1. Outranking methods derive veto thresholds from analyst preferences on pairwise differences, which is incompatible with exogenous, absolute regulatory requirements.p.1
2. Pilot A was rejected because it satisfied only 75 % of regulatory veto items, failing mandatory third-party data and cloud compliance checks.p.2
3. The framework pipeline executes in O(mn2) time complexity and processes a Design Structure Matrix of 25 million entries in 79.6 ms.p.18
4. A uniform -1 shift in Technology Readiness Level across components increases the Criticality-Weighted Risk Index by 207.33 %.p.22
5. Compensatory decision models allow high technical performance to inappropriately offset critical compliance deficits in regulated environments.p.4
6. Pilot B's backend application server exhibits an operational maturity of 6 and generates 48.0 of the project's total 54.6 technical risk score.p.21