Why human-AI collaboration fails: An operational contestability framework

Weihua ZHOU , Xin LIN , Lei FU , Ying TANG , Cangyu JIN

Eng. Manag ››

PDF (621KB)
Eng. Manag ›› DOI: 10.1007/s42524-026-6049-7
Comments
Why human-AI collaboration fails: An operational contestability framework
Author information +
History +
PDF (621KB)

Abstract

Human-AI collaboration is becoming central to operational prediction, decision-making, and control. As AI systems become embedded in operational workflows, organizations face a recurring risk: decision support may improve while the practical space for human intervention, accountability, and learning becomes too constrained for meaningful contestation. This article develops an operational contestability framework to explain when and why this risk becomes collaboration failure. The key question is not simply whether humans remain formally“in the loop,” but whether AI-enabled operational decision systems preserve practical room for questioning algorithmic representations, reallocating decision authority, and revising collaboration routines before execution makes intervention costly or infeasible. The framework identifies three driving mechanisms: cognitive asymmetry, dynamic delegation, and meta-learning. These mechanisms progressively constrain what can be represented, who can intervene, and how collaboration routines can be revised. It also specifies two amplifying conditions: cognitive coupling and accountability-defensibility. These conditions raise the operational and justificatory costs of deviating from algorithmic baselines. The erosion of operational contestability unfolds through a recurrent process of Encoding, Habituation, and Closure (EHC): representations and authority rules are built into system design, algorithmic outputs become planning baselines, and those baselines become operational commitments under time pressure, interdependence, and accountability exposure. Generative AI intensifies this process by turning recommendations, explanations, and justifications into portable decision artifacts, thereby accelerating habituation and making closure less visible. The framework reframes human-AI collaboration as an operations management problem: governing decision systems so that representation, authority, and learning remain contestable across repeated decision cycles.

Keywords

human-AI collaboration / operational contestability / AI-enabled operations / decision-system governance / generative AI

Cite this article

Download citation ▾
Weihua ZHOU, Xin LIN, Lei FU, Ying TANG, Cangyu JIN. Why human-AI collaboration fails: An operational contestability framework. Eng. Manag DOI:10.1007/s42524-026-6049-7

登录浏览全文

4963

注册一个新账户 忘记密码

References

RIGHTS & PERMISSIONS

Higher Education Press 2026

PDF (621KB)

0

Accesses

0

Citation

Detail

Sections
Recommended

/