The Imbalanced User-AI Relationships as an Ethical Failure of Front-End Design in Healthcare AI

arXiv:2604.22767v1 Announce Type: cross Abstract: Ethical discourse on AI in healthcare has focused predominantly on back-end concerns such as bias, fairness and explainability, while the front-end interface, where patients and clinicians actually encounter AI outputs, remains under explored. This paper identifies imbalanced user-AI relationships as a distinct class of front-end ethical failure: patients are rendered highly visible to AI systems through data inference, yet cannot understand, question or influence how they are represented. Through the concept of asymmetric legibility and a chat-based telemedicine case, we show how design choices e.g., default recommendations, restricted inputs and suppressed uncertainty, undermine agency, clinician judgment and human oversight even where systems are technically accurate. We propose reciprocity as a design orientation and offer interventions for more balanced, participatory user-AI relationships in healthcare.

Related

• Front-End Ethics for Sensor-Fused Health Conversational Agents: An Ethical Design Space for Biometrics
• Equity Bias: An Ethical Framework for AI Design
• Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem
• 'Taking Stock at FAccT': Using Participatory Design to Co-Create a Vision for the Fairness, Accountability and Transparency Community

Source: arXiv cs.AI | 2026-04-28