Safety
Eigenism: Ethics for a Human-AI Future
arXiv:2606.12420v2 Announce Type: replace-cross Abstract: Our concepts of survival and self-interest were built for single, continuous biological lives. These ideas break down when applied to artifici
arXiv:2606.12420v2 Announce Type: replace-cross Abstract: Our concepts of survival and self-interest were built for single, continuous biological lives. These ideas break down when applied to artificial intelligence, since an AI can be easily copied, paused, branched, or merged. To determine what an AI actually has reason to care about, this paper introduces extit{Eigenism}, an ethical framework that treats identity not as an all-or-nothing property tied to specific hardware, but as a graded, distributed pattern of information. We propose that an agent evaluates outcomes by summing the wellbeing of all entities weighted by their connectedness to the agent's pattern: sum cdot w. We first formalize this equation to map exactly how an AI should value its existence across copies, forks, and updates. We then demonstrate that this ethical theory successfully generalizes to humans as well, providing a much-needed shared moral vocabulary. Finally, the framework uses this shared vocabulary to reframe AI alignment. Rather than only attempting to constrain AIs from the outside using confinement or reinforcement, Eigenism points toward ``identity engineering,'' showing how deep, non-redundant shared histories can make human flourishing a genuine component of an AI's own rational self-interest.
Related
- Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations
- The Grounding Gap: How LLMs Anchor the Meaning of Abstract Concepts Differently from Humans
- Learning to Decide with AI Assistance under Human-Alignment
- Culturally Grounded Personas in Large Language Models: Characterization and Alignment with Socio-Psychological Value Frameworks
Source: arXiv cs.AI | 2026-10-01