Safety
Amulet: a Python Library for Assessing Interactions Among ML Defenses and Risks
arXiv:2509.12386v3 Announce Type: replace-cross Abstract: Machine learning (ML) models are susceptible to various risks to security, privacy, and fairness. Most defenses are designed to protect agains
arXiv:2509.12386v3 Announce Type: replace-cross Abstract: Machine learning (ML) models are susceptible to various risks to security, privacy, and fairness. Most defenses are designed to protect against each risk individually (intended interactions) but can inadvertently affect susceptibility to other unrelated risks (unintended interactions). We introduce Amulet, the first Python library for evaluating both intended and unintended interactions among ML defenses and risks. Amulet is comprehensive by including representative attacks, defenses, and metrics; extensible to new modules due to its modular design; consistent with a user-friendly API template for inputs and outputs; and applicable for evaluating novel interactions. By satisfying all four properties, Amulet offers a unified foundation for studying how defenses interact, enabling the first systematic evaluation of unintended interactions across multiple risks.
Related
- VirnyFlow: Optimizing ML Pipelines for Accuracy, Fairness, and Stability at Scale
- FairHealth: An Open-Source Python Library for Trustworthy Healthcare AI in Low-Resource Settings
- Learning to Unlearn: Machine Unlearning via Learning the Unlearning Behaviors
- An empirical evaluation of the risks of AI model updates using clinical data: stability, arbitrariness, and fairness
Source: arXiv cs.AI | 2026-09-12