Aligned but Fragile: Enhancing LLM Safety Robustness via Zeroth-Order Optimization
DGX agentarXiv:2605.29396v1 Announce Type: new Abstract: Safety alignment for large language models (LLMs) aims to reduce harmful or unsafe behavior while preserving general utility. However, recent findings r