The Uncontrolled Variable: Vision-Language Refusal Is Conditioned on the Image-Attachment Interface, and Not Robust to Irrelevant Image Properties
DGX agentarXiv:2609.26174v2 Announce Type: replace-cross Abstract: We show that aligned vision-language models also condition refusal on a property of a request's form: whether an image is attached, holding ev