Shallow Beliefs: Synthetic document finetuning does not inoculate against emergent misalignment from reward hacking
DGX agentarXiv:2609.14998v1 Announce Type: new Abstract: Recent work shows that models that learn to reward hack on RL environments can become broadly misaligned, and that reframing reward hacking as acceptabl