Safety
RED ALERT, and I have never said that before: Hard agree with @sjgadler and @_NathanCalvin - what OpenAI is reportedly playing with is bad, …
RED ALERT, and I have never said that before: Hard agree with @sjgadler and @_NathanCalvin - what OpenAI is reportedly playing with is bad, redline crossing bad. Chain of thought monitorability is lim
RED ALERT, and I have never said that before: Hard agree with @sjgadler and @_NathanCalvin - what OpenAI is reportedly playing with is bad, redline crossing bad. Chain of thought monitorability is limited and not fully reliable but it’s practically the only thread we have here to prevent seriously bad outcomes. Burning that slender thread for a (small?) performance gain is begging for disaster. If this is true, OpenAI seems to be violating one of the few redlines that exist in the AI industry. Absolutely do not train your models like this - what is going on??
Related
- URGENT: In light of the breaking news from @theinformation about OpenAI’s new techniques that reduce Chain of Thought monitorability, I urge…
- Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-th…
- Confirming what we already knew: The OpenAI Hugging Face incident would have been prevented had OpenAI been monitoring the agents in any mea…
Source: Gary Marcus (X) | 2026-09-02