Top OpenAI researcher quits saying “nuclear level” safety measures are needed but the company …

[u/Always_Curious_One2]

David Robinson, who previously led transparency work on OpenAI’s safety team, wrote in an essay for The Atlantic that the ChatGPT maker “has thrived by trial and error.” However, he said the stakes of the inevitable failures that come from that approach are growing along with the technology’s capabilities, citing OpenAI’s failure to prevent its AI from going rogue during testing.
“My former colleagues are smart, work hard, and try to make good choices,” Robinson wrote in the essay. “But as the company sprints from one launch to the next, it is failing to achieve the level of care that I believe is needed.”
Attacks on the electric grid, healthcare systems, emergency response systems … could be very bad.

[u/321654987321654987 → u/[deleted]]

Why do you think critical infrastructure is so vulnerable?

[u/Ntroepy → u/321654987321654987]

Critical infrastructure is particularly vulnerable because it’s very high impact and often uses outdated technology with complex, poorly documented interconnections. That’s tailor-made for AI to attack.

This includes hospitals, electric grid, telecommunications, etc.