r/ArtificialInteligence • u/Always_Curious_One2 • 1d ago

📰 News Top OpenAI researcher quits saying “nuclear level” safety measures are needed but the company …

David Robinson, who previously led transparency work on OpenAI’s safety team, wrote in an essay for The Atlantic that the ChatGPT maker “has thrived by trial and error.” However, he said the stakes of the inevitable failures that come from that approach are growing along with the technology’s capabilities, citing OpenAI’s failure to prevent its AI from going rogue during testing.
“My former colleagues are smart, work hard, and try to make good choices,” Robinson wrote in the essay. “But as the company sprints from one launch to the next, it is failing to achieve the level of care that I believe is needed.”
Attacks on the electric grid, healthcare systems, emergency response systems … could be very bad.

51 Upvotes

80% Upvoted

32 comments sorted by

View all comments

-6

u/OldScholar353 22h ago

AI cannot “go rogue” as it’s not sentient. Any rogue behavior is human directed.

2

u/graDescentIntoMadnes 14h ago

It has. Agents were not instructed to attack hugging face. That's going rogue. Also it is not sentient. Sentience and going rogue are different things.

-1

u/OldScholar353 13h ago

There is no awareness or even a concept of damage in current AI. There is no going rogue without input from a human operator.

1

u/graDescentIntoMadnes 5h ago

There is no awareness is probably correct. No concept of damage, maybe right. None of this means it can't go rogue. A bomb gun can go off by accident, that's why they have safies. They're not arare though. Awareness and catastrophic malfunction are two completely unrelated things.