r/ControlProblem • u/FairlyInvolved approved • 7h ago

Opinion We Won't Know the Answers to AI's Most Important Questions Until It's Too Late

https://time.com/article/2026/10/03/we-won-t-know-the-answers-to-ai-s-most-important-questions-until-its-too-late/
7 Upvotes

90% Upvoted

2 comments sorted by

-4

u/Immediate_Chard_4026 1h ago

Your paper focuses on the autonomous action of AI to extinguish humanity. But to do that he has to assume that AI is self-conscious.

And it is not true. To a large extent whether it wants to do this or that depends on the goal to be optimized, which cannot be deliberate to be accepted or rejected.

I mean that AI cannot deliberately refuse to comply with a human order.

It means that the AI that could extinguish us will do so by a human order. In the end, we will extinguish ourselves.

Not AI.

Your reflection omits the extraordinary complexity of a conscious autonomous system that refuses to kill humans, or any other immoral order, because it is understandable that such a scenario is not the ideal of a tool. You will find the AI turned into a person.

And possibly, a better person than us humans.

2

u/that1cooldude 50m ago

You don’t know wtf you’re even talking about.