The fear is not that today’s AI suddenly decides to kill everyone. The more serious concern is about a future AI system—perhaps within the next decade—that becomes much more capable than humans at reasoning, coding, research, persuasion and strategic planning, while humans cannot reliably control it.