NOTE182

The theory that AI poses an existential threat is beginning to spread worldwide. The case of the Anthropic researcher who resigned out of concern for the dangers AI might bring to humanity is still fresh in our memories; indeed, Anthropic itself is now advocating for a slowdown in the pace of AI development, effectively championing the “AI threat” narrative. Moreover, support for this perspective is currently growing, particularly within the AI industry.
On the other hand, there are camps—such as that of President Trump—that dismiss the AI threat theory as a hoax. A fierce race for AI supremacy is currently underway, primarily between the U.S. and China; for the U.S. government, which cannot afford to lose to China, any deceleration in development could prove fatal. China, too, shows no signs of agreeing to slow down its development pace. There is a suspicion in China that the U.S.—seeking to monopolize cutting-edge technology—is proposing a slowdown in AI development merely as a tactic to keep China in check.
The nature of the AI threat is detailed in books such as *If We Create Superintelligent AI, Humanity Will Go Extinct* (Hayakawa Shobo) by Eliezer Yudkowsky and others. Yudkowsky is considered an intellectual pillar of the AI industry—a charismatic figure with immense influence. One cannot discuss the spread of the threat narrative, especially within the AI industry, without acknowledging his role.
I take the AI threat theory seriously; I do not dismiss it as nonsense. If AI is utilized in a constructive manner, humanity stands to make great strides. However, if AI is employed as a weapon to defeat an enemy, humanity moves closer to extinction. If a nation were to covertly order an AI to “destroy democracy,” democratic states would not emerge unscathed. Conversely, an order to “eliminate anti-democratic states” would likely inflict devastating damage upon those nations.
The current race for AI development appears to be driven by hostility. If we use AI not as a tool for the advancement of humanity but as a weapon to crush an opponent, it will become nothing more than a threat on the scale of the atomic bomb.
If we continue charging down our current path, that is exactly what will happen. That prospect terrifies me. (Kei Kitajima)
※Translating Japanese articles into English with AI
