Disputes, Employee Misconduct Rattle Centerview’s Silicon Valley DreamsRead more

Sam Altman. Photo by Bloomberg.

Why AI Scientists Are Freaking Us Out

Photo: Sam Altman. Photo by Bloomberg.

Well that’s one way to get attention. According to a statement issued today by a bunch of leading names in AI, “mitigating the risk of extinction from AI should be a global priority.” Right. It’s hard to imagine anyone out there disagrees—who but the most extreme misanthrope wants to extinguish the human race? The question, then, is why the very people responsible for AI’s development are suggesting it should be a priority to stop the new technology from killing off every human. Aren’t they the best people to ensure that doesn’t happen?

Yes and no. AI scientists want governments’ help, including via an “ambitious global coordination,” according to Dan Hendrycks, the director of the Center for AI Safety, which was responsible for the statement’s publication. Otherwise there’s a danger of “unchecked competitive pressures” leading to “bad outcomes,” he told me. That makes sense. But let’s face it: Given the difficulty that climate activists have had in getting nations globally to respond to the threat of global warming, and the current chilling of relations between the U.S., China and Russia, it will take more than this statement to bring about a globally coordinated regulatory response to AI.

Access on the go
View stories on our mobile app and tune into our weekly podcast.
Join live video Q&A’s
Deep-dive into topics like startups and autonomous vehicles with our top reporters and other executives.
Enjoy a clutter-free experience
Read without any banner ads.
Former Apple design chief Jony Ive and OpenAI CEO Sam Altman. Photos by Getty.
Designer Jony Ive and OpenAI’s Sam Altman Discuss AI Hardware Project
Jony Ive, the renowned designer of the iPhone, and OpenAI CEO Sam Altman have been discussing building a new AI hardware device, according to two people familiar with the conversations.
From left to right: Blair Effron, Robert Pruzan and David Handler. Photos by Getty; Tidal Partners.
Exclusive Finance
Disputes, Employee Misconduct Rattle Centerview’s Silicon Valley Dreams
The San Francisco Bay Area–based bankers at Centerview Partners, the investment bank that advised Silicon Valley Bank’s owner and Credit Suisse through recent turmoil, got two doses of bad news last week.
Art by Clark Miller
Exclusive startups entertainment
MasterClass Takes a Crash Course in Frugality
MasterClass had a problem with the shoot featuring its latest star instructor, Walt Disney Co. CEO Bob Iger.
OpenAI CEO Sam Altman and Microsoft CEO Satya Nadella. Photos via Getty
Exclusive microsoft ai
How Microsoft is Trying to Lessen Its Addiction to OpenAI as AI Costs Soar
Microsoft’s push to put artificial intelligence into its software has hinged almost entirely on OpenAI , the startup Microsoft funded in exchange for the right to use its cutting-edge technology.
Art by Clark Miller
The Big Read policy
Europe Has Figured Out How to Tame Big Tech. Can the U.S. Learn Its Tricks?
Late last month in Belgium, Sen. Elizabeth Warren (D-Mass.) had a pressing question for Paul Tang, a Dutch politician and member of the European Parliament.
If AI researchers can meet Nat Friedman's Vesuvius Challenge, “It’ll be the first time we’ve read handwriting that hasn’t been seen in 2,000 years.” Art by Clark Miller
The AI Age culture ai
Nat Versus the Volcano: Can an AI Investor Solve an Ancient Mystery from the Ashes of Vesuvius?
Long before men’s daily thoughts about ancient Rome became a TikTok meme , former GitHub CEO Nat Friedman’s mind was regularly turning toward the Roman Empire.