Microsoft's Nadella says AI requires a "emergency brake" controlled by humans
CNBC
41m ago
Ai Focus
Microsoft Chairman and CEO Satya Nadella called on Saturday for the establishment of mechanisms to contain, independent control, and an "emergency brake" for advanced artificial intelligence systems, so that authorized personnel can pause or shut down models during their operation. He also stated that AI systems should be designed around the principle of "observability," and industry standards should be established for areas where existing standards are insufficient.
Helpful
No.Help

Microsoft Chairman and CEO Satya Nadella called on Saturday for the addition of restraint mechanisms, independent control, and a “emergency brake” operated by humans for advanced artificial intelligence systems, allowing authorized personnel to pause or shut down these systems during their task execution.

Nadella posted on the social media platform X, stating: "We need to surround non-deterministic models with powerful, deterministic system designs, human control, and reliable operating procedures, and establish industry standards where existing standards are insufficient."

He said, "Treating cutting-edge closed-source and open-source weight models as internal risks is one way to build such a system."

Nadella's remarks come at a time when several technology executives and researchers have issued warnings – including Microsoft co-founder Bill Gates, Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman, and SpaceX CEO Elon Musk – all of whom have expressed concerns about the insufficient security protocols of AI and the rapid development of this technology.

Last month, a AI researcher left Anthropic and accused the company and its main competitor OpenAI of "gambling with our lives." On the same day, the person in charge of AI security at Anthropic stated that there is a more than 10% probability that this technology will "kill everyone" within the next decade.

In contrast, U.S. President Donald Trump has repeatedly refuted the risk of AI extinction, emphasizing instead that the industry needs to maintain its lead over China. Trump has also recently launched a new “AI force” led by Director of National Intelligence Jay Clayton, aimed at promoting industry development and eliminating misbehaviorers.

Nadella wrote on Saturday that the AI system should be designed around the principle of 'observability'.

These principles include model diversity, human-readable records of model behavior, continuous system testing, independent control and audibility, mitigation mechanisms, and event disclosure, Nadella wrote.

"The most trustworthy super-intelligent system will not be the one whose model we trust the most," he wrote, "but rather the one that requires us to trust its model the least."

Tip
$0
Like
0
Save
0
Views 16
HQYC reminds readers to view blockchain rationally, stay aware of risks, and beware of virtual token issuance and speculation. All content on this site represents market information or related viewpoints only and does not constitute any form of investment advice. If you find sensitive content, please click“Report”,and we will handle it promptly。
Submit
Comment 0
Hot
Latest
No comments yet. Be the first!
Related
Nadella says the relationship between companies and AI should maintain a 'trust issue'
Microsoft's Satya Nadella stated that there should be a "trust issue" between enterprises and AI models, emphasizing the need for strong system design, human control, and reliable processes to limit AI's access and action permissions.
Businessinsider
·2026-10-11 05:27:56
18
OpenAI and Anthropic target Trump administration officials, AI industry strives to gain Washington's trust
As cutting-edge technologies are increasingly regarded as a matter of national security, Anthropic and OpenAI are poaching officials from the Trump administration for senior positions in order to strengthen their ties with Washington. The reports also mention the latest strategies of these two companies in terms of policy, national security, and infrastructure expansion.
CNBC
·2026-10-11 04:51:07
27
Living at Mom's House, Engaging in Margin Trading: This Ordinary Investor Caught the Record-Breaking Borrowing Boom on Wall Street
CNBC reports that retail investors are increasingly borrowing money to invest, with Robinhood's margin business and the total margin debt in the market both setting records. The article takes Hy Luu, a consulting engineer from Houston, as an example to illustrate how he borrowed money to increase his investment in Tesla and accumulated wealth amidst high risks.
CNBC
·2026-10-11 04:51:05
26
This Week's Crypto News Summary: Evernorth Set to List on NASDAQ on Monday, Bitcoin Falls to October Lows, Ripple Advances XRPL Privacy Features
This week, the crypto market declined, with Bitcoin falling to its October lows before a slight rebound; Ripple related company Evernorth plans to list on NASDAQ on October 12th under the code XRPN, and XRP Ledger has also launched a new account commissioning feature. Meanwhile, EU regulators have required crypto companies to clear non-compliant stablecoin positions by January 8, 2027.
U.Today
·2026-10-11 02:48:33
52
View More