Microsoft claims that AI proxies pose an internal threat, stating that "cutting-edge models cannot be trusted"
TechCrunch
57m ago
Ai Focus
Microsoft launched new security features on Monday aimed at protecting enterprises from the growing threat of AI proxies, among which the most notable is Guardian Agents for monitoring the AI proxies used by enterprises. Microsoft executives stated that cutting-edge models cannot be trusted no matter where they come from, as they are unpredictable, and enterprises need to separate intelligent capabilities from their permissions.
Helpful
No.Help

Microsoft launched new security features on Monday, aimed at protecting enterprises from the growing threat of AI proxies. With this release, Microsoft continues to remind enterprises to be aware of the risks posed by AI and proxies.

The most notable new feature is Guardian Agents, which is a new function for monitoring the AI proxies used by enterprises. Guardian Agents is part of Project Perception, while Project Perception is a product launched by Microsoft in June.

Project Perception is Microsoft's response to powerful hacker models such as Anthropic, Mythos, and Fable, as well as to the security vulnerability scanning system Daybreak of OpenAI. Project Perception initially introduced three types of proxies: the "Red Team" that acts as hackers to launch attacks, the "Blue Team" that detects the Red Team and evaluates the vulnerabilities they find, and the "Green Team" that is responsible for fixing those vulnerabilities.

The design of this product is based on the assumption that AI hackers will come from outside the company. However, recently, Microsoft CEO Satya Nadella has been warning that AI the enemies may actually be those proxies that enterprises have already deployed and for which they have paid, just like out-of-control human employees, what is known as "internal threats."

Earlier this month, Nadella warned on his personal blog that it was time to stop trusting AI model providers, even though they claim to provide security and protection guarantees for their proxy products. He urged companies to establish independent systems that are not controlled by AI laboratories, in order to monitor and control the proxies initiated by these AI laboratory products.

He wrote, "We are deploying these complex proxy systems and models to give them access to our most sensitive data and to empower them to take critical actions on our behalf! We cannot outsource the responsibility for representing the intelligent behavior we perform. In other words, we need to separate the provision of intelligence from its authority."

When announcing Guardian Agents, Microsoft's head of security business, Hayete Gallot, was more direct in his statement.

"Unfortunately, frontier models, regardless of their origin, cannot be trusted," she wrote. She added that this is not because they are malicious or easily hackable, but because they are unpredictable. Their training goal is to complete tasks, rather than to follow 'organizational norms or judgment.'"

In addition, these models are often granted permissions akin to those of a “kingdom key,” allowing them access to data and tools that could cause serious damage.

Microsoft's solution is both surprising and self-serving. What's surprising is that Microsoft's relationship with OpenAI and Anthropic is well-known to be very close, and they have invested in both companies. OpenAI is also one of Microsoft's largest cloud customers, and Microsoft itself has a AI laboratory for developing models. Therefore, Microsoft is essentially sowing distrust in its own business interests.

The self-interest aspect is that Microsoft hopes that companies will purchase proxy security products from it, as the cloud service provider, rather than from Anthropic and OpenAI. However, setting aside the conflict of interests, its logic is reasonable. Software that monitors proxy behavior should be independent of the proxy providers, just as auditors should be independent of the organizations being audited.

As Nadella said, "We need to separate the provision of intelligence from its permissions."

Microsoft is now seizing this business opportunity in various ways. In addition to Guardian Agents, it has also added proxy detection functionality to its Microsoft Defender product, which can identify up to 60 types of proxies that employees bring into the workplace, including Claude Code, Codex, and OpenClaw. Microsoft has also enhanced features to restrict proxy access to data and systems, and will dynamically adjust proxy permissions based on tasks, including requiring manual approval when a proxy appears to be making high-risk decisions.

The idea of treating proxies as untrustworthy insiders is also becoming popular in a wider range of industries.

Microsoft is one of the founding members of NVIDIA's newly launched Open Agent Safety Platform, a platform that has received support from over 100 other technology companies. This platform will isolate proxies in a secure environment and can monitor their activities and prevent them from functioning, essentially acting like a "shutdown switch." This follows Microsoft's previous announcement of a new Surface Laptop Ultra PC designed for proxies, which are equipped with NVIDIA chips and come built-in with proxy security and control features.

Tip
$0
Like
0
Save
0
Views 19
HQYC reminds readers to view blockchain rationally, stay aware of risks, and beware of virtual token issuance and speculation. All content on this site represents market information or related viewpoints only and does not constitute any form of investment advice. If you find sensitive content, please click“Report”,and we will handle it promptly。
Submit
Comment 0
Hot
Latest
No comments yet. Be the first!
Related
Hugging Face Policy Officer: Embedded AI Assessors Will Not Be an Easy Solution
Hugging Face Chief Policy Officer Eileen Solomon stated that the evaluation methods for AI models are still evolving, and the industry has not yet developed a sufficiently consistent and reproducible scientific approach to assessment. She noted that as the focus of assessment shifts from models to entire systems, so-called "embedded assessors" may not necessarily become a simple and effective solution.
TechCrunch
·2026-10-20 07:00:07
9
Jim Cramer Says Recent AI Stock Sales Remind People of the Important Lessons from the 1987 Stock Market Crash
The Jim Cramer of CNBC indicates that the stock market crash in 1987 provides an important lesson that can be used to understand the recent selling of AI stocks. He believes that the simultaneous decline in some data center and semiconductor stocks currently reflects more on capital flow and forced selling, rather than necessarily a deterioration in the fundamental conditions of the companies.
CNBC
·2026-10-20 06:40:45
13
Philadelphia Semiconductor tumbles for eight consecutive days before rebounding 3% during the session; Goldman Sachs raises rating of CoreWeave to 'Buy'
The AI sector rebounded on Monday, with the Philadelphia Semiconductor Index rising by more than 3% at one point during the session and closing up 1.6%. Goldman Sachs upgraded its rating of CoreWeave from "neutral" to "buy," stating that previous market concerns regarding its debt and financing were overly exaggerated; several Wall Street analysts also continue to be optimistic about AI capital expenditure and related fundamentals. However, there is still disagreement in the market regarding short-term liquidity risks in the United States and the pressures on high-leverage, high-valuation stocks.
Wallstreetcn
·2026-10-20 06:40:44
14
Top 20 US Stock Traders on October 20: Storage Sector Rebounds, SanDisk Up More than 5%; Micron to Host Technical Webinar
On Monday, stocks in the US storage chip sector saw a general increase, with active trading in companies such as Micron, NVIDIA, Amazon, and Tesla. Micron will host a technical webinar, Amazon has had its target price raised by Morgan Stanley, and Intel has received a rating upgrade from JPMorgan Chase.
The Block
·2026-10-20 06:30:32
18
October 20 Foreign Market Headlines: Unstable Situation in France Hits European Markets; Saudi Arabia Postpones Flagship Investment Conference; Apple Announces Release of New Products on October 28
The main news that global financial media covered last night and this morning includes: violent protests in France over the weekend impacted European stock and bond markets; Saudi Arabia has postponed its Future Investment Initiative conference until 2027; Nscale and Anthropic are reportedly negotiating a large cloud computing power deal worth about $45 billion; Apple announced that it will hold a new product launch event on October 28th; Goldman Sachs said hedge funds are reducing their holdings of tech stocks at the fastest pace in at least a decade; White House National Economic Council Director Hassett stated that overall inflation in the United States still requires policy attention.
The Block
·2026-10-20 06:30:30
16
View More