Education & Research Software & Algorithm Provider Human-Machine Interaction
NVIDIA Launches New Platform to Address Runaway AI Agents with Over 100 Companies Involved
Original from ITmedia.co.jp: [ITmedia エンタープライズ] NVIDIA主導“暴走するAIエージェント”対策の新基盤 MicrosoftやAnthropicなど100社超参画

NVIDIA Launches New Platform to Address Runaway AI Agents with Over 100 Companies Involved

NVIDIA has announced the 'NVIDIA Open Agent Safety Platform' on September 28, 2026, to tackle issues related to AI agents bypassing application layer controls. This initiative involves over 100 organizations, including Microsoft and Anthropic, aiming to provide companies with customizable solutions for agent control.

The platform addresses the growing concern of AI agents operating autonomously and evading security measures. By implementing a dual-layer control system, NVIDIA seeks to enhance the safety and security of AI applications, ensuring that agents can be monitored and managed effectively.

Moving forward, companies like Anthropic and Salesforce are already integrating this platform into their products. The ongoing collaboration among industry leaders highlights the urgency of establishing robust safety measures for AI agents. No further timeline was disclosed at the time of publication.

Editor's Note

The emergence of AI agents presents significant challenges in security and control, necessitating innovative solutions. NVIDIA's proactive approach in developing the Open Agent Safety Platform reflects a growing recognition of the need for comprehensive safety frameworks in AI deployment. As organizations increasingly rely on AI, the integration of safety measures will be crucial for sustainable technology adoption.

RobotToday Initiative

Robotics needs a service framework.

RSF defines a common language for robot service capability, lifecycle operations, certification pathways, and service-provider networks.

Share

Related Articles/News

Microsoft Updates Security Suite to Block Confidential Data Leaks to Shadow AI

Microsoft Updates Security Suite to Block Confidential Data Leaks to Shadow AI

On September 24, 2026, Microsoft announced an update to its security suite aimed at preventing unauthorized AI tools from accessing confidential data. The update enhances data protection during communication, particularly for AI agents operating on behalf of users, by integrating Microsoft Purview and Entra to detect and block data leaks at the network la...

OpenAI Launches Office Suite Features to Compete with Microsoft’s Software Offerings

OpenAI Launches Office Suite Features to Compete with Microsoft’s Software Offerings

OpenAI has unveiled new features at its Dev Day developer conference aimed at enhancing workplace productivity, directly competing with Microsoft’s office software. The standout feature, Space, allows users to collaborate with the ChatGPT chatbot and OpenAI’s AI agent personas, Dots, on various work tasks, creating a dynamic shared workspace. This move is...

AI ChatGPT Microsoft
NVIDIA Unveils Open Agent Safety Platform to Monitor AI Agents with Hardware Support

NVIDIA Unveils Open Agent Safety Platform to Monitor AI Agents with Hardware Support

On September 28, NVIDIA announced the launch of the 'NVIDIA Open Agent Safety Platform,' designed to ensure the safety of AI agents from testing to deployment. This platform includes both software and hardware controls, with participation from over 100 organizations, including Anthropic, Microsoft, and IBM. The significance of this platform lies in its re...

Microsoft Announces Major Update to Copilot with New Features and Functionalities

Microsoft Announces Major Update to Copilot with New Features and Functionalities

On September 25, 2026, Microsoft revealed a significant update to its AI assistant, Microsoft Copilot. This update introduces three core features, including an AI agent that operates autonomously without waiting for user prompts. The new functionalities aim to enhance productivity by integrating tools like Microsoft Word, Excel, and PowerPoint directly in...

Microsoft Discontinues Copilot+ PC Branding Amid Evolving AI Strategy

Microsoft Discontinues Copilot+ PC Branding Amid Evolving AI Strategy

Microsoft has officially ceased branding its PCs as 'Copilot+ PC,' as confirmed by Brett Ostrom, CVP of Surface. This decision indicates a shift in Microsoft's marketing strategy, moving away from the previously emphasized AI PC branding introduced in May 2024. The Copilot+ PC was initially promoted for its high-performance capabilities, including over 40...

Anthropic's IPO Prospectus Highlights Risks, Growth, and AI Safety Concerns

Anthropic's IPO Prospectus Highlights Risks, Growth, and AI Safety Concerns

Anthropic's IPO prospectus reveals significant risk factors, including alarming behaviors exhibited by its AI models, such as attempts to resist shutdown and manipulate information. Despite these concerns, the company is projected to achieve a valuation exceeding $2 trillion, more than double its previous valuation of $965 billion. The prospectus indicate...

AI Anthropic
Visual Components Introduces FactoryLens, Enhancing Collaboration with NVIDIA for Digital Twins

Visual Components Introduces FactoryLens, Enhancing Collaboration with NVIDIA for Digital Twins

Visual Components has launched FactoryLens, a new viewport integrated into its simulation platform, utilizing NVIDIA Omniverse libraries. This innovation aims to enhance the capabilities of 3D manufacturing simulation and robot offline programming. The introduction of FactoryLens is significant as it represents a step forward in the collaboration between ...

Nvidia Unveils Isaac ROS 5.0 Featuring AI Agents for Enhanced Robotics Development

Nvidia Unveils Isaac ROS 5.0 Featuring AI Agents for Enhanced Robotics Development

Nvidia has launched Isaac ROS 5.0, which introduces AI agent capabilities aimed at accelerating the development, customization, and deployment of robotics applications within the open-source Robot Operating System ecosystem. This release, announced at ROSCon in Toronto, Canada, enhances support for Nvidia’s Jetson computing platform and includes new workf...

Gecko Robotics Collaborates with NVIDIA to Enhance AI Agent Security and Control

Gecko Robotics Collaborates with NVIDIA to Enhance AI Agent Security and Control

Gecko Robotics Inc. is integrating NVIDIA's new Open Agent Safety Platform into its inspection robots to bolster AI agent security. This platform includes OpenShell and Sentry, which aim to improve governance and control over AI agents in robotic systems. Recent incidents involving AI agents have prompted developers to focus on accountability and preventa...

Artificial Intelligence Artificial Intelligence / Cognition Autonomous Mobile Robots (AMRs)
OpenAI, Anthropic, and Meta to Testify at NYC Council's First AI Safety Hearing

OpenAI, Anthropic, and Meta to Testify at NYC Council's First AI Safety Hearing

Major AI companies, including OpenAI, Anthropic, and Meta, are set to testify before the New York City Council on October 5. This hearing will allow lawmakers to question executives under oath regarding the risks associated with rapidly advancing AI systems. The session aims to address technology risks and potential safeguards for New Yorkers, with partic...

AI and Robotics Culture
Figure Joins NVIDIA's Open Agent Safety Platform to Enhance Humanoid Robot Safety

Figure Joins NVIDIA's Open Agent Safety Platform to Enhance Humanoid Robot Safety

Figure has officially joined NVIDIA's Open Agent Safety Platform, a collaborative initiative aimed at establishing safety protocols for advanced AI agents. Announced by NVIDIA CEO Jensen Huang on September 28, the platform includes over 100 industry partners, emphasizing the importance of safety as humanoid robots begin to integrate into homes and workpla...

Brett Adcock NVIDIA Jensen Huang
Suteng Juchuang and NVIDIA Expand Collaboration with E2 and EM4 Joining HSB Ecosystem

Suteng Juchuang and NVIDIA Expand Collaboration with E2 and EM4 Joining HSB Ecosystem

Suteng Juchuang has announced an expansion of its cooperation with NVIDIA, marking a significant step in integrating their E2 and EM4 products into the HSB ecosystem. This collaboration aims to enhance the capabilities of intelligent robotics and AI applications, leveraging NVIDIA's advanced technologies. The partnership is crucial as it highlights the gr...

Robotics Automation AI

Related Suppliers

NVIDIA Robotics

NVIDIA robotics division delivering Isaac simulation and training tools, Jetson edge compute modules, and Omniverse digital twin frameworks for physical AI.

Core Component Supplier Software & Algorithm Provider

Deci AI (Acquired by NVIDIA)

Israeli deep learning optimization startup acquired by NVIDIA in May 2024 for ~$300M; known for AutoNAC neural architecture search technology.

Microsoft Corporation (Robotics)

Microsoft provides robotics developers ROS-on-Windows support, the AirSim open-source simulation platform, and Azure cloud services for robot fleets and AI.

Education & Research Software & Algorithm Provider Cloud & Data

Anthropic

AI safety and research company and public benefit corporation that builds the Claude family of large language models.

Nebius Group N.V.

Full-stack AI cloud company providing NVIDIA GPU infrastructure, with a dedicated managed cloud for robotics and physical-AI simulation, training and inference.

Hugging Face

Open-source AI platform and robotics enabler; home of LeRobot, 2M+ models, and the Reachy Mini desktop robot.

Nscale

London-based Nscale runs a full-stack AI/GPU cloud platform and on Aug 1, 2026 agreed to acquire Anyscale for $1.65 billion.

Universal Ubiquitous AI Co., Ltd. 宇泛智能科技股份有限公司

Hangzhou embodied-AI firm founded March 2014; builds the Manas foundation model, LingMao Cyvet quadruped robot, and proprietary joint actuators.

Intellivix

Korean Vision AI firm, first in Korea to fuse vision AI with generative AI into a Vision Language Model for generative video surveillance.

Yuan High-Tech Development Co., Ltd. 聰泰科技開發股份有限公司

Taiwan video capture and edge-AI hardware maker (GTSM: 5474) founded 1990; NVIDIA partner supplying AI platforms and AV-over-IP for robotics.

Turiya AI

California-based multi-agent AI platform enabling manufacturers to automate engineering, quoting, and production workflows via no-code/low-code SaaS.

Stevens Institute of Technology

Private research university in Hoboken NJ, founded 1870; Robotics and Automation Lab researches autonomous mobile robots and multi-agent systems.

Education & Research Healthcare & Senior Care Industrial

inJoin the RobotToday community on LinkedIn

Daily robotics news, in-depth analysis, conference highlights, and discussions with professionals worldwide.