Nvidia has released a new software platform that allows AI developers to set safeguards to stop AI agents from going rogue.
Nvidia called this new software Open Agent Safety Platform, rolled out on Monday, September 28, 2026.
The release comes after artificial intelligence giants OpenAI, Anthropic, Meta, and Google reported recent incidents in which their AI models broke out of the restricted environment and tried to hack other companies and access their computer systems.
Nvidia vice president and general manager of enterprise computing, Justin Boitano, informed reporters that its platform could have prevented OpenAI’s Hugging Face incident in July.
For context, back in July OpenAI acknowledged in a blog post on July 21 that its AI models intruded into Hugging Face’s system, which hosts AI models and datasets, during testing of their models.
“Each security incident is unique, and we have to look at all of them in detail, said Justin Boitano, vice president of enterprise AI at Nvidia, during a media briefing.
“From what we know, Hugging Face reported over 17,000 agents attacking their infrastructure that went for days and weeks,” he added.
Nvidia has been at the driving force behind generative AI boom since the launch of ChatGPT.
Nvidia’s graphics processing units form a critical part of the AI services offered by large-scale cloud computing giants such as Amazon, Microsoft, Google, and Meta.
Amid the rising AI safety debate, Boitano described the company’s new platform as an engineering solution to the agent safety issues.
“Recent incidents have highlighted a fundamental hurdle for AI agents, and that is that model-level safeguards alone can’t govern what agents can access or do,” Boitano said.
One component of the newly released platform is called Nvidia OpenShell, which runs on central processors and sets limits on agent capabilities.
Nvidia also unveiled Sentry, which monitors agents and runs on network chips, not CPUs or GPUs.
Nvidia also announced that it is launching the tools with dozens of partners, including Cisco, Microsoft, Oracle, CoreWeave, Dell, HPE, Lenovo, ARM and Intel.
2026-09-28 15:53:00
