TechCrunch News 01月17日
Nvidia releases more tools and guardrails to nudge enterprises to adopt AI agents
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

英伟达发布三款新的NIM微服务,旨在帮助企业提升AI代理的控制和安全性。这些微服务包括内容安全、对话主题控制和防止越狱尝试。它们是Nvidia NeMo Guardrails的一部分,旨在弥补通用策略的不足,为复杂的AI工作流程提供更精细的保护。此举反映出AI公司意识到企业在采用AI技术时对安全性的重视。尽管市场对AI代理的兴趣日益增长,但实际采用速度可能不如预期。英伟达希望通过此类举措,提高企业对AI代理的信任度,促进其更广泛的应用。

🛡️ 内容安全微服务:防止AI代理生成有害或带有偏见的内容,确保输出信息的安全性和公正性。

💬 对话主题控制微服务:限制AI代理的对话范围,使其仅围绕预先批准的主题进行,避免跑题或讨论不相关的内容。

🔒 防止越狱微服务:阻止AI代理绕过软件限制,防止其被恶意利用或执行未经授权的操作,增强系统的安全性。

🧩 这些微服务是Nvidia NeMo Guardrails的一部分,通过应用多个轻量级、专业化的模型作为安全措施,弥补通用策略的不足,为复杂的AI工作流程提供更精细的保护。

Nvidia is releasing three new NIM microservices, or small independent services that are part of larger applications, to help enterprises bring additional control and safety measures to their AI agents.

One of these new NIM services targets content safety and works to prevent an AI agent from generating harmful or biased outputs. Another works to keep conversations focused on approved topics only, while the third new service helps prevent an AI agent from jailbreak attempts, or removing software restrictions.

These three new NIM microservices are part of Nvidia NeMo Guardrails, Nvidia’s existing open source collection of software tools and microservices meant to help companies improve their AI applications.

“By applying multiple lightweight, specialized models as guardrails, developers can cover gaps that may occur when only more general global policies and protections exist — as a one-size-fits-all approach doesn’t properly secure and control complex agentic AI workflows,” the press release said.

It seems that AI companies may be starting to catch on that getting enterprises to adopt their AI agent technology is not going to be as simple as they initially thought. While folks like Salesforce CEO Marc Benioff recently predicted there will be more than a billion agents running off of Salesforce alone in the next 12 months, reality will probably look a little different.

A recent study from Deloitte predicted that about 25% of enterprises are either already using AI agents or expect to in 2025. The report also predicted that by 2027 about half of enterprises will be using agents. This shows that while enterprises are clearly interested in AI agents, they are not adopting AI tech at the same cadence as innovation is happening in the AI space.

Nvidia likely hopes initiatives like this will make adopting AI agents seem more secure, and less experimental. Time will tell if that’s actually true.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

NIM微服务 AI安全 NeMo Guardrails AI代理 企业应用
相关文章