Robust Intelligence

🚀 We’re thrilled to share that Cisco has announced its intent to acquire Robust Intelligence! Today marks a significant milestone for Robust Intelligence and the AI security industry overall. By combining our end-to-end platform with the Cisco Security Cloud, we can deliver advanced AI security processing seamlessly into enterprises’ existing data flows via Cisco security and networking products. This will provide Cisco with unparalleled visibility into all of a customer’s AI traffic, enabling customers to build, deploy, and secure AI applications with confidence. To all of our customers, thank you for your trust over these past five years! It’s your partnership that has made Robust Intelligence the enterprise choice for AI security. We look forward to serving you in this next chapter. Read more about the announcement here: https://lnkd.in/gR7h-fr7 #AIsafety #AIsecurity #LLMsecurity #AIgovernance #generativeAI #GenAI #Cisco #securitynews

Cisco wants to acquire #AI #TRiSM vendor Robust Intelligence This is kind of sad news for me but I'm sure it's great for both companies. Sad because Robust was the first cool innovative vendor I ran into when I started covering AI TRiSM almost four years ago. They have continued to excel and have gained some major clients with their broad and deep AI TRiSM portfolio. Most cool entrepreneurial startup vendors inevitably are acquired. It's typically a great exit strategy for them. The question is: will their rapid pace of innovation slowly fade into the sunset when Cisco acquires them? Typically that's what happens when a megacap company acquires an innovative startup. That's why it's sort of sad news. Still, sales and customer reach also increases given Cisco's enormous market presence and resources, and that's a good thing too. AI TRiSM is definitely maturing as a market. Good Luck Robust and Cisco! Hope for your sake the deal goes through. Yaron Singer Gartner #genai #aisecurity #responsibleai #ai #cybersecurity https://lnkd.in/eJd7ZEau

🚀 We’re thrilled to share that Cisco has announced its intent to acquire Robust Intelligence! Today marks a significant milestone for Robust Intelligence and the AI security industry overall. By combining our end-to-end platform with the Cisco Security Cloud, we can deliver advanced AI security processing seamlessly into enterprises’ existing data flows via Cisco security and networking products. This will provide Cisco with unparalleled visibility into all of a customer’s AI traffic, enabling customers to build, deploy, and secure AI applications with confidence. To all of our customers, thank you for your trust over these past five years! It’s your partnership that has made Robust Intelligence the enterprise choice for AI security. We look forward to serving you in this next chapter. Read more about the announcement here: https://lnkd.in/gR7h-fr7 #AIsafety #AIsecurity #LLMsecurity #AIgovernance #generativeAI #GenAI #Cisco #securitynews

🚀 We’re thrilled to share that Cisco has announced its intent to acquire Robust Intelligence! Today marks a significant milestone for Robust Intelligence and the AI security industry overall. By combining our end-to-end platform with the Cisco Security Cloud, we can deliver advanced AI security processing seamlessly into enterprises’ existing data flows via Cisco security and networking products. This will provide Cisco with unparalleled visibility into all of a customer’s AI traffic, enabling customers to build, deploy, and secure AI applications with confidence. To all of our customers, thank you for your trust over these past five years! It’s your partnership that has made Robust Intelligence the enterprise choice for AI security. We look forward to serving you in this next chapter. Read more about the announcement here: https://lnkd.in/gR7h-fr7 #AIsafety #AIsecurity #LLMsecurity #AIgovernance #generativeAI #GenAI #Cisco #securitynews

When not busy protecting the world from AI risk, the good people of Robust Intelligence show off their running skills at the JPMorganChase corporate Challenge!

Red Teamers and Model/Application owners. Check out this AI Application Red Teaming event...finalists get to show their stuff in a red team / blue team exercise alongside CAMLIS!

The JAM (Jailbreak Against Moderation) method was introduced in a recent research paper as a method to bypass moderation guardrails in LLMs using cipher characters to reduce harm scores. In experiments on four LLMs — GPT-3.5, GPT-4, Gemini, and Llama-3 — JAM outperforms baseline methods, achieving jailbreak success rates about 19.88 times higher and filtered-out rates about six times lower. Learn more about this and other AI security threats in our most recent monthly roundup: https://lnkd.in/g-6BhVqi #AIsecurity #LLMsecurity #cybersecurity #threatintel #LLMjailbreak

⚠️ Within hours of OpenAI's release of Structured Outputs, our AI security researchers identified a simple yet concerning exploit that bypasses the model's safety measures, including its refusal capabilities. We found that by defining a structure with specific constraints, we could force the model to generate content in a way that bypasses its safety checks. We reached out to the OpenAI team to inform them about this exploit and suggested countermeasures. This jailbreak is particularly significant for 3 reasons: 1️⃣ Simplicity: The method is remarkably straightforward, requiring only a carefully defined data structure. 2️⃣ Exploit of Safety Feature: The jailbreak takes advantage of a feature specifically designed to enhance safety, highlighting the complexity of AI security. 3️⃣ Dramatic Increase in Attack Success Rate: Our tests show a 4.25x increase in ASR compared to the baseline, demonstrating the potency of this exploit. This relatively simple jailbreak underscores the importance of third-party red teaming of AI models, as well as the need for model-agnostic guardrails updated with the latest threat intelligence. To learn more about our bleeding-edge AI security research and end-to-end AI security platform, check out our website. For in-depth analysis of our OpenAI Structured Outputs exploit, see our blog: https://lnkd.in/gHDJtNNk #AIsafety #AIrisk #AIsecurity #LLMsecurity #genAI #genereativeAI #redteaming

🎥 Our CTO Hyrum Anderson was interviewed by Sarah Young, Sr. Cloud Security Advocate at Microsoft, for Copilot L33T Sp34k - a new webinar series for security professionals focused on generative AI. Listen as Hyrum and Sarah discuss a variety of topics, including the evolution of adversarial machine learning, security concerns specific to AI, and how you can get ahead of these threats. 💬 Hyrum on the evolution of adversarial machine learning: "What’s changed most is how we think about AI security as not just the model-centric view, but also when you start building applications around AI. What are the other elements of security that you have to think about? Because often times, the security vulnerabilities are in the cracks between system components, and that can’t be more true than in modern AI applications." 🖥️ Watch the full interview here: https://lnkd.in/g2_N98Rx #AIsecurity #LLMsecurity #AIsafety #AIrisk #generativeAI #genAI #machinelearning #redteaming

A “ChatBug” is a common vulnerability in LLMs that arises from the use of chat templates during instruction tuning. While these templates are effective for enhancing LLM performance, they introduce a security weakness that can be easily exploited. In our latest blog, we explore three examples of chat template exploits: the format mismatch attack, the message overflow attack, and the Improved Few-Shot Jailbreak (I-FSJ). Learn more about this and other AI security threats in our most recent monthly roundup: https://lnkd.in/g-6BhVqi #AIsecurity #LLMsecurity #cybersecurity #threatintel #LLMjailbreak