Dynamo AI reposted this
We're thrilled to unveil our partnership with Lenovo to deploy DynamoGuard natively on Lenovo Copilot+ PCs! With on-device DynamoGuard guardrails, Lenovo and Dynamo AI now lead the market in offering the most secure and low-latency GenAI solution. Regulated enterprises will be able to access cloud-based LLMs via Lenovo's Copilot+ PCs and leverage DynamoGuard running locally on-device to block sensitive data or noncompliant requests before any data leaves your device. We've also demonstrated that DynamoGuard can be integrated seamlessly with fully on-device language models to defend against noncompliant misuse of LLMs on the edge, while maintaining record low-latency by avoiding all network calls. This joint partnership is a testament to the Dynamo team's incredible efforts in collaboration with Lenovo over the past year optimizing our ultra-lightweight guardrail solution, which can now run on Lenovo laptop CPUs, GPUs, and NPUs in <50ms latency for a typical 400 token prompt (for context, traditional guardrailing can often 3x the latency for LLM inferencing!). Shout out to Nikhil Gupta, Tejas Ravichandran, Naveen Govindaraju, Srijan Verma, James O'Neill, David Chen, Santhosh Subramanian, Eric Lin, Kavi Arora and Shaily Fozdar on translating these algorithmic breakthroughs into production at break-neck speed! The ability to run efficiently across CPUs has also unlocked massive markets for Dynamo across regulated enterprises that require on-prem guardrailing with no access to GPUs. Special thanks to Tom Butler, Nima Baiati, Blaire Howe, Allen Lalehparvar, Surya Kuppuswamy, Pooja Sathe, Nicholas Borsotto, Cedric Courteix, MBA, and the Lenovo team for your close partnership! Read more from Lenovo's press release: https://lnkd.in/g5wTP2mk #Thinkpad #Lenovo #DynamoAI #Innovation #AICompliance #ResponsibleAI #AISecurity #Privacy #Security #LLMs #GenAI #AI #EnterpriseAI