We’ve launched our product via Y Combinator! We automate the quality assurance for your LLM application. Check it out and get in touch! 🚀🤖
MAIHEM (YC W24) creates AI agents that continuously test your LLM applications. It automates AI quality assurance, ensuring AI performance and safety from development all the way to deployment. LLMs, unlike traditional software that offers a handful of expected outcomes, are unpredictable and can produce thousands of unique responses, introducing numerous potential points of failure. MAIHEM enables companies to: • Simulate thousands of users to test LLM applications before they go live. • Evaluate LLM applications with custom performance and risk metrics. • Improve and fine-tune LLM applications with hyper-realistic simulated data. Max Ahrens, with his PhD in Natural Language Processing from Oxford University, and Eduardo Candela, who holds a PhD in AI Safety from Imperial College London and an MSc in AI from MIT, teamed up to launch MAIHEM. Together, they're on a mission to make AI reliable, safe, and perform better. They're transferring their proprietary research on AI safety for self-driving cars to LLM applications and are using their previous experience at McKinsey and Tesla to empower organizations innovating with AI. Congrats to the team on the launch!