Arize AI

Learn from Luke Chui (LlamaIndex) at our NYC meetup Nov 19! Luke and speakers from Google Weaviate Priceline & AutoGen will be covering evaluation techniques for AI agents, focusing on real-world performance metrics... We'll also dive into: ✔️ Key methods for optimizing agent systems to improve decision-making, autonomy, and robustness. ✔️ The latest tools and frameworks used in agent development and system evaluation. Discover best practices for iterating on agent behavior through continuous evaluation and feedback loops. Meet people, learn something, eat some food, grab some swag. Register: https://lnkd.in/dfi242BA

Join us for an afternoon of agent building and hacking at the Open Source Campus this Friday in SF. 🚀 AI agents are changing the game—shaping industries, communities, and digital landscapes. Whether it's OpenAI’s Swarm or the meme economy led by autonomous agents like Truth Terminal, now’s the time to dive in... Here's what you'll be doing: 🛠️ Build an AI agent from scratch with John Gilhuly 🤖 Explore autonomous agents 💻 Hack, collaborate, and learn 🍕 + Pizza This is a really great opportunity to meet and learn from other people working on agents. Thanks to Era Qian for hosting us at the Open Source Campus. Register: https://lu.ma/jiocz1m6

Berlin: See you next week at the MLOps Community meetup. ✨

At our agent meetup in NYC on 11/19, Chi Wang will share insights on agent evaluation and optimization drawn directly from his work on AutoGen. AutoGen is an open-source framework that simplifies building complex LLM applications by orchestrating conversations between multiple AI agents, allowing them to collaborate autonomously while maximizing their collective performance and compensating for individual limitations. Also at this event, we have an incredible roster of speakers joining us from Google, LlamaIndex, Priceline & Weaviate who will dive into: 📊 Advanced evaluation techniques for production agents 🛠️ Real-world optimization strategies 🔄 Building effective feedback loops ⚡ Latest tools in the agent development stack Perfect for anyone interested in learning how industry leaders are solving the complex challenges of agent evaluation and optimization. Also a great opportunity to meet other people thinking about & working on agents. Register: https://lnkd.in/dfi242BA

Join us tomorrow at 10am PT for an inside look at how Voiceflow built Tico, their customer support agent. Denys Linkov & Nicolas Arcay Bermejo will join Aman Khan to dive into... ✔️ Real architecture decisions and their implications ✔️ Actual production deployment challenges ✔️ Hands-on insights about iterative agent improvement using Voiceflow & Phoenix Skip the trial and error - learn from people who've already solved similar challenges to the ones you may be running into. This is part of our 5-week series unpacking real-world agent implementations. Perfect if you want to move beyond tutorials to production-grade agent development. We also have upcoming sessions with Geotab and Booking.com 🚀 Register: https://lnkd.in/gH3mcmPk

Jason Lopatecki, Founder & CEO of Arize AI, delivered a keynote titled "Making GenAI Tractable: The Advantages of Speed and Scalability with Cerebras Wafer-Scale Clusters". As a second-time founder, Jason is a verified expert in AI, dig data architectures, and machine learning. His second venture, Arize AI is dedicated to helping engineers develop and improve models in one place. We're so excited to host such an experienced AI business owner! #GenAISummit2024 #GenAISummit

Webinar this week with Groq 👉 Building with LLMs and struggling to get the most out of your app? Just looking for more insight into the black box of modern AI development? Join us! John Gilhuly and Hatice Ozen will share a few hands-on examples that demonstrate how tracing and evaluation give you insight into every step of your LLM apps. Register: https://lnkd.in/gepEWJS7

Think you can build an AI agent worth bragging about? We’re kicking off Community Challenge Month with 30 days of prizes – including limited-edition Phoenix swag and a cash grand prize! 💰 Here’s how to enter... 1️⃣ Build an agent that’s truly dynamic – not just a predictable pipeline or chain. 2️⃣ Trace your agent with Arize Phoenix so it’s live in the Phoenix UI. 3️⃣ Code originality matters: submit code you’ve built, not just an example notebook from an existing repo! Use any tools you like, from LangGraph and Workflows to CrewAI and beyond. And if you missed our recent bootcamp, check out our course (in the comments) on building AI agents to get up to speed. Every eligible submission scores you Phoenix swag and a shot at the grand prize. 💸 Start building: https://lnkd.in/gEGQNR2C

🚀 Exciting update for developers building and monitoring AI applications! Microsoft just launched a new AI Apps Template Gallery—and Phoenix is officially part of it! This gallery is designed to provide developers with high-quality, easy-to-deploy templates that help you build great AI applications. With the new Phoenix integration, you can spin up a Phoenix instance hosted on Azure to bring observability into your workflow. Phoenix is open-source and free to self-host on Azure, making it an accessible option for any team. Here’s how it can support your AI projects: ✔️ Capture OpenTelemetry traces on AI applications, either manually or automatically through our dozens of integrations with libraries like LlamaIndex, Langchain, and Azure OpenAI ✔️ Run evaluations and experiments to measure hallucinations, context relevancy, function calling correctness, token usage, and more. ✔️ Curate datasets for streamlined fine-tuning and retraining of your underlying models Whether you’re focused on application monitoring, dataset curation, or performance evaluation, Phoenix in the AI Apps Template Gallery offers a structured, cost-effective starting point to boost your AI workflows. Check out the integration to get started: https://lnkd.in/gB3nqdZz

We're excited to be back in New York on Nov 19 🤠! Join experts from Google, LlamaIndex, Weaviate, AutoGen ( & Arize ) for an inside look at advanced techniques for building and optimizing agent systems. Register here: https://lnkd.in/dfi242BA