Haystack 2.0 is out! Over the last months, we completely re-designed huge parts of our AI framework with a few goals in mind:
🔀 Enabling the design of more flexible compound AI systems (aka pipelines)
💙 Increase transparency and developer experience
🌍 Have a scalable, reliable way of managing the growing ecosystem of Haystack integrations
📈 Double-down on the production-readiness of Haystack
See comments below this post for materials that go deeper into all of the new features, but let me highlight a couple of things that stand out for me personally:
🔀 𝐌𝐨𝐫𝐞 𝐟𝐥𝐞𝐱𝐢𝐛𝐥𝐞 & 𝐩𝐨𝐰𝐞𝐫𝐟𝐮𝐥 𝐏𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬 (𝐚𝐤𝐚 𝐂𝐨𝐦𝐩𝐨𝐮𝐧𝐝 𝐀𝐈 𝐒𝐲𝐬𝐭𝐞𝐦𝐬)
- Write custom components in just a few lines of code
- Add loops to your Pipeline to auto-correct wrong LLM generations, retrieve relevant documents more iteratively or add agentic behavior
- A bigger ecosystem of integrations you can pick from
💙 𝐈𝐧𝐜𝐫𝐞𝐚𝐬𝐞𝐝 𝐭𝐫𝐚𝐧𝐬𝐩𝐚𝐫𝐞𝐧𝐜𝐲 & 𝐝𝐞𝐯𝐞𝐥𝐨𝐩𝐞𝐫 𝐞𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞
- New pipeline templates that get you started quickly, but under the hood use the same, general pipeline syntax so that you can easily transition to it
- Quickly visualise pipelines in an image or in your console to understand the structure
- Validation and type-checking: Ensure all components in your pipeline are compatible even before running it
📈 𝐇𝐚𝐯𝐢𝐧𝐠 𝐲𝐨𝐮𝐫 𝐛𝐚𝐜𝐤 𝐰𝐡𝐞𝐧 𝐝𝐞𝐩𝐥𝐨𝐲𝐢𝐧𝐠 𝐭𝐨 𝐩𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧
We deployed several thousands of Haystack pipelines for our customers over the last years and also heard from our community what would simplify their life in this stage. In Haystack 2.0 we added:
- Deployment guides and helm charts for K8s
- Improved speed of critical components (e.g. 6x throughput for creating embeddings in a RAG pipeline)
- Heavily improved logging and tracing to simplify observability once you are running in production.
- A completely new REST API on top of Haystack, called Hayhooks, that helps you get started quickly and can be a great starting point for your own API implementation.
Looking forward to seeing countless AI systems being built and shipped to production with it!
#HaystackV2 #genai #llms #opensource