ZCS (Zeaware Consulting Services)’s Post

Lots of MLFlow updates to help users deploy GenAI capabilities, check out the details below. #mflow

View organization page for MLflow, graphic

65,563 followers

We are happy to announce MLflow 2.10.0 release!! 🚀 MLflow 2.10 includes several significant new features that are preparing the way for current and future enhanced support for Deep Learning use cases, new features to support a broadened support for #GenAI applications, and some quality-of-life improvements for the MLflow Deployments Server (formerly the AI Gateway). ✅ New MLflow Website - MLflow.org has been completely refreshed! The new site landing page is fresh, modern, and contains more content than ever. We're adding new content and blogs all of the time. ✅ Model Signature Supports Objects and Arrays - Objects and Arrays are now available as configurable input and output schema elements. These new types are particularly useful for GenAI-focused flavors that can have complex input and output types. ✅ Langchain Autologging🦜 - MLflow LangChain flavor has autologging support now! When you invoke a chain, with autologging enabled, we will automatically log most chain implementations, recording and storing your configured LLM application for you. . ✅ Prompt Templating for Transformers Models -The MLflow Transformers🤗 flavor now supports prompt templates. You can now specify an application-specific set of instructions to submit to your GenAI pipeline to simplify, streamline, and integrate sets of system prompts to be supplied with each input request. ✅ MLflow Deployments Server Enhancement - The https://lnkd.in/etuhUMie  now supports two new requested features: (1) OpenAI endpoints that support streaming responses. You can now configure an endpoint to return real-time responses for Chat and Completions instead of waiting for the entire text contents to be completed. (2) Rate limits can now be set per endpoint to help control cost overrun when using SaaS models.  ✅ Further Document Improvements - Enhanced documentation, guides, tutorials, and examples by expanding on core MLflow functionality as well as entirely new pages for GenAI flavors. For a comprehensive list of changes, see 👉 https://lnkd.in/eZHdA8-q #opensource #mlflow #mlops #machinelearning #oss #linuxfoundation

  • No alternative text description for this image

To view or add a comment, sign in

Explore topics