Flyte

Calling the #ML Flyte community at Munich. We're stoked to meet you all there! Details 👇

✨ Monthly Contributors Spotlight ✨ We greatly appreciate the efforts of our contributors this month: • Chun-Mao Lai tackled a bunch of Jupyter notebook and interactive mode tasks, pushing through several pull requests to get everything wrapped up—awesome work! • Vincent (Mao-Siang) C. added support for extra copy commands in imagespec. • Jason Parraga implemented pod template support for init containers. We also want to give a big shoutout to Chung Yen Hung, Yenting Chen, JiaWei Jiang, Rafael Raposo, @mthemis-provenir, Buğra Gedik, Felix Mulder Witasp, and Ethan Brown for your continued support and contributions. Thanks for all you do!

The ML team at LinkedIn -one of the most active Flyte users- recently published the Liger Kernels Python package (https://lnkd.in/eY_6Fwbc), a collection of triton kernels that accelerate LLM training by increasing token throughput and reducing the memory footprint of models. In the spirit of reproducible experiments, Niels Bantilan set up a scaled-down environment -powered by Union.ai's Serverless- to reproduce benchmarks and the Weights & Biases integration to track training metrics. Results? 🔥 Effectively 20% -30% higher token throughput with 6% - 13% less reserved memory. Dive into the details! https://lnkd.in/e-GCmy_S Pin-Lun (Byron) Hsu

November Community sync will feature Xinzhou from Atomwise, sharing how they transform drug discovery with an AI platform built with Flyte. 🗓 Tuesday, Nov 5 🕒 9:00 a.m. PT ➡ Mark the event as "Attending" here: https://lnkd.in/eqqQxb_V See you there!

Flyte 1.13.2 and Flytekit 1.13.6 are here! 🚀 Check out our latest blog post to discover the key updates in Flyte's newest releases, including enhanced workflow registration, multiple bug fixes, and new integrations with MotherDuck and Ollama. Whether you're working on complex data workflows or machine learning pipelines, these improvements will streamline your experience and boost performance. ➡ Read the full blog post here: https://lnkd.in/eCQRMcdV #DataEngineering #MachineLearning #Flyte #OpenSource

🎉 Flyte is participating in Hacktoberfest! ➡ Head over to the list where we track all the labeled issues: https://lnkd.in/ezqm6y5S ⚙ Make sure to follow the guidelines 🏆 We have prizes! 👓 Learn the details and check out the getting started video: https://lnkd.in/exhih55w You all are welcome to participate!

✨ Monthly Contributors Spotlight ✨ We greatly appreciate the efforts of our contributors this month: • Robert Ulbrich for adding support for SMTP notifications. • Jason Parraga for refactoring flyteadmin to pass proto structs and updating helm docs. • Buğra Gedik for adding a listing API to stow storage. • Vincent Chen for adding support for copy commands in imagespec and default values for lists and dictionaries containing dataclass instances. • Jack Urbanek for re-adding support for mashumaro discriminated classes. Special mention to Christoph Paulik, Rafael Raposo, Wei-Yu Kao, Ethan Brown, Thomas Newton, and Fabio M. Grätz, Ph.D. for their continued support and contributions to Flyte! 👏

From a new plugin that enables native model serving in Flyte with Ollama/NIM to the next community presentations you shouldn't miss!

Join us for a virtual event with Wayve, the autonomous mobility pioneer. Learn from Victor Delépine, Senior Software Engineer, how Wayve simplified ML research workflows using Flyte, abstracting away the complexity of scheduling thousands of concurrent jobs on Kubernetes!