Delta Lake

📈 With 10,400+ Slack members, 190+ developers across 70 organizations, and 20M+ monthly downloads, Delta Lake, an LF AI & Data incubation project, is making waves in data engineering! Join us on 𝗧𝘂𝗲𝘀𝗱𝗮𝘆, 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿 𝟭𝟵 𝗮𝘁 𝟵 𝗔𝗠 𝗣𝗧 to explore why Delta Lake is a must-have for data lakes, delivering reliability, performance, and effortless scalability for organizations around the world. 🌐 Hear from Denny Lee, Principal Developer Advocate at Databricks, as he dives into the features and innovations that make Delta Lake essential in today’s data landscape. 🎥 LIVE on LinkedIn & YouTube 🎤 Hosted by Vini Jaiswal, LF AI & Data TAC Chair RSVP today! ⬇ #opensource #oss #deltalake #linuxfoundation #lfaidata #dataengineering

We're excited to launch our new live series: Ask the Authors! 🙌 Join us for the first episode on Tuesday, November 26 at 9 AM PT - connect with the authors, dive into all things Delta Lake, and get your questions answered live. 🗓 Tuesday, November 26 🕘 9 AM PT 🗣 Denny Lee, Prashanth Babu, R. Tyler Croy, Tristen Wentling, & Scott Haines 🎥 Streaming LIVE on LinkedIn & YouTube PLUS, we're giving away 5 copies of Delta Lake: The Definitive Guide! 📕 👉 RSVP: https://lnkd.in/eKZZwj2M ❓ Have questions? Submit them ahead of time: https://lnkd.in/e5z-T4Zc #opensource #deltalake #oss #linuxfoundation #lfaidata

The countdown is on! 🙌 Next week, join us for Thinking Fast and Thinking Slow: Adopting the Streaming-First Mindset! 🚀 Changing perspectives isn’t easy—especially for data engineers moving from a batch-oriented approach to a streaming-first mindset. Are you ready to embrace this shift and unlock new possibilities? In this webinar, Scott Haines (Nike) & Denny Lee (Databricks) will guide you through adopting a streaming-first approach and harnessing your data in real-time. Don’t miss out on the insights that could transform your data strategy! 💡 🗓 Tuesday, Nov 12 🕐 9AM PT / 12PM ET 📽 LIVE on YouTube & LinkedIn RSVP today! ⬇ https://lnkd.in/eqWjBwyc #opensource #oss #linuxfoundation #lfaidata #streaming

'MERGE` is one of the most powerful #DeltaLake operations. 💪 With Delta Lake merge you can apply multiple INSERT, UPDATE and/or DELETE operations in a single transaction. You can also specify conditional statements for your upserts. Merge operations allows you to make very precise changes to your data **without having to rewrite the entire table**. Updating or deleting a row is just a simple change to the transaction log. This is much more efficient than immutable file formats like Parquet. delta-rs has a great API that makes it super easy to combine different conditional merge operations. 👇 Here's how to do an UPSERT with delta-rs: Credit: Avril Aysha #opensource #oss #linuxfoundation

Join Dominique Brezinski Delta Lake's newest TSC member, as he takes us on a journey back to his beginning days at Apple, where he was tasked with finding a scalable alternative to Splunk. 🌐 Dominique shares how an early collaboration with Databricks and a pivotal discussion with Michael Armbrust transformed a side project into what we now know as Delta Lake. Watch the full conversation 👉 https://lnkd.in/eKC8XJKe 🎤 Hosted by Denny Lee & Scott Haines #opensource #deltalake #oss #linuxfoundation #lfaidata

📣 Excited to announce the publication of Delta Lake: The Definitive Guide! Authored by Tristen Wentling, Scott Haines, Prashanth Babu, Denny Lee, and R. Tyler Croy, with forewords by Michael Armbrust and Dominique Brezinski, this guide is your roadmap to tackling complex data challenges. ✅ Gain insights into how Delta Lake can enhance reliability, security, and performance for both streaming and batch data operations. Visit https://lnkd.in/ea9bs8Ds and download your PDF copy! 📕 #deltalake #opensource #oss #linuxfoundation #lfaidata #streaming #datalakes #lakehouse

Join us for the first session of our new series, Ask the Authors! 🎊 This interactive series offers a unique opportunity to meet the minds behind Delta Lake: The Definitive Guide and get your questions answered live. 🗓 Tuesday, November 26 at 9AM PT 🎤 Denny Lee, Prashanth Babu, R. Tyler Croy, Tristen Wentling, & Scott Haines 💻 LIVE on LinkedIn & YouTube If you're looking to enhance the performance of your data lake, tackle complex data challenges, or simply learn more about #DeltaLake's capabilities, this event is for you. Learn how Delta Lake provides an optimized storage layer that enhances streaming and batch data operations' reliability, security, and performance. PLUS, we're giving away 5️⃣ copies of Delta Lake: The Definitive Guide! 📕 Don't miss this chance to interact directly with the experts, gain valuable insights, and connect with fellow Delta Lake users and contributors. RSVP today! 👇 #opensource #oss #linuxfoundation #lfaidata

📣 Join us for our next webinar, Thinking Fast and Thinking Slow: Adopting the Streaming-First Mindset! In this webinar, Scott Haines (Nike) and Denny Lee (Databricks) will guide you through the complexities of adopting a streaming-first mindset. Learn how to effectively manage your data in real-time and explore the benefits it can bring to your projects. 🗓 Tuesday, November 12 ⏰ 9 AM PT / 12 PM ET 📍 Live on YouTube & LinkedIn RSVP here ➡ https://lnkd.in/eqWjBwyc #opensource #oss #deltalake #linuxfoundation

Join us next Tuesday, October 29 at 10AM PST for a live #DeltaLake AMA! Meet our newest TSC member, Dominique Brezinski, alongside hosts Denny Lee and Scott Haines. Dive into the origins of Delta Lake, sparked by a meeting between Dom and Michael Armbrust at Data + AI Summit 2018. 🚀 Learn how, in less than a year, Dom had Delta Lake running in production, reliably processing hundreds of petabytes! 🙌 Bring your questions and get ready for an interactive and fun discussion. 💬 RSVP below! ⬇️ #opensource #deltalake #oss #lfaidata #linuxfoundation

🚨 Last chance to register! Join us tomorrow, October 29 at 10AM PST for a live #DeltaLake AMA with our newest TSC member, Dominique Brezinski, alongside hosts Denny Lee and Scott Haines. Explore the beginnings of Delta Lake, sparked from a conversation between Dominique and Michael Armbrust at the Data + AI Summit 2018. Discover how Dominique quickly had Delta Lake running in production, efficiently managing hundreds of petabytes in less than a year. 💬 Bring your questions and get ready for an interactive and fun discussion! Live on LinkedIn & YouTube. 💻 RSVP here ➡ https://lnkd.in/ekYRwqer #opensource #oss #linuxfoundation #deltalake