Data Engineer Things

🤑 How I Saved €297 with Web Scraping Without Coding Using Octoparse 🖋️ Author: Kevin Meneses González 🔗 Read the article: https://lnkd.in/eEPhqXfF ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #dataextraction #webscraping #data

Welcome to the Editor Team! Toma Khalifa, Sreyashi Das, Lakshmi Srivalli K., Parthiban Manavalan, Nancy Amandi 🎉 https://lnkd.in/gC-W7Kxy

📢 The public registration for the Data Engineering Open Forum 2025 at Netflix will be open on Tuesday, March 25th! Here is a sneak peek of the session lineup: -- How Netflix Built a Real-Time Distributed Graph for Internet Scale -- Apache Spark™ 4.0 for Data Engineering -- Apache Gluten: Revolutionizing Data Processing Efficiency on Apache Spark -- Delivering Scalable Insights for a New Product Launch: Games at Netflix -- Speed up your pipelines with Storage Partitioned Joins -- Do Work that Matter - Balancing Foundational Work against Stakeholder Requests -- Big Data Analytics and DevOps belong together. Deployment Automation for Business Intelligence team. -- Making Lakehouse Table Formats & Catalogs work for your data using Apache XTable (Incubating) -- The Feedback Loop -- How Metronome Scaled Their Real-Time Usage-Based Billing Pipeline to Billions of Events per Day -- Enabling Reliable Metrics and Insights with DataJunction, a Semantic Layer -- Panel: The Future of Data Engineering We only have a limited number of seats available, so we encourage you to register early to secure your spot, and please only register if you can attend the conference in person. 👉🏼 We highly recommend you join our Google Group. By doing so, you will receive an email with a link to the event page when registration is open. The link to the GG is included in the comment section. #dataengineering #softwareengineering #data

📢 The public registration for the Data Engineering Open Forum 2025 at Netflix will be open on Tuesday, March 25th! Here is a sneak peek of the session lineup: -- How Netflix Built a Real-Time Distributed Graph for Internet Scale -- Apache Spark™ 4.0 for Data Engineering -- Apache Gluten: Revolutionizing Data Processing Efficiency on Apache Spark -- Delivering Scalable Insights for a New Product Launch: Games at Netflix -- Speed up your pipelines with Storage Partitioned Joins -- Do Work that Matter - Balancing Foundational Work against Stakeholder Requests -- Big Data Analytics and DevOps belong together. Deployment Automation for Business Intelligence team. -- Making Lakehouse Table Formats & Catalogs work for your data using Apache XTable (Incubating) -- The Feedback Loop -- How Metronome Scaled Their Real-Time Usage-Based Billing Pipeline to Billions of Events per Day -- Enabling Reliable Metrics and Insights with DataJunction, a Semantic Layer -- Panel: The Future of Data Engineering We only have a limited number of seats available, so we encourage you to register early to secure your spot, and please only register if you can attend the conference in person. 👉🏼 We highly recommend you join our Google Group. By doing so, you will receive an email with a link to the event page when registration is open. The link to the GG is included in the comment section. #dataengineering #softwareengineering #data

💫 From Simple to Maintainable: Upgrading Our Streaming Data Platform 🖋️ Author: Christopher Pike 🔗 Read the article: https://lnkd.in/egH5JPgq ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #dbt #clickhouse #data

🌟 How Meta Solves Data Lineage At Scale 🖋️ Author: Vu Trinh 🔗 Read the article: https://lnkd.in/ez3HSM24 ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #datalineage #datamanagement #data

👉 7 SQL Subqueries Replaced with Joins 🖋️ Author: Jagadesh Jamjala 🔗 Read the article: https://lnkd.in/eZXWBzi4 ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #sql #dataanalytics #datascience

🙌 Stream Processing in Capital Markets: Real-Time Portfolio Monitoring and Risk Management 🖋️ Author: Yingjun Wu 🔗 Read the article: https://lnkd.in/eRUqKwr9 ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #streamprocessing #dataanalytics #riskmanagement

💊 Real-time Medication Intake Monitoring with MotherDuck and SQLMesh 🖋️ Author: Daniel Palma 🔗 Read the article: https://lnkd.in/eSRwEZwg ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #dataanalytics #sqlmesh #motherduck

📊 Metrics for Data Engineering: Why, How, and Which Metrics to Track 🖋️ Author: Aline Rodrigues Guimarães de Oliveira 🔗 Read the article: https://lnkd.in/eQcnd5Tg ------------------------------------------- ✅ Follow Data Engineer Things for more insights and updates. 💬 Hit the 'Like' button if you enjoyed the article. ------------------------------------------- #dataengineering #dataanalytics #data #tools