Mahira Technology Pvt Ltd’s Post

✍ New Blog Alert: "Introduction to dbt: Unveiling dbt Core and dbt Cloud" is now live on Medium! Explore how dbt (data build tool) revolutionizes data transformation. Learn about the differences between dbt Core and dbt Cloud, the power of version control with GitHub, and the benefits of Jinja templating and modular data transformation. Elevate your data workflows with dbt - Check out the blog now! #datasolutions #datatransformation #dbt #medium #datainsights

I’m happy to share my latest article: 👉 "How We Use Airflow with Composer" 📖 Read it here: https://lnkd.in/dveQa36T In this post, we explore how we leverage Apache Airflow with Google Cloud Composer to orchestrate and optimize workflows. We share best practices and real-world insights to help teams streamline their data pipelines efficiently. A huge thanks to everyone who contributed to making this happen! 🙌 Let me know your thoughts in the comments! 💬 #Airflow #CloudComposer #DataEngineering #GCP #TechBlog 🚀

Great article by Alberto Crespi, showcasing how Apache Airflow is unlocking the full potential of Data & Analytics at lastminute.com! 🚀👏 Do not miss it! 🦩

Want to take control of your company's data infrastructure, while making it easier for data engineers to move faster? The key is getting out of the way. Building golden patterns can: ✅ Extend your platform team's knowledge ✅ Unblock engineers and help them move faster ✅ Lower the barrier to entry for spinning up infrastructure ✅ Cut through the noise of bad PRs with inconsistent configuration Get a free account to follow along with this example where we took a GCP event-driven pipeline with Pub/Sub, Cloud Run Functions, and Cloud Storage - turning it into a guided UI that generates Terraform that meets your company's expectations. Tutorial: https://lnkd.in/eiYE7QyZ Why streamline data infrastructure creation: https://lnkd.in/eks7Jxf4 Video walkthrough for those visually inclined people: https://lnkd.in/eQHmw7ZX

More Invent and Simplify! 2 years in the making, and here it comes - zero-ETL from SaaS/enterprise apps powered by AWS Glue! Check out our new blog post from Caio Tadeu Sgaraboto Montovani, Vivek Pinyani, Shovan Kanjilal, Kartikay Khator and myself where we explain how you can start leveraging Zero-ETL for applications to gain in a matter of minutes! If you want to learn more and you are at re:Invent - don’t miss to join us today, Wed 4 at 17:30 for ANT353 #AWS #reinvent #dataintegration #zeroetl #etl #dataprocessing #spark

I'm thrilled to share that my latest article on how to use Terraform to manage Snowflake accounts has been published in the official Snowflake Medium publication! ❄️ Big thanks to the Snowflake Builders community for giving me the platform to share my insights. Check out the full article here: https://lnkd.in/g-JgYBsB #Snowflake #Terraform #InfrastructureAsCode #DataCloud #DataEngineering #Automation #Medium #SnowflakeBuilders

A couple of days ago we shared a post on Wherobots latest capabilities including WherobotsAI for raster inference, as well as a planet scale PMtile generator that is now available in our cloud service. Today, we’re sharing the Wherobots Spatial SQL API, powered by Apache Sedona, to bring the performance of WherobotsDB to your favorite data applications. This opens the door to a world of direct-SQL integrations with Wherobots Cloud, bringing a serverless cloud engine that’s optimized for spatial workloads at any scale into your spatial ETL pipelines and applications, and taking your users and engineers closer to your data and spatial insights. Read the blog: https://bit.ly/3wXZdt9 Register for our release demo on July 10th here: https://bit.ly/3X99ays

Check out my latest article detailing how to implement CI/CD with Streamlit in Snowflake! From the Snowflake docs: "Streamlit in Snowflake helps developers securely build, deploy, and share Streamlit apps on Snowflake’s data cloud. Using Streamlit in Snowflake, you can build applications that process and use data in Snowflake without moving data or application code to an external system." https://lnkd.in/gjGSRU_k

In this article, I will walk you through the process of orchestrating Go-based #Lambda functions using #AWS #StepFunctions, enabling you to automate #workflows, handle task dependencies, and integrate error handling in a #Serverless #environment https://lnkd.in/eTPVS5bR

Developing and testing Snowflake workflows can be challenging without a reliable local environment. LocalStack enables you to create a local Snowflake development environment, allowing for an efficient developer experience and faster iteration. In this blog post, Sudhendu P. explores how LocalStack simplifies Snowflake development, detailing the steps to set up and leverage our new offering for streamlined development & testing of data workflows. #LocalStack #Snowflake #DataDevelopment #Testing #Cloud 🔗 https://lnkd.in/gjWf2q7m