dbt Labs’ Post

dbt Labs update! Check out the new Data Discovery feature - dbt Cloud Explorer and how it acts as a Data Catalog for your Data Warehouse. Sign up link below below. https://lnkd.in/emrJtgjJ

🎉 Completed My Journey with dbt Cloud Basics! 🎉 I've successfully completed the foundational steps of transforming data in dbt Cloud. 🛠️ From connecting dbt Cloud to a data warehouse and Git repository to exploring essential concepts like modeling, sources, testing, documentation, and deployment—I’ve gained valuable insights into data transformation! 📊 Wrapped it up with hands-on experience by building a model and running tests directly in dbt Cloud. Excited to apply these skills to future projects! 💡 #dbtCloud #DataTransformation #DataModeling #AnalyticsEngineering #LearningJourney #DataScience #Accomplishment

Just published a guide on leveraging dbt for streamlining analytics workflows. I explain how dbt can help data teams to take their pipelines to new heights, and present a step-by-step walkthrough for onboarding your first end-to-end analytics workflow on dbt Cloud using BigQuery – all at no cost! #dbt #dataengineering #dataanalytics #bigquery

🌟 Exciting news from GoodData's developers! GoodData-dbt integration is production ready! 🔎 Our latest article demonstrates all the related capabilities of this integration, as well as the two options for integrating with dbt: 1️⃣ Complete integration with dbt cloud & semantic layer APIs 2️⃣ Partial integration, generating BI semantic layer from dbt models Curious about what's in store for the future? Automatic metric conversion and dbt Cloud API integration might be on the horizon. 🌐 Read the full article to learn more: https://hubs.ly/Q02h92SY0 #BIIntegration #dbt #GoodData #SemanticLayer

Did you miss the dbt cloud showcase yesterday? Never mind, come and join the Australian dbt Labs team at the QT in Sydney next Wednesday for some popcorn and a cinema showing at lunch time. 🆕 Here's a summary of what’s new and coming soon to dbt Cloud: - 𝐝𝐛𝐭 𝐀𝐬𝐬𝐢𝐬𝐭: An AI-powered co-pilot to help you generate documentation and tests. (Private Beta) - 𝐀𝐝𝐯𝐚𝐧𝐜𝐞𝐝 𝐂𝐈: Enhanced Continuous Integration capabilities with a "compare changes" feature for better quality checks and smoother QA processes. (Coming soon) - 𝐋𝐨𝐰-𝐂𝐨𝐝𝐞 𝐃𝐞𝐯𝐞𝐥𝐨𝐩𝐦𝐞𝐧𝐭 𝐄𝐧𝐯𝐢𝐫𝐨𝐧𝐦𝐞𝐧𝐭: This one is HUGE 🔥 . A visual editor for creating or editing dbt models without SQL expertise, with built-in AI for custom code generation. (Private Beta) - "𝐊𝐞𝐞𝐩 𝐨𝐧 𝐋𝐚𝐭𝐞𝐬𝐭 𝐕𝐞𝐫𝐬𝐢𝐨𝐧": Automatically receive new features and fixes in dbt Cloud without manual upgrades. (GA) - 𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐜 𝐄𝐱𝐩𝐨𝐬𝐮𝐫𝐞𝐬: Your downstream dashboards can automatically show up in your DAG as exposures. (Coming soon for Tableau and Power BI) - 𝐔𝐧𝐢𝐭 𝐓𝐞𝐬𝐭𝐢𝐧𝐠: Ability to validate model logic before production to save costs and improve reliability. (GA) - 𝐝𝐛𝐭 𝐂𝐥𝐨𝐮𝐝 𝐂𝐋𝐈: Allows development from any code editor with the features of dbt Cloud, including the very popular dbt Power User for VSCode extension. Evgenia Stancheva Kieran Chalmers Rob Hueston Lucas O'Loughlin Alex Dinsmoor Mark Wan Lee Bond-Kennedy Albert Cheng Aaron Mcgrath https://lnkd.in/dJUtvdiC

Last call for today's dbt Cloud demo with experts' 🔥 June 5th 12pm ET I will showcase several #dbt Cloud features, such as the dbt explorer, lineage graphs, data modeling with the IDE, the job automation UI, and more! Learn how dbt Cloud can bring value to your business. And it is free! Register here https://lnkd.in/gmMuNWSk #dataengineering #dataengineer #analyticsengineering #analyticsengineer

🌟 Exploring Cloud Composer: A Game-Changer for Workflow Automation! 🌟 🚀 What is Cloud Composer? Cloud Composer is a fully managed workflow orchestration service by Google Cloud, built on Apache Airflow. It allows you to create, schedule, and monitor complex workflows without the need to manage the underlying infrastructure. 🌟 Benefits of Cloud Composer: 1. Fully Managed Service: Focus on building workflows without worrying about infrastructure maintenance. 2. Integration: Easily integrates with various GCP services like BigQuery, Cloud Storage, and Dataflow, as well as external services. 3. Flexibility: Supports Python-based DAGs, providing the flexibility to define complex workflows. 4. Security: Leverages GCP’s security features, including IAM and VPC Service Controls, to protect your data and workflows. 🔍 When to Use Cloud Composer? 1. Data Pipelines: Automate and manage ETL workflows across various data sources and sinks. 2. ML Pipelines: Orchestrate machine learning workflows, from data preprocessing to model deployment. 3. Batch Processing: Schedule and monitor batch processing jobs, ensuring they run efficiently. 4. Complex Workflows: Manage dependencies between tasks and services, providing a clear overview of your workflow’s status. Cloud Composer is a powerful tool for any organization looking to streamline their workflow orchestration, making it easier to manage, monitor, and scale complex workflows. #CloudComposer #GoogleCloud #WorkflowAutomation #ApacheAirflow #DataPipelines #MLPipelines #TechInnovation

Check out this webinar to learn more about our new product, dbt Explorer!

did i save the best cost savings functionality for last? you tell me! Looking to curb your development environment costs? This third and final (for now) post of this series with dbt Labs covers Deferral to production/staging - gone are the days of running a full 'dbt build' in your development schema to be able to test your downstream changes - dynamically reference production (or staging) assets for upstream models --> don't spend time (or warehouse compute) waiting for those objects to build 🛠️ in your development schema - no need to make copies of data you're not modifying in your development environment --> eliminate significant storage costs 💰! - a simple toggle in the dbt Cloud IDE and default behavior in the Cloud CLI --> speeding up 💨 developer productivity is easy Take the next <3 min (on 1.5x) to see how defer to production can save you warehouse spend (and your own valuable time) with dbt Cloud!

🚨Big news from our friends at Fivetran🚨 Fivetran recently launched their dbt Cloud integration! Now, our over 1,000 joint customers can automate transformations post data load to fully synchronize their ELT pipelines and reduce latency, cut costs, and unlock data’s full potential - all in an effort to help data teams operate more efficiently. Get the full scoop, below ⬇️