Lightdash reposted this
I've recently posted on medium an article series, "BI Infrastructure Without Robbing a Bank: a complete tutorial in 5 parts". In it I share what I think is something many might have missed with the data landscape changing ever so quickly - that the freemium BI ecosystem has finally come into a long-awaited maturity. Majority of my professional life during the last 4 years was spent freelancing among various projects and companies. And my usual role there was to come help build their BI infrastructure, usually from some rather rudimentary point. The responsibilities of a data solution architect gave me the chance to touch the majority of the most popular tools around. My typical clients were tech startups and e-commerce companies, so, sure enough, this gives a somewhat partial view. Nevertheless, I came to find the repeating requirements among the different businesses, and the tools best filling those requirements. This, in various flavors, became my current favorite stack, consisting mainly of: dbt, Airbyte, Lightdash, and Kestra, self-hosted on GCP. For my friends in data - many of whom I've already discussed this stack with on many occasions - this is an (I hope) easy-to-follow tutorial, which you could follow as a weekend's project and hands-on test all the components of the stack. Best part - all the tools are free to use (you pay for cloud services only). Some of the tools are, perhaps, already your bread and butter, though it might be fun to sit down again and try setting all of them up from scratch. The tutorial link is here: https://lnkd.in/dUcDnDPm Also, if you want to discuss or share your experience with the listed tools -please do! I am pretty hyped to hear others' experiences. Happy reading! dbt Labs Airbyte Lightdash Kestra Vėjai