Lynk.ai

Just came back from two days at Big Data LDN - a great experience! It was fun sharing thoughts with world class data geeks 🤓 Here are my main takeaways: 1. AI is still a hype. Not sure if people really want to embrace it or are more afraid of embracing it. But I'm sure it's here to stay, and that it's the best thing that will happen to data teams - finally quality data gets priority as it deserves, and data teams will be able to accelerate value delivery to the business. 2. In order to enable AI, companies need to adapt their data first - semantically. Make the data and business definitions very clear, accessible and governed. Also, the data community feels very alive and I feel honored to take part in it. I spoke with almost every vendor on the conference (and there were a lot! about 200) and found very welcoming people and inspiring products. See you next year !

#dataengineering #snowflake #cost Snowflake is a great DWH platform, but as its not a cheap one. Here's one quick win you can apply in less than 5 minutes: Optimizing Warehouse Auto-Suspend Time in Snowflake By default, Snowflake suspends a warehouse after 10 minutes of inactivity. This means you could be paying for an extra 10 minutes of runtime for each query, even when the warehouse isn’t actively being used. Fortunately, you can easily adjust these settings to minimize unnecessary credit consumption. The Tradeoff: Suspending a warehouse drops its cached data—the data Snowflake retrieves from storage to perform queries. However, this doesn't affect the query results cache, which remains available even if the warehouse is suspended. When to Reduce Auto-Suspend Time: • Infrequent Use: For warehouses that are not frequently running, such as those used for ad-hoc queries. • Frequent Data Changes: When warehouse data cache changes often, for instance, due to running queries that require data from various sources. Check the Impact: You can monitor the effect of your changes via Snowflake’s UI: Navigate to Admin > Cost Management > Consumption, and select the relevant warehouse to see credit usage over time. How to Change Auto-Suspend Settings: You can adjust the auto-suspend time either through a simple query or directly via Snowflake’s UI (see link in first comment)