DuckDB

New blog post by Mark Raasveldt: Memory Management in DuckDB This blog post explains how DuckDB manages memory. It covers streaming execution, spilling intermediate results to disk, and the buffer manager. Read more at https://lnkd.in/dxpiBB5n

We are hosting DuckCon #5, a half-day conference, in Seattle on August 15. Join us to learn about recent developments from DuckDB's co-creators and power users. Some highlights: – Mark Raasveldt and Hannes Mühleisen (DuckDB co-creators) – Overview of the latest developments in DuckDB – Frances Perry (MotherDuck) – Taking flight with interactive analytics – Matt Forrest (CARTO) – How DuckDB is changing the face of spatial analytics – Robert Kosara (Observable) – A duck for your dashboard: Performant data apps in the browser with DuckDB In addition, we have several lightning talks, and a drink & snacks session sponsored by MotherDuck. See the event details and register (for free) at https://lnkd.in/dSW6_gCU 

We launched the DuckDB Community Extensions repository, which allows secure distribution and installation of third-party extensions. To install and load a community extension, simply run: INSTALL extension_name FROM community; LOAD extension_name; We already have six extensions available in the repository. These add support for cryptographic and geospatial features, introduce new aggregations and one even adds an entirely new query language! For details, see our announcement blog post: https://lnkd.in/dxdmRm-E

🦆 Excited to share that I will be speaking at DuckDB's DuckCon 5 in Seattle on August 15th! Sign up and see the full schedule in the comments! Expand the post for more info on the talk... 😊 In the past year and a half, I've seen DuckDB become a fundamentally game-changing technology for geospatial. The sheer amount of amazing projects using DuckDB for Geospatial has blown my mind, and the ease of use to get started has made it easy to adopt for many users. Even Overture Maps Foundation uses it as a recommended tool to access their data. 🌍 My goals for this talk are to showcase some of the amazing things that the geospatial space has done with DuckDB for the broader DuckDB community and also discuss some of the different features that would help make it even more accessible in the future. 🫵🏼 If you have a project using DuckDB, please share it with me. Or if there's a feature that you are curious about, definitely make sure to ask in the comments. #gis #moderngis #spatialanalytics #spatialsql #duckdb #duckcon5 #seattle #geospatial

A copy of the “Getting Started with DuckDB” book – authored by Simon Aubury and Ned Letcher, and published by Packt Publishing – just arrived to the DuckDB Labs office! Congratulations to the authors on publishing this book.

New blog post by Alex Monahan: Benchmarking Ourselves over Time at DuckDB The DuckDB team's philosophy is to ensure correctness first, then iterate and optimize to improve performance. This blog explores how this happened over the last three years when DuckDB became approximately 3-25x faster and 10x more scalable. Read more at https://lnkd.in/dnQ7Nya8

After the release of DuckDB v1.0.0 earlier this month, we recently crossed two other milestones: – The DuckDB repository on GitHub reached more than 20,000 stars ⭐️ – The duckdb.org website surpassed more than 1 million visitor per month 📈 We wrote a few words about what happened around the project since the release and what you can expect in the coming weeks: https://lnkd.in/dzXzMUqA

Sometime around 18 months ago, I noticed there was a critical mass of excitement happening around #DuckDB. A number of people whose opinions I value and trust were saying some very bullish things about its applications for data engineering and data science, and so I decided it was time to jump down the rabbit hole. 🦆 🐇 ✨ Turns out this rabbit hole went a little deeper than I expected. 18 months later, I'm very happy to say that 'Getting Started with DuckDB: A practical guide for accelerating your data science, data analytics, and data engineering workflows', by Simon Aubury and myself, is now available! 🎉 Whether you’re a seasoned data practitioner or new to working with analytical data, this book will help you quickly get across where DuckDB sits in the data ecosystem and understand how you can apply its powerful and versatile analytical capabilities in your workflows and projects. The book is available in both physical and e-book forms: https://packt.link/byKYt Thanks to Kris Jenkins for being our first reader and writing us such a lovely forward. Thanks to our amazing technical reviewers Torsten Grust, Louisa Lambrecht, Björn Bamberg, Tim Fischer, and Denis Hirn from the database systems research group at Universität Tübingen. And thanks to our wonderful Packt team: Deepesh Patel, Shreya Moharir, Kirti Pisat, Hemangi L, Seemanjay Ameriya, and Nivedita Singh.

DuckDB Labs recently sponsored Hack4Her, a female-focused student hackathon in the Netherlands. During the DuckDB Challenge of the event, teams built a community-driven app providing safe walking routes in Amsterdam using DuckDB's data processing capabilities and its geospatial library. See the press release of the event for more details: https://lnkd.in/dcQHXzH3

New blog post by Gábor Szárnyas Command Line Data Processing: Using DuckDB as a Unix Tool This blog post shows how DuckDB stacks up against classic Unix tools (such as cut, grep, sort and sed) when performing simple data processing steps. We solve several problems using both Unix tools and DuckDB's SQL, and demonstrate that DuckDB usually yields solutions that are easier to write – and to read later. We also perform some benchmarks, which show that even for something as simple as filtering, DuckDB can be competitive with highly-optimized Unix tools. Read more at https://lnkd.in/dCF8vTSF