ScyllaDB

💪 Monday motivation: Unpredictable latency can be almost as scary as Halloween ghouls and vampires. 👀 Fear not, for on October 31, Tzach Livyatan and Attila Tóth will show the architectural elements that allow #ScyllaDB to handle workloads over 50K operations per second. No tricks, just predictable low-latency treats. 💡 https://lnkd.in/ew5K_f43 #NoSQL #database #gaming #lowlatency

What does shard-per-core architecture involve and why does it matter for teams who value database performance? We've taken three different perspectives from Dor Laor, Bo Ingram, and Tzach Livyatan to help explain how it contributes to #ScyllaDB's predictable performance at scale. https://lnkd.in/evbKsn74 #NoSQL #lowlatency #database #techtips

How Discord Stores 𝐓𝐫𝐢𝐥𝐥𝐢𝐨𝐧𝐬 𝐎𝐟 𝐌𝐞𝐬𝐬𝐚𝐠𝐞𝐬  .  .  The diagram below shows the evolution of message storage at Discord:    MongoDB ➡️ Cassandra ➡️ ScyllaDB    In 2015, the first version of Discord was built on top of a single MongoDB replica. Around Nov 2015, MongoDB stored 100 million messages and the RAM couldn’t hold the data and index any longer. The latency became unpredictable. Message storage needs to be moved to another database. Cassandra was chosen.    In 2017, Discord had 12 Cassandra nodes and stored billions of messages.    At the beginning of 2022, it had 177 nodes with trillions of messages. At this point, latency was unpredictable, and maintenance operations became too expensive to run.    There are several reasons for the issue:    - Cassandra uses the LSM tree for the internal data structure. The reads are more expensive than the writes. There can be many concurrent reads on a server with hundreds of users, resulting in hotspots.  - Maintaining clusters, such as compacting SSTables, impacts performance.  - Garbage collection pauses would cause significant latency spikes    ScyllaDB is Cassandra compatible database written in C++. Discord redesigned its architecture to have a monolithic API, a data service written in Rust, and ScyllaDB-based storage.    The p99 read latency in ScyllaDB is 15ms compared to 40-125ms in Cassandra. The p99 write latency is 5ms compared to 5-70ms in Cassandra.    Over to you: What kind of NoSQL database have you used? How do you like it?    References:  scylladb. com/product/technology/shard-per-core-architecture  discord. com/blog/how-discord-stores-trillions-of-messages --  Subscribe to our weekly newsletter to get a Free System Design PDF (158 pages): https://bit.ly/3KCnWXq #systemdesign #coding #interviewtips  .

Eliminating cloud vendor lock-in, supporting rapid growth, and achieving it with a 5x cost reduction are great accomplishments for a CTO. At this past #ScyllaDB Summit, Kishore Krishnamurthy shared his perspective on their massive, business-critical database migration. Check out the lessons learned here > https://lnkd.in/eVwSS3ei #NoSQL #databasemigration #techtips

Quality documentation is extremely valuable to developers and engineers. When it comes to moving from a relational to a #NoSQL database, you can now easily avoid some of the bad habits we've seen along the way thanks to Tim Koopmans. Check out what he learned in this blog. https://ow.ly/64hg50SebbJ #ScyllaDB #techtips #database #datamigration

"ScyllaDB outperforms #MongoDB with higher throughput and lower latency for all measured configurations of the social workload." - benchANT comparison What did their tests performed for the social workload reveal? Find out from Daniel Seybold > https://lnkd.in/gq_RSZjY #ScyllaDB #NoSQL #database

📖 Your Weekend Watch: What better way to kick off the weekend than by browsing the full library of #P99CONF tech talks and presentations? 😎 Discover how experts from the world's largest companies tackle low-latency, high-performance distributed computing challenges. https://lnkd.in/edejH_fG #ScyllaDB #Rustlang #Golang #techtalks #Linux #Kubernetes

We can't believe #P99CONF is over, but the conversation is just getting started! Thank you to all of our speakers and attendees for making this such an incredible event. If you missed the conference or a session you're interested in, all of our highly technical talks will be available on-demand for free. Just make sure you are signed up so you can watch any of them whenever you'd like. https://ow.ly/OIx750TSBav #ScyllaDB #techtips #Rustlang #Golang #techtalk

Day 2 of #P99CONF begins soon! There is still time to join over 20,000 engineers for a day full of technical and interactive sessions. Today is packed with highly anticipated speakers like Andy Pavlo, Bryan Cantrill, Cameron Morgan, Cary Millsap, Łukasz Paszkowski, Tanel Poder, Vivek Iyer Vaidyanathan, Julia Kroll, Michael Stonebraker, Richard Startin, Nikita Lapkov, Avi Kivity, Benjamin Cane, Tyler Wedin, Aleksei Kladov, Joe Rowell, Dominik Tornow, Peter Zaitsev, Ivan Burmistrov, David Malinge, Ash Vardanian, Cristian Velazquez, Yichen Wei, and Jose Fernandez. If you missed Day 1, sign up so you can receive all of the sessions on-demand after the conference ends. https://lnkd.in/edejH_fG #ScyllaDB #Rustlang #Golang #Linux #Kubernetes #techtips

The #P99CONF speakers and attendees always bring it and today was no exception! 🔥 Thank you to everyone who joined the conversation and helped make Day 1 one to remember. We'll be back on October 24 with more great sessions, interactive speaker chats, and networking opportunities. If you aren't registered you can still secure your Day 2 spot, as well as the Day 1 sessions on-demand and 30-day access to all O'Reilly Media digital books. https://lnkd.in/edejH_fG #ScyllaDB