CentML

One of my favourite episodes yet with Gennady Pekhimenko the CEO and Co-Founder of ⁠CentML! Also, his first podcast focused on CentML. Gennady is also an Associate Professor at the University of Toronto and a Faculty Member at ⁠Vector Institute⁠. We discussed... -Genesis of CentML - from academia to industry -Commercializing university research -Tailwinds behind AI and market opportunities -Three Pillars of AI - models, data and hardware -Enterprise adoption of AI - trends and insights -The future of AI models - commoditization vs. innovation -Raising $30M+ from Gradient, Radical Ventures, Deloitte Ventures Canada, NVIDIA, Thomson Reuters Ventures and more -Attracting talent - competitive AI job market -The UofT AI talent pool with Geoff Hinton, Raquel Urtasun, Aidan Gomez, Ilya Sutskever and many more -What the federal government should do with the $2.4B in AI funding -Why compute in Canada is critical to our AI success -The role of Vector Institute -Personal growth as a CEO and constantly learning CC - Salim Teja, Jonathan Wolkin, Raquel Urtasun, Aidan Gomez, Vaneezeh Siddiqui, Darian Shirazi, Ilya Sutskever Thank you Akbar Nurlybayev for making this happen!

Have you heard? CentML’s CServe is now available as a Snowflake Native App! 🐻❄️🩵  https://lnkd.in/gm_APhx3 In our new blog, you’ll learn how to deploy your applications on Snowpark Container Services. Here’s a glimpse at how it works: → Push Your Docker Image: Start by uploading your container image to the Snowflake image repository. → Create Jobs or Services: Configure long-running services or jobs with Kubernetes-style specifications to run on Snowflake Compute Pools. → SQL Integration: Wrap your service into a SQL-accessible function for seamless execution within Snowflake. With CServe on Snowflake, you’ll be ready to harness LLMs while leveraging Snowflake’s secure, scalable infrastructure! #Snowflake #LLMs  #AIdevelopment  #MLoptimization  #CServe

The CentML team is thrilled to introduce ‘Sylva’, a groundbreaking method for developing high-performance enterprise LLMs! 😎🦾 https://lnkd.in/gPNc5YxV Sylva sets a new benchmark in AI adaptability, delivering superior performance: → 5.1x speedup over ZeRO and 1.2x speedup over LoRA method → Comparable quality to full fine-tuning → No additional inference overhead We can't wait to see Sylva help enterprises rapidly and efficiently fine-tune powerful models ⚡ #LLMs #AIdevelopment #MLdevelopment #AIinnovation #MLinnovation

Heading to Snowflake World Tour Toronto next week? ❄️👋 CentML co-founder Akbar Nurlybayev will be discussing the ‘Top Architectural Patterns for SPCS’. Let's connect! Learn more → https://lnkd.in/gnQ4pSd6 #SnowflakeTour #DataCloud #SnowflakeToronto #SnowflakeWorldTour

We are happy to announce that the team's latest paper — featuring the new Tally GPU sharing method — was accepted by ASPLOS! https://lnkd.in/gg5Edp9s We’re excited that the team’s work is being recognized by a renowned organization like ASPLOS, and we can’t wait to see how Tally will help address critical AI challenges. Key features of Tally: → Efficient task management and prioritization without interference from other jobs → Seamless integration into existing GPU setups with no changes needed → Versatile usage across many different applications. #MLresearch #AIresearch #AIengineers #MLengineering #ASPLOS2025 🎓 University of Toronto

We are happy to announce that the team's latest paper — featuring the new Tally GPU sharing method — was accepted by ASPLOS! https://lnkd.in/gg5Edp9s We’re excited that the team’s work is being recognized by a renowned organization like ASPLOS, and we can’t wait to see how Tally will help address critical AI challenges. Key features of Tally: → Efficient task management and prioritization without interference from other jobs → Seamless integration into existing GPU setups with no changes needed → Versatile usage across many different applications. #MLresearch #AIresearch #AIengineers #MLengineering #ASPLOS2025 🎓 University of Toronto

In yet another achievement showcasing our team’s commitment to building a world class LLM and GenAI hosting platform, we’re proud to announce CentML’s SOC 2 compliance attestation. This milestone reflects our dedication to delivering secure, reliable, and compliant AI/ML software to our clients. I want to send a big thank you to our team and our partners for ensuring our platform meets the highest standards of trust and security. I’ve said it before and I’ll say it again, we’ve got some of the most talented, hardworking AI/ML professionals at CentML, and I couldn’t be more excited to continue delivering innovative solutions with them, all while prioritizing the protection of our clients’ data. #SOC2 #Compliance #Security #AI #ML #CentML

I couldn’t be more excited to welcome Tatiana Shpeisman to the CentML team! As we look to drive new innovation across the AI and machine learning industry, we’re thrilled to enhance our team with Tatiana’s invaluable AI and ML engineering expertise, drawn from her experience with industry leaders like Intel, Google, and Modular. Her foundational knowledge and leadership is exactly what will propel CentML into its next growth phase. It’s a privilege and an honour to have someone join us with so many key contributions in the compiler space, specifically with machine learning systems (MLSys) and seminal contributions to the MLIR at Google, as well as previous contributions to Java runtime optimization and transactional memory. Spanning more than two decades across AI, ML, software engineering, programming, and research, Tatiana comes to us with a wealth of experience and numerous career accomplishments. Please join me as we extend a warm welcome to our new colleague. See this short blog post: https://lnkd.in/ercXmXH6 for more details. #centml #hiring #ai #ml #compilers

We are thrilled to announce that Tatiana Shpeisman has joined the CentML team as Director of Engineering! As a leading AI/ML researcher and innovator, Tatiana will help guide the CentML team in taking ML and AI innovation to new heights 🚀 From driving groundbreaking research at Intel to leading next-gen compiler infrastructure at Google, Tatiana brings over two decades of deep experience to the CentML team — please join us in welcoming her! 🔗 Read more about Tatiana over on the blog → https://lnkd.in/gcrcAtky #AIengineering #MLengineering #CentML #AIinnovation #MLinnovation

CentML’s first Snowflake native app has launched with a 30-day discount! ❄️💚 https://lnkd.in/g-pUd-J3 Using CentML CServe to self-host Mixtral-8x7b on Snowpark Container Services, you can: → Lower compute costs by 81% → Ensure top-tier security and privacy → Get flexible model support Take your AI projects to new heights with CServe on Snowflake ⚒️ #Snowflake #LLM #AIdevelopment #MLoptimization #CServe