Cerebras Systems

Cerebras Inference runs Llama 3.1-70B at an astounding 2,100 tokens per second. It’s 16x faster than the fastest GPU solution. That’s 3x faster since our launch just 2 months ago. We can’t wait to help our partners push the boundaries of what’s next. Try it today: https://chat.cerebras.ai/

Last week our partners at Recall.ai launched a new Output Media functionality providing an easy way to build live, interactive AI agents that can listen and react to meetings in real time. Speed is critical to ensure seamless interaction, watch the video below to see the speed of Cerebras Inference in action -  https://lnkd.in/gXt88qFZ

🎉 Cerebras and Tokyo Electron Device, Ltd. (TED) have trained Llama3-tedllm-8B-v1, a proprietary Japanese large-scale language model based on Meta’s Llama3-8B and trained on 173 billion tokens using Cerebras CS-3. This model offers enhanced Japanese language precision with industry-specific adaptation, efficient training powered by Cerebras CS-3, and effective document generation and decision support. Learn more about TED’s advancements in corporate AI in Japan: https://hubs.li/Q02WT2Zw0 Check out Llama3-tedllm-8B-v0 on Hugging Face: https://hubs.li/Q02WSTFG0

"Why does anyone need incredibly fast inference processing that can generate text faster than anyone can read? It’s because the output of one AI can become the input for another, enabling scalable applications for search, self-correcting summarization, and soon, agentic AI." - Karl Freund, Forbes. Cerebras' latest update: 2100 tokens/sec with Llama 3.1-70B – that’s 4 pages per second! This breakthrough is redefining fast, responsive AI applications – pushing far beyond the limits of traditional GPU tech. Read the article here: https://hubs.li/Q02WT0y-0

Come build with us! Cerebras inference is powering the next generation of AI applications — 70x faster than on GPUS. We are so excited to announce the Cerebras Fellows Program, in partnership with Bain Capital Ventures. The fellows program invites engineers, researchers, and students to build impactful, next-level products unlocked by instant AI. Join us for exclusive access to free Cerebras inference, higher rate limits, and more. Learn more at https://lnkd.in/g7bc_Cfp

Andy Hock, Senior Vice President of Product & Strategy at Cerebras Systems with a keynote on "Developing and Deploying Cutting-Edge GenAI with Wafer-Scale Engines". #GenAISummit #GenAISummit2024

October was full of breakthroughs and milestones for Cerebras! Here's a quick rundown: 🚀We announced Cerebras Inference now runs Llama 3.1-70B at an astounding 2,100 tokens per second. This is 16x faster than the fastest GPU solution and 3x the performance that we launched just two months ago.  🎉 Llamapalooza NYC was a hit with over 450+ attendees. 🤝We partnered with the National Energy Technology Laboratory (NETL) following their recent DOE award.  🏆Our partners at Sandia, Lawrence Livermore, and Los Alamos were nominated for the SC24 Gordon Bell Prize for their groundbreaking work in molecular dynamics.   💡Our cutting-edge research on model compression has been accepted at NeurIPS 2024. Follow us to keep up with updates and read the latest newsletter here - https://lnkd.in/gCaG6UQC

Meet Llama-3-Nanda-10B-Chat— a state-of-the-art Hindi language model built in partnership with MBZUAI (Mohamed bin Zayed University of Artificial Intelligence) and Inception. 🪔 10B Parameters 🪔 65B Hindi tokens 🪔 Custom-built tokenizer for Hindi-English language processing, boosting efficiency and reducing latency 🪔 Trained on Condor Galaxy AI Supercomputer, built by Cerebras In GPT-4 evaluations, Nanda scored an average of 8.05 in Hindi text generation quality, leading by at least 3 points over competitors like Qwen2.5-14B-Instruct (4.65), Llama-3-8B-Instruct (3.36), and Nemotron-Hi-4B-Instruct (5.03). The scoring metric (0-10 scale) reflects GPT-4's judgment on how well each model performed in generating quality Hindi text. This margin underscores Nanda's excellence in generating accurate, fluent, and culturally aligned Hindi responses, making it the most advanced Hindi language model available. Read the paper: https://lnkd.in/gizFDRxf

Cerebras Systems we are proud that our CS-3 AI supercomputer is one of TIME magazines best inventions of 2024. Today, our inference speeds for Llama 70B are 70 times faster than NVIDIA running on Microsoft Azure and Amazon Web Services (AWS) Bedrock. In fact, Cerebras Systems inference on LLama 70B is 8 X faster than NVIDIA fastest inference on Llama 3B. Cerebras Systems is 8X faster on a model 23 X larger. How cool is that?