Muchiu (Henry) Chang, PhD. Cantab (Cambridge, UK)’s Post

This is will revolutionise AI eco system. Enterprises will have to adopt Chips to enable AI capability to the fullest..

Very interesting! (🧙♂️*🤖)*NVIDIA=🚀😀!! El regalo perfecto para el Día del Padre !! y el Día de la Madre (en mayo) !!  Introducing Blackwell. It’s not a chip; it’s a platform. —Jensen Huang, CEO, NVIDIA Blackwell platform for trillion-parameter scale generative AI.  Main features: - AI Superchip, 208B transistors - 2nd Gen Transformer Engine: FP4/FP6 Tensor Core - 5th Generation NVLink: Scales to 576 GPUs - RAS Engine: 100% In-System Self-Test - Secure AI: Full Performance Encryption - Decompression Engine: 800GB/sec The most powerful GPU in the market. Exciting announcement, live from GTC. -- Os dejo un link a una noticia muy interesante relacionada: https://lnkd.in/dyp7Hrn6

🔥What a remarkable achievement for NVIDIA - 𝗧𝗵𝗲 𝗻𝗲𝘄 𝗕𝗹𝗮𝗰𝗸𝘄𝗲𝗹𝗹 𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺 𝗮𝗻𝗱 𝗚𝗕𝟮𝟬𝟬: • 1000X AI compute in 8 years. • First machine exceeding 1 exaFLOP in one rack. • LLM inference improved by up to 30 times comparing with the Hopper (previous generation). • Training a 1.8 trillion parameter model would have previously taken 8,000 Hopper GPUs and 15 megawatts of power, while today 2,000 Blackwell GPUs can do it while consuming just 4 megawatts for the same two months period. 📌 𝙼𝚘𝚜𝚝 𝚖𝚎𝚖𝚘𝚛𝚊𝚋𝚕𝚎 𝚖𝚘𝚖𝚎𝚗𝚝: Jensen: "This is what makes it possible. That's the back of DGX (supercomputer in a rack). 130tb/sec goes to the back of that chassis. 𝗧𝗵𝗮𝘁 𝗶𝘀 𝗺𝗼𝗿𝗲 𝘁𝗵𝗮𝗻 𝘁𝗵𝗲 𝗮𝗴𝗴𝗿𝗲𝗴𝗮𝘁𝗲𝗱 𝗯𝗮𝗻𝗱𝘄𝗶𝗱𝘁𝗵 𝗼𝗳 𝘁𝗵𝗲 𝗶𝗻𝘁𝗲𝗿𝗻𝗲𝘁." Audience: ... Audience: *𝘍𝘪𝘯𝘢𝘭𝘭𝘺 𝘳𝘦𝘢𝘭𝘪𝘻𝘦𝘴* Starts clapping. ❓Considering this breakthrough, how do you foresee the future direction of #generativeai?

Everyone talks about data. Data is the new oil. However, no one talks about how to compute that data. What Nvidia focused on, its computation unlike other competitors, is really commendable. Not only in hardware, but they're also expanding vertically by creating their own open-source frameworks and toolkits in fields such as ASR, TTS, NLP, Vision, and generative AI, which one can use to train their customized models using their GPUs. Additionally, they're collaborating with industries to increase productivity. No surprise that its shares have given more than 100% return in just 6 months, over 250% return in a year, and more than 1900% return in 5 years. Interestingly the return of Bitcoin in one year is 130%, and in 5 years, it's more than 1700%. It's no surprise that as crypto transactions increase, more mining is done, and more GPUs are required, ultimately increasing their value. If you see, the return of Nvidia and Bitcoin almost go hand in hand. On a lighter note, if you fear crypto investment but are fascinated by its returns, if you're unsure which company will lead in AI in the end, you can at least confidently bet on Nvidia, as all these things require a GPU at the very least.

A new Blackwell GPU, GB200 has been introduced which offers upto 20 petaflops of FP4 horsepower. It is the first TEE-I/O capable GPU that helps in protecting sensitive data from unauthorised access in AI models. Its transformer engine uses Blackwell Tensor Core along with TensorRT-LLM for accelerating the inference and training for LLMs and Mixture-of-Experts (MOE) models. The Decompression Engine used helps in accelerating the full pipeline of database queries for the highest performance in data analytics and data science. #nvidia #gpu #gpucomputing #transformermodels #innovation #innovationinengineering

NVIDIA GB200 Grace Blackwell Superchip: Tailored for the generative AI era. - Core Components: Combines two NVIDIA B200 Tensor Core GPUs with an NVIDIA Grace CPU. - Interconnect Technology: Utilizes a 900GB/s NVLink for high-speed CPU-GPU communication. - Manufacturing Process: Employs a TSMC 4NP custom process. - Transistor Count: Boasts 208 billion transistors, indicating advanced computational capability. - Chip Design: Features a dual-die design connected by a 10TB/s chip-to-chip interconnect. - NVLink Switch: Facilitates the connection of four NVLinks at 1.8TB/s for scalable AI processing. - Strategic Focus: Aims at setting new benchmarks in scalable, efficient AI computing infrastructure.

Ever wished you could run CUDA code on Nvidia GPUs without proprietary constraints? 🤔 Enter LibreCUDA! Dive into open-source freedom and power up your AI projects like never before. Discover more here: https://lnkd.in/gUmthwGz 🚀 #OpenSource #AIRevolution

NVIDIA GTC 2024 is only going to be bigger and bolder this year with high anticipation of next-gen GPUs and generative AI applications. “In six weeks, I am going to tell everybody about a whole bunch of things we are working on – the next generation of AI,” said NVIDIA chief Jensen Huang, last month at the World Governments Summit 2024, referring to the upcoming GTC 2024, that will be held from March 17 to 21 at San Jose, California. Read the complete article to learn more Link in the comments below

Streamdiver's AI-driven video analytics reinvents real-time video stream analysis. But how? ⬇️ By providing actionable insights across various industries. Leveraging Exoscale's advanced GPU instances powered by NVIDIA, Streamdiver achieves unmatched speed, performance, and cost-efficiency. We handle their intensive analytics, harnessing the power of NVIDIA GPUs for real-time data processing. Our partnership ensures scalability and reliability, allowing Streamdiver to seamlessly expand its operations. Want to become a successful Use Case yourself? Contact us right here, right now via link in the comments! . . . #cloudcomputing #videodata #ai #streaminganalytics #exoscale

#NEXCF #NTAR 🎥 ICYMI: Dive into our recent interview with CEO Evan Gappelberg, where he discusses latest advancement: an AI-powered 3D model search engine. Developed by our in-house team and supported by Nvidia's GPUs, this tool efficiently sifts through vast model databases to improve production speeds and meet growing demands. 📈 Discover the impact of this technology on our operations and industry. Watch the full interview here ➡️ https://hubs.la/Q02wGS880 #Nextech3Dai #AI #3DModeling