A new Blackwell GPU, GB200 has been introduced which offers upto 20 petaflops of FP4 horsepower. It is the first TEE-I/O capable GPU that helps in protecting sensitive data from unauthorised access in AI models. Its transformer engine uses Blackwell Tensor Core along with TensorRT-LLM for accelerating the inference and training for LLMs and Mixture-of-Experts (MOE) models. The Decompression Engine used helps in accelerating the full pipeline of database queries for the highest performance in data analytics and data science. #nvidia #gpu #gpucomputing #transformermodels #innovation #innovationinengineering
Introducing Blackwell. It’s not a chip; it’s a platform. —Jensen Huang, CEO, NVIDIA Blackwell platform for trillion-parameter scale generative AI. Main features: - AI Superchip, 208B transistors - 2nd Gen Transformer Engine: FP4/FP6 Tensor Core - 5th Generation NVLink: Scales to 576 GPUs - RAS Engine: 100% In-System Self-Test - Secure AI: Full Performance Encryption - Decompression Engine: 800GB/sec The most powerful GPU in the market. Exciting announcement, live from GTC.