TrendForce Corporation’s Post

🔥 Here's what happened in #AI this week: ➡ NVIDIA, AMD, and Intel Corporation all made announcements at #Computex 2024 in Taiwan that represent a revolution in computing and the next era of AI hardware! ➡ These include NVIDIA's new Rubin platform, Intel's Xeon 6 and Gaudi 3 chips, and AMD's Instinct chips. Learn more in this week's newsletter! #nvidia #machinelearning #gpu

Could AMD challenge NVIDIA’s dominance in accelerated computing and AI chips? It surely is making an attempt. AMD is unifying its consumer-focused RDNA and data center-focused CDNA architectures into one microarchitecture called UDNA. This move aims to tackle Nvidia's dominant CUDA ecosystem more effectively. UDNA will enable AMD to simplify development and improve software compatibility across consumer and data center GPUs. AMD is also prioritizing forward and backward compatibility to avoid losing optimizations in future generations of chips. AMD’s UDNA could also bring much-needed full-stack support for tensor operations, crucial for AI workloads, to consumer GPUs, leveling the playing field against Nvidia's tensor core-equipped offerings. Only time will tell who wins the trillion-dollar upgrade of computing infrastructure. The race is on and no company wants NVIDIA to gain any further lead. Will they succeed? What do you think? #AMD #UDNA #AI #AcceleratedComputing #GPUs #Nvidia #innovation #genAI

Nvidia and Intel promote their support for Meta Llama 3 genAI LLM. Intel and Nvidia vie for dominance in supporting Meta's latest large language model, Llama 3, reflecting the competitive landscape of the HPC market. Intel, positioning its Gaudi accelerators and Xeon processors, emphasizes enhanced AI capabilities with Llama 3. Performance tests show significant improvements, with Xeon 6 processors achieving faster inference latency compared to previous generations. Nvidia’s take on Llama 3 Nvidia joins the competition with its TensorRT-LLM software library, enhancing inference performance on Nvidia GPUs for Meta's new LLMs. Intel's CEO acknowledges Nvidia as a strong competitor amidst the launch of Intel's Gaudi 3 GPU and Nvidia's latest Blackwell GPUs. Despite Nvidia's dominant market share, Intel's rapid support for ecosystem developments signals its determination to catch up, potentially gaining share this year. Nvidia's TensorRT-LLM significantly boosts LLM inference performance on its GPUs, contributing to its success in MLPerf testing. Support for Meta Llama 3 is seamlessly integrated into Nvidia's AI platform, offering flexible deployment options across various environments. #Nvidia #Intel #MetaLlama3 #GenAILLM #HPC #Competition #AI #GaudiAccelerators #XeonProcessors #TensorRTLLM #GPU #InferencePerformance #BlackwellGPUs #MLPerf #AIPlatform #TechCompetiton #AIInnovation #HardwareSupport #AIInfrastructure #TechLeadership #MarketShare #TechTrends #AIHardware #GPUPerformance #MLM #InnovationRace #AIecosystem #MLDevelopment #TechIntegration #DeepLearning #AIProgress #MLResearch

Micron has announced that its high bandwidth memory (HBM) production capacity for 2024 has already been sold out, and orders for 2025 are almost filled. During its conference call for its Dec-Feb quarter, the company revealed that its latest HBM3E chip will be used in Nvidia H200 and is being qualified by other customers. According to Micron, customers have reported that its chips consume 30% less power than its competitors Samsung and SK Hynix, which is great news for Micron as it continues to lead the way in HBM technology. #micron #chips #memorychips #chipmaker #hbm #technology #nvidia #semiconductors #semiconductorindustry #semiconductormanufacturing #technology #innovation #technologynews

💥 Hinting at a strong competitive stance against NVIDIA? AMD's latest AI chip, the MI325X, is claimed by CEO Lisa Su to be better in both performance and bandwidth compared to NVIDIA's H200! Moreover, AMD even projects to release a new generation of AI chips annually! 🔎 In addition, Su also shared the projected schedules for the MI350 and MI400, expected in 2025 and 2026, respectively. 💡 Explore more details on Su’s updated AMD’s dynamics here: https://buff.ly/3V6en7x 🔗 #AMD #MI325X #Semiconductor #NVIDIA #H200

TSMC's chip-on-wafer-on-substrate (CoWoS) production capacity has been exceeded by demand, leading the company to double its capacity by the end of 2024. But this has not stopped Nvidia, which is reportedly tapping Intel's advanced packaging technology, in addition to TSMC's, to ship as many of its high-demand AI processors as possible. According to a report, the deal is purportedly for 5,000 wafers per month. If true, this would equate to 300,000 of Nvidia's H100 chips per month. #nvidia #techgiants #chips #chipmaker #aichips #gpus

An AI Chip just beat Nvidia, AMD and Intel! Integrating 44GB of SRAM and built upon a wafer scale engine, this massive chip incorporates 4 trillion transistors and Cerebras Systems claims to be 20x faster than Nvidia's GPU's. Removing the need for external memory reduces the significant bottle neck caused, allowing the chip to deliver a huge 1,800 tokens per second for Llama3.1 8B. What other benefits can you see AI bringing to technology market? #Nvidia #AMD #Intel #Chipset #ChipEngineering #AI #AIEngineering

AI Chip Giants Nvidia and AMD Ride High on Analyst-Driven Optimism #AI #AIdatacenterchips #AIpoweredchips #AMD #AMDchallengesNvidia #artificialintelligence #Barclays #Electronics #KeyBanc #llm #machinelearning #Marketdominance #marketshare #mostvaluablechipmaker #Nvidia #Nvidiasstockrecordhigh #positiveoutlook #pricetargethikes #sharessurge #stockpricetargets #supplyconstraints #Techgiants #WallStreetanalysts

📣 Heads up, #AI enthusiasts! #Intel had something cooking - 🫕- meet the... 🥳 𝔾𝕒𝕦𝕕𝕚 𝟛 - 𝔸𝕀 𝕒𝕔𝕔𝕖𝕝𝕖𝕣𝕒𝕥𝕠𝕣 👨🍳 ⚡ Promising 4x the AI compute power and 1.5x more memory than its predecessor 🤯 50% faster in training and inference as compared to the #Nvidia H100 🌏 Going green! In-built Ethernet ports cut the need for extra networking hardware. Eco-friendly and efficient! 🍃 💡 What's unique? #Gaudi3 rocks a chiplet-based design for easier manufacturing and more design flexibility 💵 𝔹𝕦𝕕𝕘𝕖𝕥-𝕗𝕣𝕚𝕖𝕟𝕕𝕝𝕪 & 𝕡𝕠𝕨𝕖𝕣𝕗𝕦𝕝! 💪 💰 Bang for your buck! Offering better efficiency than Nvidia's H100 but at a lower price. 🍒 And the cherry on top? Intel plans to merge Gaudi with their Xeon Max GPU series into a new product portfolio, Falcon Shores! 🎉 ✅ Discover more ✅ 1. Intel Gaudi Software: (t.ly/Intel/Rpowu) 2. NVidia Competition: (t.ly/vLfee) 3. Gaudi 3, 2 1 Comparison: (t.ly/8uk8s) #DeepLearning #ArtificialIntelligence #PyTorch #HuggingFace

🔥 The battle of AI chips between NVIDIA and AMD is more intense, as the total number of their AI high-performance chips for TSMC in 2024 is anticipated to reach 3.5 million units. 📊 Notably, AMD has challenged NVIDIA’s position with its MI300 series product, which have already begun shipping. 🌟 To counter, NVIDIA also has upgraded its product line for new products like B100 and GB 200, utilizing TSMC’s 3nm process. Learn more behind the battle here: https://buff.ly/48LiFq1 .