Myrat Matsapayev’s Post

Green cards are not the only solution in the market....... With Intel's AMX (Intel Advanced Matrix Extensions), scalable Xeons can deliver higher machine learning compute performance for both Training and Inference. Ask me what an Xeon is capable of. #iamintel #ai #inference #gpu

Do you know, that our Xeon CPUs can replace GPU in some of the cloud workloads? GCP C3/H3 instances are perfect match for your #AI inference workloads and not only... Feel free to contact me, if you want to know more 😎 #IamIntel #Xeon #GoogleCloud

Nice to see a public mention of a customer moving from GPU to Intel Xeon. I see this dozens of times a week. GPU shortages may be the reason to initially consider CPUs. Once we engage, the customer realizes that they need the right compute fit for the AI workload demand. Most enterprise task specific models can be fine tuned in minutes-to-hours and achieve most inference latency targets on 4th Generation Intel Xeon Processors with Intel’s AI SW Suite #intel #ai #artificialintelligence #artificialintelligenceforbusiness #xeon #machinelearning #deeplearning

Stay tuned to this channel for ongoing updates from #gtc24. SiliconANGLE & theCUBE has covered our free, open source fractional #gpus and new orchestration capabilities -- read the article here: https://lnkd.in/gZy43ZRv #ai #genai #generativeai #gai

"I have a GPU. Why do I need an NPU?" Well known LLMs such as ChatGPT often use GPUs from Nvidia to perform inference in the cloud. And your PC or smartphone will always include a GPU. Nvidia has been successfully turning its GPUs into devices that are highly effective accelerators for machine learning training and inference. It has done this through the development of both a high-quality software ecosystem (centered on #CUDA) and through the refinement of its hardware, including adding specialized tensor matrix multiplication units to its GPUs. Other GPU designers have either not done this or have been much less effective in doing so. Plus the GPU on your PC or smartphone is already needed to perform its original function: drawing images on your display. What happens if your device needs to draw some complex graphics and perform machine learning at the same time? Having a separate NPU removes this potential contention. #GPU #npu #llm #AI NVIDIA https://lnkd.in/dPckEKfF

** Gaudi 2 Shows Promise for AI! #Intel oneAPI Paying Off (Early Look)** Intel's Gaudi 2 is beginning to show promise for AI workloads as the hardware and OneAPI efforts finally paying off. Still lots of work to do here but here is a link from Databricks that that gives more details of LLM training on Gaudi. https://lnkd.in/gwQuBQTj #iamintel #AI #intel #gaudi #oneapi

In our most recent blog, we take a deep dive into the world of GPU clusters, explore what they are, why they matter, and how Redapt can help you harness their full potential. Read our blog now: https://hubs.li/Q025052r0. #GPU #AI #Blog

Gaudi2 is leaving nothing but dust to A100, and just a little behind H100. MLPerf inference benchmark #ai #deeplearning #genai https://lnkd.in/g6m_stzj