Jarosław Jendrysko’s Post

Green cards are not the only solution in the market....... With Intel's AMX (Intel Advanced Matrix Extensions), scalable Xeons can deliver higher machine learning compute performance for both Training and Inference. Ask me what an Xeon is capable of. #iamintel #ai #inference #gpu

Nice to see a public mention of a customer moving from GPU to Intel Xeon. I see this dozens of times a week. GPU shortages may be the reason to initially consider CPUs. Once we engage, the customer realizes that they need the right compute fit for the AI workload demand. Most enterprise task specific models can be fine tuned in minutes-to-hours and achieve most inference latency targets on 4th Generation Intel Xeon Processors with Intel’s AI SW Suite #intel #ai #artificialintelligence #artificialintelligenceforbusiness #xeon #machinelearning #deeplearning

Multiplying development of AI x10

Retrieval-augmented generation Billed as a technique for cutting down on #AI “hallucinations” or inaccuracies, retrieval-augmented generation lets a #generative #AI model check its work against external resources such as research papers or articles. #RAG appeals to enterprise customers because it increases the reliability of generated content. https://lnkd.in/eJSdr8JS

"I have a GPU. Why do I need an NPU?" Well known LLMs such as ChatGPT often use GPUs from Nvidia to perform inference in the cloud. And your PC or smartphone will always include a GPU. Nvidia has been successfully turning its GPUs into devices that are highly effective accelerators for machine learning training and inference. It has done this through the development of both a high-quality software ecosystem (centered on #CUDA) and through the refinement of its hardware, including adding specialized tensor matrix multiplication units to its GPUs. Other GPU designers have either not done this or have been much less effective in doing so. Plus the GPU on your PC or smartphone is already needed to perform its original function: drawing images on your display. What happens if your device needs to draw some complex graphics and perform machine learning at the same time? Having a separate NPU removes this potential contention. #GPU #npu #llm #AI NVIDIA https://lnkd.in/dPckEKfF

The reason why Intel Corporation is talking about its pricing is simple: Gaudi demonstrates good value for the dollar as well as competitive performance. As a reminder, the AI accelerator that offers the best price/performance is the one you can actually get. Secondly, if the AI accelerator you can get can do matrix math at a reasonable mix of precisions - and if it can run the PyTorch framework and the Llama 2 or Llama 3 model - that choice is the one you make. #supermicro #Intel #gaudi #AI #GPU #PyTorch Source: https://lnkd.in/gGiNj7zP

Discover the future of AI with AMD! 🚀 Dive into the MI300 family, strategic partnerships, and how it's reshaping the tech landscape. #ai #innovation #amd Read More: https://lnkd.in/dFZw2xKZ

AI Power Consumption: Rapidly Becoming Mission-Critical https://lnkd.in/gwXpEkPw #AI