🚀 Just attended an insightful webinar on "GenAI Fundamentals with OpenVINO™" by Intel Corporation! 🌟
This workshop is part of the Virtual DevCon Workshop Series and is the first virtual workshop in the latest edition of the OpenVINO™ DevCon series.
The session delved into the future of AI and GenAI, featuring live demos on running large language models (LLMs) locally with OpenVINO™ for smarter, faster inference. 🧠💡
Speakers:
👩💻 Anisha Udayakumar - AI Software Evangelist, Asia-Pacific and Japan, Intel
👩🔬 Paula Ramos - AI Software Evangelist, USA, Intel
👩💼 Ria Cheruvu - AI Software Evangelist, USA, Intel
👨💻 Yury Gorbachev - Intel Fellow , OpenVINO Product Architecture, Intel
Key Takeaways:
⚖️ Balance Between Small and Large LLMs: Understanding the trade-offs and finding the sweet spot for local inference.
🧩 LLM Compression Techniques: Exploring INT8, INT4, and 1-bit models for enhanced performance.
✨ New OpenVINO™ Features: Broader LLM models, Mixture of Experts (MoE) architecture, and memory optimization.
🖥️ Live Demos: Showcasing GenAI deployment on Intel hardware.
🔧 Efficient Deployment: Insights into deploying AI models with OpenVINO™ Model Server and new GenAI workloads.
Optimum Intel : https://lnkd.in/gGxN6zxJ
As GenAI’s sphere of influence expands, it's exciting to see smaller models proving to be as effective as larger ones, offering agility and resource efficiency. Can't wait to explore these advancements further! 🤖✨
Thanks to Intel Corporation for arranging this webinar! 🙏
#AI#GenAI#OpenVINO#Intel#MachineLearning#AIInnovation#TechAdvancements
Greetings connections,
Exciting news from our recent hackathon where my team - Madhenkumar R, Mohamed Aakhil A, Karthikeyan Chintala, and D Harshil Kumar Reddy - collaborated to bring a groundbreaking product to life: an AI-integrated Online Shopping platform.
-Our creation boasts GenAI-powered "personal shoppers" that predict preferences, curate wishlists, and craft hyper-personalized campaigns. One of the standout features is the integration of Stable Diffusion for immersive virtual fitting rooms, eliminating online purchase uncertainty. We leveraged the power of Intel® oneAPI Deep Neural Network Library, incorporating oneDNN to optimize deep learning in Pytorch, achieving superior performance.
-Our deployment of opensource falcon 7b into 4th Gen Intel Sapphire Rapids, coupled with advanced user search tracking and database updates, enables us to personalize user experiences, execute targeted email and ad campaigns based on preferences.
-Special thanks to Kazi Haque for his invaluable assistance. The efficiency gains achieved through Intel components were pivotal in making our vision a reality. #oneapiKavita AroorIntel Software
CEO @Tigon Advisory Corp. | Host of CXO Spice | Board Director |Top 50 Women in Tech | AI, Cybersecurity, FinTech, Insurance, Industry40, Growth Acceleration
Ever had those moments that stick with you, moments you'll never forget?
Well, picture this: Pat Gelsinger dancing at #IntelVision, unveiling the Gaudi 3 AI accelerator. It's like Steve Jobs revealing the iPhone in 2007—pure magic, right? These moments, they're what make history.
Here's what I took away from Intel Corporation’s Gaudi 3 announcement:
✅ Gaudi 3 is a game-changer, plain and simple. It's got 4 times more AI power for BF16 and better memory bandwidth. It's smashing benchmarks left and right, making training 50% faster and inferencing 50% better, all while being 40% more power-efficient comparing to H100.
✅ And it's not just powerful; it's flexible too. Gaudi 3 can scale from one setup to a massive network, all using standard Ethernet. It's easy to integrate into existing systems and grow as needed.
✅ What about deployment? You don't need to be a coding whiz to get it up and running. It plays nice with popular frameworks like PyTorch and community models, so you can hit the ground running.
✅ And here's the kicker: Intel's not just dropping this tech and calling it a day. They're teaming up with OEMs like Dell Technologies, HP, Lenovo and Supermicro to get Gaudi 3 out there. Bharti Airtel, Bosch, CtrilS, IBM, IFF, Landing AI, Ola, NAVER, NielsenIQ, Roboflow, and Seekr are among the new customers and partners adopting Gaudi accelerators.
But the best part? Intel's not just thinking about today; they're setting the stage for the future of AI. Intel aims to create an open platform for enterprise AI in collaboration with SAP, Red Hat, VMware, and other industry leaders. This open platform will accelerate the deployment of secure generative AI systems enabled by retrieval-augmented generation (RAG). By collaborating with industry leaders and pushing for open standards, they're paving the way for secure, cutting-edge AI systems that anyone can use.
So, from PCs to data centers, Intel's on a mission to make AI accessible and powerful for everyone. And with Gaudi 3 leading the charge, it's an exciting time to be in the game.
Stay tuned for more updates throughout this week.
#IntelVision#IntelAmbassador#Edge#Technology#CEO#BoardDirectors
Subscribe to #CXOSpice newsletter (https://lnkd.in/gy2RJ9xg) and tune in for more insights about #IntelVision.
Subscribe to #CXOSpice Youtube channel (https://lnkd.in/gnMc-Vpj) and tune in for the latest episode with Jen Larson at Intel Corporation.
Follow me on X @YuHelenYu (https://lnkd.in/gD9Ti6fJ) to gain additional insights on #Technology and #Innovation
CEOs of #OpenAI and #Intel cite #artificialintelligence's voracious appetite for #processingpower. Two #tech CEOs scrambling to produce more of the sophisticated #chips needed for #artificialintelligence (AI) met for a brainstorming session on Wednesday. The on-stage conversation between #Intel CEO Pat Gelsinger and #OpenAI CEO #SamAltman unfolded in a San Jose, California, convention centre a few hours after Nvidia disclosed its quardrupled revenue for the November-January period. #Intel, a #SiliconValley pioneer that has been struggling in recent years, laid out its plans for catching up to #Nvidia during a daylong conference. Gelsinger kicked things off with an opening speech outlining how he envisions the feverish demand for #AI-equipped chips revitalizing his company in a surge he dubbed the “Siliconomy.” #artificialintelligence#aichips#openai#Intel#AIcompute#aiworkloads
Greetings Connections,
We're thrilled to share the remarkable achievements stemming from the BOLT 2.0 Hackathon at the ic-ETITE'24 Conference, where our dynamic team - comprised of Karthikeyan Chintala,D Harshil Kumar Reddy, Mohamed Aakhil A, and Madhenkumar R-collaborated to unveil a groundbreaking product: an AI-infused E-commerce platform.
At the core of our innovation lies the GenAI-driven "personal consultants" that not only anticipate user preferences, curate wishlists, and craft personalized campaigns but also revolutionize the online shopping experience. A standout feature is our seamless integration of Stable Diffusion, offering users immersive virtual fitting rooms that eradicate uncertainties tied to online purchases.
A significant pillar of our success story is the unwavering support from Intel® and their cutting-edge software. The Intel® oneAPI Deep Neural Network Library, with the incorporation of oneDNN to optimize deep learning in Pytorch, has propelled our platform to achieve unparalleled performance. This synergy between our team's ingenuity and Intel's software prowess has resulted in a product that not only meets but exceeds industry standards.
The deployment of the opensource falcon 7b onto the 4th Gen Intel Sapphire Rapids, coupled with advanced user search tracking and real-time database updates, empowers us to offer users personalized experiences. Intel's software capabilities have not only elevated the functionality of our platform but have also enabled us to execute targeted email and advertising campaigns, finely tuned to individual preferences.
We extend our heartfelt appreciation to Kazi Haque and Kavita Aroor for their invaluable support. The efficiency gains achieved through Intel's robust software components were undeniably pivotal in transforming our vision into a tangible reality, showcasing the immense power and innovation that Intel brings to the table.
#oneapiIntel SoftwareKavita Aroor
Not only Nvidia, but also AMD to set up R&D centers in Taiwan
Report Date: July 27, 2024
Reading Time: 5 minutes
Key Points:
- 💰 AMD to establish a research center in Taiwan with a total budget of NT$8.64 billion.
- 🤝 The project attracts 33 Taiwanese companies to co-develop AI technologies.
- 📈 The initiative is estimated to drive NT$15 billion in new investments and train over 1,000 AI talents annually.
- 🌏 AMD commits to bringing in 50% foreign talent, fostering global innovation.
- 🏢 The Ministry of Economic Affairs subsidizes 30% of the project, approximately NT$2.59 billion.
Summary:
AMD announced the establishment of a research center in Taiwan, with a total budget of NT$8.64 billion, receiving a 30% subsidy from the Ministry of Economic Affairs, amounting to approximately NT$2.59 billion. The project will develop cutting-edge AI hardware and software technologies and promises to introduce 50% foreign talent to enhance global research and innovation. AMD's open-architecture GPU and AI software platform have attracted 33 Taiwanese companies to participate in the research and development, estimated to drive NT$15 billion in new investments and train over 1,000 AI talents annually. The cooperation, initiated in August 2023, involved extensive discussions and reviews, culminating in a finalized agreement in July 2024. This initiative not only strengthens Taiwan's competitiveness in the semiconductor industry but also contributes to the global advancement of AI technologies.
#AMD#research center #Taiwan#AI technology #new investment #Nvidia
Source:
不只輝達!AMD研發中心落腳台灣 總經費破86億
https://lnkd.in/gUkmSTMT
Nvidia R&D center project in Taiwan on schedule: economic official
https://lnkd.in/gjxAYM6r
Advanced Micro Devices to set up an R&D center in Taiwan, ministry says
https://lnkd.in/g8Sa8Kfe
Riding on the AI PC whirlwind, Intel’s new CPU goes into battle and is said to be the fastest on the planet
Intel has launched a new series of central processors, including the HX series aimed at AI PCs, which is said to be the fastest CPU on the planet. The new processors support Thunderbolt 5 and high-speed transmission specifications, and major brand manufacturers are optimistic about the business opportunities and have announced the launch of new terminal machines equipped with Intel's new processors. The three major chip giants, including Intel, are aggressively launching AI competition to promote new products, and the global economy is expected to recover and get rid of inventory reduction in 2024.
#AI#Taiwanhttps://lnkd.in/g_3nkQZB
Focused on our mission to bring #AIEverywhere, Intel works closely with the ecosystem investing in AI software and hardware solutions. In that direction, we are proud to share our latest partnership with Microsoft to enable our AI platforms, such as Intel Gaudi AI accelerators and Intel Xeon and Intel Core Ultra processors, to accelerate their open GenAI Phi-3 models.
The Phi-3 family of small, open models can run on lower computing power hardware, be tuned to meet specific demands, and allow developers to create applications that can run locally, representing a massive integration to our AI product portfolio.
Know more about this work here: https://lnkd.in/eKQ9ZZdK#IAmIntel#AIEverywhere#GenAI
We build Embedded Hardware and Software | Empowering businesses to build innovative products | Want to build high performance embedded systems? Get in touch today
Intel AI Summit yesterday at Munich
One key takeaway for me was that
Intel Corporation can compete in the one horse GPU race ...
As the CEO of Creative Insights Technologies GmbH, I had the privilege of attending the recent #intelaisummit yesterday. The objective? To show the world that Intel Corporation has SW and HW tools to compete with the like of NVIDIA. GIVEN that the intel compiler tools are used to optimise for intel HW.
Thanks for the chat Martha Ivanovas (after almost a year again!), who the Intel Ignite team says is the pedal power behind the cohorts!
Here are some insights from the event:
The keynote from Holger Banzhaf from DeepScenario unraveled the scope of video data in autonomous transport. The #IntelIgnite alum, known for computer vision AI, merges data from varying sources for automated system supervision. A testament to startups' role in driving AI technology forward.
Prediction Guard presented their prompt sanitizing technology which also uses Intel HW to gain massive performance advantage!
Vishwa Mohan Singh (Dimensify) presented their innovative platform harnessing the power of Machine Learning, combining NeRF and Stable Diffusion techniques to create immersive 3D content like never before.
Stephan Gillich (Head of EMEA AI Center of Excellence, Intel Corporation) talk centred on Intel's AI suite and portfolio, with an emphasis on Intel® Tiber™ Developer Cloud. An essential resource for AI solution developers.
@BjoernTaubert (Software Engineering EMEA, Intel Corporation) talked about AI PC where Intel Corporation introduces NPU, CPU and GPU all in one silicon die.
OpenVINO toolkit is the SW of choice to compile your AI workloads to the respective optimized core.
𝗖𝗣𝗨 - Fast Response (Ideal for low-latency AI workloads)
𝗚𝗣𝗨 - Low Power (Ideal for sustained AI workloads and AI offload for battery life)
𝗡𝗣𝗨 - High Throughput (Ideal for AI accelerated digital content creation)
With great food and drinks as always at #intelignite met a really interesting founder Arya Mazaheri (Founder of PanocularAI). He explained to Alois Eder and I about how they want to bring AI to low power ARM cores. Which coincidentally is also the strength of Creative Insights Technologies GmbH
Many memorable conversations! That was my Intel AI Summit. What about yours?
NVIDIA faces a formidable challenge in the AI chip market as a coalition of tech giants, including Qualcomm, Google, and Intel Corporation, unite under the UXL Foundation to disrupt Nvidia's dominance.
Spearheading an open-source initiative, they aim to develop a suite of software tools capable of running AI applications across diverse accelerator chips, directly targeting Nvidia's proprietary ecosystem, as reported by Reuters.
The UXL Foundation, supported by Intel's OneAPI technology, seeks to democratize AI development, promoting productivity and hardware choice within a collaborative, open ecosystem.
Do you really believe these companies actually keen on democratizing AI hardware? Or is this just a move to disrupt a looming threat to their continued dominance of the tech sector?
_______________________________
Get up to speed on the latest developments in tech with our newsletter:
https://lnkd.in/dgR5-YPx#techbuzz#techbuzzventures#innovation#technology#ai#aihardware#aicommunity#generativeai#artificialintelligence#nvidia#qualcomm#intel#google#machinelearning#llms