G.M.S.C. Consulting’s Post

Name: Challenges for multimodal AI
Uploaded: 2024-03-21T12:00:19.935Z
Channel: G.M.S.C. Consulting

View organization page for G.M.S.C. Consulting, graphic

610 followers

7mo

What does it take to build a versatile AI solution? One that responds to different kinds of input and not just text? In this clip, podcast episode 12 guest Duarte O. Carmo describes one approach to creating multimodal AI systems, and the challenges one can expect in the process. ▶ Watch on to learn more about this type of AI and how it may be the perfect fit for your business. 👉Want to hear the rest of the episode? Click here https://lnkd.in/dGBCUmxb #multimodalai #techpodcast #artificialintelligence #productmanagement

Transcript

One of the areas that we can talk about is that, yeah, fine, multimodality is great, everything unicorns and rainbows. But at the end of the day, all of the the modalities, either it's images, audio, video, whatever, it all is text, right? So we can look at an image and say and ask a model, hey, write a caption for this image. We can look at a video and we say, OK, a video is just thousands of images and then we'll just write a description for each one of those. Thousands of images and look at an audio and we say OK audio, audio is great, we can just transcribe that audio and then we have text represent audio and we can do the same thing for video. We'd like the audio and the video part. So the idea here is that we can reduce everything to text which is also has some great parallels of how kind of these GP2 even before vision models are trained. This is a way of looking at it Gabrielle and and of course one of the challenges that OK, great now you have 12 models instead of just one now. Are you having to have a model that's only like can create captions of images, can transcribe, and model that can do all of these different models in? This creates several challenges.

To view or add a comment, sign in

More Relevant Posts

Open Data Science Conference (ODSC)

140,143 followers
3w
Report this post
It’s another one for the books! We’ve an incredible conversation with Jason Lopatecki, CEO and Co-Founder at Arize AI, to share with you on the ODSC’s Ai X Podcast! In this episode, you’ll dive deep into evaluation, challenges and possibilities, for LLMs, AI Agents, and RAG. Get ready to explore: ✅ Challenges: Primary challenges for evaluating GenAI, Foundational Models, AI Agents, and Agentic AI ✅AI Agents: Breaking them down into manageable components, Control Flow, evaluating individual actions ✅RAG: Evaluation and ensuring retrieved information is accurate and relevant Don’t miss this chance to dive deep into the ins and outs of GenAI evaluations. 🎧 Listen Now: https://linktr.ee/odsc #AI #Podcast #ODSC
Like Comment
To view or add a comment, sign in
Open Data Science Conference (ODSC)

140,143 followers
3w
Report this post
It’s another one for the books! We’ve an incredible conversation with Jason Lopatecki, CEO and Co-Founder at Arize AI, to share with you on the ODSC’s Ai X Podcast! In this episode, you’ll dive deep into evaluation, challenges and possibilities, for LLMs, AI Agents, and RAG. Get ready to explore: ✅ Challenges: Primary challenges for evaluating GenAI, Foundational Models, AI Agents, and Agentic AI ✅AI Agents: Breaking them down into manageable components, Control Flow, evaluating individual actions ✅RAG: Evaluation and ensuring retrieved information is accurate and relevant Don’t miss this chance to dive deep into the ins and outs of GenAI evaluations. 🎧 Listen Now: https://linktr.ee/odsc #AI #Podcast #ODSC
Like Comment
To view or add a comment, sign in
Dave Gulas

Warehousing. Fulfillment. Transportation. | Helping E-Commerce Brands Scale | 🎙️ Host of Beyond Fulfillment Podcast
5mo
Report this post
Can AI Ever Leave Genuine Comments? This podcast episode featuring Zsike Peter 🧛🏻♀️'s explores the future of AI & the challenges of replicating human connection online. Listen to the full episode here: https://lnkd.in/ekG86Hne #AI #futureofwork #podcast #aitech #aicontent #onlinemarketing #bots

2 Comments
Like Comment
To view or add a comment, sign in
DEPT®

120,023 followers
5mo Edited
Report this post
Standing out in today’s marketing industry means taking the plunge into AI. But, if everyone is using AI, is anyone REALLY standing out? More in the latest episode of The Drum’s Network Podcast, featuring our own Isabel Perry: dept.ly/AIPod-LI As focus shifts from digital transformations to AI transformations, the secret to success isn’t whether or not you can tack the “Powered by AI” label onto your brand… It’s how creatively you apply it. Fortunately, AI happens to be the perfect tool for figuring that out. #AITransformation #AIStrategies #Podcast #CreativeProcess #AI
1 Comment
Like Comment
To view or add a comment, sign in
Innovation and The Digital Enterprise Podcast

431 followers
8mo
Report this post
🎙️ Exciting news! Our upcoming podcast episode, dropping this Thursday, features Maya Mikhailov, CEO and Founder of Savvi AI. Join us as Maya delves into the realm of machine learning, separating the hype from practical business solutions. Trust us, you won't want to miss this insightful discussion! #MachineLearning #Podcast #AI #ArtificialIntelligence #AILeaders #Innovation #InnovationLeaders
Like Comment
To view or add a comment, sign in
Jimi Allen

I provide high production value while coaching and publishing your expertise at scale.
4mo
Report this post
Meet Quentin Reul, the mastermind behind innovative AI tools. In a recent podcast episode, he emphasizes the importance of focusing on problems rather than solutions. Quentin warns of an impending intersection where understanding is key to control. #AI #Innovation #PodcastEpisode

2 Comments
Like Comment
To view or add a comment, sign in
Chris Daigle

ChiefAIOfficer.com | AI Strategy & Implementation for Mid-Market & Portfolios | AI Training & CAIO Certification - Become the AI expert in Your Company in 8 Weeks or less
1mo Edited
Report this post
Start using AI as your thought partner and take problem-solving to the next level. In the latest episode of the Using AI at Work podcast, Geoff Woods shares how AI can simulate real-world interactions to help you refine your approach. Want approval from your CFO? Have AI simulate their response to your plan. AI lets you tap into expert perspectives, making you far more effective in your role. Ready to level up your problem-solving?

2 Comments
Like Comment
To view or add a comment, sign in
Using AI at Work

175 followers
1mo
Report this post
Start using AI as your thought partner and take problem-solving to the next level. In the latest episode of the Using AI at Work podcast, Geoff Woods shares how AI can simulate real-world interactions to help you refine your approach. Want approval from your CFO? Have AI simulate their response to your plan. AI lets you tap into expert perspectives, making you far more effective in your role. Ready to level up your problem-solving?

1 Comment
Like Comment
To view or add a comment, sign in
ChiefAIOfficer.com

2,441 followers
1mo
Report this post
Start using AI as your thought partner and take problem-solving to the next level. In the latest episode of the Using AI at Work podcast, Geoff Woods shares how AI can simulate real-world interactions to help you refine your approach. Want approval from your CFO? Have AI simulate their response to your plan. AI lets you tap into expert perspectives, making you far more effective in your role. Ready to level up your problem-solving?

1 Comment
Like Comment
To view or add a comment, sign in
Nick Borelli

Empowering Event Pros With AI
2mo
Report this post
Listen for practical ways AI can be leveraged to accomplish your event goals!
eSpeakers

2,920 followers
2mo

Trending topic! 🔥 Nick Borelli teaches event planners the benefits of using AI with human creativity. Find out how he saves time and pushes the envelope with AI by his side. 👨💻 — Listen now to his episode on eSpeaker’s No More Bad Events podcast hosted by Scott Bloom! https://lnkd.in/gMJFt4Pv — #eventprofs #podcast #AI #AIexpert #AIbenefits #eventplanning #eventmanagement #eventtech
Like Comment
To view or add a comment, sign in

610 followers

View Profile Follow

G.M.S.C. Consulting’s Post

Challenges for multimodal AI

Transcript

More Relevant Posts

Explore topics