Ellie Yun’s Post

Hands-on with Gemini: Interacting with multimodal AI 💻🎉☁️ Gemini is our natively multimodal AI model capable of reasoning across text, images, audio, video and code. This video highlights some of our favorite interactions with Gemini. Learn more and try the model: https://lnkd.in/gPpf4PGT Explore our prompting approaches here: https://lnkd.in/gbGhWyxB #google #gemini #googlegemini #googleai #artificialintelliegence #lifeatgoogle #googlecloud #vertexai #generatieveai #machinelearning

Top ML Papers Of The Week :rocket: From Google DeepMind's Gemini to improvement over Meta’s Segment-Anything-Model, and more. 🟢 Gemini - is a collection of multimodal models possessing reasoning abilities across various modes like text, images, video, audio, and code. It asserts superiority over human experts on the MMLU benchmark, a widely-used assessment evaluating AI models' knowledge and problem-solving skills. Blog: https://lnkd.in/d9_Zb98B Technical Report: https://lnkd.in/dDDZtd9P 🟢 LLMs on Graphs - is a comprehensive overview that provides a summary of various scenarios in which LLMs are utilized on different types of graphs. These scenarios include implementations on pure graphs, text-rich graphs, and text-paired graphs. Details: https://lnkd.in/dcnC6XZ3 🟢 The Efficiency Spectrum of LLMs - a comprehensive review of algorithmic advancements aimed at improving LLM efficiency. Details: https://lnkd.in/dVZzZw3T 🟢 EfficientSAM - is a lightweight implementation of the Segment Anything Model (SAM) that demonstrates commendable performance while significantly reducing complexity. It achieves this by utilizing masked autoencoders with a parameter reduction of 20 times fewer parameters and achieving a runtime that is 20 times faster than conventional models. Paper: https://lnkd.in/dxEf45Kb #ai #llm

What a week for AI ! During the Google I/O 2024 yesterday, 3 new cutting edge technologies were announced: 🖼 Imagen 3: New image generation model that is more realistic and detailed, with a massive improvement in text rendering. 🎵 Music AI Sandbox: Suite of AI tools to help artists be more creative, allowing them to create instrumental segments from scratch or switch the style of track. 📽 Veo: Video generative AI tool that has impressive detail levels and image quality. The demo is worth watching ! As they become more and more sophisticated, these exciting new technologies are going to have interesting use cases for artists, social media content creators, and marketers. Demo: https://lnkd.in/e3UB_4PC

Love this simple definition from #forrb2bsummit - Generative AI is the technology that lets people converse with big piles of data.

GenAI for the Edge is here! Edge Impulse The fusion between Large Language Models (LLM) with Edge computing is setting a new benchmark in the deployment of AI. Sign up for our latest talk from our Co-Founder and CTO Jan Jongboom on 1st August. Don't miss it! #edgeai #largelanguagemodels #ai #edgecompute

2-minute video (thank you Dovid Schick for sharing): Google DeepMind posted this astonishing demo last month. The tester interacts with a prototype of AI agents supported by Google's Project Astra multimodal foundation model, Gemini. There are two continuous takes: one with the prototype running on a Google Pixel phone and another on a prototype glasses device. The agent takes in a constant stream of audio and video input. It can reason about its environment in real time and interact with the tester in a conversation about what it is seeing. The future is here and the implications far-reaching. #google #deepmind #innovation #ai

David vs Goliath: The AI Underdog Takes Aim! 💪🏽🤖 Meet Molmo, the game-changing open-source multimodal AI model that's taking on the giants of Visual LLM! 🚀 In the battle of Visual LLM, Molmo is David to the industry Goliaths like Google, OpenAI, and Anthropic. But don't underestimate its power! 💥 🙌Slaying the giants: Molmo matches the capabilities of GPT-4, Gemini 1.5 Pro, and Claude-3.5 Sonnet. 🥷Efficient warrior: 72B, 7B, and 1B-parameter variants for flexible deployment. Smart strategy: Trained on 600,000 curated and annotated images, ensuring accurate and conversational results. Molmo's arsenal includes: ✅Visual question answering 🤔: Identify objects, count items, and answer complex questions. ✅Zero-shot actions 🔍: "Points" at relevant image parts and navigates web interfaces. ✅Cross-modal understanding 💡: Seamlessly integrates vision and language. Why is Molmo a game-changer? 😎Democratizing AI 🌎: Empowers developers, researchers, and creators to build AI-powered apps without permission or subscription fees. 😎Disrupting the AI landscape 🌪️: Challenges the notion that only big tech companies can develop state-of-the-art models. Share your thoughts! Can Molmo take down the giants? 💬 #AI #OpenSource #Molmo #Multimodal #ComputerVision #NaturalLanguageProcessing #Innovation #Tech #DavidVsGoliath #VisualLLM https://lnkd.in/gR2eEu5M

What a fantastic February on Vertex AI! 🎉 🔎 You can now query an index from the Vector Search console, making it even easier to validate your retrievals. 🌻 New models have been added to the Model Garden, including Stable Diffusion XL LCM, LLaVA 1.5, PyTorch-ZipNeRF, WizardLM, and more. 🎥 Multimodal Embeddings video support went GA, giving you the possibility to extend your AI applications. ✨ Vertex AI Gemini 1.0 Pro and Gemini 1.0 Pro Vision multimodal language models also went GA! Check out links in the comments to know more 👇🏻 #GoogleCloud #VertexAI #Updates #NewFeatures #Multimodal #VectorSearch #LLMs #NewModels

Personalize your AI experience with webAI. Run cutting-edge Large Language Models across your personal devices, creating a seamless, private cluster. Imagine LLAMA 70B operating smoothly between your Vision Pro and Mac Pro. Unlock the potential of state-of-the-art AI, tailored to your hardware ecosystem.