Samsung unveiled the first Galaxy AI-powered smartphones—Galaxy S24, Galaxy S24+, and Galaxy S24 Ultra—a few days ago. But what is Galaxy AI? It's Samsung's branding for its suite of AI and Generative AI-powered features that help users with creative, lifestyle, and productivity tasks.
What is Galaxy AI? Watch it in our in-depth video below
In our new video, we have showcased all the AI features that are a part of the Galaxy AI suite. Those features include real-time language translation during messaging and voice calls, Interpreter mode for language translation during face-to-face scenarios, and writing style suggestions (via Samsung Keyboard). These features are powered by Google's or Samsung's own LLM models and run using the Exynos 2400 or Snapdragon 8 Gen 3 For Galaxy processors, depending on the model. Some of these features require internet connectivity, but most of them can run completely on-device (without internet).
Circle to Search
Circle to Search with Google is another neat feature. It is an improved version of Google Lens, which lets you circle any part of the screen to search for information about the content that you circled. If you find any book, product, or landmark that you want to know more about, circle it. The Circle to Search with Google pop-up window will find information relevant to it via the internet. It also works by pressing and holding the home button or the dedicated area on the screen to invoke Circle to Search with Google.
AI-powered image and video editing
Galaxy AI also features various image and video editing features. If you have an image that is not level (horizontally or vertically) with respect to the object, scene, or subject, you can correct its angle without losing other parts of the image. The blank parts of that angle-corrected image are filled with Generative AI-powered content. The image editor tries to fill in the blank parts of the image with AI-generated content that suits the best. You can also erase objects or subjects in an image. Another feature lets you select an object/subject in an image and change its position, angle, or size.
It can also turn normal videos into slow-motion videos. While a video is playing, you need to hold the screen for the duration of the video that you want to be converted into slow-motion, and AI will generate frames and insert them between real frames to create a slow-motion effect.
Samsung Keyboard
Samsung Keyboard now features AI. It can correct your language and grammar, suggest several styles for texts, and translate language in real time. It can also summarize text messages and suggest replies on your behalf. Summarization of text messages is also possible (and it even works in Android Auto mode).
Samsung Notes gets text summarization and other features
Samsung has also developed a feature that lets you summarize notes in Samsung Notes or webpage/article content on Samsung Internet. In Samsung Notes, your handwritten notes can be converted to text and then summarized in neat-looking templates (bullet points or meeting styles) with attractive-looking text formatting styles. You can use Galaxy AI to use Auto Format, Language Correction, Summarize, and Translate features separately.
Webpage summarization in Samsung Internet
Samsung Internet can summarize entire articles or webpages and present all that information in a condensed and easier-to-digest format. Language translation on webpages also works better with AI.
Voice-to-text transcribing, language translation, and summarization in Voice Recorder
The built-in voice recorder also uses AI to transcribe voice to text. Not only that, but it can also use that text and translate it into a different language. It can also detect up to ten people in the voice recording and tag their voices/sentences. You can then use that text even to summarize the contents of the voice recording into easy-to-understand blocks of text.
Wallpaper Generator
There is a Wallpaper Generator in One UI 6.1, and it lets you select certain wallpaper templates and create new wallpapers based on your inputs and suggestions. You can name the backdrop, color, and subject for the wallpaper, and Galaxy AI will generate a wallpaper based on your taste. It can also create weather effects for the lock screen wallpaper.
Some of these features could come to existing high-end Galaxy smartphones with the One UI 6.1 update, but Samsung hasn't revealed which features will be compatible with its existing smartphones and tablets.
