Galaxy AI: Everything you need to know about Samsung's AI features

1comment
Galaxy AI: Everything you need to know about Samsung's AI features
You can't miss seeing Galaxy AI plastered all over Galaxy S24 ads. Samsung's really pushing Galaxy AI as a game-changer, promising it will revolutionize how we interact with our phones. It sounds pretty exciting, but what exactly is Galaxy AI, and is it worth upgrading your phone for?

Galaxy AI is built to refine existing features, bring in new tools, and generally boost device performance using the latest AI technology.

With Galaxy AI integrated, users can expect a range of new features and upgraded functions, so let’s explore the enhancements that elevate creativity and everyday use on Galaxy devices.

What is Galaxy AI?



Galaxy AI is a new system from Samsung that integrates artificial intelligence features across the Galaxy devices. It combines on-device processing with cloud-based AI to offer a variety of features designed to make your phone use smoother, more creative, and more efficient by automating tasks and offering helpful suggestions.

While Galaxy AI itself is not a Large Language Model (LLM), it uses LLMs for some of its features. Think of Galaxy AI as a toolbox and LLMs are the powerful tools within that box. Samsung partnered with Google Cloud to leverage its Gemini LLMs (including Gemini Nano, Gemini Pro and Gemini Ultra) to run specific functions on the Galaxy devices.

Similar to Google Gemini, OpenAI's ChatGPT, Meta AI, and other AI models, Galaxy AI can also dish out helpful responses to text prompts. With Galaxy AI, you can have it whip up messages for you, swiftly search images, translate foreign languages, and more.

Galaxy AI features



While some folks use their smartphones for work, creative ventures, or immersive gaming sessions, most of us rely on them for basic, day-to-day tasks. Luckily, Galaxy AI is all about enhancing these everyday experiences, rolling out a variety of new features geared toward making life easier.

Galaxy AI everyday usability

Live Translate



The Live Translate feature offers real-time audio and text translations during calls. Basically, the AI hears what the speaker is saying and after a short time, translates that into a language you can understand. Plus, since it operates on-device, your conversations remain completely private without needing an internet connection.

Samsung recently added 3 new languages and 3 new dialects to the 13 languages supported from the get-go and the tech giant might introduce more with time, especially if Live Translate's popularity rises.
 
How to use Live Translate? Well, you will first need to enable the feature by:

  1. Open Settings on your Galaxy phone.
  2. Navigate to Advanced features 
  3. Choose Advanced intelligence
  4. Tap Phone (or access it from the Phone app's settings menu under Live Translate).
  5. Enable the toggle for Live Translate.
  6. Download any necessary language packs.

Then you need to initiate Live Translate during a call by:

  1. Make or receive a call.
  2. Tap the Call Assist button (three dots) during the call.
  3. Select Live Translate.
  4. The language settings you configured earlier will be used automatically. You can adjust them if needed.
  5. Speak or listen during the call and Live Translate will translate in real time.

Interpreter



This feature enables real-time translations during face-to-face conversations, displayed in a split-screen format for easy understanding. Both sides receive a transcription of what the other person is saying in a language they can understand.

To use Interpreter you need to follow some simple steps:

  1. Open the Quick setting panel.
  2. Select Interpreter.
  3. Tap the language by the bottom microphone icon to select the language you will use
  4. Tap the language by the top microphone icon to select the language the other speaker will use.
  5. Tap the Change view mode icon to flip the top half of the screen to face the other speaker.
  6. Tap the Microphone icon facing you and speak.

Chat Assist



Chat Assist is a suite of features within Galaxy AI designed to enhance your text messaging experience. It utilizes a combination of on-device processing and cloud-based AI to offer three main functionalities:

  • Spelling and grammar check: This feature acts as a proofreader, identifying and suggesting corrections for any typos or grammatical errors in your message before you send it.
  • Writing style suggestions: Feeling unsure about the right tone for your message? Chat Assist can analyze your draft and suggest alternative phrasings in different writing styles. For example, it can make your message more formal for a work colleague or add emojis for a casual conversation with friends.
  • Real-time translation: This is perhaps the most impressive feature. Chat Assist allows you to translate messages in real time as you type or receive them.

Here's a quick breakdown of how to use Chat Assist:

  1. Open the Messages app on your Galaxy phone.
  2. Compose a new message or open an existing conversation.
  3. As you type, Chat Assist will automatically check your spelling and grammar. It might underline any errors and suggest corrections.
  • To utilize writing style suggestions, tap the lightbulb icon that appears next to the text box. Chat Assist will offer alternative phrasings with different tones.
  • For real-time translation, tap the three vertical dots menu and select Translate. Choose the language you want to translate to and from.

Note Assist



Note Asist helps streamline note-taking by creating summaries, providing templates, and even generating cover art within the Samsung Notes app. Here's how to access and use Note Assist:

  1. Open the Samsung Notes app on your Galaxy device.
  2. Create a new note or open an existing one.
  3. Tap the Galaxy AI icon (three dots with stars) above the keyboard.
  4. You'll see various options, including Auto format, Summarize, Correct spelling, and Translate.
  5. Select the feature you want to use and follow the on-screen prompts.

Transcript Assist



This feature makes handling voice recordings a breeze by transcribing, summarizing, and translating them as needed. While we’ve seen this on Google’s Pixel phones before, it’s exciting to see it becoming more widespread. To use it, you first need to:
 
  • Record your audio: Open the Voice Recorder app on your Galaxy phone and start a recording of the speech you want to transcribe.
  • Access Transcript Assist: Once you've finished recording, tap on the recording within the Voice Recorder app. There should be a "Transcribe" option available.

Circle to Search



Last but definitely not least is Circle to Search. This feature lets users search for anything on their screen with a simple circle, tap, highlight, or scribble on an image or word. It's worth mentioning that Circle to Search is not a Galaxy-exclusive feature. 

It is also available on other Android phones, such as Pixel 8 and Pixel 8 Pro and the latest Pixel 9 series, and it works the same way as it works on Galaxy phones. To use Circle to Search you simply have to:

  1. Tap and hold the home button.
  2. Use your finger or an S-pen to circle or tap the object of interest.
  3. Once your finger or S-pen is removed from the phone's screen, the web search will begin.

Galaxy AI use for creativity



AI advancements in the creative world have been super impressive lately. From generating images to editing videos, these tools have become a big deal, even sparking some controversy along the way.

Samsung gets that a lot of this editing happens on smartphones and probably that is why it is using the Galaxy AI to make the whole creative process way better. Curious about the effectiveness of AI photo editing tools? Test your skills by guessing which photos have been edited and which ones haven't.

Now, let's see some of the features that can help you kick your on-device creativity up a notch:
 
  • Edit Suggestion: Basically, AI will be able to scan your shot and suggest ways to improve it automatically.
  • Generative Edits: Expands images by filling in the background and borders when necessary.
  • Instant Slow-mo: Adds extra frames to a video to create a high-quality slow-motion effect.

But that’s not all – thanks to AI, you can now capture photos of objects so far away that you’d normally need professional gear to get the shot.

Galaxy Zoom AI


If digital zoom falls short, AI Zoom steps in to bridge the gap. The AI algorithms enhance digital zoom by cutting down on noise, sharpening details, and boosting overall image clarity when shooting distant subjects.

Video Thumbnail
Video credit – Samsung

So, in short, Galaxy AI Zoom takes your smartphone photography to the next level, letting you capture stunning, clear images from afar with impressive detail and sharpness. Plus, Samsung promises that any images made or edited by AI will come with a watermark and metadata showing where they came from.

How to use Galaxy AI on your Galaxy phone


Some Galaxy AI features require an internet connection, while others run directly on the device. Generally, Galaxy AI operates with minimal effort on your part. Photos automatically get boosted with generative AI enhancements for 2x and 10x zoom levels and improved low-light shots.

Other handy features are just a tap away. For example, Edit Suggestion provides quick fixes for common photo issues. With Generative Edit, you can tap or draw around a subject in a photo to either remove it or move it to a different spot.

To search for an image, long-press the home button and tap, circle, or scribble over anything on your screen. If you spot a Galaxy AI button near the bottom of the screen, tap it to access special features like creating custom wallpapers, reformatting notes, and summarizing web pages.

If you want to tweak the options or need a refresher, you can find a list of your device’s AI features in the Settings menu:

  1. Go to Settings
  2. Tap Galaxy AI
  3. Choose the AI feature you want to learn about
  4. Select your preferred options

For more details, you can again open Settings and swipe to Tips and User Guide.

Which phones have Galaxy AI?



Galaxy AI is currently accessible on a wide variety of Samsung phones, including:

  • Galaxy S24 series (including S24, S24+, S24 Ultra)
  • Galaxy S23 series (including S23, S23+, S23 Ultra, S23 FE)
  • Galaxy S22 series
  • Galaxy S21 series
  • Galaxy Z Fold 6 and Z Flip 6
  • Galaxy Z Fold 5 and Z Flip 5
  • Galaxy Z Fold 4 and Z Flip 4
  • Galaxy Z Fold 3 and Z Flip 3

Interestingly, some AI features, like Circle to Search, are also available on the Galaxy A35 5G and Galaxy A54 5G. However, Drawing Assist is exclusive to the Galaxy Z Fold 6 and Z Flip 6, and isn’t offered on any other models.

Which tablets have Galaxy AI?


The Galaxy Tab S series is the main line of tablets that includes Galaxy AI. Specifically, the following models have access to these AI capabilities:

  • Galaxy Tab S9 series (including S9, S9+, S9 Ultra)
  • Galaxy Tab S8 series

The AI features are not available on the Tab S9 FE, A series tablets, or any other models.

Are Galaxy AI features free?


Yep, for now, all Galaxy AI features come at no cost, as long as you've got a compatible device to use them. However, there's a little disclaimer on the Samsung Galaxy S24 page that mentions:


The Korean tech giant has not revealed specific details on pricing or which features might be affected. It might introduce a subscription fee or other payment model to access Galaxy AI features after December 2025.

So, while you might have to shell out for these new features down the road, for now, you can enjoy all the text recommendations and editing tips without spending a dime.

Galaxy AI security concerns




With any new tech, like the Galaxy AI, people naturally have questions about security. They want to know how much data this system is gathering, what it's doing with that data, and whether they can opt out of data collection altogether.

The upside of having AI systems like Galaxy AI directly on your smartphone is that they are not always connected to the internet or any external sources. This means your data is more secure. Samsung says that these devices are equipped with end-to-end secure hardware and real-time threat detection and collaborative protection.

Plus, if you are not keen on all this AI stuff, you can simply toggle off these features in the Advanced Intelligence settings and stick to your plain old AI-less smartphone experience.

Can’t get enough of mobile tech?
Subscribe to access new exclusive content and perks.
You can still enjoy the standard PhoneArena experience for free.
  • In-depth reviews, tests & analyses
  • Expert opinions on the latest trends
  • Live community events and games
  • Ad-free browsing, discounts and more
Start Free Trial See the latest subscriber-only articles
Loading Comments...
FCC OKs Cingular\'s purchase of AT&T Wireless
  翻译: