Samsung Galaxy S24 Ultra — all the AI features rumored so far

Samsung Galaxy S24 Ultra render
(Image credit: Technizo Concept/YouTube)

Rumors of the Galaxy S24 family embracing artificial intelligence have recently been gathering steam, and now Samsung has confirmed it. In a blog post announcing Galaxy AI, the company revealed that artificial intelligence will be “universal intelligence on your phone as you’ve never seen it before.” 

Called Samsung Gauss, it will be “in all the places it matters most” with the promise of “barrier-free communication,” “simplified productivity” and “unleashed creativity,” Samsung says. It will function both locally with on-device AI developed by Samsung and with cloud-based AI collaborations with “like-minded industry leaders”.

New Galaxy S24 series: save up to $1,020 off @ Samsung

New Galaxy S24 series: save up to $1,020 off @ Samsung
Not only can you save $50 instantly off the cost of an upcoming Galaxy device, but Samsung's sweetening the deal by offering up to an additional savings of $970 with a trade-in.

Outside of Samsung Gauss, there are also several rumors about the upcoming ONE UI 6.1 that promises to offer several new features for the Galaxy S24 range. These include several AI improvements that will help user accessibility. 

Buzzwords aside, what does that look like in practice? Here’s what we’re expecting Galaxy AI to offer.

Live AI translations

Samsung Galaxy AI translate feature

(Image credit: Samsung)

There’s one feature we know is going to feature for sure, because Samsung specifically mentioned it in the blog post: AI Live Translate Call.

“Audio and text translations will appear in real-time as you speak, making calling someone who speaks another language about as simple as turning on closed captions when you stream a show,” the company explains. This one uses on-device Galaxy AI, Samsung says, to limit the privacy concerns that present themselves when data is uploaded to the cloud.

This sounds very clever, but we’re not sure how practical it is. After all, if you don’t speak the language they’re communicating in, then your reply may still be meaningless to the person you’re speaking to — unless they happen to have an AI-equipped Galaxy phone too. 

Generative text assistance

This one is a little bit more vague, occupying a single line in a Samsung press release, but it looks like the company’s AI will be taking a leaf out of ChatGPT’s book with its Gauss Language generative language model. 

The release says that it “enhances work efficiency by facilitating tasks such as composing emails, summarizing documents and translating content.”

Composing emails is certainly an interesting proposition — but there are different ways it could be implemented. It could merely be offering recommendations as you type, or it could possibly generate an entire email based on a prompt — for example, writing a complaint letter to an airline based on a few key details.

As for summarizing documents, this is something that Google already does — but it requires Chrome or the Google app. Hopefully, Samsung will offer something a bit more universal. 

Camera tricks aplenty

In the same press release, Samsung Gauss Image is mentioned: “a generative image model that can easily generate and edit creative images.” It can make “style changes and additions” and also convert “low-resolution images to high resolution.”

That all sounds promising, and we wouldn’t be surprised if Samsung tried to mimic the Pixel’s Magic Eraser or Best Take features here too.

YouTube YouTube
Watch On

Finally, Samsung has also teased a few video features coming to 200MP cameras powered by the Qualcomm Snapdragon 8 Gen 3’s AI smarts (i.e.: the S24 Ultra). AI tracking will allow you to keep tabs on a subject in a video at all times, while simultaneously filming both cropped and full-angle shots. It also promises “end-to-end AI Remosaic image capture,” which should offer “richer details and colors.”

Recent leaks indicate several new features coming to the S24's AI capability. These include the ability to upscale videos with improved lowlight performance, as well as grain reduction and improved stability. The AI could also be able to erase subjects from videos as well as photos. Finally, it appears that the  Galaxy S24 will be able to gather important information from calls and offer options for better planning, as well as an on-device AI chatbot.

A keyboard that writes like you

Galaxy AI will also likely be integrated into the Samsung keyboard, making your responses to messages sound more like you — or a smarter, more witty sounding version. This AI-powered keyboard will not only offer tone detection for sentences, allowing users to choose from five tone options. Therefore, you can choose responses that have causal or professional tone, or simply going with emojis.

Samsung's Galaxy AI presence should also be present in the Samsung Notes app, allowing for hand-written notes to be converted into another format. For example, it could be smart enough to know you're writing a bulleted list and show that in the Samsung Notes app, saving you precious time from having to adjust it later on.

AI at what cost?

This all sounds very promising, but there are two big caveats. 

The first is that the implementation might not be that good. After all, Samsung went big on its virtual assistant Bixby, and it’s still a bit underwhelming six years after being introduced — a pale imitation of Google Assistant, Alexa and Siri.

Secondly, one rumor suggests that Samsung intends to paywall some of its AI features behind a subscription. That may well prove to be nonsense — why would it give Google a free win with its free-to-use Pixel AI features? — but if not, it could majorly dent its appeal.

We’ll have to see what happens when the Samsung Galaxy S24 family is released. We’ve still got a few months to go, with one report predicting a launch event on January 17, which would likely mean the phone going on sale on February 2, 2024. 

TOPICS
Alan Martin

Freelance contributor Alan has been writing about tech for over a decade, covering phones, drones and everything in between. Previously Deputy Editor of tech site Alphr, his words are found all over the web and in the occasional magazine too. When not weighing up the pros and cons of the latest smartwatch, you'll probably find him tackling his ever-growing games backlog. Or, more likely, playing Spelunky for the millionth time.

Read more
Samsung Galaxy S25 Ultra hands-on
Samsung Galaxy S25 AI features — here's everything that's new
Galaxy S25 Ultra Now brief
Samsung Galaxy S25 — here’s the AI features that could make you upgrade
Galaxy Unpacked header
Galaxy S25 AI features — I asked the Tom's Guide staff what they want to see
Samsung Galaxy S25 render
Samsung Galaxy S25 could come with this great AI freebie for millions
Samsung Galaxy S25 Ultra hands-on
Samsung execs on Galaxy S25 Galaxy AI: it will make you ‘twice as happy’
Samsung Galaxy Unpacked 2025 invitation with January 22 date and ai graphic
Samsung Galaxy S25 Unpacked event: 5 biggest unanswered questions
Latest in Samsung Phones
Galaxy S25 Plus held in the hand.
Samsung could delay One UI 7’s release in the US — here’s what we know
Galaxy S25 Ultra Now brief
Samsung’s Personal Data Engine is a big addition to the Galaxy S25 — here’s why
Samsung Galaxy S25 Edge next to Galaxy S25 Plus
Samsung Galaxy S25 Edge vs. Galaxy S25 Plus: Everything we know so far
Showing the front of a Galaxy S25 Ultra held in hand
One UI 7 will arrive late for US Samsung users — here’s when it’ll launch for you
samsung galaxy s25 edge mockup at galaxy unpacked
Galaxy S25 Edge is overhyped — I want Samsung to make this phone thinner instead
Samsung Galaxy S23 Ultra
Older Samsung phones are finally getting One UI 7 — here's all the devices
Latest in News
A first look at Amazon's Fallout TV series coming to Prime Video
‘Fallout’ season 3 plans are reportedly being made — while season 2 is still filming
Surface Laptop 7 from the front
Amazon just gave Surface Laptop 7 a 'frequently returned' label — here's what's going on
New emojis with iOS 18.4 beta release.
iOS 18.4 beta brings 8 new emoji to your iPhone — here's all the new options
23andME box
23andMe has declared bankruptcy — here's how to delete your data now
half-life alyx
Latest Half-Life 3 rumors point to a 2025 release — and maybe pigs will fly
NFL Sunday Ticket logo for YouTube
NFL Sunday Ticket 2025 pricing revealed — and it's bad news