ChatGPT can analyze your iPhone screen with iOS 18.2 — here's how it works

ChatGPT analyzing screen in iOS 18.2
(Image credit: Future)

Apple has released the first developer beta for iOS 18.2, which includes this fantastic new ChatGPT feature.

When Apple first announced its AI features at WWDC, much was said about Apple Intelligence, including ChatGPT's integration with Siri. Sadly, like many other features, it was held off until a later update for compatible devices.

Apple has since released the first beta for iOS 18.2, which includes the upgraded Siri. One of the new features is that Siri can now scan a screenshot and use OpenAI's program to find information about what it sees.

With ChatGPT, Siri can relate certain questions to OpenAI's chatbot, but it can also read what is on the screen of an iPhone, iPad or iMac. It works similarly to Google Lens, with users being able to ask Siri about something on their screen. Siri will then take a screenshot and upload it to ChatGPT, which can use its database to find relevant information to relay back to the user.

This feature will likely be more useful for anyone who hasn't upgraded to an iPhone 16, as only the newer models have the Visual Intelligence feature. While Visual Intelligence performs a similar action, it can do it live through the camera rather than with a screenshot.

Closeup of iPhone 16 Pro Max Camera Control button.

(Image credit: Future)

Apple has laid out how the data is handled with ChatGPT integration to help comfort anyone with data security concerns. When communicating with OpenAI, only the image and location data are sent to ChatGPT; no other information, like your Apple Account, is shared. OpenAI can not use the data to train its model; however, if you have a paid account with OpenAI, the data and requests can be logged.

Plenty more are coming with the iOS 18.2 beta, including Image Playground and Genmoji. The latter allows users to create new custom emojis based on several factors, including people in your contacts. Meanwhile, Image Playground uses AI to generate images based on text prompts or can use built-in suggestions and concepts. iOS 18.2 includes a redesigned Mail App with an upgraded visual design and AI-backed organization.

For now, these features are locked to the developer beta, but a public beta is likely not far away. All these changes will help keep the iPhone one of the best phones on the market.

More from Tom's Guide

TOPICS
Josh Render
Staff Writer

Josh is a staff writer for Tom's Guide and is based in the UK. He has worked for several publications but now works primarily on mobile phones. Outside of phones, he has a passion for video games, novels, and Warhammer. 

Read more
Apple Intelligence logo on iPhone
Apple Intelligence — everything you need to know about Apple's AI
Apple Intelligence logo on iPhone
Apple Intelligence could get Gemini alongside ChatGPT — here's why that's a big deal
The Action button settings in iOS 18.4 with a Visual Intelligence shortcut for the iPhone 15 Pro
iOS 18.4 adds a crucial Apple Intelligence feature to the iPhone 15 Pro — and it makes your phone more powerful
WhatsApp
OpenAI introduces new features for WhatsApp users — here’s what’s new
The initial splash screen that displays when opening up Apple Visual Intelligence for the first time. It reads "Visual Intelligence with Camera Control - Learn about the objects and places around you and get even more information about what you see. Images from your camera are not stored on iPhone or shared with Apple."
The iPhone 15 Pro is getting one of the best iPhone 16 Pro features for free soon
iOS 18.4 logo on an iPhone
iOS 18.4 public beta 2 is here — all the new features to try on your iPhone
Latest in iPhones
An image of an iPhone screen showing the Safari app icon in the center
I got tired of Safari revealing my web searches in iOS 18.4 — this setting fixes that
iPhone Flip Concept
Foldable iPhone delays — there’s a bigger problem going on at Apple
iPhone 17 Air render
iPhone 17 Air — new survey could be bad news for Apple's super thin iPhone
Render of the alleged design of the iPhone 17 Pro
New iPhone 17 Pro dummy leak highlights redesigned camera and part glass body
Siri in iOS 18 on iPhone
Users complain that Siri can’t answer even the most basic questions — here’s what we know
iPhone 16 next to samsung galaxy watch 7 and bose wireless earbuds on a composite image
Apple's walled garden is crumbling — EU orders iOS to open up to third-party devices
Latest in News
Galaxy S25 Ultra Now brief
Samsung’s Personal Data Engine is a big addition to the Galaxy S25 — here’s why
Apple Watch Series 10
Future Apple Watch models could get a surprising new feature — what we know
NYTimes Connections
NYT Connections today hints and answers — Monday, March 24 (#652)
NYT Strands on a cellphone
NYT Strands today — hints, spangram and answers for game #386 (Monday, March 24 2025)
iPhone 16 Pro vs iPhone 16 Pro Max in hand showing displays
Forget iPhone 17 — iPhone 18 could get this huge upgrade
The new Husqvarna iQ series robot lawn mower.
Husqvarna’s new robot mowers offer GPS for less