OpenAI to launch deepfake detector as realism of AI-generated content grows

still from a video created with a text prompt by OpenAI Sora
(Image credit: OpenAI)

It's no secret that AI-generated content is changing how people interact with the digital world. However, it also poses its fair share of risks as people create images and videos for potentially malicious reasons. And now, OpenAI says it's planning to address that.

OpenAI on Tuesday (May 7) launched a new image detection tool to help people identify whether an image was generated by its DALL-E 3 image-generation tool or if it was created without AI's assistance. In addition, OpenAI will make the tool available to a limited number of testers who are using its platform so they can integrate the image-detection feature into their apps.

In a blog post, OpenAI said that its tool could identify when an image was generated by AI in approximately 98 percent of cases and only returned false positions — identifying an actual image as one created by AI — in 0.5 percent of cases.

The new tool's announcement came alongside OpenAI's acknowledgment that it's been integrating metadata into the images and videos users create with its DALL-E 3 and Sora image- and video-creation tools, respectively. But as OpenAI acknowledged, with a little bit of know-how, malicious actors can remove that metadata, making its tool all the more necessary.

Deepfakes, or synthetically generated content designed to dupe users into believing it's human-generated, have become an increasingly concerning problem on the Internet. With an ever-increasing number of people turning to AI to create fake videos, images, and audio recordings, it's quickly becoming clear that verifying the veracity of content is exceptionally important.

While OpenAI's new tool is a step in the right direction, it's by no means a panacea. While it apparently works well, it's only been trained on DALL-E 3-generated images. In other words, if bad actors create images in other AI image generators, there's no guarantee the OpenAI tool will work as well—if it works at all. It's also worth noting that while OpenAI touted its image-sensing performance, deepfake videos designed to dupe users can be far more difficult to identify.

Still, at least OpenAI is doing something. In a world where bad actors are looking to fool users, companies like OpenAI need to find ways to protect users, or reality itself could fall prey to AI.

And in keeping with that, OpenAI also said on Tuesday that it's joined the steering committee for the Coalition for Content Provenance and Authenticity (C2Pa), a widely used standard that certifies digital content.

OpenAI stopped short of saying exactly how it'll impact C2PA, but did say that it "looks forward to contributing to the development of the standard, and we regard it as an important aspect of our approach."

More from Tom's Guide

Category
Arrow
Arrow
Back to MacBook Air
Brand
Arrow
Processor
Arrow
RAM
Arrow
Storage Size
Arrow
Screen Size
Arrow
Colour
Arrow
Storage Type
Arrow
Price
Arrow
Any Price
Showing 10 of 36 deals
Filters
Arrow
Show more
TOPICS

Don Reisinger is CEO and founder of D2 Tech Agency. A communications strategist, consultant, and copywriter, Don has also written for many leading technology and business publications including CNET, Fortune Magazine, The New York Times, Forbes, Computerworld, Digital Trends, TechCrunch and Slashgear. He has also written for Tom's Guide for many years, contributing hundreds of articles on everything from phones to games to streaming and smart home.

Read more
ChatGPT and Deepseek side by side on smartphones
This tool identifies AI-generated images, text and videos — here’s how it works
ChatGPT logo on a smart phone resting on a laptop keyboard, lit with a dark purple light
OpenAI has been actively banning users if they’re suspected of malicious activities
ChatGPT logo on a smartphone screen being held outside
ChatGPT just got OpenAI's most powerful upgrade yet — meet 'Deep Research'
DeepSeek R1 illustrations
DeepSeek’s Janus Pro AI image generator is here to take on Midjourney and DALL-E
Sam Altman
OpenAI takes aim at authors with a new AI model that's 'good at creative writing'
OmniHuman screenshot of AI generated video
TikTok parent company just launched stunning AI video generator — OmniHuman-1 is taking the world by storm
Latest in AI
A nervous woman looking at her phone
Is ChatGPT making us lonely? MIT/OpenAI study reveals possible link
AI in man's hand
AI
AI Madness faceoff logo
I just tested Grok vs. DeepSeek with 7 prompts — here's the winner
ChatGPT on iPhone
ChatGPT was down — updates on quick outage
Claude AI on phone sitting on keyboard
Claude 3.7 Sonnet now supports real-time web searching — but there's a catch
The Dnsys X1 Exoskeleton being worn
I tested an AI exoskeleton to help treat my immune arthritis — here’s what happened
Latest in News
iPhone 16 with Apple Intelligence logo for iOS 18.1
iOS 18.4: All the newest Apple Intelligence features coming to your iPhone
Maria Debska in "Just One Look" now streaming on Netflix
3 best Netflix shows in March you haven't watched yet
Split image featuring the Galaxy S25 Edge (left) and Galaxy S25 Ultra (right)
Samsung Galaxy S25 Edge just tipped for two Galaxy S25 Ultra-level features
Wolfenstein: The Old Blood
Amazon is giving away a ton of free games for its Big Spring Sale — here’s how to claim yours
A TV with the Netflix logo sits behind a hand holding a remote
Netflix is rolling out a big video quality upgrade — what you need to know
Choi Hyun-Wook, Hong Kyung, and Park Ji-hoon in "Weak Hero Class 1" now streaming on Netflix
This action-packed K-drama is now streaming on Netflix — and now’s the time to binge-watch before season 2