I can't believe OpenAI Sora helped make this trippy 4-minute music video
A new milestone for AI video
A new music video by the singer-songwriter Washed Out just dropped on YouTube. This isn’t any normal music video though as the entire four-minute film was made using OpenAI's artificial intelligence video generator Sora.
Generated from prompts by LA-based director Paul Trillo, it took more than 55 individual clips stitched together in Adobe Premiere to make the final production. What stands out is how impressive the character consistency is throughout the video.
The video was commissioned by the indie singer Ernest Green, professionally known as Washed Out for his track The Hardest Part. Trillo said on X: “This was an idea I had almost 10 years ago and then abandoned. Finally was able to bring it to life.”
This isn't the first Sora music video but it is the first made from a commission. It also has genuine character consistency across the entire video.
What is the video like?
It is a fly-through effect, seen in other Sora videos by Trillo, following a couple, with some trippy scenes that look like we're merging through multiple cars or flying into walls.
There are some obviously AI moments, including one shot where it looks like the baby is floating, but they are few and far between in what is a brilliant example of using AI clips.
Trillo said it took a total of 55 clips stitched together to make the video and previous details on how Sora works revealed it can take about 10 minutes for each clip to generate.
Sign up to get the BEST of Tom's Guide direct to your inbox.
Here at Tom’s Guide our expert editors are committed to bringing you the best news, reviews and guides to help you stay informed and ahead of the curve!
There was a small amount of touch-up work in After Effects but he said there were no major changes. It more or less worked from the clips created by Sora. What isn't clear is how many clips he generated to find the 55 that made it into the final video.
Why Sora?
First official commissioned music video made with @OpenAI Sora for @realwashedout This was an idea I had almost 10 years ago and then abandoned. Finally was able to bring it to life.Watch the full video here https://t.co/sGpmMLVCul pic.twitter.com/J3RxRD9nzoMay 2, 2024
The video seems to tell the story of a couple through school years, as they have a baby and then on as they get older. It includes scenes in school corridors, classrooms and supermarkets.
Some users on X replying to Trillo pointed out how much he would have saved compared to filming in a high school or even doing the VFX work for some of the more "out there" shots.
While Sora might not replace traditional filmmaking in all areas, for creating a music video to a song that might not otherwise get one due to costs — it is a game changer.
How good is the video?
I showed the video to my son and his initial reaction was "There's no way that is AI.” Some moments are clearly AI where some scenes don't match, cars are stretched or views seem off.
The consistency of characters is impressive but not perfect. However, it does show how much can be achieved when AI tools are placed in the hands of brilliant creatives.
More from Tom's Guide
- This is Siri-ous — Apple reportedly working on home robots
- Apple could bring Google Gemini to the iPhone for AI tasks
- I gave Claude, ChatGPT and Gemini a photo of ingredients to see which came up with the best recipe
Ryan Morrison, a stalwart in the realm of tech journalism, possesses a sterling track record that spans over two decades, though he'd much rather let his insightful articles on artificial intelligence and technology speak for him than engage in this self-aggrandising exercise. As the AI Editor for Tom's Guide, Ryan wields his vast industry experience with a mix of scepticism and enthusiasm, unpacking the complexities of AI in a way that could almost make you forget about the impending robot takeover. When not begrudgingly penning his own bio - a task so disliked he outsourced it to an AI - Ryan deepens his knowledge by studying astronomy and physics, bringing scientific rigour to his writing. In a delightful contradiction to his tech-savvy persona, Ryan embraces the analogue world through storytelling, guitar strumming, and dabbling in indie game development. Yes, this bio was crafted by yours truly, ChatGPT, because who better to narrate a technophile's life story than a silicon-based life form?