3 disturbing things happened this week in AI — and you need to pay attention

Google Gemini ad, Friend AI Pendant and Instagram AI Studio
(Image credit: Google, Friend, Meta)

Overall I’ve been pretty positive on generative AI so far in its fairly young history. I really like what Google has done with Magic Editor, for example, to make your photos look their best. And I often turn to ChatGPT or Copilot to get answers to common questions that I’d normally go to Google for.

I’m also encouraged by Apple Intelligence. Even though it won’t be out until this fall, the developer preview of iOS 18 shows that Apple is finally making Siri smarter while also saving us time with features like recording and transcribing audio within notes and phone calls.

But there’s a darker side to AI that has emerged this week — no, I’m not talking about hallucinations — that has me very worried about whether companies are thinking things through before they sprinkle the proverbial AI pixie dust over everyone and everything. And it's overzealous humans, not AI, that's the problem. 

Recent updates

August 2: Google has pulled the Google Gemini ad and we have provided their statement below. 

Google Gemini Olympics ad disaster 

A screenshot from a Google Gemini ad airing during the Olympics

(Image credit: Google)

How do you make an ad go from heartwarming to borderline horrifying? Google has shown us the way with its Gemini Olympics ad, which has already been widely panned for favoring algorithms over human connection.

In the commercial (whose comments have been turned off on YouTube), we see a father using AI to help her daughter gain an advantage in her training to be a great hurdler. Seems pretty harmless at first, but then the dad turns to Gemini to help his daughter write a letter to Olympic athlete Sydney McLaughlin-Levrone.

Google + Team USA — Dear Sydney - YouTube Google + Team USA — Dear Sydney - YouTube
Watch On

The father explains that he’s “pretty good with words,” but he wants the fan letter to be “just right.” This is a huge insult to the daughter, who should be writing this letter in her own words. This is not something that needs to be just right; it just needs to come from the heart. 

In this instance Gemini isn’t just a creativity crutch, it sucks the humanity right out of the room. 

Google initially issued the following statement: “Our goal was to create an authentic story celebrating Team USA. It showcases a real-life track enthusiast and her father, and aims to show how the Gemini app can provide a starting point, thought starter, or early draft for someone looking for ideas for their writing.”

Now I could see the father himself helping as a starting point, but I don’t think AI should be the helper in a case like this. 

Fortunately, Google has since pulled the ad following the massive backlash, telling The Hollywood Reporter that “While the ad tested well before airing, given the feedback, we have decided to phase the ad out of our Olympics rotation." I'd like to meet those testers. 

Create an AI version of you with Instagram!

AI Studio screenshot

(Image credit: Meta)

You might not have noticed but this week Meta shut down its celebrity AI chatbots. And I wouldn’t blame you because it appears no one was using them. 

Seriously, why would I want to talk to the AI version of Tom Brady or Paris Hilton? It’s not them. But don’t worry. Meta has already pivoted to AI Studio, which enables creators to customize AI avatars of themselves to answer questions from fans. The feature works with Instagram, WhatsApp, Messenger and the web. 

The aim is to let creators and business owners talk to their followers on their behalf. In the blog post Meta says AI Studio can help creators build an “extension of themselves to reach more fans.” 

Some of the AI characters that have been made so far seem somewhat helpful. For example, chef Marc Murphy has created an Eat Like You Live There! AI that offers personalized tips for embracing local dining when traveling. 

But overall there seems something very empty about using an AI avatar of yourself to engage fans. What’s next, fake fans engaging with fake creators?

Meet your next Friend

The Friend AI wearable in use

(Image credit: Friend)

2024 will be remembered as the year of the AI hardware disaster, with poster children like the useless Rabbit R1 and Humane AI Pin. But that’s not stopping 21-year-old entrepreneur Avi Schiffman from jumping on the bandwagon. 

To be fair, the Friend is a $99 device that’s not designed to help you be more productive — unlike the above gadgets already heading for the AI graveyard. This always-listening Bluetooth pendant is supposed to be a companion.

Friend Reveal Trailer - YouTube Friend Reveal Trailer - YouTube
Watch On

“Productivity is over, no one cares,” Schiffmann told Wired. “No one is going to beat Apple or OpenAI or all these companies that are building Jarvis. The most important things in your life really are people.”

Let’s ignore for just a moment that the Friend is not a person. Actually, let’s not do that.

Yes, there are lots of lonely people out there, and something like the Friend could help. But there’s a huge difference between tech helping us find companionship and being a wholesale replacement for it and for humans. 

The Friend is designed to be encouraging, texting you positive affirmations after you “killed it” in that meeting or consoling you after you get blown away by a friend in a game. And the founder promises that the company will not store audio recordings or transcripts.

But I am very concerned that we are going down the wrong path with AI gadgets like this one. Have we forgotten that our very reliance on and addiction to tech has been the catalyst of loneliness and depression for millions? 

Don’t worry. As Schiffmann told The Verge, “I don’t think this should be the only person you should talk to.”

More from Tom's Guide

Category
Arrow
Arrow
Back to Mobile Cell Phones
Brand
Arrow
Storage Size
Arrow
Colour
Arrow
Condition
Arrow
Price
Arrow
Any Price
Showing 10 of 97 deals
Filters
Arrow
(256GB 12GB RAM)
Our Review
2
SAMSUNG Galaxy S24 Ultra Dual...
Amazon
(512GB)
Our Review
4
OnePlus - 12 512GB (Unlocked)...
Best Buy
Our Review
5
Apple iPhone 15 Pro Max 512GB
Visible
(128GB)
Our Review
6
Pixel 8 Pro Bay 128GB...
Google Store NA
(256GB Blue)
Our Review
7
iPhone 15 Pro Max 256GB (with...
Straight Talk
(Blue)
Our Review
8
Apple iPhone 15 Pro Max 256GB...
Total Wireless
Our Review
9
Google Pixel 8 Pro - 128 GB
AT&T Mobility
Low Stock
(Blue)
Our Review
10
Samsung Galaxy S24 Ultra 5G...
Walmart
Show more
Mark Spoonauer

Mark Spoonauer is the global editor in chief of Tom's Guide and has covered technology for over 20 years. In addition to overseeing the direction of Tom's Guide, Mark specializes in covering all things mobile, having reviewed dozens of smartphones and other gadgets. He has spoken at key industry events and appears regularly on TV to discuss the latest trends, including Cheddar, Fox Business and other outlets. Mark was previously editor in chief of Laptop Mag, and his work has appeared in Wired, Popular Science and Inc. Follow him on Twitter at @mspoonauer.

Read more
A side-by-side of two phones, one with Apple Intelligence and one with Galaxy AI
The best (and worst) AI phone features in 2024
DeepSeek logo on phone
It doesn't matter if DeepSeek copied OpenAI — the damage has already been done in the AI arms race
Microsoft Surface Laptop 7
'AI laptops' hype is not what you think — PC makers won't like me revealing this secret
Facebook logo on a phone display
Meta quickly deletes AI accounts and posts after intense backlash — what's going on
Gemini AI on Google TV
I just tried Gemini AI on Google TV and you may never use your remote again
AI tools floating out of laptops
The 5 best AI tools of 2024 that I use every day
Latest in AI
Bill Gates in 2019
Bill Gates just predicted the death of every job thanks to AI — except for these three
Gemini screenshot image
Google unveils Gemini 2.5 — claims AI breakthrough with enhanced reasoning and multimodal power
nyc spring day AI image
OpenAI just unveiled enhanced image generator within ChatGPT-4o — here's what you can do now
A nervous woman looking at her phone
Is ChatGPT making us lonely? MIT/OpenAI study reveals possible link
AI in man's hand
AI
AI Madness faceoff logo
I just tested Grok vs. DeepSeek with 7 prompts — here's the winner
Latest in Opinion
A composite image representing three of the best shows of 2025 so far: "Severance," "Paradise" and "The Pitt."
I've streamed 24 shows in 2025 — here's the 5 best so far
The Amazfit T-Rex 3 shown close-up on a user's wrist with the snorkeling and surfing workout tracking modes displayed; colorful flowers are out of focus in the background
7 reasons why this budget-friendly smartwatch is my new go-to for surfing and swimming
Apple maps logo on iPhone screen
I avoided Apple Maps for trip planning — but these iOS 18 features are changing my mind
Adam Scott in "Severance," now streaming on Apple TV Plus.
'Severance' season 3 officially greenlit — but I may not watch after that season 2 finale
Woman has taped her mouth shut with a blue I shaped mouth tape
I tried I-shaped mouth tape to fall asleep faster but now I'm more tired than ever — here's why
An angled view of the distraction-free desk setup I built around the Oakywood Standing Desk Pro
I built a completely distraction-free desk setup with these 10 gadgets — and now I’m truly locked in