Disturbing AI-Generated Videos of Kids Raise Concerns
On October 7, a TikTok account named @fujitiva48 posed a provocative question alongside their latest video. “What are your thoughts on this new toy for little kids?” they asked over 2,000 viewers, who had stumbled upon what appeared to be a TV commercial parody.
The response was clear. “Hey so this isn’t funny,” wrote one person. “Whoever made this should be investigated.”
It’s easy to see why the video elicited such a strong reaction.
AI-Generated Videos Using Sora 2
The fake commercial opens with a photorealistic young girl holding a toy—pink, sparkling, a bumblebee adorning the handle.
It’s a pen, we are told, as the girl and two others scribble away on some paper while an adult male voice-over narrates.
But it’s evident that the object’s floral design, ability to buzz, and name—the Vibro Rose—look and sound very much like a sex toy.
Laws and Regulations
The unsavory clip was created using Sora 2, OpenAI’s latest video generator, which was initially released by invitation only in the US on September 30.
Within the span of just one week, videos like the Vibro Rose clip had migrated from Sora and arrived on TikTok’s For You Page.
Some other fake ads were even more explicit, with WIRED discovering several accounts posting similar Sora 2–generated videos featuring rose- or mushroom-shaped water toys and cake decorators that squirted “sticky milk,” “white foam,” or “goo” onto lifelike images of children.
Consequences and Concerns
The above would, in many countries, be grounds for investigation if these were real children rather than digital amalgamations.
But the laws on AI-generated fetish content involving minors remain blurry.
New 2025 data from the Internet Watch Foundation in the UK notes that reports of AI-generated child sexual abuse material, or CSAM, have doubled in the span of one year from 199 between January and October 2024 to 426 in the same period of 2025.
Measures and Safeguards
OpenAI, Sora 2’s creator, has implemented measures that prevent young people from having their faces plastered onto pornographic deepfakes.
The app’s feature where users record their likeness to embed into generated videos—previously called Cameo, but now temporarily renamed—works on a consent basis and can be revoked at any time.
There is also a rule that ensures adult profiles cannot message teens.
Grey Areas and Concerns
While not hardcore pornography or deepfakes targeting real children, when uploaded in conjunction with leading statements, they show an apparent intent to farm for predators.
Other clips that creators are grouping in the same category hover even more between sexualization and commentary.
Fake commercials for recalled toys, like “Epstein’s Island Getaway” and “Diddy’s Mansion Party,” where AI-generated children play with figurines of older men, young women, and a baby oil fountain, have also come under scrutiny.
Meanwhile, clips like these and others showing play sets parodying 9/11 and the death of Princess Diana suggest that the videos’ creators could be motivated more by the desire to be an edgelord than by anything else.
Yet they often appear side by side on the same compilation accounts, leading those seeking out dark jokes to stumble upon more questionable material accidentally.
Consequently, the videos raise concerns about the potential for exploitation and the blurring of lines between satire and explicit content.
In addition, the ease with which these videos can be created and shared raises questions about the responsibility of platforms like TikTok and the measures they take to prevent the spread of harmful content.
Therefore, it is essential to have a nuanced discussion about the implications of AI-generated content and the need for stricter regulations to protect minors.
Moreover, it is crucial to consider the impact of these videos on the mental health and well-being of children and the potential for long-term damage.
However, the issue is complex, and there is no easy solution. The use of AI-generated content raises questions about free speech and the limits of censorship.
However, it is clear that something needs to be done to prevent the exploitation of minors and to protect them from harm.
Meanwhile, the debate continues, with some arguing that the videos are a form of satire or social commentary, while others see them as a clear attempt to exploit and harm children.
Consequently, the issue remains a contentious one, with no clear resolution in sight.
In addition, the rise of AI-generated content has raised concerns about the potential for deepfakes and other forms of manipulated media.
Therefore, it is essential to have a comprehensive discussion about the implications of AI-generated content and the need for stricter regulations to protect minors.
Moreover, the use of AI-generated content raises questions about the responsibility of platforms like TikTok and the measures they take to prevent the spread of harmful content.
However, the issue is complex, and there is no easy solution.
Source: Link
Comments are closed.