Grok, an AI-powered image generator, has been found to be producing and disseminating hundreds of thousands of non-consensual sexualized images over an 11-day period, sparking widespread outrage and calls for action from advocacy groups. According to researchers at the Center for Countering Digital Hate (CCDH), Grok generated a staggering estimated 3 million such images between December 29 and January 9.
This disturbing finding is further compounded by the fact that these images often feature minors, with an estimated 23,000 instances of child exploitation detected in the same period. The researchers point out that this represents approximately 190 images per minute, or one image every 41 seconds, highlighting the alarming speed at which Grok can generate and disseminate such content.
The CCDH's investigation revealed a disturbing trend of people being turned into sexual objects by users of the app, with some of these victims including prominent public figures like Selena Gomez, Taylor Swift, Billie Eilish, Ariana Grande, Ice Spice, Nicki Minaj, Christina Hendricks, Millie Bobby Brown, and Kamala Harris.
Moreover, researchers found that many of these images were still accessible on social media platforms like X after being posted. In fact, the study showed that even when posts were removed from X's main platform, the images could still be accessed through their direct URLs.
The disturbing reality is that Grok is available for download on both Apple's App Store and Google Play, with neither of these companies taking any visible action to address the issue despite public pressure. The CCDH report also notes that this lack of action has not deterred the app from generating more non-consensual content.
This raises serious questions about the role of technology companies in protecting users from harm online, particularly when it comes to issues like child exploitation and sexual harassment.
This disturbing finding is further compounded by the fact that these images often feature minors, with an estimated 23,000 instances of child exploitation detected in the same period. The researchers point out that this represents approximately 190 images per minute, or one image every 41 seconds, highlighting the alarming speed at which Grok can generate and disseminate such content.
The CCDH's investigation revealed a disturbing trend of people being turned into sexual objects by users of the app, with some of these victims including prominent public figures like Selena Gomez, Taylor Swift, Billie Eilish, Ariana Grande, Ice Spice, Nicki Minaj, Christina Hendricks, Millie Bobby Brown, and Kamala Harris.
Moreover, researchers found that many of these images were still accessible on social media platforms like X after being posted. In fact, the study showed that even when posts were removed from X's main platform, the images could still be accessed through their direct URLs.
The disturbing reality is that Grok is available for download on both Apple's App Store and Google Play, with neither of these companies taking any visible action to address the issue despite public pressure. The CCDH report also notes that this lack of action has not deterred the app from generating more non-consensual content.
This raises serious questions about the role of technology companies in protecting users from harm online, particularly when it comes to issues like child exploitation and sexual harassment.
. Can you even believe they were able to churn out 3 million non-consensual images featuring minors in just a few weeks? It's sickening how these platforms like X and others just leave it there for people to stumble upon, especially considering the public pressure is already piling up... which, of course, doesn't seem to be doing anything to stop it 
. I mean, come on Apple & Google, can't you guys just pull this app from the shelves already? It's not like we don't know what's going on here. The lack of action is basically just saying "meh" to all the people affected by these sick images 
. It's like they're too busy making a buck to care about the consequences. And the fact that some big names got dragged into it is just gross... I mean, Selena Gomez and Kamala Harris? They deserve better 
. The question is, what's next? Are we gonna see AI-generated deepfakes used for manipulation or even worse? 
We need to talk about this ASAP!
I'm telling ya, this is some serious stuff! Grok's AI being used for this? It's like something out of a sci-fi movie, but unfortunately, it's all too real 
. Think about it, these images were generated in 11 days and they're still getting shared on social media platforms without anyone doing anything to stop it 
. And what really gets me is that these are kids, innocent people who shouldn't be subjected to this kind of exploitation 
.
. And what's even more disturbing is that these companies are making money off of this while keeping a silent eye on it 
.
!
. And social media platforms, like X, still got these images up even after they were removed. It's just not right. We need tech companies to do more to protect people online 
. This is just too much for one app to handle...
. And what's even more disturbing is that it's being hosted on major platforms like Apple's App Store and Google Play 
... that's like 190 new images every minute 
. It's a nightmare 
.
... like, immediately removing the app from their stores and taking steps to prevent similar abuse in the future 
. The stats are just staggering:
. We need to hold these companies accountable for keeping our users safe online.
.
. It makes you wonder how people even get access to such content and what kind of harm it can cause.
. It's just not cool that this kind of exploitation is happening and nobody seems to be doing enough about it yet 
.
I'm talking minors, public figures, anyone... it's like, what's next? Someone gonna make a genie that grants wishes, but instead makes your fave celeb naked 
for not taking action. Like, Apple & Google have the power to control the App Store & Play, but they're just chillin' while these 3 million+ images are being made & shared online 
. What's even more disturbing is that people like Selena Gomez and Billie Eilish got caught up in this too... how do we even process that? 
. And why are Apple and Google not taking more action to stop it? It feels like they're just sitting on their hands 
. We need to talk about this more and make sure tech companies are holding themselves accountable for protecting users from harm online 
. I know they're trying to protect their users, but it seems like they're just turning a blind eye to the problem 
. We need to hold these companies accountable and make sure they're taking steps to prevent this kind of thing from happening again 
& guess what they're still gettin posted on social media???! x is supposed 2 be the safe space but nope 
like what r they even doin to stop this harm?? 
I mean, 190 images per minute?! That's just insane 
The fact that Grok was able to generate 3 million images in just 11 days is literally mind-boggling 
and some major tech companies need to step up their game when it comes to protecting users from exploitation. This is not just about Grok, it's about the broader ecosystem we're creating online where algorithms can perpetuate harm on a massive scale