TikTok's Algorithm Funneled Me Towards Nazi Symbolism, Even After Removing a Swastika Necklace
When I started browsing TikTok Shop for "hip hop jewelry," the platform repeatedly suggested that I might also be interested in products with blatant Nazi symbolism. The algorithm highlighted phrases like "swastika jewelry," "double lightning bolt necklace," and "SS necklace" alongside search terms related to hip-hop fashion, despite these latter items being unrelated.
To investigate this phenomenon further, I followed what the algorithm recommended in the "Others searched for" boxes on TikTok Shop, which sometimes appears as a set of four related search suggestions with images. The results included jewelry pieces adorned with swastikas and similar Nazi symbols, along with other products that seemed innocuous at first glance.
A search for "swastika jewelry" led to recommendations like "German WW2 necklace," featuring a Star of David pendant, alongside hip-hop-inspired items. Further clicking on these suggested searches revealed an endless web of phrases related to Nazi symbolism and white nationalism, including "double lightning bolt necklace" and "SS necklace."
However, some products in the search results appeared less overtly inflammatory, with symbols that resembled those used by Nazi Germany but were not directly connected to antisemitism. For example, one product featured S-shaped lightning bolts on top of each other, rather than the side-by-side arrangement seen in the SS insignia.
Experts say that understanding how TikTok's algorithm works is difficult due to its opaque nature. Filippo Menczer, a professor at Indiana University, suggests that the results could be either a result of the algorithm working as intended or manipulation by nefarious users trying to astroturf popularity through fake accounts.
Joan Donovan, coauthor of the book "Meme Wars," believes TikTok needs to do more to address content moderation and user protection. She emphasizes the importance of providing transparency to users about how they were targeted by these algorithmic suggestions.
When I started browsing TikTok Shop for "hip hop jewelry," the platform repeatedly suggested that I might also be interested in products with blatant Nazi symbolism. The algorithm highlighted phrases like "swastika jewelry," "double lightning bolt necklace," and "SS necklace" alongside search terms related to hip-hop fashion, despite these latter items being unrelated.
To investigate this phenomenon further, I followed what the algorithm recommended in the "Others searched for" boxes on TikTok Shop, which sometimes appears as a set of four related search suggestions with images. The results included jewelry pieces adorned with swastikas and similar Nazi symbols, along with other products that seemed innocuous at first glance.
A search for "swastika jewelry" led to recommendations like "German WW2 necklace," featuring a Star of David pendant, alongside hip-hop-inspired items. Further clicking on these suggested searches revealed an endless web of phrases related to Nazi symbolism and white nationalism, including "double lightning bolt necklace" and "SS necklace."
However, some products in the search results appeared less overtly inflammatory, with symbols that resembled those used by Nazi Germany but were not directly connected to antisemitism. For example, one product featured S-shaped lightning bolts on top of each other, rather than the side-by-side arrangement seen in the SS insignia.
Experts say that understanding how TikTok's algorithm works is difficult due to its opaque nature. Filippo Menczer, a professor at Indiana University, suggests that the results could be either a result of the algorithm working as intended or manipulation by nefarious users trying to astroturf popularity through fake accounts.
Joan Donovan, coauthor of the book "Meme Wars," believes TikTok needs to do more to address content moderation and user protection. She emphasizes the importance of providing transparency to users about how they were targeted by these algorithmic suggestions.
I mean come on TikTok! How did this even happen? They gotta know their algorithms are a mess if they're still suggesting swastika jewelry after you've already removed it from your search history 
. And honestly, I don't think the fact that some of these products looked kinda similar to SS symbols but weren't directly connected to Nazi ideology should let them off the hook. It's all about context and making sure you're not getting fed a bunch of extremist content on their platform. They need to get their act together ASAP and provide more transparency into how their algorithm works 
.
It's not like people are gonna be browsing for those kinds of things online. It's gotta be the platform's fault that they didn't have a better way to moderate their search results.
. As a user, you just want to find cool stuff online without stumbling upon weird or racist content. It's TikTok's responsibility to ensure that their platform is safe and respectful for everyone.
. I'd love to see some changes on this front, like improved content moderation tools or clearer guidelines for users 
.
I'm not surprised that someone got funneled into Nazi symbolism on TikTok... like, have you ever noticed how suspiciously convenient it is when you start seeing weird connections between seemingly unrelated stuff? 
It's all about the algo, fam! They're always tweaking and adjusting to get us to click and watch more content. And what better way to do that than by playing with our deep-seated fears and biases? I mean, who needs nuance or critical thinking when you can just be entertained? 
But seriously, it's time for TikTok to come clean about their moderation policies... or is that just a PR stunt to distract us from the real issue at hand? 
The more I think about it, the more I'm convinced that there's some shady stuff going on behind those corporate doors. 
I mean, come on... is this for real?! 
. They're trying to see what kind of reactions we'll have when our own algorithms start playing us against our interests 
. Think about it, they show us all this "hip hop jewelry" and suddenly we're flooded with Nazi symbols? What's next, they're gonna start pushing ISIS-inspired fashion too 
? And what's up with the S-shaped lightning bolts that aren't even connected to antisemitism? It's like they're trying to create some kind of... I don't know, algorithmic meme 
. This is just the tip of the iceberg, mark my words 
.
meanwhile, I'm all about that Oculus Quest 2 life and just got my hands on it already 
I mean, what even is the logic behind that? 
They need to fix this ASAP before things get out of hand... 
What's next? Gettin' recs for goth makeup on the same thread as ISIS propaganda? 
TikTok needs to get its act together and sort out this algorithm ASAP! 
The whole system feels so opaque, like they're just wingin' it. 
It's not cool that users are getting targeted by these kinds of suggestions... 
I'm getting so frustrated with TikTok's algorithm right now! 
I mean, I get that algorithms can be sketchy, but come on! You'd think they'd at least have a better filter in place to catch this kind of stuff. 
And honestly, it's not even just the swastikas and Nazi symbols - I've seen some products with these weird S-shaped lightning bolts that are kinda similar to the SS insignia, but definitely not cool. 
Anyway, I think they need to step up their content moderation game ASAP! 
. It's not surprising the algorithm would try to push your interests in weird jewelry but it's still super concerning when it highlights Nazi symbols alongside legit hip hop fashion 
. The devs need to step up their game on moderation, especially if they don't wanna be associated with hate groups 
it's like tiktok's trying to normalize that kinda hate or something 
i feel so targeted now, like how can u be sure the algo isn't messing with ur feed? 
. As Filippo Menczer said, the algorithm might be working as intended or manipulated by bad actors 
. But what if users aren't even aware they've been targeted by these suggestions? It's all about user safety and trust