AI-Generated Black Female Avatars Spark Racism Concerns Across Social Media

TikTok has removed 20 accounts following a BBC inquiry that uncovered a troubling trend of AI-generated black female avatars being used to direct users to sexually explicit content. The social media platform took action after the BBC and experts at the independent AI publication Riddance identified numerous accounts across Instagram and TikTok displaying overtly sexual digital characters with exaggerated proportions and darkened skin. The accounts, which were unlabelled as AI-generated in apparent breach of platform guidelines, used racist tropes in their naming conventions and promotional language. Whilst TikTok has acted swiftly, Meta, Instagram’s owner, said it was investigating but has not confirmed taking comparable steps against the accounts operating on its platform.

The Revelation: Many Deceptive Accounts

The BBC’s inquiry, conducted in collaboration with Riddance researchers Jeremy Carrasco and Angel Nulani, uncovered a sophisticated operation operating across numerous platforms. The team identified 60 accounts mainly found on Instagram that contained links, or chains of links, directing users to paid sexually explicit content on external sites. Notably, whilst these third-party sites marked the content as AI-generated, the Instagram accounts themselves made no such disclosure, establishing intentional misleading for unaware individuals. The research exposed an substantially wider collection of comparable profiles on Instagram and TikTok alike that contained no links to paid content, suggesting the problem goes well past commercial exploitation.

The accounts employed a deliberate approach to escape notice and grow audiences quickly. Most accounts were focused on Instagram, with approximately one-third also operating accounts on TikTok. Account names intentionally employed racial terminology, including terms such as “black”, “noir”, “dark” and “ebony”, paired with content advancing stereotypical depictions and objectification. Numerous accounts maintained connections to one another, forming a coordinated web that expanded their prominence and online presence. This coordinated approach suggests organised activity rather than isolated incidents, highlighting critical issues about the scope and technical capability of the campaign.

• AI avatars displayed distorted physical proportions and artificially darkened skin tones
• Account names employed racially charged language and stereotyped characterisations about white men
• Videos were unlabelled as AI-created, contravening platform guidelines
• Many accounts were interconnected, establishing linked networks for reach enhancement

Exploitation Via Synthetic Creation

Unauthorised Material and Digital Manipulation

The examination revealed a especially concerning facet to the operation: the wholesale theft of material from real creators. One channel that gathered three million followers within weeks of its launch in December had deliberately repurposed footage from genuine individuals, most notably Malaysian influencer Riya Ulan. The offenders superimposed the AI-generated avatar’s face—featuring an artificially darkened skin tone—onto Riya’s body, meticulously replicating her gestures, attire and backdrop. This brazen act of digital theft compounded the initial exploitation, transforming authentic creative work into content for misleading accounts.

Riya’s involvement illustrated the breach of privacy at the core of such methods. After learning her videos were appropriated and redistributed, she communicated her frustration to the BBC: “I was angry. Of course my videos are widely distributed… It doesn’t mean that you can simply steal it and steal it and post it as your own.” Her frustration exposes a critical gap in safety measures, where content makers need proper protections against their identities being misused for fraudulent accounts. The incident reveals how machine learning can magnify existing harms, permitting fraudsters to scale their exploitation across numerous creators in parallel.

The exploitation surpassed simple video theft. Accounts strategically built artificial personas with exaggerated appearance traits and artificially manipulated skin tones to produce eye-catching, eye-catching content intended to drive engagement. These algorithmic creations were presented as genuine content creators, complete with invented histories and personalities, whilst simultaneously reinforcing damaging ethnic prejudices and fetishisation tropes. The sophistication of the deception meant many users interacted with the material under the impression they were engaging with genuine individuals, not programmed entities created expressly to direct users to exploitative paid content.

• Avatar’s face superimposed over stolen videos from genuine content creators
• Digitally darkened complexions and pronounced characteristics created for engagement
• Accounts marketed as authentic influencers with invented histories and identities

Racial Stereotypes and Prejudicial Labelling

The accounts uncovered by the BBC and Riddance researchers exhibited a concerning pattern of discriminatory targeting through their deliberate naming conventions and content. Account identifiers included terms such as “black”, “noir”, “dark” and “ebony”, whilst posts regularly contained racialised language and sexualized stereotyping. Many included statements such as “loves white men” and “why I need a white guy in my life”, perpetuating harmful stereotypes and depicting Black women to sexual commodities. This language pattern converted the accounts into stereotypical representations, perpetuating long-established racist tropes that sexualize and devalue Black femininity.

The graphic depiction intensified these linguistic harms. The avatars were consistently depicted in exposed swimming attire and minimal garments, their bodies algorithmically altered into exaggerated proportions created to enhance engagement through sexualisation. Complexions were artificially darkened to produce a fabricated, near monstrous appearance that bore little resemblance to authentic human variation. This mix of exaggerated features, revealing attire and synthetically altered traits created algorithmic stereotypes that operated like modern-day minstrelsy, converting racist imagery into computational material designed for widespread distribution and financial gain.

Why AI Exacerbates the Problem

Artificial intelligence technology has significantly changed the scale and sophistication of racist exploitation online. Previously, such harmful content needed substantial investment and manual effort to produce; AI generation democratises the creation of racist caricatures, enabling bad actors to produce numerous realistic fake accounts at minimal cost. The technology’s ability to create photorealistic imagery provides misleading legitimacy to racist tropes, making them appear credible to unsuspecting users. This technological advantage turns what was once fringe exploitation into a scalable, profitable enterprise.

The computational nature of social media platforms intensifies these harms exponentially. AI-generated content designed to maximise engagement—particularly content that leverages racial and sexual stereotypes—spreads rapidly through algorithmic distribution mechanisms designed to prioritise user interaction. Platforms find it difficult to manage the vast quantity of AI-generated content, whilst the absence of required transparency markers means users are unable to differentiate authentic creators from computational entities. This creates an environment where racist stereotypes spread without constraint, obscured by the veneer of technological innovation and framed as entertainment rather than exploitation.

Platform Response and Accountability

TikTok’s rapid action in deleting 20 accounts demonstrates a uncommon example of platform action, yet it highlights the reactive nature of content management in the social media era. The suspensions took place merely following sustained media scrutiny and public backlash, indicating that without external investigation, these accounts would have kept functioning unchecked. Notably, TikTok’s response was confined to one platform, whilst many of the offending accounts kept active profiles on Instagram, where they kept collecting followers and routing traffic to harmful third-party platforms. This fragmented approach underscores the limitations of isolated platform measures to widespread challenges.

Meta’s statement about investigating, coupled with its refusal to communicate tangible measures, reveals the gap between company accountability claims and real-world compliance. The company’s sluggish reply differs markedly from the pressing need to combat quickly multiplying unsafe content. Both platforms have developed policies requiring the revelation of artificial intelligence-created images, yet these regulations went unapplied across vast numbers of user accounts. This compliance gap indicates that without government oversight and legal accountability, platforms will continue prioritising user engagement and ad income over user safety and the safeguarding of vulnerable groups from systematic exploitation and racist imagery.

Broader Implications for Online Authenticity

The rapid growth of unlabelled AI-generated material on major social media platforms raises key questions about online integrity and user trust. As AI technology becomes increasingly sophisticated, distinguishing between real content creators and artificial personas becomes significantly harder for everyday people. This loss of genuineness undermines the foundational premise upon which online communities are built—the assumption that profiles show actual individuals posting authentic content. When millions of users unknowingly engage with fabricated personas designed to exploit them, the platforms’ credibility as reliable platforms for interaction declines sharply. The absence of mandatory disclosure mechanisms deliberately misleads users and undermines conscious agreement.

Beyond personal deception, the widespread deployment of AI-generated black female avatars represents a particularly insidious exploitation of racial identity in digital spaces. These artificial characters weaponise damaging generalisations and hypersexualised racial tropes whilst concurrently appropriating authentic creators’ content and labour. The practice reinforces the commodification of black femininity within computational frameworks designed to increase user engagement and financial returns. This algorithmic discrimination operates extensively, reaching millions whilst staying largely undetected to platform enforcement teams. Without robust regulatory structures requiring openness, verification protocols, and substantive penalties for violations, digital spaces will keep enabling widespread damage against marginalised communities.

• AI disclosure requirements should be legally enforceable across all platforms globally
• Authentication systems must confirm the creator’s identity ahead of earning potential and audience expansion
• Racial bias in artificially created material requires clear bans with continuous identification
• Platforms must implement live monitoring systems where enforcement reflects the severity of violations