In a striking development that underscores the growing sophistication of digital disinformation, Poland has formally requested European Union intervention against AI-generated TikTok videos promoting “Polexit” – a hypothetical Polish withdrawal from the EU. This marks a significant escalation in the ongoing battle between democracies and foreign-backed disinformation campaigns.
The Polish Government’s Concerns
Poland’s Digital Minister Dariusz Standerski sent a formal letter to European Commission Vice-President Henna Virkkunen, requesting proceedings under the Digital Services Act (DSA) against TikTok. The letter cited serious concerns about the platform hosting artificial intelligence-generated content calling for Poland to withdraw from the European Union.
The Polish government has attributed this disinformation campaign to Russian interference, stating there is “no doubt this is Russian disinformation.” This assertion reflects ongoing tensions between Poland and Russia, as well as Poland’s sensitivity to external influences on its domestic politics.
The Nature of the Disinformation
The “Prawilne Polki” Phenomenon
The core of the campaign centered on a TikTok account called “Prawilne Polki,” which translates roughly to “Proper Polish Women.” This account featured AI-generated videos of attractive young women wearing Polish flags and patriotic symbols, advocating for Poland’s exit from the EU. These videos specifically targeted users aged 15-25, a demographic known for its heavy use of TikTok.
The sophistication of these AI-generated personas demonstrates the evolving tactics of disinformation campaigns, which now employ cutting-edge technology to create seemingly authentic content that can quickly go viral among susceptible audiences.
Detection and Identification
According to Polish fact-checking organizations, the videos were identified as AI-generated through careful analysis of subtle inconsistencies in facial features, movement patterns, and other indicators that human eyes might miss. This case highlights the urgent need for better detection tools and the challenges facing content moderators in identifying increasingly realistic AI-generated content.
TikTok’s Role and Responsibility
TikTok’s apparent failure to promptly identify and remove these AI-generated videos has raised questions about the platform’s content moderation capabilities. While TikTok has implemented some measures for detecting and labeling AI-generated content, this incident suggests gaps in their approach remain.
The company has yet to issue a formal response to Poland’s concerns, though it had previously opened a transparency center in Ireland in 2022 and regularly releases transparency reports about content removal.
The Legal Framework: Digital Services Act
The Digital Services Act (DSA), which entered into force in 2022 and became fully applicable in February 2024, establishes extensive obligations for online intermediaries aimed at addressing illegal and harmful content at scale. The act requires platforms to:
- Implement effective content moderation systems
- Provide transparency regarding their algorithms and content distribution
- Remove illegal content promptly
- Cooperate with EU institutions in cases of systemic risk
Notably, the DSA includes provisions for proactive monitoring of disinformation, making platforms accountable for failing to address coordinated inauthentic behavior, even when individual pieces of content don’t violate specific laws.
A Pattern of Interference
This incident in Poland is part of a broader pattern of AI-enhanced disinformation campaigns targeting European democracies. Similar cases have been documented in Romania, Ireland, and other EU member states, suggesting a coordinated effort to exploit social media platforms for political influence operations.
The timing is particularly sensitive given ongoing tensions between Poland and EU institutions over judicial reforms and rule of law issues. Some analysts suggest that foreign actors are leveraging existing domestic divisions to amplify their influence operations.
Broader Implications for Democracy
The emergence of AI-generated political content represents a fundamental challenge to democratic discourse. Unlike traditional disinformation that relies on human actors, AI can produce massive quantities of convincing fake content at minimal cost, enabling influence operations to reach unprecedented scales.
As EU institutions grapple with this evolving threat, the case highlights several critical issues:
- Technical Challenges: Identifying AI-generated content becomes increasingly difficult as the technology improves
- Regulatory Gaps: Existing frameworks may not adequately address the speed and scale of AI-generated disinformation
- Platform Accountability: Social media companies must enhance their detection and moderation capabilities
- Public Awareness: Citizens need education about recognizing potentially manipulated content
Moving Forward: Policy and Technology Responses
The European Commission has acknowledged the need for updated approaches to combat AI-generated disinformation. Draft election security guidelines under the DSA emphasize the importance of clear labeling for AI-generated content, while researchers continue developing better detection tools.
However, the technological arms race between disinformation creators and detection systems shows no signs of slowing. As AI capabilities advance, so too must defensive measures – both technical and regulatory.
Conclusion
Poland’s formal request for EU intervention against AI-generated TikTok disinformation represents a significant moment in the ongoing struggle to protect democratic processes from digital manipulation. As AI technology continues advancing, the line between authentic and synthetic content becomes increasingly blurred, creating new vulnerabilities in public discourse.
This case demonstrates that protecting democratic institutions requires coordinated action between governments, technology platforms, and civil society. Only through such collaboration can societies hope to maintain the integrity of their political processes in an age of sophisticated digital disinformation.
Leave a Reply