Faking Fake News for Real Fake News Detection: Propaganda-Loaded Training Data Generation
Kung-Hsiang HuangKathleen R. McKeownPreslav NakovYejin ChoiHeng Ji
Proposes an automated framework that combines natural language inference-guided infilling with propaganda generation to create realistic synthetic disinformation that significantly improves the detection of human-written fake news.
Online disinformation poses a growing threat to public trust and social stability, yet building automated systems to detect it is hindered by a lack of high-quality training data. Manually fact-checking human-written disinformation is slow and unscalable, while standard machine-generated fake news fails to reflect how real disinformation is crafted. In reality, human-authored disinformation rarely fabricates an entire story; instead, it strategically embeds false claims within otherwise factual reporting and employs psychological manipulation through propaganda techniques.
The article demonstrates a novel framework to automatically generate realistic training data that mirrors the structure and style of human-written disinformation. Its primary objective is to evaluate whether training machine learning detectors on this propaganda-loaded synthetic data improves their accuracy in spotting actual human-written fake news.
To achieve this, the researchers developed a multi-stage approach using authentic news articles as a foundation. They first identified the most critical, central sentence in an article and replaced it with a plausible but false alternative. To ensure the new sentence was truly disinformative and not logically implied by the original context, they applied a natural language inference reward mechanism during generation. Next, they injected two prevalent propaganda techniques: appeal to authority, which fabricates quotes from domain experts, and loaded language, which adds sensationalized, emotion-triggering phrasing. The researchers used this pipeline to create a benchmark dataset containing 2,256 verified articles and evaluated several transformer-based detection models across standard public benchmarks.
The findings confirm that this generation strategy significantly enhances detection capabilities. First, detectors trained on the new dataset achieved a 3.62% to 7.69% improvement in detection performance on real-world benchmark datasets compared to models trained on existing synthetic baselines. Second, the generated articles demonstrated a substantially closer statistical similarity to real disinformation than previous fully synthetic methods. Third, human evaluation confirmed that incorporating propaganda significantly increased the plausibility of the generated articles, with nearly 30% of evaluators noting that the propaganda techniques directly influenced their perception of the story's credibility. Finally, ablation tests proved that adding both emotional and authoritative propaganda directly contributed to the overall performance gains of the detectors.
These results demonstrate that effective disinformation detection requires training models on subtle, mixed-factuality text rather than entirely fabricated articles. By capturing stylistic nuances and rhetorical manipulation, synthetic data generation becomes a viable, cost-effective substitute for labor-intensive manual curation. Furthermore, identifying specific manipulated sentences enables more explainable and auditable detection systems, reducing compliance and operational risks for platforms tasked with content moderation.
Organizations developing automated moderation or intelligence analysis tools should transition from fully synthetic training regimes to targeted, manipulation-based data pipelines. To manage ethical and dual-use risks, practitioners must implement strict governance, as the underlying generation techniques could potentially be repurposed to generate harmful disinformation. For safety, the source code for the detectors and the resulting dataset are made available, while the direct generation engine is restricted.
Certain limitations remain, warranting measured confidence in specific operating environments. Performance gains plateaued when scaling synthetic data volume, indicating an enduring gap in capturing human intent, narrative novelty, and broader deceptive styles. The framework is currently limited to English-language texts and automates only two specific propaganda techniques, while failing to detect disinformation that requires dynamic, real-time knowledge or multi-document reasoning. Future initiatives should focus on broadening language coverage, integrating additional propaganda strategies, and connecting detectors to live, external knowledge bases.
- Paper: Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations, Zhuoyan Li et al. (2023). This study establishes when LLM-generated synthetic text can train classifiers effectively, providing the key baseline for understanding why the source enriches synthetic examples with realistic propaganda.
- Paper: “Liar, Liar Pants on Fire”: A New Benchmark Dataset for Fake News Detection, William Yang Wang (2017). The LIAR benchmark illustrates the challenges of building and evaluating fake-news detectors on real-world misinformation data, a foundation for the source’s synthetic-data approach.
- Paper: Fake News Detection on Social Media: A Data Mining Perspective, Kai Shu et al. (2017). This survey organizes fake-news detection methods, datasets, and definitions, supplying the field’s core framework for the source’s targeted detection contribution.
- Paper: Disarming Strategic Text: Span-Aware Counterfactuals for Robust Content Moderation, Hardik Meisheri et al. (2025). Building on targeted identification of manipulated text, this work uses span-aware counterfactuals to make content moderation more robust to strategic rewrites.
- Paper: Examining the Expanding Role of Synthetic Data Throughout the AI Development Pipeline, Shivani Kapania et al. (2025). This later study broadens synthetic-data generation from a detection-training technique into an organizational pipeline, examining its validation, risks, and governance.
