Zero-Shot Rumor Detection with Propagation Structure via Prompt Learning
Hongzhan LinPengyao YiJing MaHaiyun JiangZiyang LuoShuming ShiRuifang Liu
Proposes a response-aware prompt learning framework that integrates domain-invariant propagation structures and hierarchical prompt encoding into multilingual pre-trained language models to accurately detect rumors across unseen languages and domains without target-specific annotations.
During fast-moving global crises and breaking events, rumors spread rapidly across social media platforms in multiple languages, threatening public health, safety, and institutional trust. Existing automated rumor detection systems rely heavily on large volumes of annotated data, which are typically concentrated in high-resource languages like English and Chinese. As a result, standard tools fail when confronted with unforeseen events emerging in low-resource or minority languages where labeled training examples do not exist, and human fact-checkers cannot scale quickly enough to assess the claims.
The article demonstrates an automated zero-shot rumor detection framework that identifies unverified claims across new languages and domains without requiring target-language training annotations. It evaluates how prompt-based learning and the structural dynamics of social media conversations can overcome the scarcity of labeled data during breaking events.
To achieve this, the researchers developed the Response-aware Prompt Learning framework. The approach decouples language-dependent grammar from shared semantic meaning by freezing the lower layers of a multilingual language model and fine-tuning the upper layers. It structures user replies using tree-based search patterns, models both absolute and relative propagation positions within conversation threads, applies adversarial data augmentation to handle social media noise, and uses class prototypes to classify rumors without language-specific label tuning. The framework was evaluated across four public datasets and a newly constructed low-resource benchmark containing Cantonese and Arabic social media threads related to COVID-19.
The framework consistently outperformed all conventional transfer learning, adapter, and baseline prompt-tuning methods across multiple evaluation metrics. Among structural ranking strategies, breadth-first traversal yielded the most robust and accurate results, outperforming depth-first and purely chronological orderings. Crucially, the system demonstrated strong early-detection capabilities, reaching saturated predictive accuracy with only 20 reply posts or within 4 hours of an initial post, significantly faster than baseline methods.
These findings indicate that user response patterns and conversational structures carry universal, language-agnostic signals that can be leveraged to detect misinformation. For platform operators, policymakers, and public health organizations, this provides a cost-effective and scalable pathway to monitor emergent crises globally without maintaining expensive fact-checking or annotation pipelines for every regional dialect. Early automated flagging also reduces response timelines, allowing timely interventions before false narratives become deeply entrenched.
Organizations monitoring misinformation should incorporate conversation propagation structures and hierarchical prompt architectures into their content moderation workflows. As a next step, deploying a pilot system to evaluate live streaming feeds during unfolding events would help determine practical operational trade-offs between speed and accuracy.
The approach is bounded by the standard context length limits of underlying language models and relies on the existence of initial user interactions. However, across the evaluated benchmarks, the framework delivers strong, consistent performance and offers a reliable foundation for zero-shot rumor detection.
- Paper: Detecting Rumors from Microblogs with Recurrent Neural Networks, Jing Ma et al. (2016). This foundational work establishes how temporal and conversational propagation sequences on microblogs can be modeled for rumor detection, which the source extends into tree-structured prompt learning.
- Paper: How Multilingual is Multilingual BERT?, Telmo Pires et al. (2019). This paper analyzes the zero-shot cross-lingual capabilities and shared semantic representations of multilingual language models, providing the core linguistic foundation leveraged by the source's multilingual transfer approach.
- Paper: Multitask Prompted Training Enables Zero-Shot Task Generalization, Victor Sanh et al. (2021). This work demonstrates how natural language prompt formatting enables zero-shot task generalization across unseen domains, a key mechanism adapted in the source's zero-shot detection framework.
- Paper: Information credibility on twitter, Carlos Castillo et al. (2011). This seminal paper introduces social context, reply dynamics, and propagation patterns as critical features for assessing information credibility on social media.
- Paper: Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment, Di Jin et al. (2019). This paper establishes adversarial textual perturbation techniques and vulnerabilities in text classification, motivating the adversarial data augmentation used in the source framework.
- Paper: Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm, Laria Reynolds et al. (2021). This work provides critical insight into structuring zero-shot prompts to elicit latent model capabilities without reliance on few-shot demonstrations.
- Paper: Fake News Detection on Social Media: A Data Mining Perspective, Kai Shu et al. (2017). This survey provides a comprehensive taxonomy of social-context and propagation-based features in misinformation detection on social platforms.
- Paper: Sniffer: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection, Peng Qi et al. (2024). This work extends zero-shot and language model-based misinformation detection into the multimodal domain by detecting out-of-context text-image pairs and generating natural language explanations.
- Paper: BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer, Akari Asai et al. (2024). This candidate builds upon cross-lingual prompt transfer research by establishing a comprehensive benchmark for evaluating few-shot and zero-shot transfer across 54 diverse languages.
- Paper: Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languages, Zihao Li et al. (2025). This paper advances the study of low-resource cross-lingual representations by introducing a quantitative metric to measure representation alignment between high- and low-resource languages.
- Paper: Factuality of Large Language Models: A Survey, Yuxia Wang et al. (2024). This survey provides a broader follow-up on factuality verification, error detection, and mitigation strategies across modern language model architectures.
