Can debating LLMs detect breaking event rumors?
Breaking Event Rumor Detection via Stance-Separated Multi-Agent Debate
This paper introduces S2MAD, a multi-agent debate system for detecting rumors on social media during breaking events. S2MAD uses multiple LLMs as "debaters" with assigned stances (supporting or opposing a claim) determined by analyzing comments. Claims are categorized as subjective or objective, guiding initial prompt design for each LLM. Debaters engage in multiple rounds of argumentation, and if no consensus is reached, a "judge" LLM makes the final veracity determination. Key to LLM-based multi-agent systems is the stance separation, specialized prompting based on claim subjectivity, and the debate framework for refining and consolidating information from multiple LLMs, leading to more robust rumor detection.