Can LLMs reliably coordinate under attacks?
IBGP: Imperfect Byzantine Generals Problem for Zero-Shot Robustness in Communicative Multi-Agent Systems
This paper introduces IBGP, a novel approach for achieving secure and robust coordination in multi-agent systems, even with the presence of malicious agents. Unlike traditional Byzantine protocols that aim for global consensus, IBGP focuses on achieving partial consensus, making it more efficient and suitable for real-world applications where not all agents need to agree.
The key point relevant to LLM-based multi-agent systems is that IBGP can be implemented as a lightweight communication protocol within these systems, allowing LLM agents to coordinate reliably and safely despite potential risks posed by hallucinations or external attacks. The protocol's effectiveness is demonstrated through theoretical analysis and simulations across various scenarios.