How can LLMs build reliable AI swarms in untrusted environments?
SELF-SUPERVISED INFERENCE OF AGENTS IN TRUSTLESS ENVIRONMENTS
September 16, 2024
https://arxiv.org/pdf/2409.08386This paper proposes a new method for decentralized AI inference using a swarm of agents. Each agent can generate responses and rank those of other agents, with a focus on using LLMs as response classifiers. A consensus mechanism ensures robust and accurate output while mitigating malicious attacks like Sybil attacks and prompt engineering. The system boasts low latency (under 125ms) even with large language models like Llama 3 405B thanks to parallel processing, selective ranking, and efficient consensus.