How can I efficiently route LLMs in multi-agent systems?
MasRouter: Learning to Route LLMs for Multi-Agent Systems
February 18, 2025
https://arxiv.org/pdf/2502.11133This paper introduces MasRouter, a system for efficiently managing multiple LLMs within a multi-agent framework. It addresses the cost and complexity of using multiple LLMs by intelligently routing tasks to the most appropriate LLM and coordinating interactions between agents. MasRouter determines the best collaboration strategy, assigns roles to different LLMs (e.g., programmer, tester), and selects the optimal LLM for each role based on the task's complexity and domain. It significantly reduces cost and improves performance compared to existing methods, and can also be integrated with existing multi-agent systems for enhanced efficiency.