How can robots collaborate with humans in complex tasks?
HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams
September 27, 2024
https://arxiv.org/pdf/2409.18047This paper introduces HARMONIC, a new system for multi-robot collaboration that emphasizes natural language communication, explainability, and cognitive abilities like understanding team structure and adapting to new information.
Key features relevant to LLM-based multi-agent systems:
- Human-like communication: HARMONIC robots understand and generate natural language, allowing them to seamlessly interact with human teammates.
- Transparency and explainability: Unlike black-box LLMs, HARMONIC focuses on "glass-box" modules, making its decision-making processes clear and understandable, which is crucial for building trust in human-robot teams.
- Cognitive control: The system combines high-level, strategic reasoning (similar to LLMs) with low-level, reactive robot control, allowing for flexible and adaptable behavior in complex tasks.