How does ToM impact real-time human-AI teamwork?
Mutual Theory of Mind in Human-Al Collaboration: An Empirical Study with LLM-driven Al Agents in a Real-time Shared Workspace Task
September 16, 2024
https://arxiv.org/pdf/2409.08811This research explores how humans and AI agents with Theory of Mind (ToM) capabilities interact and collaborate in real-time tasks within a shared workspace.
- It finds that an LLM-driven AI agent with ToM can enhance human understanding and feeling of being understood, even if not significantly impacting team performance.
- Bidirectional verbal communication may hinder performance due to increased workload and distraction for the human.
- Humans tend to rely on observing the AI's actions rather than verbal communication to infer its intentions and coordinate their own actions.
- The AI agent's ability to adapt its behavior based on human actions is crucial for effective collaboration.
- Hallucination in LLMs can negatively influence ToM capabilities, requiring protective measures for future applications.
- Exploring multi-level recursive ToM processes and enhancing non-verbal communication abilities of LLM-driven agents are important future directions.