Can AI musicians collaborate with humans live?
Revival: Collaborative Artistic Creation through Human-AI Interactions in Musical Creativity
March 21, 2025
https://arxiv.org/pdf/2503.15498Revival is a live audiovisual performance showcasing real-time human-AI musical improvisation. Human musicians (percussionist, electronic musician, VJ) interact with AI musical agents (MASOM, SpireMuse) and an AI-driven visual synthesizer (Autolume). Agents are trained on existing musical works and dynamically respond to human input, generating music and visuals.
Key points for LLM-based multi-agent systems:
- Real-time interaction: Demonstrates complex real-time coordination between human and AI agents in a creative context.
- Small data approach: Emphasizes using curated datasets for training AI agents, relevant to ethical and resource considerations in LLM development.
- Machine listening: Agents analyze audio input using low-level (MFCCs, chroma) and high-level (valence, arousal) features, mirroring aspects of LLM understanding.
- Co-creative framework: Humans and AI contribute creatively, highlighting potential for collaborative LLM applications.
- Conductor system: Chataigne software manages communication and parameters between agents and other components, analogous to orchestration in multi-agent LLM systems.
- Challenges of multi-agent systems: Addresses synchronization, balancing autonomy, and audience perception, which are relevant to building collaborative LLM applications.