Human/Machine Ensemble Performance

 · 2024

This research explores incorporating computational agents into thee Doug Van Nort Electro-Acoustic Orchestra (EAO), a telematic electroacoustic ensemble that uses a gestural language adapted from Soundpainting to communicate performance instructions. This paper adapts the co-creative system Dicy2 from IRCAM for use in the ensemble. The paper then investigates the implications of including reactive machine voices alongside established ensemble players, and we analyzed feedback from EAO members who participated in play sessions with these agents.

We adapted Dicy2 for the EAO context by training six agents, each based on past recordings from a specific human EAO member. The recordings captured a wide array of timbral content and dynamics respective of the instrumentation and play tendencies of each player. The system allows for flexible routing, enabling agents to receive input from various sources, including other agents. This allows for complex networks of listening and response, similar to structures found in Pauline Oliveros’ Sonic Meditations.

Published in Hoy R.D., D. Van Nort, "Human-Machine Co-creation in an Electroacoustic Ensemble Performance Context", in Proc. of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures, 2024. |
PDF: [ACM Digital Library]

Scrubbing sorted spectral kurtosis memory segments.
Agent logic system diagram:
Agent system diagram
Agent Staging interface:
Agent staging interface