A wireless real-time controller for the Apollo 'Ensemble' audio visual system

This research investigates the development of a surround sound controller prototype application for the Apple iPhone and iPad (iOS) for the users of Apollo Creative’s ‘Ensemble’ system. ‘Ensemble’ is an interactive audio, lighting and video software and hardware package. It allows users to design multi-sensory environments and software instruments reacting to a range of input sensors. The users are primarily music therapists and special needs specialists. The iOS application functionality and user interface is designed primarily to accommodate Ensemble users but the study additionally explores complex functionality for advanced users such as composers and sound designers. Some of the features of the application allow users to: position multiple speakers arbitrarily in a 2D environment; adjust the volume of a single or groups of speakers; route sound source inputs; directly position sound; automate positioning by drawing pan trajectories; play back and manipulate the pan trajectories in a complex way including the use of touch gestures; further automate using multiple path layers. The software incorporates the OpenFrameworks library and communicates wirelessly with a Max/MSP spatialiser, using the Open Sound Control (OSC) protocol via control messages. Surround sound panning is controlled using Distance-Based Amplitude Panning to allow arbitrary speaker and listener positions. The application was evaluated by a series of diagnostic tests and detailed interviews.