4 Feb 2016

Diemo Schwarz, from IRCAM, will give a talk on "Tangible and Embodied Interaction on Surfaces, with Mobile Phones, and with Tapioca" on Thursday February 4th 2016 at 3:30pm in room 52.123 of the Communication Campus of the UPF.

Abstract: This talk will present current work of the Sound, Music, Movement Interaction team (ISMM) at Ircam about various ways to enhance interaction with digital sound synthesis or processing through the use of everyday objects and materials. The interaction is tangible and embodied and makes use of a variety of everyday gestures up to expert gestures. We will focus on three examples:

• First, we show how the timbral potential of intuitive and expressive contact interaction on arbitrary surfaces can be enhanced through latency-free convolution of the microphone signal with grains from a sound corpus.
• Second, using inertial sensors as found in commodity smartphones to produce sound depending on the devices' motion allows to leverage the creative potential and group interaction of the general public, as shown in the CoSiMa project (Collaborative Situated Media) based on the Web Audio API.
• Third, with granular or liquid interaction material as in the DIRTI tangible interfaces, we forego the dogma of repeatability in favor of a richer and more complex experience, creating music with expressive gestures, molding sonic landscapes by plowing through tapioca beads.

Diemo Schwarz's website