Visualisation and Measurement Assisted Design

TitleVisualisation and Measurement Assisted Design
Publication TypeReport
Year of Publication2009
AuthorsAdiloglu, K., Anniés R., Purwins H., & Obermayer K.
AbstractIf a sound makes you relax - when listening to the waves on the beach - or lets you shiver - like scratching fingernails on the blackboard - makes a crucial difference when creating the sounds for an interaction with a physical object, a video game, a movie, or a cyber instrument. Being a sound designer, you may have Gigabytes of sounds on your hard drive or a high number of parameters for your sound synthesis model to tune. But imagine a painter with hundreds oil paint tubes all piled up with no labels on them informing you about the color content. How tiresome if you have to open each tube until you find the appropriate color. Imagination would be much more inspired if the perceptual space of different functional-aesthetic, and emotional shades could be mapped intuitively on a two-dimensional plane, on a color palette for perceptual sound attributes. If you use sound synthesis models, be it spectral, granular, physical, general algorithmic models, . . . : in the end there are parameters to set (mostly using some sort of sliding controller or just number inputs) to fine tune or even to make the model work inside the specifications of audible signals. At this point the complexity of the model, i.e. the number of parameters or its dimensionality determines the utility of it. Moreover, it can determine if a model is feasible at all for sound design. How can a machine assist the sound designer with methods that represent audio signals visually and make them accessible to manipulations using visualization? We have shed light to the topic from different perspectives.
preprint/postprint document