Back Article in IEEE Signal Processing Magazine on Expression control in singing voice synthesis

Article in IEEE Signal Processing Magazine on Expression control in singing voice synthesis

22.10.2015

 

Martí Umbert and Jordi Bonada coauthor a journal article on the state of the art work on expression control in singing voice synthesis, that has just been published for the November issue of the IEEE Signal Processing Magazine. It reviews the features typically used to control singing voice expression, the approaches that have been proposed, how these are evaluated, and highlights the challenges that we currently foresee.

M. Umbert, J. Bonada. M. Goto. T. Nakano, and J. Sundberg, "Expression control in singing voice synthesis: Features, approaches, evaluation, and challenges," IEEE Signal Processing Mag., vol. 32, no. 6, pp. 55-73, Nov. 2015.

Abstract: In the context of singing voice synthesis, expression control manipulates a set of voice features related to a particular emotion, style, or singer. Also known as performance modeling, it has been approached from different perspectives and for different purposes, and different projects have shown a wide extent of applicability. The aim of this article is to provide an overview of approaches to expression control in singing voice synthesis. We introduce some musical applications that use singing voice synthesis techniques to justify the need for an accurate control of expression. Then, expression is defined and related to speech and instrument performance modeling. Next, we present the commonly studied set of voice parameters that can change perceptual aspects of synthesized voices. After that, we provide an up-to-date classification, comparison, and description of a selection of approaches to expression control. Then, we describe how these approaches are currently evaluated and discuss the benefits of building a common evaluation framework and adopting perceptually-motivated objective measures. Finally, we discuss the challenges that we currently foresee.

Multimedia

Categories:

SDG - Sustainable Development Goals:

Els ODS a la UPF

Contact