News and Events
18 Nov 2016
On November 18th 2016, Friday, from 10h to 18:30h in room 55.410 of the Communication Campus of the Universitat Pompeu Fabra in Barcelona, we will have a CompMusic seminar. This seminar accompanies the PhD thesis defenses of Ajay Srinivasamurthy and Sankalp Gulati, carried out in the context of the CompMusic project.
10:00 Simon Dixon (QMUL, London)
"Music Similarity and Cover Song Identification: The Case of Jazz"
Similarity in music is an evasive and subjective concept, yet computational models of similarity are cited as important for addressing tasks such as music recommendation and the management of music collections. Cover song (or version) identification deals with a specific case of music similarity, where the underlying musical work is the same, but its realisation is different in each version, usually involving different performers and differing arrangements of the music, which may vary in instrumentation, form, tempo, key, lyrics or in other aspects of rhythm, melody, harmony and timbre. The new version retains some features of the original recording, and it is usually assumed that the sequential pitch content (corresponding to melody and harmony) is preserved with limited alterations from the original version.
In music information retrieval, a standard approach to version identification uses predominant melody extraction to represent melodic content and chroma features to represent harmonic content. These features are adapted to allow for variation in key or tempo between versions, and a pairwise sequence matching algorithm computes the pairwise similarity between tracks, which can be used to estimate groups of cover songs. Different versions of a jazz standard can be regarded as a set of cover songs, but the identification of such covers is more complicated than for many other styles of music, due to the improvisatory nature of jazz, which allows ornamentation and transformation of the melody as well as substitution of chords in the harmony. We report on experiments on a set of 300 jazz standards using discrete-valued and continuous-valued measures of pairwise predictability between sequences, based on work with a former PhD student, Peter Foster.
11:00 Geoffroy Peeters (IRCAM, Paris)
"Recent researches at IRCAM related to the recognition of rhythm, vocal imitations and music structure"
In this talk, I will present some recent researches at IRCAM related to - the description of rhythm (especially the use of the Fourier-Mellin transform or of the Modulation Scale Transform with Auditory statistics) - the recognition of vocal imitations (using HMM decoding of SI-PLCA kernels over time) - the estimation of musical structure (using Convolutional Neural Networks).
12:00 Coffe break
12:30 Andre Holzapfel (KTH, Stockholm)
"Tracking time: State-of-the-art and open problems in meter inference"
Throughout the last years, significant progress was made in algorithmic approaches that aim at the recognition of metrical cycles, and the tracking of their structure in music audio signals. The automatic adaption to rhythmic patterns enabled to go beyond manually tailored tracking approaches, and deep learning based features increase the accuracy of the inference given an unknown audio signal. In principle, arbitrary time signatures can be recognized and tracked from a music recording, assuming the existence of a large enough representative dataset to learn from. In this talk a short summary of the state of the art will be provided, and open problems will be presented that represent potential subjects of future studies. These open problems comprise the tracking of metrical cycles of very long duration, the inclusion of modes beyond the acoustic signal, and a variety of subjects that arise within areas like performance studies, music theory, and ethnomusicology.
13:30 Lunch break
15:00 Barış Bozkurt (Koç University, Istanbul)
"Melodic analysis for Turkish makam music"
A makam generally implies a miscellany of rules for melodic composition, a design for melodic contour as a sequence of melodies (from specific categories) emphasising specific tones. This talk will start by presenting melody concepts in Turkish makam music and then continue discussing the methods, uses and automatisation of melodic analysis for that music tradition. A study on culture-specific automatic melodic segmentation (of scores) will be presented. Finally we will discuss future perspectives for melodic analysis within the context of corpus-based study of makams.
16:00 Juan Pablo Bello (NYU, New York)
"Some Thoughts on the How, What and Why of Music Informatics Research"
The framework of music informatics research (MIR) can be thought of as a closed loop of data collection, algorithmic development and benchmarking. Much of what we do is heavily focused on the algorithmic aspects, or how to optimally combine various techniques from e.g., signal processing, data mining, and machine learning, to solve a variety of problems, from auto-tagging to automatic transcription, that captivate the interest of our community. We are very good at this, and in this talk I will describe some of the know-how that we have collectively accumulated over the years. On the other hand, I would argue that we are less proficient at clearly defining the “what” and “why” behind our work, that data collection and benchmarking have received far less attention and are often treated as afterthoughts, and that we sometimes tend to rely on widespread and limiting assumptions about music that affect the validity and usability of our research. On this, we can learn from other fields, such as music cognition, particularly with regards to the adoption of methods and practices that fully embrace the complexity and variability of human responses to music, while still clearly delineating the scope of the solutions or analyses being proposed.
17:00 Coffee break
17:30 Joan Serrà (Telefónica R+D, Barcelona)
"Facts and myths about deep learning"
Deep learning has revolutionized the traditional machine learning pipeline, with impressive results in domains such as computer vision, speech analysis, or natural language processing. The concept has gone beyond research/application environments, and permeated into the mass media, news blogs, job offers, startup investors, or big company executives' meetings. But what is behind deep learning? Why has it become so mainstream? What can we expect from it? In this talk, I will highlight a number of facts and myths that will provide a shallow answer to the previous questions. While doing that, I will also highlight a number of applications we have worked on at our lab. Overall, the talk wants to place a series of basic concepts, while giving ground for reflection or discussion on the topic.
Ajay Srinivasamurthy and Sankalp Gulati defend their PhD thesis
17 Nov 2016
Thursday, November 17th 2016 at 15:00h in room 55.309 (Tanger Building, UPF Communication Campus)
Ajay Srinivasamurthy: “A Data-driven Bayesian Approach to Automatic Rhythm Analysis of Indian Art Music”
Thesis director: Xavier Serra
Thesis Committee: Simon Dixon (QMUL), Geoffroy Peeters (IRCAM) and Juan Pablo Bello (NYU)
[Full thesis document and accompanying materials]
Abstract: Large and growing collections of a wide variety of music are now available on demand to music listeners, necessitating novel ways of automatically structuring these collections using different dimensions of music. Rhythm is one of the basic music dimensions and its automatic analysis, which aims to extract musically meaningful rhythm related information from music, is a core task in Music Information Research (MIR).
Musical rhythm, similar to most musical dimensions, is culture-specific and hence its analysis requires culture-aware approaches. Indian art music is one of the major music traditions of the world and has complexities in rhythm that have not been addressed by the current state of the art in MIR, motivating us to choose it as the primary music tradition for study. Our intent is to address unexplored rhythm analysis problems in Indian art music to push the boundaries of the current MIR approaches by making them cultureaware and generalizable to other music traditions.
The thesis aims to build data-driven signal processing and machine learning approaches for automatic analysis, description and discovery of rhythmic structures and patterns in audio music collections of Indian art music. After identifying challenges and opportunities, we present several relevant research tasks that open up the field of automatic rhythm analysis of Indian art music. Data-driven approaches require well curated data corpora for research and efforts towards creating such corpora and datasets are documented in detail. We then focus on the topics of meter analysis and percussion pattern discovery in Indian art music.
Meter analysis aims to align several hierarchical metrical events with an audio recording. Meter analysis tasks such as meter inference, meter tracking and informed meter tracking are formulated for Indian art music. Different Bayesian models that can explicitly incorporate higher level metrical structure information are evaluated for the tasks and novel extensions are proposed. The proposed methods overcome the limitations of existing approaches and their performance indicate the effectiveness of informed meter analysis.
Percussion in Indian art music uses onomatopoeic oral mnemonic syllables for the transmission of repertoire and technique, providing a language for percussion. We use these percussion syllables to define, represent and discover percussion patterns in audio recordings of percussion solos. We approach the problem of percussion pattern discovery using hidden Markov model based automatic transcription followed by an approximate string search using a data derived percussion pattern library. Preliminary experiments on Beijing opera percussion patterns, and on both tabla and mridangam solo recordings in Indian art music demonstrate the utility of percussion syllables, identifying further challenges to building practical discovery systems.
The technologies resulting from the research in the thesis are a part of the complete set of tools being developed within the CompMusic project for a better understanding and organization of Indian art music, aimed at providing an enriched experience with listening and discovery of music. The data and tools should also be relevant for data-driven musicological studies and other MIR tasks that can benefit from automatic rhythm analysis.
Thursday, November 17th 2016 at 17:00h in room 55.309 (Tanger Building, UPF Communication Campus)
Sankalp Gulati: “Computational Approaches for Melodic Description in Indian Art Music Corpora”
Thesis director: Xavier Serra
Thesis Committee: Juan Pablo Bello (NYU), Emilia Gómez (UPF) and Barış Bozkurt (Koç Univ.)
[Full thesis document and accompanying materials]
Abstract: Automatically describing contents of recorded music is crucial for interacting with large volumes of audio recordings, and for developing novel tools to facilitate music pedagogy. Melody is a fundamental facet in most music traditions and, therefore, is an indispensable component in such description. In this thesis, we develop computational approaches for analyzing high-level melodic aspects of music performances in Indian art music (IAM), with which we can describe and interlink large amounts of audio recordings. With its complex melodic framework and well-grounded theory, the description of IAM melody beyond pitch contours offers a very interesting and challenging research topic. We analyze melodies within their tonal context, identify melodic patterns, compare them both within and across music pieces, and finally, characterize the specific melodic context of IAM, the ragas. All these analyses are done using data-driven methodologies on sizable curated music corpora. Our work paves the way for addressing several interesting research problems in the field of music information research, as well as developing novel applications in the context of music discovery and music pedagogy.
Seminar by Dr. Tetsuro Kitahara
11 Oct 2016
Dr. Tetsuro Kitahara from Nihon University will be giving a talk on "From Instrument Recognition to Support of Amateurs' Music Creation" on Tuesday 11 Oct 17:00 in room 52.105.
New students in the SMC Master
In this new academic year 2016-2017, twenty new students have joined the Master in Sound and Music Computing.
Helena Cuesta Mussarra (Spain), Manuel Florencio Olmedo (Spain), Jimmy Jarjoura (Lebanon), Simon Kilmister (UK), Kushagra Sharma (India), Tessy Anne Vera Troes (Luxemburg), Pablo Alonso Jiménez (Spain), Daniel Balcells Eichenberger (Spain), Natalia Delgado Galán (Spain), Manaswi Mishra (India), Nestor Napoles Lopez (Mexico), Minz Sanghee Won (South Korea), Vibhor Bajpai (India), Siddharth Bhardwaj (India), Vsevolod Eremenko (Russia), Gerard Erruz Lopez (Spain), Joseph Munday (UK), Germán Ruiz Marcos (Spain), Marc Siquier Peñafort (Spain), Meghana Sudhindra (India).
New session of the MOOC on Audio Signal Processing for Music Applications
A new session of the MOOC on Audio Signal Processing for Music Applications is starting in Coursera on September 26th. To enrol go to https://www.coursera.org/learn/audio-signal-processing
This is a 10 week long course that focuses on the spectral processing techniques of relevance for the description and transformation of sounds, developing the basic theoretical and practical knowledge with which to analyze, synthesize, transform and describe audio signals in the context of music applications.
The course is free and based on open software and content. The demonstrations and programming exercises are done using Python under Ubuntu, and the references and materials for the course come from open online repositories. The software and materials developed for the course are also distributed with open licenses.
The course assumes some basic background in mathematics and signal processing. Also, since the assignments are done with the programming language Python, some software programming skills in any language are most helpful.
Awards from the Board of Trustees of the UPF
Gopala K. Koduri and Sankalp Gulati got the 3rd price of the Knowledge Transfer category given by the Board of Trustees of the UPF for their MusicMuni initiative. MusicMuni will be a spin-off company of the MTG aiming to exploit several technologies developed within the CompMusic project specific for analyzing Indian music in the context of music education. (https://www.upf.edu/consellsocial/premis/_pdf/guany_tc_2016.pdf)
Xavier Serra got an award in the category of teaching quality, also given by the Board of Trustees of the UPF, for the Master course on Audio Signal Processing for Music Applications and the accompanying MOOC with the same name. (https://www.upf.edu/consellsocial/premis/_pdf/guany_qd_2016.pdf)
Jordi Bonada and Merlijn Blaauw present at Interspeech 2016 and win the Singing Synthesis Challenge
A few days ago Merlijn Blaauw and Jordi Bonada attended the Interspeech 2016 conference in San Francisco, USA.
The following four papers were coauthored by MTG members:
It is worth saying that we won the special challenge for singing voice synthesis :-)
Zacharias Vamvakousis defends his PhD thesis on September 16th
16 Sep 2016
Zacharias Vamvakousis defends his PhD thesis entitled "Digital Musical Instruments for People with Physical Disabilities" on Friday September 16th 2016 at 17:30h in room 55.316 of the Communication Campus of the UPF.
The jury of the defense is: Jose Manuel Iñesta (Alicante University), Hendrik Purwins (Aalborg University), Alfonso Perez (UPF)
Playing a musical instrument has been shown to have a positive impact in the life of individuals in many different ways. Nevertheless, due to physical disabilities, some people are unable to play conventional musical instruments. In this dissertation, we consider different types of physical disabilities and implement specific digital musical instruments suitable for people with disabilities of each type. Firstly, we consider the case of people with limited sensorimotor upper limb functions, and we construct low-cost digital instruments for three different scenarios. Results indicate that the constructed prototypes allow musical expression and improve the quality of life of these users. Secondly, we consider disabilities such as tetraplegia or locked-in syndrome with unaffected eye-movements. For individuals with such conditions, we propose the EyeHarp, a gaze-controlled digital music instrument, and develop specific target selection algorithms which maximize the temporal and spatial accuracy required in music performance. We evaluate the instrument on subjects without physical disabilities, both from an audience and performer perspective. Results indicate that the EyeHarp has a steep learning curve and it allows expressive music performances. Finally, we examine the case of brain-controlled music interfaces. We mainly focus in auditory event related potential-based interfaces. In particular, we investigate and evaluate how timbre, pitch and spatialization auditory cues affect the performance of such interfaces.
Sergio Giraldo defends his PhD thesis on September 16th
16 Sep 2016
Sergio GIraldo defends his PhD thesis entitled "Computational Modelling of Expressive Music Performance in Jazz Guitar: A Machine Learning Approach" on Friday September 16th 2016 at 15:00h in room 55.309 of the Communication Campus of the UPF.
The jury of the defense is: Jose Manuel Iñesta (Alicante University), Hendrik Purwins (Aalborg University), Enric Guaus (UPF)
Computational modelling of expressive music performance deals with the analysis and characterization of performance deviations from the score that a musician may introduce when playing a piece in order to add expression. Most of the work in expressive performance analysis has focused on expressive duration and energy transformations, and has been mainly conducted in the context of classical piano music. However, relatively little work has been dedicated to study expression in popular music where expressive performance involves other kinds of transformations. For instance in jazz mu- sic, ornamentation is an important part of expressive performance but is seldom indicated in the score, i.e. it is up to the interpreter to decide how to ornament a piece based on the melodic, harmonic and rhythmic contexts, as well as on his/her musical background. In this dissertation we investigate the computational modelling of expressive music performance in jazz music, using the guitar as a case study. High-level features are extracted from music scores, and expressive transformations (including timing, energy and ornamentation transformations) are obtained from the corresponding audio recordings. Once each note is characterized by its musical context description and expressive deviations, several machine learning techniques are explored to induce both, black-box and interpretable rule-based predictive models for duration, onset, dynamics and ornamentation transformations. The models are used to both, render expressive performances of new pieces, and attempt to understand expressive performance. We report on the relative importance of the considered music features, quantitatively evaluate the accuracy of the induced models, and discuss some of the learnt expressive performance rules. Furthermore, we present different approaches to semi-automatic data extraction-analysis, as well as some applications in other research fields. The findings, methods, data extracted, and libraries developed for this work are a contribution to expressive music performance field.
Technology Transfer position at the MTG
The Music Technology Group (MTG) of the Universitat Pompeu Fabra, Barcelona (http://mtg.upf.edu) invites applications for a tech transfer position.
The MTG is a research group specialized in sound and music computing committed to have social impact and with a strong focus on technology transfer activities. The MTG has created several spin-off companies, is active in licensing technologies, collaborates and has contracts with a number of companies, and develops and maintains open software and collaborative based technologies, like Essentia or Freesound, that are exploited in industrial contexts.
Successful candidates for this position should be experienced researchers with a motivation and experience on technology transfer wanting to take a leading role in promoting technology transfer initiatives within the music sector.
Responsible for driving all technology transfer processes to resolution, from market prospection, preparation of internal results for exploitation and the negotiation and follow-up of contracts / license agreements with external customers and the university. Specifically to:
Interested candidates should send a resume as well as a motivation letter, addressed to Xavier Serra, to mtg-info [at] upf [dot] edu (subject: tech%20transfer%20position) before October 15th.