Back Seminar by Julio José Carabias on audio to score alignment

Seminar by Julio José Carabias on audio to score alignment

07.06.2013

 

13 Jun 2013

Julio José Carabias Orti from University of Jaén will give a seminar titled "RealTime Audio to Score Alignment System using Spectral Factorization and Online Time Warping" on Thursday, June 13th, at 15.30 in room 52.321.

Abstract:
In this work, we present a realtime score follower based on spectral factorization and online Dynamic Time Warping (DTW). The presented system has two separated stages, preprocessing and alignment. On the first one, we convert the score into a reference audio signal using a MIDI synthesizer software and we analyze the provided information in order to obtain the spectral patterns (i.e. basis functions) associated to each combination of notes. These basis functions are learned from the synthetic MIDI signal using a method based on NMF with Beta-divergence where the gains are initialized as the ground- truth transcription inferred from the MIDI. On the second stage, a realtime signal decomposition method with fixed basis functions per combination of notes is used over the magnitude spectrogram of the input signal resulting in a distortion matrix that can be interpreted as the cost of the matching for each combination of notes at each frame. Finally, two online DTW approaches are proposed to find the path with the minimum cost and then determine the real duration of the MIDI states. Our system has been compared to other state-of the-art systems obtaining reliable results.

Biography:

Julio José Carabias-Orti received the M.Sc. degree in computer science and the Doctor of Science degree from the University of Jaen, Jaen, Spain, in 2006 and 2011, respectively. He is currently working as a research fellow at the Telecommunication Engineering Department, University of Jaen. His research topics include automatic music transcription, sound source separation, factorization algorithms and machine learning.

 

Multimedia

Categories:

SDG - Sustainable Development Goals:

Els ODS a la UPF

Contact