Crossole: A Gestural Interface for Composition, Improvisation and Performance using Kinect

TitleCrossole: A Gestural Interface for Composition, Improvisation and Performance using Kinect
Publication TypeConference Paper
Year of Publication2012
Conference NameProceedings of the International Conference on New Interfaces for Musical Expression (NIME)
AuthorsŞentürk, S., Lee S. W., Sastry A., Daruwalla A., & Weinberg G.
Conference Start DateMay 21-23
PublisherUniversity of Michigan
Conference LocationAnn Arbor, Michigan
Keywordsbody gesture, chord progression, Kinect, meta-instrument
AbstractIn many non-Western musical traditions, such as North Indian classical music (NICM), melodies do not conform to the major and minor modes, and they commonly use tunings that have no fixed reference (e.g., A = 440 Hz). We present a novel method for joint tonic and raag recognition in NICM from audio, based on pitch distributions. We systematically compare the accuracy of several methods using these tonal features when combined with instance-based (nearest-neighbor) and Bayesian classifiers. We find that, when compared with a standard twelve-dimensional pitch class distribution that estimates the relative frequency of each of the chromatic pitches, smoother and more continuous tonal representations offer significant performance advantages, particularly when combined with appropriate classification techniques. Best results are obtained using a kernel-density pitch distribution along with a nearest-neighbor classifier using Bhattacharyya distance, attaining a tonic error rate of 4.2 percent and raag error rate of 10.3 percent (with 21 different raag categories). These experiments suggest that tonal features based on pitch distributions are robust, reliable features that can be applied to complex melodic music.