In this paper, we present the SyncPlayer system for multimodal presentation of high quality audio and associated music-related data. Using the SyncPlayer client interface , a user may play back an audio recording that is locally available on his computer. The recording is then identified by the SyncPlayer server, a process which is performed entirely content-based. Subsequently, the server deliver s music-related data like scores or lyrics to the client, whic h are then displayed synchronously with audio playback using a multimodal visualization plug-in. In addition to visualization, the system provides functionality for conten tbased music retrieval and semi-manual content annotation. To the best of our knowledge, our system is moreover the first to systematically exploit automatically generate d synchronization data for content-based symbolic browsing in high quality audio recordings. SyncPlayer has already proved to be a valuable tool for evaluating algorithms in MIR research on a larger scale. In this paper, we describe the technical background of the SyncPlayer framework in detail. We also give an overview of the underlying MIR techniques of audio matching, music synchronization, and text-based retrieval that are incorpora ted in the current version of the system.
['Frank Kurth', 'Meinard Müller', 'David Damm', 'Christian Fremerey', 'Andreas Ribbrock', 'Michael Clausen']
Syncplayer - An Advanced System for Multimodal Music Access.