A framework to provide fine-grained time-dependent context for active listening experiences

Author version | Version of record | Further information

Publication type: Articles in peer reviewed conference proceedings

Abstract: This work presents a system that is able to provide fine-grained time-dependent context while listening to recorded music. By utilizing acoustic fingerprinting techniques the system recognizes which music is playing in the environment and also determines an exact playback position. This makes it possible to provide context at exactly the right time. The design of the system can be used to augment listening experiences with lyrics, scores, tablature or even music videos. To test the concept, a prototype has been built that is able to give feedback that coincides with the beat of music playing in the users environment. The system is evaluated with respect to timing and is able to respond to beats within 16 ms on average.

@inproceedings{six2017activelistening,
  author      = {Joren Six and Marc Leman},
  title       = {{A framework to provide fine-grained time-dependent 
                  context for active listening experiences}},
  booktitle   = {{Proceedings of the AES Conference on Semantic Audio 2017}}, 
  year        =  2017
}