---
title: Publications - 0110.be
canonical: https://0110.be/Publications
markdown_url: https://0110.be/Publications.md
page: 0
posts_per_page: 30
total_posts: 57
filters:
  content_page: Publications
  tags:
  - Presentation
  - Research papers
previous:
next: https://0110.be/Publications.md?page=1
---

# Publications - 0110.be

 # Publications

I have profiles on [UGent Biblio](https://biblio.ugent.be/person/000130780248), [Google Scholar](https://scholar.google.be/citations?user=3DN9bk8AAAAJ), [ResearchGate](https://www.researchgate.net/profile/Joren-Six), [Research Portal Flanders](https://www.researchportal.be/nl/onderzoeker/joren-six), and [UGent Research](https://research.ugent.be/web/person/joren-six-0/nl). However, this page is the most complete and regularly updated source for my publications. The full list can be found below.


## [Sampo-UI 4.0 released at SEMANTiCS 2026](https://0110.be/posts/Sampo-UI_4.0_released_at_SEMANTiCS_2026.md)

- Published: 2026-09-16T00:00:00Z
- Updated: 2026-09-16T13:08:21Z
- Author: Joren
- ID: 585
- Canonical: https://0110.be/posts/Sampo-UI_4.0_released_at_SEMANTiCS_2026

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

Sampo-UI 4 was officially released at the SEMANTiCS conference in Ghent. Together with Jahid Chetti, Heikki, Annastiina Ahola and Frederic Lamsens, we worked on bringing the GhentCDH fork back into the [main Sampo-UI repository](https://github.com/SemanticComputing/sampo-ui).

The release includes an updated software stack, a clearer separation between the shared core and project-specific configuration, and a new plug-in system. These changes make it easier to reuse components across projects and keep portals up to date.

The GhentCDH fork has now been merged upstream. Our work continues as part of the shared Sampo-UI project, in collaboration with the original SeCo team.



<center>
<div style="width:70%">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 1400 500" role="img" aria-labelledby="timeline-title timeline-desc">
<title id="timeline-title">Sampo-UI development and GhentCDH contributions</title>
<desc id="timeline-desc">Sampo-UI development at SeCo continues along the main branch. GhentCDH forks the project, modernises its architecture and software stack, and improves modularity. The fork has merged back into upstream development.</desc>
<defs><marker id="timeline-arrow" markerWidth="10" markerHeight="10" refX="8" refY="4" orient="auto"><path d="M0 0L8 4L0 8Z" fill="#1E64C8"/></marker></defs>
<g font-family="PannoTextNormal, Arial, sans-serif" fill="#202020">
<text x="45" y="65" font-size="34" fill="#1E64C8">SeCo · Helsinki / Aalto</text><text x="45" y="108" font-size="26">Sampo-UI development</text>
<path d="M60 175H1335" fill="none" stroke="#1E64C8" stroke-width="8" marker-end="url(#timeline-arrow)"/>
<path d="M290 175C400 175 350 345 460 345H875C1010 345 975 175 1090 175" fill="none" stroke="#FFD200" stroke-width="10"/>
<g fill="#FFFFFF" stroke="#1E64C8" stroke-width="6"><circle cx="75" cy="175" r="14"/><circle cx="290" cy="175" r="14"/><circle cx="1090" cy="175" r="17"/></g>
<text x="270" y="225" text-anchor="end" font-size="26">Fork</text>
<text x="1060" y="90" font-size="32" fill="#1E64C8">Merged upstream</text><text x="1060" y="130" font-size="25">Shared development</text>
<rect x="435" y="240" width="500" height="70" rx="10" fill="#E9F0FA"/><text x="685" y="284" text-anchor="middle" font-size="32" fill="#1E64C8">GhentCDH modernisation</text>
<text x="455" y="400" font-size="27">Architecture · software stack · modularity</text>
<text x="455" y="447" font-size="25" fill="#646464">Contributions return to the shared framework</text>
</g>
</svg>
</div>
</center>

For more on the changes and their use in our projects, see [Sampo-UI Meets Ontop](https://0110.be/posts/Sampo-UI_Meets_Ontop%3A_Publishing_Relational_Digital_Humanities_Data_-_Semantics_2026).
```


![Official Sampo UI publication](https://0110.be/files/photos/585/PXL_20260916_111149116_small.jpg)

---

## [Explore Intra-Belgian book translation flows with a SAMPO-UI](https://0110.be/posts/Explore_Intra-Belgian_book_translation_flows_with_a_SAMPO-UI.md)

- Published: 2026-09-16T00:00:00Z
- Updated: 2026-09-16T08:10:58Z
- Author: Joren
- ID: 584
- Canonical: https://0110.be/posts/Explore_Intra-Belgian_book_translation_flows_with_a_SAMPO-UI

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [Projecten](https://0110.be/tags/Projecten.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)


Another contribution presented at the [SEMANTiCS conference](https://2026-eu.semantics.cc/) in Ghent was a Sampo-UI portal for the BELTRANS project. I made a small contribution to the software and the paper, working with colleagues at KBR, the Royal Library of Belgium.

> *[Explore Intra-Belgian book translation flows with a SAMPO-UI](https://0110.be/files/attachments/584/BELTRANS_SAMPO.pdf)*, Sven Lieber¹, Ann Van Camp¹, Joren Six², Julie M. Birkholz¹ ²<br>
> ¹ KBR — Royal Library of Belgium <br>
> ² Ghent University, Department of History & Ghent Centre for Digital Humanities

The BELTRANS project studied book translations between Dutch and French from 1970 to 2020, involving at least one Belgian author, scenarist, illustrator or editor. The resulting dataset brings together publication metadata from different libraries. Making these data available is one thing; making them easy to explore is another.

The [BELTRANS portal](https://w3id.org/kbr/beltrans/ui) uses Sampo-UI to let researchers filter publications, browse authors and publishers, explore maps and download selected data as CSV. It uses the modernized Sampo-UI core described in my [Sampo-UI Meets Ontop post](https://0110.be/posts/Sampo-UI_Meets_Ontop%3A_Publishing_Relational_Digital_Humanities_Data_-_Semantics_2026). Here, the data are served by QLever, a graph database with a SPARQL endpoint. The same interface components find another use, this time for translation history.

> **Abstract**: *In the field of Big Translation History, (historical) book translation flows are studied based on publication metadata. This research data is often kept internally or only provided as domain-specific MARC21 records, a standard library format. Within the recently completed BELTRANS project, we created a large integrated data corpus of worldwide translations between Dutch and French between 1970 and 2020, where at least one Belgian was involved as author, scenarist, illustrator or editor, to study intra-belgian book translation flows, and published the corpus as FAIR data. In this paper we present the SAMPO-UI-based platform that can be used by non-technical users to explore the underlying BELTRANS Linked Data corpus. The off-the-shelf software SAMPO-UI was configured to build a user interface allowing the exploration of our data related to book publications, authors, publishers and linked temporal and geospatial information. The different search perspectives, filters and visualizations enable researchers to explore the corpus or download self-chosen subsets, without having to process the large underlying data dumps. Both the application and corpus data are opened up in a sustainable way, i.e. besides deposits at research repositories, the application is hosted in the long term at the Royal Library of Belgium (KBR) and the integrated data is equipped with provenance information allowing to click-through to the related metadata records at different national libraries. Future work can extend the application itself with novel visualization techniques or different download formats if necessary. Also, this application can serve as a role model to inspire other researchers to distribute their corpora as Linked Data and via such a SAMPO-UI platform.*

The [BELTRANS corpus](https://doi.org/10.5281/zenodo.20668316) and the [portal configuration](https://github.com/kbrbe/beltrans-ui-config) are available for reuse.




---

## [Sampo-UI Meets Ontop: Publishing Relational Digital Humanities Data - Semantics 2026](https://0110.be/posts/Sampo-UI_Meets_Ontop%3A_Publishing_Relational_Digital_Humanities_Data_-_Semantics_2026.md)

- Published: 2026-09-16T00:00:00Z
- Updated: 2026-09-16T07:46:02Z
- Author: Joren
- ID: 582
- Canonical: https://0110.be/posts/Sampo-UI_Meets_Ontop%3A_Publishing_Relational_Digital_Humanities_Data_-_Semantics_2026

- Tags: [Code](https://0110.be/tags/Code.md), [GhentCDH](https://0110.be/tags/GhentCDH.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

The [SEMANTiCS conference](https://2026-eu.semantics.cc/) took place in Ghent from 15 to 17 September 2026. Our contribution was a collaboration between GhentCDH and the Semantic Computing Research Group at Aalto University on publishing humanities data with Sampo-UI and Ontop.

> *[Sampo-UI Meets Ontop: Publishing Relational Digital Humanities Data on the Semantic Web](https://0110.be/files/attachments/582/semantics-poster-sampo-ui.pdf)*, Joren Six¹, Jahid Chetti¹, Annastiina Ahola², Frederic Lamsens¹, Heikki Rantala², Eero Hyvönen²<br>
> ¹ Ghent University, Ghent Centre for Digital Humanities ([GhentCDH](https://www.ghentcdh.ugent.be)) <br>
> ² Aalto University, Department of Computer Science, Semantic Computing Research Group ([SeCo](https://seco.cs.aalto.fi))

At GhentCDH, we often publish research datasets in the digital humanities. Several projects need similar search filters, map visualizations and data exports. Sampo-UI makes it possible to reuse these components when the data is available as Linked Data. In collaboration with the original Sampo-UI team, we worked on modernizing the framework. Our first contribution separates the shared core from project-specific configuration, making updates and reuse more manageable. The second uses Ontop to expose existing *relational databases* through a SPARQL endpoint. This lets us use Sampo-UI while keeping the database infrastructure and tooling we already have. Having one fewer database system to maintain is welcome.

> **Abstract**: *The Sampo model and its Sampo-UI framework have become an established approach for publishing Cultural Heritage and Digital Humanities data on the Semantic Web. Sampo-UI enables exploration of data originating from SPARQL endpoints through faceted search across multiple views with seamlessly integrated visualization and data analytic tools. Here, we present two contributions to the Sampo-UI ecosystem: (i) a separation of Sampo-UI core from application-specific configuration; decoupling core and application simplifies updates and facilitates reuse of efforts, and (ii) the use of Ontop --- a virtual knowledge graph system --- to expose relational databases through a SPARQL endpoint and Sampo-UI. The use of relational databases and reuse of tooling and expertise around relational databases lower the operational burden of publishing small-to-medium-sized datasets typical of digital humanities projects. These contributions originated outside the original Sampo-UI team but were developed in collaboration with it, and are being prepared for upstream integration. We illustrate the approach with two projects at Ghent University: one on Roman coin finds in Belgium (NuMAD) and one on historic Belgian company data (BelHisFirm). Both portals run the same Sampo-UI core with a different configuration, and operate on existing institutional relational database infrastructure without a dedicated graph database.*

The demo below shows the NuMAD portal for exploring Roman coin finds in Belgium through the modernized Sampo-UI. Another [demo presents historical records of Belgian companies](https://0110.be/files/attachments/582/belhisfirm_demo.mp4) through the BelHisFirm portal. Both portals run the same Sampo-UI core with different configurations, demonstrating the flexibility of the system.

Alongside the [Sampo-UI Meets Ontop paper](https://0110.be/files/attachments/582/sampo-ui_ontop-semantics_2026.pdf), a [conference poster on Sampo-UI](https://0110.be/files/attachments/582/semantics-poster-sampo-ui.pdf) that I prepared is also available.

<video style="width: 100%; height: auto;" src="https://0110.be/files/attachments/582/numad_demo.mp4" controls playsinline preload="metadata"></video>
<small>Video: NuMAD — exploring Roman coin finds in Belgium.</small>
<br>


---

## [ Introduction to Sampo-UI at FedOSC Linked Open Data Visualisation Workshop](https://0110.be/posts/_Introduction_to_Sampo-UI_at_FedOSC_Linked_Open_Data_Visualisation_Workshop.md)

- Published: 2026-09-08T00:00:00Z
- Updated: 2026-09-08T12:02:58Z
- Author: Joren
- ID: 583
- Canonical: https://0110.be/posts/_Introduction_to_Sampo-UI_at_FedOSC_Linked_Open_Data_Visualisation_Workshop

- Tags: [GhentCDH](https://0110.be/tags/GhentCDH.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

FedOSC, the Belgian Federal Open Science Cloud, supports open science and research data management at Belgium's federal scientific institutions. On 8 September 2026, it organised a [day on data visualisation and Linked Open Data](https://fedosc.miraheze.org/wiki/Events/DataViz) at KIK-IRPA in Brussels, with talks, demos and a approaches on cultural heritage datasets.

My contribution to the closing talks was an introduction to Sampo-UI, an open-source framework for building search and visualisation interfaces on top of Linked Open Data. I explained why we use it at the Ghent Centre for Digital Humanities: several projects need similar filters, maps and data exports, so it makes sense to reuse a common framework. The presentation covers how Sampo-UI works, our contributions to it, and a practical example with the NuMAD coin database.

The [Sampo-UI presentation](https://0110.be/attachment/cors/2026.09.08-sampo-ui-fedosc-brussels/index.html) is available online and embedded below.

<iframe src="https://0110.be/attachment/cors/2026.09.08-sampo-ui-fedosc-brussels/index.html" title="Introduction to Sampo-UI at FedOSC" style="width: 100%; aspect-ratio: 16 / 9; border: 0;" loading="lazy" allowfullscreen></iframe>

<br>

---

## [Guest lecture on \`Music Information Retrieval - Opportunities for digital musicology'](https://0110.be/posts/Guest_lecture_on_%60Music_Information_Retrieval_-_Opportunities_for_digital_musicology%27.md)

- Published: 2025-11-13T00:00:00Z
- Updated: 2025-11-13T11:19:36Z
- Author: Joren
- ID: 572
- Canonical: https://0110.be/posts/Guest_lecture_on_%60Music_Information_Retrieval_-_Opportunities_for_digital_musicology%27

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

This morning I gave a guest lecture introducing the field of music information retrieval to musicology students at Ghent University. Next to the more general MIR intro, two specific topics are fleshed out: duplicate detection and pitch patterns in music around the world. Two topic I have been working on before. 

 The presentation has the form of an interactive website via [reveal.js](https://revealjs.com/). It features a couple of slides which are full-blown applications or have an interactive sound visualization component. Please do try out the slides and check the [Music Information Retrieval - Opportunities for digital musicology](https://0110.be/attachment/cors/2025.11.MIR-Intro/index.html) presentation or try it below.
 
<iframe style="width:100%;min-height:40rem;border:none" src="https://0110.be/attachment/cors/2025.11.MIR-Intro/index.html">
</iframe>

- [MIR\_intro.pdf](https://0110.be/files/attachments/572/MIR_intro.pdf)

---

## [GhentCDH at the Faculty Research Day](https://0110.be/posts/GhentCDH_at_the_Faculty_Research_Day.md)

- Published: 2024-11-27T00:00:00Z
- Updated: 2024-11-27T10:07:51Z
- Author: Joren
- ID: 551
- Canonical: https://0110.be/posts/GhentCDH_at_the_Faculty_Research_Day

- Tags: [GhentCDH](https://0110.be/tags/GhentCDH.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

The [research day of the faculty of Arts and Philosophy of Ghent University](https://www.lwresearchday.ugent.be/) took place last November. The theme of the day was ‘*From Source to Understanding*’ and the program gave an overview of the breadth of research at our faculty with topics as logic, history, archeology, chemistry, geography, language studies, ... There were several contributions by our group: the Ghent Center for Digital Humanities. The contribution by me and my close colleagues [was a poster about a reusable text annotation](https://0110.be/files/attachments/551/poster_text_annotation.webp) building block.

<center>
<img style="max-height:550px" src="https://0110.be/files/attachments/551/poster_text_annotation.webp" /><br>
<small>Fig: Poster on a text annotation component.</small>
</center>

At GhentCDH we support several text annotation projects and have extracted a text annotation component for reuse. The abstract reads: 

> "*Text annotation is essential for analyzing ancient texts, identifying entities in texts, or documenting evolving grammar. There is a need for reusable annotation methods which copes with challenges such as overlapping annotations, filtering annotation types, and enabling large-scale collaboration and computational analysis on text annotation work.*
> 
> *We present a reusable text annotation component built with TypeScript and Vue 3. It provides an intuitive interface for creating, visualizing, and editing annotations, it allows component users to enrich annotations with complex metadata, and facilitates flexible annotation filtering. This solution meets many needs of researchers in digital humanities and ancient language studies and will be used in several GhentCDH projects.*"

Get more info, try it out and use it in your project by checking the [text annotator source code repository](https://github.com/GhentCDH/vue_component_annotated_text).




---

## [Validity and reliability of peak tibial accelerations as real-time measure of impact loading during over-ground rearfoot running at different speeds](https://0110.be/posts/Validity_and_reliability_of_peak_tibial_accelerations_as_real-time_measure_of_impact_loading_during_over-ground_rearfoot_running_at_different_speeds.md)

- Published: 2024-10-01T00:00:00Z
- Updated: 2024-10-01T14:30:24Z
- Author: Joren
- ID: 550
- Canonical: https://0110.be/posts/Validity_and_reliability_of_peak_tibial_accelerations_as_real-time_measure_of_impact_loading_during_over-ground_rearfoot_running_at_different_speeds

- Tags: [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<div style="float:right;width:30%;max-width:200px;margin-left:10px;margin-bottom:10px;box-shadow: 0 3px 5px rgba(0, 0, 0, 0.4);">
<center>
<img loading="lazy" style="width:100%" src="https://0110.be/files/attachments/550/foot_strike.png">
</center>
</div>

The publication of this paper seemed an almost sisyphean task, but it is now finally in print after about four years since first submission.
All's well that ends well and it is well indeed: the paper contributes a fundamental insight around the resultant peak tibial acceleration (PTA) in forefoot running: contrary to what is often presumed, the resultant PTA is higher in forefoot running! The paper combines two separate experiments into a single analysis framework which ensures robustness in the finding. The conclusions of the article can be found below:


> ***Conclusions*** *Many coaches and practitioners presume that forefoot striking decreases impact severity and prevents overuse injuries; however, our data show that instructed and habitual forefoot strikes have greater resultant but not axial PTA than habitual rearfoot strikes in level running at a submaximal speed. The forefoot strikes had a sharp decrease in the antero-posterior velocity of the shank following touchdown and, therefore, a greater antero-posterior acceleration, which resulted in the greater resultant peak tibial acceleration compared to the rearfoot strikes. Conclusively, the foot strike pattern differently affected PTAs and should be taken into account when evaluating 3D impact severity in distance runners.*

My contribution to the paper was limited to technical development and support during the measurements at Ghent University. For the full paper, please read the publishers version of [Validity and reliability of peak tibial accelerations as real-time measure of impact loading during over-ground rearfoot running at different speeds](https://www.tandfonline.com/doi/full/10.1080/14763141.2024.2367619). 


---

## [Olaf: a lightweight, portable audio search system](https://0110.be/posts/Olaf%3A_a_lightweight%2C_portable_audio_search_system.md)

- Published: 2023-07-04T00:00:00Z
- Updated: 2023-07-12T09:52:54Z
- Author: Joren
- ID: 519
- Canonical: https://0110.be/posts/Olaf%3A_a_lightweight%2C_portable_audio_search_system

- Tags: [Command Line Application](https://0110.be/tags/Command%20Line%20Application.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<div style="float:right; margin: 8px; width:20%">
<img src="https://0110.be/files/attachments/519/OIG.webp" style="object-fit:contain; width: 100%;" /><small>Fig: Some AI imagining audio search.</small>

</div>
Recently I have published a paper titled [*'Olaf: a lightweight, portable audio search system'*](https://joss.theoj.org/papers/10.21105/joss.05459) in the Journal of Open Source Software (JOSS). The journal is [a 'hack' to circumvent the focus on citable papers](https://www.arfon.org/announcing-the-journal-of-open-source-software) in the academic world: getting recognition for publishing software as a researcher is not straightforward.

Both Ghent University's research output tracking system and Flanders FWO academic profile do not allow to enter software as research output. The focus is still solely on papers, even when custom developed research software has become a fundamental aspect in many research areas. My role is somewhere between that of a 'pure' researcher and that of a [research software engineer](https://www.nature.com/articles/d41586-022-01516-2) which makes this focus on papers quite relevant to me.

The paper aims to make the recent development on [Olaf](https://github.com/JorenSix/Olaf) *'count'*. Thanks to the JOSS review process the Olaf software was improved considerably: CI, unit tests, documentation, containerization,... The paper was a good reason to improve on all these areas which are all too easy to neglect. The paper itself is a short, rather general overview of Olaf:

> "*Olaf stands for **Overly Lightweight Acoustic Fingerprinting** and solves the problem of finding short audio fragments in large digital audio archives. The content-based audio search algorithm implemented in Olaf can identify a short audio query in a large database of thousands of hours of audio using an acoustic fingerprinting technique.*"


---

## [Attempting humor in academic writing](https://0110.be/posts/Attempting_humor_in_academic_writing.md)

- Published: 2023-01-24T00:00:00Z
- Updated: 2023-01-31T15:05:49Z
- Author: Joren
- ID: 501
- Canonical: https://0110.be/posts/Attempting_humor_in_academic_writing

- Tags: [Poging tot humor](https://0110.be/tags/Poging%20tot%20humor.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<div style="float:right; width:20%">
<center>
<a href="https://link.springer.com/book/10.1007/978-3-031-18444-4"><img style="width:80%" src="https://0110.be/files/attachments/501/springer_book_cover.jpeg" alt="Screenshot of a browser based pitch organization extraction tool"></a><br><small>Fig: Advances in Speech and Music Technology book cover.</small>

</center>
</div>
I have recently published an chapter in an academic book published by Springer. The topic of the book is of interest to me but can be perceived as rather dry: [*Advances in Speech and Music Technology*](https://link.springer.com/book/10.1007/978-3-031-18444-4).

The chapter I co-authored presented two case studies on detecting duplicates in music archives. The fist case study deals with segmentation reuse in an archive of early electronic music. The second with meta-data reuse in an archive of a public broadcaster containing digitized commercial shellac disc recordings with many duplicates.

Duplicate detection being the main topic, I decided to title the article *[Duplicate Detection for for Digital Audio Archive Management](https://link.springer.com/chapter/10.1007/978-3-031-18444-4_16__). It is easy to miss, and not much is lost if you do, but there is a duplicate*'for' in the title. If you did detect the duplicate you have detected the duplicate in the duplicate detection article. Since I have fathered two kids I see it as an hard earned right to make dad-jokes like that. Even in academic writing.

It was surprisingly difficult to get the title published as-is. At every step of the academic publishing process (review, editorial, typesetting, lay-outing) I was asked about it and had to send an email like the one below. Every email and every explanation made my second-guess my sense of humor but I do stand by it.

<blockquote style="font-family: monospace">
From: Joren<br>\
To: Editors ASMT<br>\
<br>\
Dear Editors,<br>\
<br>\
I have updated my submission on easychair in...\
<br>\
I would like to keep the title however as is an attempt at word-play. These things tend to have less impact when explained but the article is about duplicate detection and is titled 'Duplicate detection for for digital audio archive management'. The reviewer, attentively, detected the duplicate 'for' but unfortunately failed to see my attempt at humor. To me, it is a rather harmless witticism.

Regards

Joren

</pre>
</blockquote>
Anyway, I do think that humor can serve as a gateway to direct attention to rather dry, academic material. Also the message and the form of the message should not be confused. [John Oliver](https://www.youtube.com/@LastWeekTonight/videos), for example, made his whole career on delivering serious sometimes dry messages with heaps of humor: which does not make the topics less serious. I think there are a couple of things to be learned there. Anyway, now that I have your attention, please do read the [author version of *Duplicate Detection for for Digital Audio Archive Management: Two Case Studies*](https://0110.be/files/publications/2022/2022.duplicates-author_version.pdf).


---

## [Panako: a scalable audio search system](https://0110.be/posts/Panako%3A_a_scalable_audio_search_system.md)

- Published: 2022-10-12T00:00:00Z
- Updated: 2023-07-04T09:25:18Z
- Author: Joren
- ID: 496
- Canonical: https://0110.be/posts/Panako%3A_a_scalable_audio_search_system

- Tags: [Panako](https://0110.be/tags/Panako.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<div style="float:right; margin: 8px; width:20%">
<img src="https://0110.be/files/attachments/496/papers_vs_software.webp" style="object-fit:contain; width: 100%;" /><small>Fig: DALL.E 2 imagining a fight between papers and software.</small>

</div>
Recently I have published a paper titled [*'Panako: a scalable audio search system'*](https://joss.theoj.org/papers/10.21105/joss.04554) in the Journal of Open Source Software (JOSS). The journal is [a 'hack' to circumvent the focus on citable papers](https://www.arfon.org/announcing-the-journal-of-open-source-software) in the academic world: getting recognition for publishing software as a researcher is not straightforward.

The research output tracking system of Ghent University (biblio) and Flanders FWO's academic profile are not built to track software as research output. The focus is still solely on papers, even when custom developed research software has become a fundamental aspect in many research areas. My role is somewhere between that of a 'pure' researcher and that of a [research software engineer](https://www.nature.com/articles/d41586-022-01516-2) which makes this focus on papers quite relevant to me.

The paper aims to make the recent development on [Panako](https://github.com/JorenSix/Panako) *'count'*. Thanks to the JOSS review process the Panako software was improved considerably: CI, unit tests, documentation, containerization,... The paper was a good reason to improve on all these areas which are all too easy to neglect. The paper itself is a short, rather general overview of Panako:

> "*Panako solves the problem of finding short audio fragments in large digital audio archives. The content based audio search algorithm implemented in Panako is able to identify a short audio query in a large database of thousands of hours of audio using an acoustic fingerprinting technique.*"


---

## [Low impact runner: a music based bio-feedback system](https://0110.be/posts/Low_impact_runner%3A_a_music_based_bio-feedback_system.md)

- Published: 2022-10-01T00:00:00Z
- Updated: 2025-11-29T14:22:46Z
- Author: Joren
- ID: 490
- Canonical: https://0110.be/posts/Low_impact_runner%3A_a_music_based_bio-feedback_system

- Tags: [IPEM](https://0110.be/tags/IPEM.md), [Java](https://0110.be/tags/Java.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<div style="float:right;margin-left:10px">
<video  width="320" autoplay muted loop>
<source src="https://0110.be/files/attachments/490/lir-demo.mp4">
</video><br>
<small>Fig: schema of the low impact runner system.</small>
</div>

I have been lucky to have been involved in an interdisciplinary research project around the *low impact runner*: a music based bio-feedback system to reduce tibial shock in over-ground running. In the beginning of October 2022 the PhD defence of Rud Derie takes place so it is a good moment to look back to this collaboration between several branches of Ghent University: [IPEM](https://www.ugent.be/lw/kunstwetenschappen/ipem/en) , [movement and sports science](https://www.ugent.be/ge/bsw/en) and [IDLab](https://www.ugent.be/ea/idlab/en).

The idea behind the project was to first select runners with a high foot-fall impact. Then an intervention would slightly nudge these runner to a running style with lower impact. A lower repetitive impact is expected to reduce the chance on injuries common for runners. A system was invented in which musical bio-feedback was given on the measured impact. The schema to the right shows the concept.

I was involved in development of the first hardware prototypes which measured acceleration on the legs of the runner and the development of software to receive and handle these measurement on a tablet strapped to a backpack the runner was wearing. This software also logged measurements, had real-time visualisation capabilities and allowed remote control and monitoring over the network. Finally measurements were send to a Max/MSP sonification engine. These prototypes of software and hardware were replaced during a valorization project but some parts of the software ended up in the final Android application.

<center>
<video width="60%" autoplay muted loop>
<source src="https://0110.be/files/attachments/490/low_impact_runner-system.mp4">
</video><br>
<small>Video: the left screen shows the indoor positioning system via UWB (ultra-wide-band) and the right screen shows the music feedback system and the real time monitoring of impact of the runner. Video by Pieter Van den Berghe</small>

</center>
Over time the first wired sensors were replaced with wireless Bluetooth versions. This made the sensors easy to use and also to visualize sensor values in the browser thanks to the Web Bluetooth API. I have experimented with this and made two demos: a [low impact runner visualizer](bt.html) and one [with the conceptual schema](bt_bg.html).

<center>
<video width="60%" autoplay muted loop>
<source src="https://0110.be/files/attachments/490/bt_html_interface.mp4">
</video><br>
<small>Vid: Visualizing the Bluetooth Low Impact Runner sensor in the browser.</small>
</center>

The following three studies shows a part of the trajectory of the project. The first paper is a validation of the measurement system. Secondly a proof-of-concept study is done which finally greenlights a larger scale intervention study.

1.  Van den Berghe, P., Six, J., Gerlo, J., Leman, M., & De Clercq, D. (2019). *Validity and reliability of peak tibial accelerations as real-time measure of impact loading during over-ground rearfoot running at different speeds*. Journal of Biomechanics, 86, 238-242.

2.  Van den Berghe, P., Lorenzoni, V., Derie, R., Six, J., Gerlo, J., Leman, M., & De Clercq, D. (2021). *Music-based biofeedback to reduce tibial shock in over-ground running: A proof-of-concept study*. Scientific reports, 11(1), 1-12.

3.  Van den Berghe, P., Derie, R., Bauwens, P., Gerlo, J., Segers, V., Leman, M., & De Clercq, D. (2022). *Reducing the peak tibial acceleration of running by music‐based biofeedback: A quasi‐randomized controlled trial*. Scandinavian Journal of Medicine & Science in Sports

There are quite a number of other papers but I was less involved in those. The project also resulted in two PhD's:

-   *Motor retraining by real-time sonic feedback: understanding strategies of low impact running* (2021) by Pieter Van den Berghe
-   *Running on good vibes: music induced running-style adaptations for lower impact running* (2022) by Rud Derie

I am also recognized as co-inventor on the [low impact runner system patent](https://worldwide.espacenet.com/patent/search/family/062816385/publication/WO2020002275A1?q=WO2020002275A1) and there are concrete plans for a commercial spin-off. To be continued...

![Conceptual schema](https://0110.be/files/photos/490/li-jogger-schema.png)

![Music feedback schema](https://0110.be/files/photos/490/music_feedback_schema.jpg)

![Screening and selection](https://0110.be/files/photos/490/screening_selection_schema.jpg)

![Screenshot of the smartphone app](https://0110.be/files/photos/490/Screenshot_20220407-155541_pixel_quite_black_landscape.png)

---

## [ISMIR 2020 - Virtual Conference](https://0110.be/posts/ISMIR_2020_-_Virtual_Conference.md)

- Published: 2020-10-20T00:00:00Z
- Updated: 2025-11-29T14:33:11Z
- Author: Joren
- ID: 477
- Canonical: https://0110.be/posts/ISMIR_2020_-_Virtual_Conference

- Tags: [Command Line Application](https://0110.be/tags/Command%20Line%20Application.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

<img style="float:right;margin:5px" alt="ISMIR 2020 Logo" src="https://0110.be/files/attachments/477/ISMIR2020-logo.png">

From 11-16 October 2020 the latest instalment of the ISMIR conference series was held. Due to the pandemic, the 21st ISMIR conference was the first virtual one. As usual, participants and presenters from around the world joined the conference. For the first time, however, not all participants synchronised their circadian rhythm. By repeating most events with 12h in between, the organisers managed to put together a schedule befitting nearly all participants.

The virtual format had some clear advantages: travel was not needed, so (environmental) cost was low. Attendance fees were lower than usual since no spaces or catering was needed. This democratised the conference experience and attendance reached a record high.

The scientific program of the conference was impressive and varied. It is At the conferences Late Breaking/Demo session I presented [Olaf: Overly Lightweight Acoustic Fingerprinting](https://program.ismir2020.net/lbd_418.html).


<center>
<iframe width="480" height="280" src="https://www.youtube.com/embed/wP29RaQicwE" frameborder="0" allow="picture-in-picture" allowfullscreen>
</iframe>
</center>



---

## [LW Research Day 2019 on Digital Humanities](https://0110.be/posts/LW_Research_Day_2019_on_Digital_Humanities.md)

- Published: 2019-09-10T00:00:00Z
- Updated: 2019-10-03T08:53:08Z
- Author: Joren
- ID: 473
- Canonical: https://0110.be/posts/LW_Research_Day_2019_on_Digital_Humanities

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/473/AfficheLWRD2019_klein-272x300.png" style="width:150;float:right;margin:10px"> On the 9th of September 2019 the second [research day organized by the faculty of Arts and Philosophy of Ghent University](https://www.lwresearchday.ugent.be/) took place. The theme of the day was 'Digital Humanities' and [the program](https://www.lwresearchday.ugent.be/programme/) gave an overview of the breadth of research at our faculty with topics as logic, history, archeology, chemistry, geography

<center>
<img src="https://0110.be/files/attachments/473/balance_board_screenshot.png" style="width:400px"/>

</center>
Together with Jeska, I presented an ongoing study on musical interaction. In the study one of the measurements was the body movement of two participants. This is done with boards that are equipped with weight sensors. The data that comes out of this can be inspected for synchronisation, quality and quantity of movement, movement periodicities.

<center>
<video src="https://0110.be/files/attachments/473/web_2019-09-16_15.30.32.mp4" style="width:400px" controls/>
</center>
<br>

The hardware is the work of Ivan Schepers, the software used to capture and transmit messages is called "the MIDImorphosis" and developed by me. The research is in collaboration with Jeska Buhman, Marc Leman and Alessandro Dell'Anna. An article with detailed findings is forthcoming.


---

## [AAWM/FMA 2019 - Birmingham ](https://0110.be/posts/AAWM%2FFMA_2019_-_Birmingham_.md)

- Published: 2019-07-02T00:00:00Z
- Updated: 2025-11-29T14:37:46Z
- Author: Joren
- ID: 471
- Canonical: https://0110.be/posts/AAWM%2FFMA_2019_-_Birmingham_

- Tags: [Folk Music Analysis (FMA) conference](https://0110.be/tags/Folk%20Music%20Analysis%20%28FMA%29%20conference.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

I am currently in Birmingham, UK at the 2019 at the joint [Analytical Approaches to World Music (AAWM) and Folk Music Conference (FMA)](http://fma2019.bcu.ac.uk). The opening concert by the [RBC folk ensemble](https://www.youtube.com/watch?v=TxcMPWTlaaI) already provided the most lively and enthusiastic conference opening probably ever. Especially considering the early morning hour (9.30). At the conference, two studies will be presented on which I collaborated:

### Automatic comparison of human music, speech, and bird song suggests uniqueness of human scales

<a href="https://0110.be/files/attachments/471/FMA2019_paper_12.pdf"><img src="https://0110.be/files/attachments/471/12.png" style="float:right;width:140px"></a> "Automatic comparison of human music, speech, and bird song suggests uniqueness of human scales":\[FMA2019_paper_12.pdf\] by Jiei Kuroyanagi, Shoichiro Sato, Meng-Jou Ho, Gakuto Chiba, Joren Six, Peter Pfordresher, Adam Tierney, Shinya Fujii and Patrick Savage

> The uniqueness of human music relative to speech and animal song has been extensively debated, but rarely directly measured. We applied an automated scale analysis algorithm to a sample of 86 recordings of human music, human speech, and bird songs from around the world. We found that human music throughout the world uniquely emphasized scales with small-integer frequency ratios, particularly a perfect 5th (3:2 ratio), while human speech and bird song showed no clear evidence of consistent scale-like tunings. We speculate that the uniquely human tendency toward scales with small-integer ratios may relate to the evolution of synchronized group performance among humans.

### Automatic comparison of global children's and adult songs

<a href="https://0110.be/files/attachments/471/FMA2019_paper_13.pdf"><img src="https://0110.be/files/attachments/471/13.png" style="float:right;width:140px"></a> "Automatic comparison of global children's and adult songs":\[FMA2019_paper_13.pdf\] by Shoichiro Sato, Joren Six, Peter Pfordresher, Shinya Fujii and Patrick Savage

> Music throughout the world varies greatly, yet some musical features like scale structure display striking crosscultural similarities. Are there musical laws or biological constraints that underlie this diversity? The "vocal mistuning" hypothesis proposes that cross-cultural regularities in musical scales arise from imprecision in vocal tuning, while the integer-ratio hypothesis proposes that they arise from perceptual principles based on psychoacoustic consonance. In order to test these hypotheses, we conducted automatic comparative analysis of 100 children's and adult songs from throughout the world. We found that children's songs tend to have narrower melodic range, fewer scale degrees, and less precise intonation than adult songs, consistent with motor limitations due to their earlier developmental stage. On the other hand, adult and children's songs share some common tuning intervals at small-integer ratios, particularly the perfect 5th (\~3:2 ratio). These results suggest that some widespread aspects of musical scales may be caused by motor constraints, but also suggest that perceptual preferences for simple integer ratios might contribute to cross-cultural regularities in scale structure. We propose a "sensorimotor hypothesis" to unify these competing theories.


---

## [Validity and reliability of peak tibial accelerations as real-time measure of impact loading during over-ground rearfoot running at different speeds - Journal of Biomechanics](https://0110.be/posts/Validity_and_reliability_of_peak_tibial_accelerations_as_real-time_measure_of_impact_loading_during_over-ground_rearfoot_running_at_different_speeds_-_Journal_of_Biomechanics.md)

- Published: 2019-02-05T00:00:00Z
- Updated: 2025-11-29T14:40:02Z
- Author: Joren
- ID: 466
- Canonical: https://0110.be/posts/Validity_and_reliability_of_peak_tibial_accelerations_as_real-time_measure_of_impact_loading_during_over-ground_rearfoot_running_at_different_speeds_-_Journal_of_Biomechanics

- Tags: [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/466/journal_of_biomechanics.jpg" style="float:right" width="250"/>With the goal in mind to reduce common runner injuries we first need to measure some running style characteristics. Therefore, we have developed a sensor to measure how hard a runners foot repeatedly hits the ground. This sensor has been compared with laboratory equipment which proofs that its measurements are valid and can be repeated. The main advantages of our sensor is that it can be used 'in the wild', outside the lab on the runners regular tours. We want to use this sensor to provide real-time biofeedback in order to change running style and ultimately reduce injury risk.

We have published an article on this sensor in the journal of Biomechanics: Pieter Van den Berghe, Joren Six, Joeri Gerlo, Marc Leman, Dirk De Clercq [*Validity and reliability of peak tibial accelerations as real-time measure of impact loading during over-ground rearfoot running at different speeds*](https://www.sciencedirect.com/science/article/pii/S0021929019300764), ([author version](https://0110.be/files/attachments/466/author_version.pdf), Journal of Biomechanics, 2019

> Studies seeking to determine the effects of gait retraining through biofeedback on peak tibial acceleration (PTA) assume that this biometric trait is a valid measure of impact loading that is reliable both within and between sessions. However, reliability and validity data were lacking for axial and resultant PTAs along the speed range of over-ground endurance running. A wearable system was developed to continuously measure 3D tibial accelerations and to detect PTAs in real-time. Thirteen rearfoot runners ran at 2.55, 3.20 and 5.10 m\*s-1 over an instrumented runway in two sessions with re-attachment of the system. Intraclass correlation coefficients (ICCs) were used to determine within-session reliability. Repeatability was evaluated by paired T-tests and ICCs. Concerning validity, axial and resultant PTAs were correlated to the peak vertical impact loading rate (LR) of the ground reaction force. Additionally, speed should affect impact loading magnitude. Hence, magnitudes were compared across speeds by RM-ANOVA. Within a session, ICCs were over 0.90 and reasonable for clinical measurements. Between sessions, the magnitudes remained statistically similar with ICCs ranging from 0.50 to 0.59 for axial PTA and from 0.53 to 0.81 for resultant PTA. Peak accelerations of the lower leg segment correlated to LR with larger coefficients for axial PTA (r range: 0.64--0.84) than for the resultant PTA per speed condition. The magnitude of each impact measure increased with speed. These data suggest that PTAs registered per stand-alone system can be useful during level, over-ground rearfoot running to evaluate impact loading in the time domain when force platforms are unavailable in studies with repeated measurements.


---

## [ISMIR 2018 Conference - Automatic Analysis Of Global Music Recordings  suggests Scale Tuning Universals](https://0110.be/posts/ISMIR_2018_Conference_-_Automatic_Analysis_Of_Global_Music_Recordings__suggests_Scale_Tuning_Universals.md)

- Published: 2018-09-24T00:00:00Z
- Updated: 2019-07-03T13:46:15Z
- Author: Joren
- ID: 462
- Canonical: https://0110.be/posts/ISMIR_2018_Conference_-_Automatic_Analysis_Of_Global_Music_Recordings__suggests_Scale_Tuning_Universals

- Tags: [IPEM](https://0110.be/tags/IPEM.md), [ISMIR](https://0110.be/tags/ISMIR.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/462/ismir_2018_logo.jpg" style="float:right" width="250"/>Thanks to the support of a travel grant by the faculty of Arts and Philosophy of Ghent University I was able to attend the ISMIR 2018 conference. A conference on Music Information Retrieval. I am co author on a contribution for the [the Late-Breaking / Demos session](http://ismir2018.ircam.fr/pages/events-lbd.html)

> The structure of musical scales has been proposed to reflect universal acoustic principles based on simple integer ratios. However, some studying tuning in small samples of non-Western cultures have argued that such ratios are not universal but specific to Western music. To address this debate, we applied an algorithm that could automatically analyze and cross-culturally compare scale tunings to a global sample of 50 music recordings, including both instrumental and vocal pieces. Although we found great cross-cultural diversity in most scale degrees, these preliminary results also suggest a strong tendency to include the simplest possible integer ratio within the octave (perfect fifth, 3:2 ratio, \~700 cents) in both Western and non-Western cultures. This suggests that cultural diversity in musical scales is not without limit, but is constrained by universal psycho-acoustic principles that may shed light on the evolution of human music.


- [musical\_scales\_extended\_abstract\_\_0826\_revision\_copy.pdf](https://0110.be/files/attachments/462/musical_scales_extended_abstract__0826_revision_copy.pdf)

- [animated\_logo.gif](https://0110.be/files/attachments/462/animated_logo.gif)

- [ismir\_2018\_logo.jpg](https://0110.be/files/attachments/462/ismir_2018_logo.jpg)

---

## [TISMIR journal article - A Case for Reproducibility in MIR: Replication of ‘A Highly Robust Audio Fingerprinting System’](https://0110.be/posts/TISMIR_journal_article_-_A_Case_for_Reproducibility_in_MIR%3A_Replication_of_%E2%80%98A_Highly_Robust_Audio_Fingerprinting_System%E2%80%99.md)

- Published: 2018-09-12T00:00:00Z
- Updated: 2018-09-26T13:00:47Z
- Author: Joren
- ID: 463
- Canonical: https://0110.be/posts/TISMIR_journal_article_-_A_Case_for_Reproducibility_in_MIR%3A_Replication_of_%E2%80%98A_Highly_Robust_Audio_Fingerprinting_System%E2%80%99

- Tags: [ISMIR](https://0110.be/tags/ISMIR.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/463/TISMIR.png" style="float:right;background-color:#313131" width="250"/> As an extension of the ISMIR conferences the International Society for Music Information Retrievel started a new journal: TISMIR. The first issue contains an article of mine:\
[A Case for Reproducibility in MIR: Replication of 'A Highly Robust Audio Fingerprinting System'](https://transactions.ismir.net/articles/10.5334/tismir.4/). The abstract can be read here:

> Claims made in many Music Information Retrieval (MIR) publications are hard to verify due to the fact that (i) often only a textual description is made available and code remains unpublished -- leaving many implementation issues uncovered; (ii) copyrights on music limit the sharing of datasets; and (iii) incentives to put effort into reproducible research -- publishing and documenting code and specifics on data -- is lacking. In this article the problems around reproducibility are illustrated by replicating an MIR work. The system and evaluation described in 'A Highly Robust Audio Fingerprinting System' is replicated as closely as possible. The replication is done with several goals in mind: to describe difficulties in replicating the work and subsequently reflect on guidelines around reproducible research. Added contributions are the verification of the reported work, a publicly available implementation and an evaluation method that is reproducible.


---

## [JNMR article - Beyond documentation – The digital philology of interaction heritage](https://0110.be/posts/JNMR_article_-_Beyond_documentation_%E2%80%93_The_digital_philology_of_interaction_heritage.md)

- Published: 2018-07-31T00:00:00Z
- Updated: 2018-09-26T13:13:46Z
- Author: Joren
- ID: 464
- Canonical: https://0110.be/posts/JNMR_article_-_Beyond_documentation_%E2%80%93_The_digital_philology_of_interaction_heritage

- Tags: [JNMR](https://0110.be/tags/JNMR.md), [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

Marc Leman and myself have recently published an article in the Journal of New Music Research for a special issue on Digital Philology for Multimedia Cultural Heritage. Our contribution is titled <img src="https://0110.be/files/attachments/464/jnmr.jpg" width="120" style="float:right"/>[Beyond documentation -- The digital philology of interaction heritage](https://www.tandfonline.com/doi/abs/10.1080/09298215.2018.1479428)

> A philologist's approach to heritage is traditionally based on the curation of documents, such as text, audio and video. However, with the advent of interactive multimedia, heritage becomes floating and volatile, and not easily captured in documents. We propose an approach to heritage that goes beyond documents. We consider the crucial role of institutes for interactive multimedia (as motor of a living culture of interaction) and propose that the digital philologist's task will be to promote the collective/shared responsibility of (interactive) documenting, engage engineering in developing interactive approaches to heritage, and keep interaction-heritage alive through the education of citizens.


---

## [MIR Meetup Berlin - Acoustic Fingerprinting in Research](https://0110.be/posts/MIR_Meetup_Berlin_-_Acoustic_Fingerprinting_in_Research.md)

- Published: 2018-04-26T00:00:00Z
- Updated: 2025-11-29T14:40:22Z
- Author: Joren
- ID: 461
- Canonical: https://0110.be/posts/MIR_Meetup_Berlin_-_Acoustic_Fingerprinting_in_Research

- Tags: [Computational musicology](https://0110.be/tags/Computational%20musicology.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

I was kindly invited by SoundCloud to give a presentation on "Acoustic fingerprinting in research". The presentation took place during one of the "MIR Meetups" in Berlin on Monday, April 23, 2018. Before my presentation there was a presentation by Derek and Josh (both SoundCloud engineers) detailing the state of the internal fingerprinting system of SoundCloud.

During my presentation I gave an overview of various applications of acoustic fingerprinting in a music research environment and detailed how these applications can be handled and are implemented in [Panako: an open source fingerprinting system](http://panako.be)

Below the slides used during the presentation can be found:

<iframe style="width:100%;height:50vh;border:1px black solid" src="https://0110.be/attachment/presentations/2018.04.22-Panako-Berlin/index.html">
</iframe>


---

## [Engineering systematic musicology](https://0110.be/posts/Engineering_systematic_musicology.md)

- Published: 2018-02-02T00:00:00Z
- Updated: 2025-11-29T14:41:35Z
- Author: Joren
- ID: 460
- Canonical: https://0110.be/posts/Engineering_systematic_musicology

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

The 11th of January I successfully completed my PhD training under mentorship of Marc Leman with a public defense at [de Krook](http://dekrook.be) in Ghent.

I also handed in my dissertation titled  [Engineering systematic musicology: methods and services for computational and empirical music research](https://0110.be/files/attachments/460/2018.01.phd.joren.six-Engineering.systematic.musicology.pdf)  ([version of record](https://biblio.ugent.be/publication/8544101)). The dissertation bundles several of [my publications](https://0110.be/Publications) and places them in a framework in the introduction and reflects upon these in the conclusion. The publications all contribute either directly to the field of systematic musicology (e.g. tone scale research) or contributes indirectly by facilitating specific research tasks (e.g. synchronization of multi-modal research data).

The presentation during my defense was meant for a broader audience. During the presentation I gave examples of the research topics I have been working and focused on how these are connected. The [presentation titled Engineering systematic musicology](https://0110.be/phd/presentation/) can be seen by following the previous link and is included below. The slide with the live spectrogram and the slide with the map need to be started by *double clicking* otherwise they remain empty.

<div style="width:100%">
<iframe height="550px" width="100%" style="border:none;width:100%,height:550px"  src="https://0110.be/phd/presentation/index.html">
</iframe>
</div>
The presentation is essentially an interactive HTML5 website build with the [reveal.js](https://revealjs.com) framework. This has the advantage that multimedia is well supported and all kinds of interactions can be scripted. The presentation above, for example, uses the web audio API for live audio visualization and the google maps API for interactive maps. Video integration is also seamless. It would be a struggle to achieve similar multi-media heavy presentations with other presentation software packages such as Impress, Keynote or Powerpoint.


![De Krook - Ghent](https://0110.be/files/photos/460/krook.jpg)

![Defending](https://0110.be/files/photos/460/IMG_20180111_165705271.jpg)

![](https://0110.be/files/photos/460/IMG_3962.JPG)

- [2018.01.phd.joren.six-Engineering.systematic.musicology.pdf](https://0110.be/files/attachments/460/2018.01.phd.joren.six-Engineering.systematic.musicology.pdf)

---

## [IRCDL 2018 - Applications of Duplicate Detection in Music Archives: from Metadata Comparison to Storage Optimisation](https://0110.be/posts/IRCDL_2018_-_Applications_of_Duplicate_Detection_in_Music_Archives%3A_from_Metadata_Comparison_to_Storage_Optimisation.md)

- Published: 2018-01-23T00:00:00Z
- Updated: 2025-11-29T14:42:43Z
- Author: Joren
- ID: 458
- Canonical: https://0110.be/posts/IRCDL_2018_-_Applications_of_Duplicate_Detection_in_Music_Archives%3A_from_Metadata_Comparison_to_Storage_Optimisation

- Tags: [Computational ethnomusicology](https://0110.be/tags/Computational%20ethnomusicology.md), [IPEM](https://0110.be/tags/IPEM.md), [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

Together with Federica Bressan I have contributed to the [Italian Research Conference on Digital Libraries 2018](http://ircdl2018.dimi.uniud.it/):

> *"Since 2005, the Italian Research Conference on Digital Libraries has served as an important national forum focused on digital libraries and associated technical, practical, and social issues. IRCDL encompasses the many meanings of the term "digital libraries", including new forms of information institutions; operational information systems with all manner of digital content; new means of selecting, collecting, organizing, and distributing digital content..."*

The 26th of January Federica presented our joint contribution titled "Applications of Duplicate Detection in Music Archives: from Metadata Comparison to Storage Optimisation". The work focuses on applications of duplicate detection for managing digital music archives. It aims to make this mature music information retrieval (MIR) technology better known to archivists and provide clear suggestions on how this technology can be used in practice. More specifically applications are discussed to complement meta-data, to link or merge digital music archives, to improve listening experiences and to re-use segmentation data.

The [version of record](https://link.springer.com/chapter/10.1007/978-3-319-73165-0_10) of the article and an [author version](https://0110.be/files/attachments/458/2018.IRCDL-duplicates-article-author-version.pdf) are available. The [presentation](https://0110.be/files/attachments/458/2018.IRCDL-duplicates-presentation.pdf) is available here as well.


- [2018.IRCDL-duplicates-presentation.pdf](https://0110.be/files/attachments/458/2018.IRCDL-duplicates-presentation.pdf)

- [2018.IRCDL-duplicates-article-author-version.pdf](https://0110.be/files/attachments/458/2018.IRCDL-duplicates-article-author-version.pdf)

---

## [International Symposium on Computational Ethnomusicological Archiving](https://0110.be/posts/International_Symposium_on_Computational_Ethnomusicological_Archiving.md)

- Published: 2017-11-24T00:00:00Z
- Updated: 2017-12-13T09:00:47Z
- Author: Joren
- ID: 457
- Canonical: https://0110.be/posts/International_Symposium_on_Computational_Ethnomusicological_Archiving

- Tags: [Computational ethnomusicology](https://0110.be/tags/Computational%20ethnomusicology.md), [Computational musicology](https://0110.be/tags/Computational%20musicology.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

This weekend the University Hamburg - Institute for Systematic Musicology and more specifically Christian D. Koehn organized the [International Symposium on Computational Ethnomusicological Archiving](https://www.fbkultur.uni-hamburg.de/sm/iscea.html). The symposium featured a broad selection of research topics (physical modelling of instruments, MIR research, 3D scanning techniques, technology for (re)spacialisation of music, library sciences) which all had a relation with archiving musics of the world:

> *How could existing digital technologies in the field of music information retrieval, artificial intelligence, and data networking be efficiently implemented with regard to digital music archives? How might current and future developments in these fields benefit researchers in ethnomusicology? How can analytical data about musical sound and descriptive data about musical culture be more comprehensively integrated?*

I was able to attend the symposium and contributed with a talk titled "Challenges and opportunities for computational analysis of wax cylinders":\[2017.12.Hamburg-Wax-presentation.pdf\] and by chairing a panel discussion. The symposium was kindly sponsored by the VolkswagenStiftung. The talk had the following abstract:

> *In this presentation we describe our experience of working with computational analysis on digitized wax cylinder recordings. The audio quality of these recordings is limited which poses challenges for standard MIR tools. Unclear recording and playback speeds further hinder some types of audio analysis. Moreover, due to a lack of systematical meta-data notation it is often uncertain where a single recording originates or when exactly it was recorded. However, being the oldest available sound recordings, they are invaluable witnesses of various musical practices and they are opportunities to improve the understanding of these practices. Next to sketching these general concerns, we present results of the analysis of pitch content of 400 wax cylinder recordings from Indiana University (USA) and from the Royal Museum from Central Africa (Belgium). The scales of the 400 recordings are mapped and analyzed as a set. It is found that the fifth is almost always present and that scales with four and five pitch classes are organized similarly and differ from those with six and seven pitch classes, latter center around intervals of 170 cents, and former around 240 cents.*


- [2017.12.Hamburg-Wax-presentation.pdf](https://0110.be/files/attachments/457/2017.12.Hamburg-Wax-presentation.pdf)

- [ISCEA-final-program.pdf](https://0110.be/files/attachments/457/ISCEA-final-program.pdf)

---

## [4th International Digital Libraries for Musicology workshop (DLfM 2017)](https://0110.be/posts/4th_International_Digital_Libraries_for_Musicology_workshop_%28DLfM_2017%29.md)

- Published: 2017-10-28T00:00:00Z
- Updated: 2017-12-05T13:56:47Z
- Author: Joren
- ID: 456
- Canonical: https://0110.be/posts/4th_International_Digital_Libraries_for_Musicology_workshop_%28DLfM_2017%29

- Tags: [Computational musicology](https://0110.be/tags/Computational%20musicology.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Panako](https://0110.be/tags/Panako.md), [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/456/dlfm.png" style="float:right;margin:5px" width="250" alt="DLFM logo"/>I have contributed to the 4th International Digital Libraries for Musicology workshop (DLfM 2017) which was organized in Shanghai, China. It was a satellite event of the ISMIR 2017 conference. Unfortunately I did not mange to find funding to attend the workshop, I did however contribute as co-author to two proceeding papers. Both were presented by Reinier de Valk (thanks again).

### [MIRchiving: Challenges and opportunities of connecting MIR research and digital music archives](https://dl.acm.org/citation.cfm?id=3144755)

By Reinier de Valk (DANS), Anja Volk (Utrecht University), Andre Holzapfel (KTH Royal Institute of Technology) , Aggelos Pikrakis (University of Piraeus), Nadine Kroher (University of Seville - IMUS) and Joren Six (Ghent University - IPEM). Next to the [version of record](https://dl.acm.org/citation.cfm?id=3144755) there is also an author version available of the contribution titled "MIRchiving: Challenges and opportunities of connecting MIR research and digital music archives":\[2017.DLfM.MIRchiving-author.pdf\].

> This study is a call for action for the music information retrieval (MIR) community to pay more attention to collaboration with digital music archives. The study, which resulted from an interdisciplinary workshop and subsequent discussion, matches the demand for MIR technologies from various archives with what is already supplied by the MIR community. We conclude that the expressed demands can only be served sustainably through closer collaborations. Whereas MIR systems are described in scientific publications, usable implementations are often absent. If there is a runnable system, user documentation is often sparse----posing a huge hurdle for archivists to employ it. This study sheds light on the current limitations and opportunities of MIR research in the context of music archives by means of examples, and highlights available tools. As a basic guideline for collaboration, we propose to interpret MIR research as part of a value chain. We identify the following benefits of collaboration between MIR researchers and music archives: new perspectives for content access in archives, more diverse evaluation data and methods, and a more application-oriented MIR research workflow.

### [Applications of duplicate detection: linking meta-data and merging music archives: The experience of the IPEM historical archive of electronic music](https://dl.acm.org/citation.cfm?id=3144759)

By Federica Bressan, Joren Six and Marc Leman (Ghent University - IPEM). Next to the [version of record](https://dl.acm.org/citation.cfm?id=3144759) there is also an author version available of the contribution titled "Applications of duplicate detection: linking meta-data and merging music archives: The experience of the IPEM historical archive of electronic music":\[2017.dlfm_duplicates-author.pdf\].

> This work focuses on applications of duplicate detection for managing digital music archives. It aims to make this mature music information retrieval (MIR) technology better known to archivists and provide clear suggestions on how this technology can be used in practice. More specifically applications are discussed to complement meta-data, to link or merge digital music archives, to improve listening experiences and to re-use segmentation data. The IPEM archive, a digitized music archive containing early electronic music, provides a case study.

The [full DLfM 2017 proceedings](https://dl.acm.org/citation.cfm?id=3144749) are published by ACM.


- [2017.DLfM.MIRchiving-author.pdf](https://0110.be/files/attachments/456/2017.DLfM.MIRchiving-author.pdf)

- [2017.dlfm\_duplicates-author.pdf](https://0110.be/files/attachments/456/2017.dlfm_duplicates-author.pdf)

- [dlfm.png](https://0110.be/files/attachments/456/dlfm.png)

---

## [ESCOM 2017 - Regularity and asynchrony when tapping to tactile, auditory and combined pulses](https://0110.be/posts/ESCOM_2017_-_Regularity_and_asynchrony_when_tapping_to_tactile%2C_auditory_and_combined_pulses.md)

- Published: 2017-07-31T00:00:00Z
- Updated: 2017-08-02T15:40:23Z
- Author: Joren
- ID: 455
- Canonical: https://0110.be/posts/ESCOM_2017_-_Regularity_and_asynchrony_when_tapping_to_tactile%2C_auditory_and_combined_pulses

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/455/escom-logo-g-1.png" width="100" alt="ESCOM 2017 Logo" style="float:right;margin:10px"/>The 25th anniversary edition of the [ESCOM 2017 Conference](http://www.escom2017.org/) conference was organised in August 2017 by the IPEM research group from Ghent University. ESCOM is the conference of the [European Society for the Cognitive Sciences of Music](http://www.escom.org/.I) had two contributions to the conference.

The first was a collaboration with Frank Desmet, Micheline Lesaffre, Nathalie Ehrlé and Séverine Samson. The contribution is titled "Multimodal Analysis of Synchronization Data from Patients with Dementia":\[Desmet-et-al.pdf\]. It details a famework to analyze data in an experiment for patients with dementia.

For the second contribution I was the main researcher. It is the result of a project with students of the systematic musicology course at Ghent University (Laura Arens, Hade Demoor, Thomas Kint) . The contribution is called "Regularity and asynchrony when tapping to tactile, auditory and combined pulses":\[2017.escom_multimodal_async.pdf\]

The presentation "details a multi sensory tapping task":\[six-escom2017-presentation.pdf\] with the aim to develop an assistive technology for dancers.


![ESCOM 2017 presentation](https://0110.be/files/photos/455/IMG-20170802-WA0002.jpg)

---

## [Real-time signal synchronization with acoustic fingerprinting - A Master's Thesis By Ward Van Assche ](https://0110.be/posts/Real-time_signal_synchronization_with_acoustic_fingerprinting_-_A_Master%27s_Thesis_By_Ward_Van_Assche_.md)

- Published: 2016-06-24T00:00:00Z
- Updated: 2025-11-29T19:33:03Z
- Author: Joren
- ID: 446
- Canonical: https://0110.be/posts/Real-time_signal_synchronization_with_acoustic_fingerprinting_-_A_Master%27s_Thesis_By_Ward_Van_Assche_

- Tags: [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

During the last semester Ward wrote a Masters thesis titled "Real-time signal synchronization with acoustic fingerprinting":\[Van_Assche_2016_Realtime_signaal_synchronisatie_met_acoustic_fingerprinting.pdf\]. For his thesis Marleen Denert and I served both as promoter.

<div align="center">
<img src="https://0110.be/files/attachments/446/max-msp.png"/>

</div>
The aim of the thesis was to design and develop a system to automatically synchronize streams of incoming sensor data in real-time. Ward followed up on an idea that was described in an article called [Synchronizing Multimodal Recordings Using Audio-To-Audio Alignment](https://0110.be/posts/Synchronizing_Multimodal_Recordings_Using_Audio-To-Audio_Alignment_-_In_Journal_on_Multimodal_User_Interfaces). The [extended abstract](https://0110.be/files/attachments/446/2016_Real-time_signal_synchronization_with_acoustic_fingerprinting.pdf) can be consulted. The remainder of the thesis is in Dutch.

For the thesis Ward developed a Max/MSP object to read data from sensors together with audio. Also provided by Ward is an object to synchronize audio and data in real-time. The objects are depicted above.


---

## [Connecting Musical Modules - Musical Hardware and Software Interfaces](https://0110.be/posts/Connecting_Musical_Modules_-_Musical_Hardware_and_Software_Interfaces.md)

- Published: 2016-03-19T00:00:00Z
- Updated: 2025-11-29T19:33:25Z
- Author: Joren
- ID: 445
- Canonical: https://0110.be/posts/Connecting_Musical_Modules_-_Musical_Hardware_and_Software_Interfaces

- Tags: [Hackerspace Ghent](https://0110.be/tags/Hackerspace%20Ghent.md), [IPEM](https://0110.be/tags/IPEM.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

<img src="https://0110.be/files/attachments/445/logo.png" width="150" alt="Axoloti logo" style="float:right"/> I have given a presentation at the the [Newline](https://0x20.be/newline/2016/) conference, a yearly event organized by the [Hackerspace Ghent](http://0x20.be). It was about:

> <em>"In this talk I will give a practical overview on how to connect hard- and software components for musical applications. Next to an overview there will be demos! Do you want to make a musical instrument using a light sensor? Use your smartphone as an input device for a synth? Or are you simply interested in simple low-latency communication between devices? Come to this talk! More concretely the talk will feature the Axoloti audio board, Teensy micro-controller with audio board, MIDI and OSC protocols, Android MIDI features and some sensors."</em>

During the presentation the hard and software components were demonstrated. More concretely an introduction was given to the following:

-   [Axoloti audio board](http://www.axoloti.com/): An audio DSP board.
-   [Teensy 3.2](https://www.pjrc.com/teensy): A general purpose microcontroller with audio capabilities.
-   [TarsosDSP](https://github.com/JorenSix/TarsosDSP): A library for audio processing in Java available for Android.

The "presentation about DIY musical modules":\[2016.03.19.music-interfaces.pdf\] can be downloaded here.


- [2016.03.19.music-interfaces.pdf](https://0110.be/files/attachments/445/2016.03.19.music-interfaces.pdf)

- [logo.png](https://0110.be/files/attachments/445/logo.png)

---

## [Lecture on MIR - Tone Scale Extraction - Acoustic Fingerprinting](https://0110.be/posts/Lecture_on_MIR_-_Tone_Scale_Extraction_-_Acoustic_Fingerprinting.md)

- Published: 2015-10-30T00:00:00Z
- Updated: 2025-11-29T19:35:10Z
- Author: Joren
- ID: 444
- Canonical: https://0110.be/posts/Lecture_on_MIR_-_Tone_Scale_Extraction_-_Acoustic_Fingerprinting

- Tags: [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

This morning, the 30th of October 2015, I gave a lecture on Music Information Retrieval in general and two MIR-tasks in particular. The two more detailed tasks were tone scale analysis and acoustic fingerprinting.

<center>
<img src="https://0110.be/files/attachments/444/slide.jpg" alt="A slide" width="300px">

</center>
During the lecture some live demonstrations were done with [Panako](http://panako.be) and [Tarsos](https://0110.be/Software). Also some examples from [TarsosDSP](https://0110.be/Software) were used. Excerpts of the music used is available [here](https://0110.be/files/attachments/444/Acoustica-MIR-Tarsos-Panako-examples.zip), this is especially interesting if you want to repeat the demos. [Sonic visualizer](http://www.sonicvisualiser.org/), [Music21](http://web.mit.edu/music21/) and [MuseScore](https://musescore.org/) were also mentioned during the lecture.

The [presentation about Music Information Retrieval](https://0110.be/files/attachments/444/2015.10.30.MIR-Acoustica.pdf) and the [handouts](https://0110.be/files/attachments/444/2015.10.30.MIR-Acoustica-handout.pdf) can be found here als well.


- [Acoustica-MIR-Tarsos-Panako-examples.zip](https://0110.be/files/attachments/444/Acoustica-MIR-Tarsos-Panako-examples.zip)

- [2015.10.30.MIR-Acoustica-handout.pdf](https://0110.be/files/attachments/444/2015.10.30.MIR-Acoustica-handout.pdf)

- [2015.10.30.MIR-Acoustica.pdf](https://0110.be/files/attachments/444/2015.10.30.MIR-Acoustica.pdf)

- [slide.jpg](https://0110.be/files/attachments/444/slide.jpg)

---

## [Synchronizing Multimodal Recordings Using Audio-To-Audio Alignment - In Journal on Multimodal User Interfaces](https://0110.be/posts/Synchronizing_Multimodal_Recordings_Using_Audio-To-Audio_Alignment_-_In_Journal_on_Multimodal_User_Interfaces.md)

- Published: 2015-08-06T00:00:00Z
- Updated: 2025-11-29T19:45:17Z
- Author: Joren
- ID: 434
- Canonical: https://0110.be/posts/Synchronizing_Multimodal_Recordings_Using_Audio-To-Audio_Alignment_-_In_Journal_on_Multimodal_User_Interfaces

- Tags: [Code](https://0110.be/tags/Code.md), [Java](https://0110.be/tags/Java.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Panako](https://0110.be/tags/Panako.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

The article titled *"Synchronizing Multimodal Recordings Using Audio-To-Audio Alignment"* by Joren Six and Marc Leman has been accepted for publication in the [Journal on Multimodal User Interfaces](https://www.springer.com/computer/hci/journal/12193). The article will be published later this year. It describes and tests a method to synchronize data-streams. Below you can find the abstract, pointers to the software under discussion and an author version of the article itself.

### Synchronizing Multimodal Recordings Using Audio-To-Audio Alignment <br><small><small>An Application of Acoustic Fingerprinting to Facilitate Music Interaction Research</small></small>

> **Abstract:** *Research on the interaction between movement and music often involves analysis of multi-track audio, video streams and sensor data. To facilitate such research a framework is presented here that allows synchronization of multimodal data. A low cost approach is proposed to synchronize streams by embedding ambient audio into each data-stream. This effectively reduces the synchronization problem to audio-to-audio alignment. As a part of the framework a robust, computationally efficient audio-to-audio alignment algorithm is presented for reliable synchronization of embedded audio streams of varying quality. The algorithm uses audio fingerprinting techniques to measure offsets. It also identifies drift and dropped samples, which makes it possible to find a synchronization solution under such circumstances as well. The framework is evaluated with synthetic signals and a case study, showing millisecond accurate synchronization.*

To read the article, consult the author version of [Synchronizing Multimodal Recordings Using Audio-To-Audio Alignment](https://0110.be/files/attachments/434/2015.synchronized-recording.pdf). The data-set used in the case study is available here. It contains a [recording of balanceboard data, accelerometers, and two webcams](https://0110.be/files/attachments/434/SyncDataset.zip) that needs to be synchronized. The final publication is available at Springer via [10.1007/s12193-015-0196-1](http://dx.doi.org/10.1007/s12193-015-0196-1)

The algorithm under discussion is included in [Panako](http://panako.be) an audio fingerprinting system but is also available for download here. The [SyncSink application](https://0110.be/files/attachments/434/SyncSink-1.4.jar) has been packaged separately for ease of use.

To use the application start it with double click the [downloaded SyncSink JAR-file](https://0110.be/files/attachments/434/SyncSink-1.4.jar). Subsequently add various audio or video files using drag and drop. If the same audio is found in the various media files a time-box plot appears, as in the screenshot below. To add corresponding data-files click one of the boxes on the timeline and choose a data file that is synchronized with the audio. The data-file should be a CSV-file. The separator should be ',' and the first column should contain a time-stamp in fractional seconds. After pressing Sync a new CSV-file is created with the first column containing correctly shifted time stamps. If this is done for multiple files, a synchronized sensor-stream is created. Also, [ffmpeg](http://ffmpeg.org) commands to synchronize the media files themselves are printed to the command line.

This work was supported by funding by a Methusalem grant from the Flemish Government, Belgium. Special thanks goes to Ivan Schepers for building the balance boards used in the case study. If you want to cite the article, use the following BiBTeX:

<pre>
@article{six2015multimodal,
      author      = {Joren Six and Marc Leman},
      title       = {{Synchronizing Multimodal Recordings Using Audio-To-Audio Alignment}},
      issn        = {1783-7677},
      volume      = {9},
      number      = {3},
      pages       = {223-229},
      doi         = {10.1007/s12193-015-0196-1},
      journal     = {{Journal of Multimodal User Interfaces}}, 
      publisher   = {Springer Berlin Heidelberg},
      year        = 2015
 }
</pre>

![SyncSink Synchronize media files. A user-friendly interface to synchronize media and data files.  First a reference media-file is added using drag-and-drop. The audio steam of the reference is extracted and plotted on a timeline as the topmost box. Subsequently other media-files are added. The offsets with respect to the reference are calculated and plotted. CSV-files with timestamps and data recorded in sync with a stream can be attached to a respective audio stream. Finally, after pressing Sync!, the data and media files are modified to be exactly in sync with the reference.](https://0110.be/files/photos/434/syncsink_synchronize_media_files.png)

![Synchronized streams in Sonic Visualizer. Here you can see two channel audio synchronized with accelerometer data (top, green) and balanceboard data (bottom, purple).](https://0110.be/files/photos/434/sonic_visualizer_waveform.png)

![The synchronized data from the two webcams, accelerometer and balanceboard in ELAN. From top to bottom the synchronized streams are two video-streams, balance-board data (red), accelerometer-data (green) and audio (black).](https://0110.be/files/photos/434/elan_analysis.png)

![Conceptual drawing used as a basis for the SyncSync application. A reference stream (blue) can be synchronized with streams one and two. It allows a workflow where streams are started and stopped (red) or start before the reference stream (green).](https://0110.be/files/photos/434/drift_and_stuff.png)

![A microcontroller fitted with an electret microphone and a microSD card slot. It can record audio in real-time together with sensor data.](https://0110.be/files/photos/434/teensy_audio.jpg)

![Multimodal recording system diagram. Each webcam has a microphone and is connected to the pc via USB. The dashed arrows represent analog signals. The balance board has four analog sensors but these are simplified to one connection in the schematic. The analog output of the microphones is also recorded through the DAQ. An analog accelerometer is connected with a microcontroller which also records audio.](https://0110.be/files/photos/434/system_diagram.png)

![Two streams of audio with fingerprints marked. Some fingerprints are present in both streams (green, O) while others are not (red, x). Matching fingerprints have the same offset, indicated by the dotted lines.](https://0110.be/files/photos/434/sync_two_streams_landmarks.png)

- [2015.synchronized-recording.pdf](https://0110.be/files/attachments/434/2015.synchronized-recording.pdf)

- [SyncDataset.zip](https://0110.be/files/attachments/434/SyncDataset.zip)

- [SyncSink-1.4.jar](https://0110.be/files/attachments/434/SyncSink-1.4.jar)

---

## [Audio Fingerprinting - Opportunities for digital musicology](https://0110.be/posts/Audio_Fingerprinting_-_Opportunities_for_digital_musicology.md)

- Published: 2014-11-25T00:00:00Z
- Updated: 2025-11-29T22:11:24Z
- Author: Joren
- ID: 425
- Canonical: https://0110.be/posts/Audio_Fingerprinting_-_Opportunities_for_digital_musicology

- Tags: [Computational musicology](https://0110.be/tags/Computational%20musicology.md), [IPEM](https://0110.be/tags/IPEM.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Panako](https://0110.be/tags/Panako.md), [Presentation](https://0110.be/tags/Presentation.md), [UGent](https://0110.be/tags/UGent.md)

The 27th of November, 2014 a lecture on audio fingerprinting and its applications for digital musicology will be given at [IPEM](http://www.ipem.ugent.be/). The lecture introduces audio fingerprinting, explains an audio fingerprinting technique and then goes on to explain how such algorithm offers opportunities for large scale digital musicological applications. Here you can download the slides about [audio fingerprinting and its opportunities for digital musicology](https://0110.be/files/attachments/425/2014.11.27.aucoustic_fingerprinting.pdf).

With the explained audio fingerprinting technique a specific form of very reliable musical structure analysis can be done. Below, in the figure section, an example of repetitive structure in the song [Ribs Out](https://www.youtube.com/watch?v=WI7MonB-hig) is shown. Another example is comparing edits or versions of songs. Below, also in the figure section, the radio edit of Daft Punk's Get Lucky is compared with the original version. Audio synchronization using fingerprinting is another application that is actively used in the field of digital musicology to [align audio with extracted features](http://acousticbrainz.org/).

Since acoustic fingerprinting makes structure analysis very efficiently it can be applied on a large scale (20k songs). The figure below shows that identical repetition is something that has been used more and more since the mid 1970's. The trend probably aligns with the amount of technical knowledge needed to 'copy and paste' a snippet of music.

<div  align="center">
<img width="70%" src="https://0110.be/files/photos/425/repetition_over_time.png" alt="How much identical repetition is used in music, over the years"/>\
<br><span>Fig: How much identical repetition is used in music, over the years.</span>

</div>
The [Panako audio fingerprinting system](http://panako.be) was used to generate data for these case studies. The lecture and this post are partly inspired by [a blog post by Paul Brossier](http://aubio.org/news/20091111-2339_shazam).


![Spectral peak Acoustic fingerprinting system](https://0110.be/files/photos/425/spectral_peak_based_fingerprinting_system.png)

![Structure in Ribs Out](https://0110.be/files/photos/425/structure_in_ribs_out.png)

![Radio edit vs. original of Daft Punk's Get Lucky](https://0110.be/files/photos/425/radio_vs_original_edit.png)

![How much identical repetition is used in a set of 20k songs.](https://0110.be/files/photos/425/repetition_over_time.png)

- [2014.11.27.aucoustic\_fingerprinting.pdf](https://0110.be/files/attachments/425/2014.11.27.aucoustic_fingerprinting.pdf)

- [get\_lucky\_radio\_vs\_original.ods](https://0110.be/files/attachments/425/get_lucky_radio_vs_original.ods)

- [music\_structure\_analysis\_ribs\_out.ods](https://0110.be/files/attachments/425/music_structure_analysis_ribs_out.ods)

- [repetition\_over\_time.ods](https://0110.be/files/attachments/425/repetition_over_time.ods)

---

## [ISMIR 2014 - Panako - A Scalable Acoustic Fingerprinting System Handling Time-Scale and Pitch Modification](https://0110.be/posts/ISMIR_2014_-_Panako_-_A_Scalable_Acoustic_Fingerprinting_System_Handling_Time-Scale_and_Pitch_Modification.md)

- Published: 2014-10-27T00:00:00Z
- Updated: 2025-11-29T22:14:07Z
- Author: Joren
- ID: 424
- Canonical: https://0110.be/posts/ISMIR_2014_-_Panako_-_A_Scalable_Acoustic_Fingerprinting_System_Handling_Time-Scale_and_Pitch_Modification

- Tags: [Computational musicology](https://0110.be/tags/Computational%20musicology.md), [IPEM](https://0110.be/tags/IPEM.md), [ISMIR](https://0110.be/tags/ISMIR.md), [Music Information Retrieval](https://0110.be/tags/Music%20Information%20Retrieval.md), [Presentation](https://0110.be/tags/Presentation.md), [Research papers](https://0110.be/tags/Research%20papers.md), [UGent](https://0110.be/tags/UGent.md)

<a href="https://0110.be/files/attachments/424/panako_poster_portrait.svg"><img src='https://0110.be/files/attachments/424/panako_poster.png' style="float:right;margin-left:10px" alt="Panako poster" ></a> At [ISMIR 2014](http://www.terasoft.com.tw/conf/ismir2014) i will present a paper on a fingerprinting system. ISMIR is the annual conference of the International Society for Music Information Retrieval is the world's leading interdisciplinary forum on accessing, analyzing, and organizing digital music of all sorts. This years instalment takes place in Taipei, Taiwan. My contribution is a paper titled [Panako - A Scalable Acoustic Fingerprinting System Handling Time-Scale and Pitch Modification](http://www.terasoft.com.tw/conf/ismir2014/proceedings/T048_122_Paper.pdf), it will be presented during a poster session the 27th of October.

> *This paper presents a scalable granular acoustic fingerprinting system. An acoustic fingerprinting system uses condensed representation of audio signals, acoustic fingerprints, to identify short audio fragments in large audio databases. A robust fingerprinting system generates similar fingerprints for perceptually similar audio signals. The system presented here is designed to handle time-scale and pitch modifications. The open source implementation of the system is called Panako and is evaluated on commodity hardware using a freely available reference database with fingerprints of over 30,000 songs. The results show that the system responds quickly and reliably on queries, while handling time-scale and pitch modifications of up to ten percent.*

> *The system is also shown to handle GSM-compression, several audio effects and band-pass filtering. After a query, the system returns the start time in the reference audio and how much the query has been pitch-shifted or time-stretched with respect to the reference audio. The design of the system that offers this combination of features is the main contribution of this paper.*

The system is available, together with documentation and information on how to reproduce the results from the ISMIR paper, on the <a href="http://panako.be">Panako website</a>. Also available for download is the [Panako poster (pdf)](https://0110.be/files/attachments/424/panako_poster.pdf), [Panako ISMIR paper](https://0110.be/files/attachments/424/ismir_2014_panako_fingerprinter.pdf) and the [Panako poster (inkscape SVG)](https://0110.be/files/attachments/424/panako_poster_portrait.svg).<br/><br/>


![General fingerprinter](https://0110.be/files/photos/424/general_fingerprinter.png)

![Fingerprint and modifications](https://0110.be/files/photos/424/fingerprint_modifications.png)

![Results after pitch shifting](https://0110.be/files/photos/424/results_pitch_shift.png)

![Results after time scale modification](https://0110.be/files/photos/424/results_time_scale_mod.png)

![Results after time stretching](https://0110.be/files/photos/424/results_time_stretch.png)

![](https://0110.be/files/photos/424/15661087512_4bdcf16035_o.jpg)

![](https://0110.be/files/photos/424/15039600264_52afd0cce4_o.jpg)

![](https://0110.be/files/photos/424/15657586301_668d4c9f37_o.jpg)

![](https://0110.be/files/photos/424/15657657061_065e764e34_o.jpg)

![](https://0110.be/files/photos/424/15661231592_d76a2a8420_o.jpg)

- [panako\_poster.png](https://0110.be/files/attachments/424/panako_poster.png)

- [panako\_poster.pdf](https://0110.be/files/attachments/424/panako_poster.pdf)

- [panako\_poster\_portrait.svg](https://0110.be/files/attachments/424/panako_poster_portrait.svg)

- [ismir\_2014\_panako\_fingerprinter.pdf](https://0110.be/files/attachments/424/ismir_2014_panako_fingerprinter.pdf)

---

[Older posts](https://0110.be/Publications.md?page=1)
