Learn how to master body motion in music creation

Bart Moens
bart.moens@ugent.be

Joren Six
joren.six@ugent.be

MuTechLab Workshop
October 3, 2025

Bart Moens

Postdoctoral Researcher

  • IPEM, Ghent University
  • XRHIL Core Facility
  • Music Technology Expert

Joren Six

Postdoctoral Researcher

  • Former IPEM member, Ghent University
  • Now at Ghent Centre for Digital Humanities (GhentCDH)
  • Music Technology Expert

Timeline

  • 09.30 - 10.00 Background, concept and demo
  • 10.10 - 12.00 Hands-On
  • 12.00 - 12.30 Discussion

IPEM

Research on embodied music cognition

Focus: relationship between movement and music

IPEM Research

Studying music through embodied interaction

"The body in action"

Using XR technologies for immersive musical experiences

Improving Musical Interfaces

One key research area at IPEM:

Extending and improving musical interfaces

Traditional MIDI Controllers

Improving Musical Interfaces

Some IPEM projects

The Music Paint Machine

Interactive musical painting interface

Body movement creates music and visuals

SoundBikes

Cycling synchronized with music

Participatory music-making installation

Movement entrainment research

D-Jogger

Music player adapting to running rhythm

Alignment of music and movement

Entrainment strategies

One Person Choir

Gestural control for singers

Real-time voice harmonization

Embodied music interface

Today's Session

Easy-to-use wearable for music interaction

M5Stack IMU sensors

Low-cost solution for body motion

Concept

Measure sensor values

Convert to MIDI controls

Integrate in your practice

Focus

  • Orientation - Pitch, yaw, roll
  • Taps - Motion detection

Demo: Orientation Control

Demo: Tap Detection

Integration with DAW

Works with any MIDI-compatible software

Demo DAW integration

Device Operation

Hands-On Session

Try the sensors yourself

Experiment with mappings

Create your own interactions

Discussion

Questions & Ideas

Potential applications

Future directions

References

  • Maes et al. (2011): The One-Person Choir
  • Maes et al. (2018): The SoundBike
  • Moens & Leman (2015): D-Jogger alignment strategies

www.ugent.be/lw/kunstwetenschappen/ipem/en
xrhil.ugent.be