TEACHx 2026

Motion capture technology, long established in industries such as sports, animation, and medical research, is a powerful tool for mapping and analyzing human movement. Its precision and ability to visualize biomechanical detail offer unique benefits when applied to music education—particularly in piano pedagogy, where mastery of physical nuance supports and enhances expressive performance.


Our project at Northwestern University, conducted in partnership with the Northwestern IT Emerging Technologies Lab, investigates motion capture as a platform to modernize piano instruction. By combining wearable sensor data from instructors with synchronized MIDI and multi-angle video, we facilitate dynamic visualization of expert technique—granting students access to practical demonstrations that surpass the limits of conventional teaching. The system’s interactive features, including targeted practice modes and accessible tools, encourage self-directed learning and promote a more informed development and understanding of playing habits.


Through iterative design and continued collaboration with faculty and students, we are refining this approach to prioritize accessibility and expand functionality. Beyond technical advancement, our work highlights how motion capture can foster creativity, exploration, and personalized learning—helping learners bridge the gap between understanding of physicality and technical execution in a technology-driven landscape.