Coordination Skill Learning System for Musicians

We are developing a machine-learning-based biofeedback system that can effectively transfer the sensorimotor skills of experts to leaners.

Using classification and regression algorithms, we extract features of particular skills, and then provide them visually and haptically with CG and robotics technologies. Our focus is on the coordinating structure of multiple joints and muscles (i.e. synergy), which is fed back to learners intuitively in a multi-modal manner (coordination skill learning: CSL). To achieve this, we are developing a hand exoskeleton and its control algorithm. Furthermore, based on sensorimotor learning principles of the nervous system, we aim to identify the optimal methods for acquisition of musical virtuosity.