In this project, the instrument was designed as two pairs of gloves and socks with accelerometer sensors on as gesture controllers. The controller transmits real-time data via Bluetooth to the mapping algorithm for drum sound synthesis output. While the performer begins his/her performance and dances to the background music, the dance movements can be translated into drum beats. The auditory experience is enriched since this second layer sonic pattern is added on top of the background music. The performer can react to both layers of music, and his/her artistic expression, with the shifting between the identities as a dancer or a musician/composer, can vary accordingly. He/she is also the audience of the performance with the augmented auditory feedback, using it to inspect the movement just now and improve or improvise based on it.
This project investigated the embodiment theory, somaesthetic, and the expanded definition of musical instruments. From the design of the gesture controller, and mapping methods, to the sound synthesis, this project carefully explored and analyzed the design of the instrument, to examine how the instrument shared a relationship with the performer, and how could the instrument support the performing body, particularly the dancing body.