Link / BA Graduation Project II
2019
–
Link is an interactive movement game created using PoseNet and p5.js, designed to connect yoga poses with animal movements to generate real-time music videos. Initially conceived as a therapeutic tool for Parkinson’s patients, Link leverages the therapeutic benefits of both yoga and music therapy to promote ease of movement and offer an enjoyable experience.
The system uses computer vision, with PoseNet capturing the player’s gestures via a webcam. These movements are mapped to video fragments that represent animal-inspired actions such as swimming and flying, which are synchronized with music. By embodying animals in motion and exploring natural themes, players are encouraged to stretch and perform yoga poses, creating a dynamic and engaging audiovisual experience.
Through this multisensory interaction, Link aims to improve movement quality by correlating various senses and distributing cognitive processes. By blending movement, music, and visual elements, it provides a unique way to explore therapeutic possibilities and foster an immersive, playful experience for users of all abilities.