Music Interaction - Entertainment, Creative and Sociable
Prototype 1 : Finger-less Music Making Application
This is a finger-less application project that users could create their music without use voice and touch the phone screen. I made an application and a prototype with distance sensor to manipulate this special experience. The idea of finger-less could suit in many particular scenarios and users such as long distance environment, underwater environment, people with multitasking, and people with disabilities.
There are ten different gestures could control this fingerless music conductor application: blow to the microphone, use the camera to tracking the eye's movement, shake in different directions, drawing circle clockwise or anticlockwise on top of the phone or blink the eyes once, twice or more.
Users can blow the microphone to start the application, then move their eyes to choose the different style, blink once to determine the style and then start to use different shaking strategies to create their music. Blink again to push the music and blink twice to save and share the music file they just create.
Users and overlap the six different shaking and drawing methods to create much more complicated and rich music effect. They can create up to 720 different combinations of the gestures and music effects with this method.
Prototype 2: motion conductor
This is a motion conductor that you can use your hands' movement to compose music.
In this project, I coded 16 movements in 3 instruments from " the cloud atlas end title " and Yann Tierson's "La valse d'Amelie". You can recombine the different movements within different instruments effect to create a new song or symphony with your free hands. The process just like we playing music, or conducting an orchestra. It have 4 distaste sensors, Those 4 sensors could call music movements each time when your hands active in a certain distance. It will give more than 140,000 combinations of music.
The floating dots will be active in 2.8 meters, music will be active in 1.2meter. This is designed to make people get attractive by the visual effect first. Then when they come very closer to the device, it will start to have sound. Otherwise, it could be influenced by the environment too much, the effect of the music that we're making will be less clean and beautiful.
