So far my prototype consists of the custom made code for the Arduino that sends an array with the values of each of the sensors every few times in the second and the code inside Processing that reads the data and works with it. If something gets into the range it will start playing music and you can modify its volume. But it was time to work with a real track.
I recently found old files from the game Guitar Hero. The useful part is that the songs in there are split up into the different instruments that it consists of . This seemed fun to play around with as I tried it in Ableton and decided to give it a shot in the prototype also.
My plan was to attach a song with 5 different instruments to 5 different ports of the mpr121 and be able to trigger them with a touch of the cable. The easy part was to put the music files into the program, but now I also had to make them responsive. I wanted to have a single channel playing the whole time and what better and more consistent throughout the track then the drums. Now when you get it the range the drums were starting right away. I wanted to be able to add stems with a touch of the other cables and my initial idea was to write scipt that is tracking constantly the position of the player on the drums channel and it would save it and send it to the next channel, so it knows where to start. Unfortunatelly, errors occured with delay and replaying overtimes and I had to swith to another strategy Andro suggested me. Now it works perfect – the script plays all the tracks when you get into range but everything out of the drums is muted and whenever you press a cable, the corresponding audio track will be unmuted and will join in sync with the other part/s.
Leave a comment