Development

I used Python because I hadn't used it in a while.  The image processing library is OpenCV.  When I started I had no idea how I was going to be able to do the computer vision part of the code.  

Major hurdles:

• Framework compatibility.  I went through several distributions of SciPy, and of each package, before finding a combination that works.  
• Learning computer vision.  OpenCV is a massive library.  As it turns out I really only needed a few functions.  I admit to a lot of coding-by-Google to find the functions and parameters that would do what I needed.
• Real-time audio.  I had to try several different libraries.  It still isn't perfect.  

What is WebCamJam?

WebCamJam is a Python application that lets you work with a pattern based sequencer using tangible objects.  In simpler terms, you make beats and melodies by putting dots on a piece of paper.  A webcam watches the paper from above, and the computer figures out what you're doing and plays the right sound at the right time.