This is the first demo of my series of experiments with real time shape recognition using HTML5 getUserMedia, OpenCV and Box2D.
While I was working as a creative technologist at WCRS, I started to play with Box2d a lot. I was also experimenting with Kinect and OpenFrameworks to recognise shapes/blobs in real time, which led me to build some demos mixing both technologies.
In this HTML5 demo, I’m using a webcam to get a live video stream of some shapes drawn in a paper sheet. These video is analysed with JavaScript (using OpenCV) to identify the shapes. Once we have the 2D coordinates of those shapes, I use Box2d to create their representation in the Box2d world.
In the following images, you can see how the lines drawn in the paper become static platforms that contain the other boxes falling from the top of the screen.
