Inspired by the work with Organic projection mapping software, I wanted to make something like these interactive projection installations from LUMOplay.

Since Blender has a built-in game and physics engine, that seemed like the easiest way to get started. The first iteration was a little 3D model that I could control via UDP from a Python script.

The second iteration was a model of the traverse stage I was working in. I created a separate Java application that used OpenCV to detect movement on a webcam and then would translate the coordinates of the object on the webcam to the 3D model. As long as the webcam field of view was aligned to the 3D model, the image projected on the floor of the theater reacted to the objects detected by the webcam and to the shape of the stage itself.

This project always remained a prototype, but I think stuff like this has a lot of potential in theater productions as well as an instructional aid.