Our Emerging Media group at Nordstrom proposed a interactive, projected experience for a display window or in-store location to run during Holiday 2012. The demonstration was accepted for in-store use, and a full experience detecting and drawing user’s silhouettes and allowing them to interact with falling snowflakes was installed for the Holiday season.
We customized and refactored open source Processing code that used the Microsoft Kinect to detect user bodies via infrared camera, and trace & fill the silhouettes into solid shapes via the Box2d physics library. The falling snowflakes were dynamically drawn as polygons with physics properties and the system allowed users to catch and push snowflakes as they fell. An overhead projector displayed the entire experience on wall, and the Processing/Java app captured basic metrics information in XML files via our own custom classes.