Project Description (from the site)
SNIFF: public interactive projection
As you walk down the street you are approached by a dog. He is on his guard trying to discern your intentions. He will follow you and interpret your gestures as friendly or aggressive. He will try to engage you in a relationship and get you to pay attention to him.
Sniff is an interactive projection in a storefront window. As the viewer walks by the projection, her movements and gestures are tracked by a computer vision system. A CG dog dynamically responds to these gestures and changes his behavior based on the state of engagement with the viewer.
How it works:
SNIFF is composed of two main components,the first one is a video tracking system which was built in openFrameworks and the second one is a game engine for real time graphics using Unity3d.
People on the sidewalk are monitored by an IR camera in openFrameworks. In oF each individual person is isolated and assigned a unique id for the duration of their interaction. Each persons’ position and gesture information is continually sent to Unity3d via OSC networking protocol. In Unity, an artificial intelligence system representing the dog forms relationships with the individuals. He chooses which person to pay attention to, is able to move towards them or back away, responds to their gestures and initiates gestures of his own. Based on the interaction he gets excited or bored, friendly or aggressive, which is reflected in his behavior.