Beside sound interaction we are exploring ways to communicate with Ellie using movement and body language. In this case Ellie is mimicking the body language of a user. While at rest Ellie is slowly breathing, as soon as she notices a person she’ll react to the person’s body language. The idea is that Ellie can recognize the people who had interactions with her. For example when she sees a familiar face she’ll start the movement of the last interaction she remembers with that person.
We used a kinect (v2) and OpenFrameworks to realize this prototype.