Archives For April 30, 2012

After a long journey, my team at Microsoft shipped our real-time face tracking technology as API in Kinect For Windows 1.5 in 2012. I worked on the 2D & 3D face tracking technology. Here I describe its capabilities and limitations. For more information, see my paper “Real-time 3D face tracking based on active appearance model constrained by depth data” in IMAVIS 2014. Later on, this technology was used in Skype’s face augmentations.

Continue Reading...

Here I describe how to control Robotis Dynamixels (smart actuators) from a PC via a serial protocol. I also provide code for this.

Continue Reading...

Avatar Kinect

May 19, 2012 — 4 Comments

In summer 2011, my group at Microsoft shipped an interesting Computer Vision app/mini game for XBox 360 called “Avatar Kinect”. I worked on the 2D/3D face tracking technology. You can pose in front of the Kinect camera and the application tracks movements of your head and facial features (lips, eyebrows) and renders you as an XBox avatar. Pretty cool app if you want to record little videos of yourself as an animated cartoon avatar and then post them to YouTube. Or if you want to talk to your friends as an avatar, the app allows a multiparty avatar chat. 

Continue Reading...