Microsoft has taken the wraps off some of the natural user interface projects currently in development within its research group.
Following a natural user interfacte (NUI) and Kinect SDK TechForum event on Monday, the company posted videos of 3D talking heads, as well as new initiatives in smart displays — both of which make use of camera technologies to create new types of interaction experiences.
Microsoft Research principal researcher Zhengyou Zang demonstrates 3D facial mapping technology. Video credit: Microsoft Research
The first is an evolution of Microsoft's face-mapping technology, which is soon to be introduced as part of the Xbox 360's Avatar Kinect feature. Instead of mapping facial movements to a virtual character, however, the technology grabs a 2D, high-quality video of a person from a webcam (or Kinect) and maps it onto a 3D facial mesh model. The end result is a 3D face that can track speech or head movements it picks up on camera and display it back on the 3D avatar.
In the video demo above, Microsoft Research principal researcher Zhengyou Zhang demonstrates how to take that model and have it play back any text as well.
For more on this ZDNet UK-selected story, see Microsoft demos 3D photo avatars, display tech on CNET News.
Get the latest technology news and analysis, blogs and reviews delivered directly to your inbox with ZDNet UK's newsletters.
