Published on June 12th,2012 at 8:02 PM
By >Daimaou - G.G-B

Keio University demonstrates Avatar mirrors users facial expressions in real-time using a standard webcam

A Keio University group, led by Associate Professor Yasue Mitsukura, has developed a method for measuring which way a person is facing and how their expression changes. This system achieves high speed and high precision, using an ordinary PC and a USB camera.

“We think this system could be used by CG animation hobbyists, in Web dialog systems that show a character instead of the person’s face, and for making characters move in real time at events. Because the system uses just one PC and one camera, it can be applied in many situations very easily.”

To detect and track faces, this system uses time-series signal processing. It tracks characteristic points, including the eyes, nose, and mouth, at high speed with high precision. The white dots on the screen show the points used to track the face, and the red line shows the orientation of the face. So you can see that the system is detecting the face appropriately, in line with the way it’s facing and the movement of the mouth.

“We’re using an algorithm that gets updated in line with the motion of the face. So it can track the face very fast, with very high precision. That’s the basic technology for this avatar system.”

This system also analyzes the shape of the person’s expression. So it can reproduce how the eyebrows and mouth are moving, and whether the person is laughing, angry, or surprised.

As well as avatars, this system could also be used for games that detect and react to changes in people’s faces.

“Systems using motion capture with markers on the face aren’t convenient for ordinary users. In that sense, until now, there hasn’t been technology for moving a model freely in real time.”

From now on, the researchers aim to develop motion generation software for standard PCs. That should enable various ways to apply and implement this system.

This Video is provided to you by DigInfo.tv, AkihabaraNews Official Partner.


Via Keio U
              
Related Articles


 

0

ZMP demos RoboCar HV driverless R&D test vehicle can be driven with an iPad

0

Sony announce the XAV-601BT in Europe as well

Comments
 

  • nnn

    typo on title 

    • akihabaranews

      thnks

 

0

Panasonic - Massager that relaxes your muscles and warms them gently

1

World's lightest and thinnest circuits pave the way for 'imperceptible electronics'

0

Panasonic - Smartphone-sized portable full body massager

0

Nestlé - KitKat - 2013 summer seasonal special flavors

0

Turn your iPhone 4/4s or 5 into a real pocket camcorder thanks to Donya

0

Japanese Technology from the Future Friday!

0

LG - Pink-colored model will be added to Pocket photo

3

Sharp - Electronic handwriting notebook that can save 2000 pages data

0

LG - Ultra-wide LCD monitor with a cinematic 21:9 aspect ratio

0

Panasonic – DMC-XS3 – Slim & classic designed Lumix camera

0

Panasonic - DMC-FZ70 - Lumix camera with the world's first 60X optical zoom

0

Japanese Robots: The Seemingly Least Cool Robotics Story of July is a Must-Read!

1

Sony - α58 - DSLR camera with interchangeable lenses

0

Thanko - 7.5mm biz card sized portable battery - Increased in battery capacity by 1200mAh over the previous model

0

JVC Kenwood - ADIXXION "GC-XA2" - dustproof, shockproof, waterproof, low-temperature resistant action camera

0

NTT docomo - Disney Mobile on docomo F-07E - Disney official smartphone