Published on October 10th,2012 at 2:00 PM
By >DigInfo TV

[Hands-On] Docomo Hands-Free Videophone for futuristic glasses-type HMD devices

NTT Docomo has developed the Hands-Free Videophone, which enables video calls without having to hold the camera. This is part of docomo’s research on creating future glasses-type devices.

The Hands-Free Videophone captures the user’s face with three cameras in each of the left and right sides of the frames. The video sent to the other person is created by combining the pictures with a pre-rendered 3D model of the users face.

“Each camera has 720p resolution, and a fish-eye lens, with a 180-degree field of view. This is the High Definition picture currently being captured in real time. If you look at the face, you can see it’s really distorted, because the fish-eye lens is so close. The distortion is compensated, and the picture is combined with a 3D model of the person in the computer. Currently, priority is given to the part around the eyes. As you can see when the man closes his eyes, the eyelids and the corners of the eyes appear quite realistic. Such a level of realism is hard to achieve with models like CG-based avatars, where parts are overlaid on the face.”

Currently, the resolution isn’t high enough to handle the mouth and upper body parts of the picture, so those are based on CG. The orientation of the face is based on six-axis sensor data, and the motion of the mouth is based on audio data from the microphone.

There’s also a camera on the back of the device, so more realistic video calls can be achieved by combining the person’s image with the actual background.

“So, in the picture the other person receives, it looks as if there’s a virtual camera taking pictures from in front of this person’s face. In the current prototype, we haven’t yet built in a HMD. But we’d like to do that in the future, to make it feel as if the picture of the other person is floating before your eyes. We think it could be possible to make it seem as if you’re having a face-to-face dialog anywhere, even in an empty outdoor space.”

If the camera resolution is increased dramatically, to 4K or 8K, it’ll be possible to increase the amount of actual video used. Ultimately, the aim is for most of the face to be recreated from actual video.

This Video is provided to you by DigInfo.tv, AkihabaraNews Official Partner.


Category Phones
              
Related Articles


 

0

Acer outs a new Atom based Iconia slate with the W510

0

LCD-MF271CGBR, I-O Data new WQHD IPS monitor

Comments
 

 

0

Panasonic - Massager that relaxes your muscles and warms them gently

1

World's lightest and thinnest circuits pave the way for 'imperceptible electronics'

0

Panasonic - Smartphone-sized portable full body massager

0

Nestlé - KitKat - 2013 summer seasonal special flavors

0

Turn your iPhone 4/4s or 5 into a real pocket camcorder thanks to Donya

0

Japanese Technology from the Future Friday!

0

LG - Pink-colored model will be added to Pocket photo

3

Sharp - Electronic handwriting notebook that can save 2000 pages data

0

LG - Ultra-wide LCD monitor with a cinematic 21:9 aspect ratio

0

Panasonic – DMC-XS3 – Slim & classic designed Lumix camera

0

Panasonic - DMC-FZ70 - Lumix camera with the world's first 60X optical zoom

0

Japanese Robots: The Seemingly Least Cool Robotics Story of July is a Must-Read!

1

Sony - α58 - DSLR camera with interchangeable lenses

0

Thanko - 7.5mm biz card sized portable battery - Increased in battery capacity by 1200mAh over the previous model

0

JVC Kenwood - ADIXXION "GC-XA2" - dustproof, shockproof, waterproof, low-temperature resistant action camera

0

NTT docomo - Disney Mobile on docomo F-07E - Disney official smartphone