Published on April 16th,2013 at 1:09 PM
By >DigInfo TV

Fujitsu Laboratories – Touchscreen interface for seamless data transfer between the real and virtual worlds

Fujitsu Laboratories has developed a next generation user interface which can accurately detect the users finger and what it is touching, creating an interactive touchscreen-like system, using objects in the real word.

“We think paper and many other objects could be manipulated by touching them, as with a touchscreen. This system doesn’t use any special hardware; it consists of just a device like an ordinary webcam, plus a commercial projector. Its capabilities are achieved by image processing technology.”

Using this technology, information can be imported from a document as data, by selecting the necessary parts with your finger.

This technology measures the shape of real-world objects, and automatically adjusts the coordinate systems for the camera, projector, and real world. In this way, it can coordinate the display with touching, not only for flat surfaces like tables and paper, but also for the curved surfaces of objects such as books.

“Until now, gesturing has often been used to operate PCs and other devices. But with this interface, we’re not operating a PC, but touching actual objects directly, and combining them with ICT equipment.”

“The system is designed not to react when you make ordinary motions on a table. It can be operated when you point with one finger. What this means is, the system serves as an interface combining analog operations and digital devices.”

To detect touch accurately, the system needs to detect fingertip height accurately. In particular, with the low-resolution camera used here (320 x 180), if fingertip detection is off by a single pixel, the height changes by 1 cm. So, the system requires technology for recognizing fingertips with high precision.

“Using a low-res webcam gives a fuzzy picture, but the system calculates 3D positions with high precision, by compensating through image processing.”

This system also includes technology for controlling color and brightness, in line with the ambient light, and correcting for individual differences in hand color. In this way, it can identify fingertips consistently, with little influence from the environment or individual differences.

Also, in situations that don’t use touch, the system can be operated by gesturing. In this demo, when you move your fist, you can manipulate the viewpoint for 3D CAD data. So, there could be applications for this touch system by combining it with current gesture systems.

“For example, we think this system could be used to show detailed information at a travel agent’s counter, or when you need to fill in forms at City Hall.”

“We aim to develop a commercial version of this system by fiscal 2014. It’s still at the demonstration level, so it’s not been used in actual settings. Next, we’d like to get people to use it for actual tasks, see what issues arise, and evaluate usability. We want to reflect such feedback in this system.”

This Video is provided to you by DigInfo.tv, AkihabaraNews Official Partner.

Category Touch Panel
              
Related Articles


 

0

Thanko - Camera mount with 2 powerful suction cups to secure a video camera on the hood or side of a vehicle

0

Elecom - Cute design iPad Mini shell cover kit - TB-A12SPSTT series

Comments
 

 

0

Panasonic - Massager that relaxes your muscles and warms them gently

1

World's lightest and thinnest circuits pave the way for 'imperceptible electronics'

0

Panasonic - Smartphone-sized portable full body massager

0

Nestlé - KitKat - 2013 summer seasonal special flavors

0

Turn your iPhone 4/4s or 5 into a real pocket camcorder thanks to Donya

0

Japanese Technology from the Future Friday!

0

LG - Pink-colored model will be added to Pocket photo

3

Sharp - Electronic handwriting notebook that can save 2000 pages data

0

LG - Ultra-wide LCD monitor with a cinematic 21:9 aspect ratio

0

Panasonic – DMC-XS3 – Slim & classic designed Lumix camera

0

Panasonic - DMC-FZ70 - Lumix camera with the world's first 60X optical zoom

0

Japanese Robots: The Seemingly Least Cool Robotics Story of July is a Must-Read!

1

Sony - α58 - DSLR camera with interchangeable lenses

0

Thanko - 7.5mm biz card sized portable battery - Increased in battery capacity by 1200mAh over the previous model

0

JVC Kenwood - ADIXXION "GC-XA2" - dustproof, shockproof, waterproof, low-temperature resistant action camera

0

NTT docomo - Disney Mobile on docomo F-07E - Disney official smartphone