Published on May 19th,2011 at 3:01 PM
By >Daimaou - G.G-B

Sony develops “SmartAR” Integrated Augmented Reality technology

Sony develops “SmartAR” Integrated Augmented Reality technology

Sony introduced today new integrated Augmented Reality (AR) technology called “Smart AR.”
This technology enables additional information to be displayed on the device’s screens such as virtual objects, or images and texts that cannot be identified by visual perception alone. The technology employs the markerless approach, forgoing any requirement for special markers such as 2D barcodes. The object captured by the camera is quickly recognized and can be tracked at high-speed along with the movement of the camera, as it is displayed over the actual 3D space.

AR information can be displayed on the captured image which appears on a device’s screen, including those images that do not have any special markers for AR. This technology is also compatible with image recognition technologies that use conventional markers (such as “CyberCode*2”). Because “SmartAR” can recognize everyday objects such as posters and menus, it has the potential for a wide variety of applications.

“SmartAR” object recognition technology identifies objects by analyzing features detected from a portion of the image (hereafter, ‘local features’) together with their positional relationship. Our feature matching technology that employs a proprietary probabilistic method that matches local features with minimal calculations enables high-speed recognition that is resistant to changes in lighting or the position of the object. In addition, recognition is still possible even if the object captured appears to be comparatively small in the display.

High-speed tracking (‘rapid & accurate’)
Sony achieved its natural-feeling ‘rapid & accurate’ AR by quickly displaying AR information on the screen and then tracking the camera’s movements at high-speed. This has been realized by combining object recognition technology with our proprietary matching technology that uses features detected from a portion of the image (‘local features’) and image tracking technology that is capable of dealing with changes in the shape of the object.

3D space recognition
With our dynamic, large-scale AR, virtual objects can be merged with 3D structures detected in the physical world. For example, even if the AR image is a gigantic virtual character whose size exceeds the dimensions of the device’s screen, the technology allows the user to grasp the entirety of the virtual character when the camera is moved around. Furthermore, it is also possible to move the virtual object in the actual 3D space as if it were really there.

Three-dimensional space recognition technology is based on use of the disparity observed by the camera movements to estimate the shape of the 3D space and the position and angle of the camera. By combining this with object recognition technology, devices become capable of identifying and remembering 3D space constructions.

AR Interaction
Information can be intuitively acquired and navigated by directly touching the AR information displayed on the smartphone or device’s screen. The distinctiveness of “SmartAR” technology comes from the user interface which enables users to naturally use and operate additional information and virtual objects.

Via Sony
Category Software
              
Sony develops “SmartAR” Integrated Augmented Reality technology
Related Articles


 

2

NEC announces LifeTouch W Dual Screen Android 2.2 Tablet shipment schedule for next month

3

Canon unleashes WUXGA 4000 Lumens LCOS Projector with swappable lenses

Comments
 

 

0

Panasonic - Massager that relaxes your muscles and warms them gently

1

World's lightest and thinnest circuits pave the way for 'imperceptible electronics'

0

Panasonic - Smartphone-sized portable full body massager

0

Nestlé - KitKat - 2013 summer seasonal special flavors

0

Turn your iPhone 4/4s or 5 into a real pocket camcorder thanks to Donya

0

Japanese Technology from the Future Friday!

0

LG - Pink-colored model will be added to Pocket photo

3

Sharp - Electronic handwriting notebook that can save 2000 pages data

0

LG - Ultra-wide LCD monitor with a cinematic 21:9 aspect ratio

0

Panasonic – DMC-XS3 – Slim & classic designed Lumix camera

0

Panasonic - DMC-FZ70 - Lumix camera with the world's first 60X optical zoom

0

Japanese Robots: The Seemingly Least Cool Robotics Story of July is a Must-Read!

1

Sony - α58 - DSLR camera with interchangeable lenses

0

Thanko - 7.5mm biz card sized portable battery - Increased in battery capacity by 1200mAh over the previous model

0

JVC Kenwood - ADIXXION "GC-XA2" - dustproof, shockproof, waterproof, low-temperature resistant action camera

0

NTT docomo - Disney Mobile on docomo F-07E - Disney official smartphone