Sony

Japanese
Research Gallery

Augmented Reality (AR)

Many technologies termed as Augmented Reality at present are derived from researches conducted at Sony Computer Science Laboratories, Inc. in the early 90's.

 

Herebelow are some examples of such researches:

 

Navicam:
  naviNewNaviCam is a system comprised of a computer, a camera and a small display to detect real-world color-codes (markers). The system is designed to generate information when it recognizes a color-code through its camera, allowing users to look at the real world with context sensitive information.

http://www.sonycsl.co.jp/person/rekimoto/navi.html


Jun Rekimoto and Katashi Nagao, "The World through the Computer: Computer Augmented Interaction with Real World Environments", ACM User Interface Software and Technology (UIST '95) , 1995

 

TransVision:
  pointingNewTransVision is a system that uses augmented reality (AR) technology for two or more participants to share the same computer generated information (such as molecular models or mock-up CGs) overlaid on the real world.
http://www.sonycsl.co.jp/person/rekimoto/transvision.html


Jun Rekimoto, "TransVision: A Hand-held Augmented Reality System for Collaborative Design" Virtual Systems and Multi-Media (VSMM)'96, 1996

 

CyberCode:
CyberCode is a visual tagging system designed for augmented reality (AR) applications, based on an image recognition technology that uses visual-markers. In addition to its ID number, the 3D position of a printed 2D code can be determined from images captured by low-cost sensors such as webcams. CyberCode is designed so that it can be easily recognized in the real world by computers.

http://www.sonycsl.co.jp/en/research_gallery/cybercode.html

http://www.sonycsl.co.jp/person/rekimoto/matrix/Matrix.html


Jun Rekimoto, "Augmented Reality using the 2D matrix code" Workshop on Interactive Systems and Software (WISS'96)

 

Augment-able Reality:
cscamAugment-able Reality is a system that allows users to dynamically attach newly created digital information such as voice notes or photographs to the real world, by sensing location information through computers.
http://www.sonycsl.co.jp/person/rekimoto/augmentable/


 

Jun Rekimoto, Yuji Ayatsuka and Kazuteru Hayashi "Augment-able Reality: Situated Communication through Physical and Digital Spaces" ISWC'98, 1998

 


 

Patents

 

Major Patents Issued to Sony Corporation concerning AR:


[USA]
   US Patent 6,020,891
   US Patent 6,389,182 
   US Patent 6,636,249

[JAPAN]
   JP Patent 3,558,104 
  JP Patent 3,786,166 
  JP Patent 4,289,329  

 


Realization of such researches and technologies seemed too futuristic and more like dream applications back in the early 90's, but with the advance in feature technologies and small sized devices, we are finally seeing such technologies actually enter our daily lives.

 

For example, following game titles come with Augmented Reality capabilities:

 

Sony Computer Entertainment Inc. "Eye of Judgement(TM)" (PlayStation(R)3) EyePetWashingHairdry_New
http://www.jp.playstation.com/scej/title/eoj/

 

Sony Computer Entertainment Europe "EyePet(TM)" (PlayStation(R)3)
http://uk.playstation.com/games-media/games/detail/item156369/EyePet%E2%84%A2/

 

Sony Computer Entertainment Europe "Invizimals(TM)" (PlayStation(R)Portable)
http://uk.playstation.com/games-media/games/detail/item156403/Invizimals%E2%84%A2/

 

The above CyberCode technology is also licensed to Koozyt, Inc., and is incorporated in their KART (Koozyt AT Technology). Various applications that use this technology are already available.

AR Layout Simulator [Beta ver.] (available only in Japanese) 
AR Layout Simulator is a web application that allows you to overlay real size Sony products (TV, VAIO etc) on printed CyberCode markers by using web cameras.  Users can experience room layouts prior to purchasing such products. Android version is also now available.

# Web Camera version: http://www.sony.jp/hitokoto/ar-simulation/

#Android version: http://www.sony.jp/hitokoto/ar-layout/

GnG (Get and Go) Service

GnG(Get and Go) is a mobile augmented reality (AR) application that uses the camera device on smartphones to detect CyberCode.

http://www.koozyt.com/solutions/gng/?lang=en

KART Solution (Marker type) (available only in Japanese)
By using the ITpro EXPO AR application, users were able to access
various content related to ITpro EXPO 2009, simply by pointing their
smartphones to posters within the venue. The posters were printed
with special markers that were able to be detected by the smartphone camera.


 EyePet™ ©2009 Sony Computer Entertainment Europe. Published by Sony Computer Entertainment Europe. Developed by SCEE London Studio. "EyePet" is a trademark of Sony Computer Entertainment Europe.  All rights reserved.

Invizimals™ ©2009 Sony Computer Entertainment Europe. Published by Sony Computer Entertainment Europe. Developed by Novarama Technology S.L.. Invizimals is a trademark of Sony Computer Entertainment Europe. All rights reserved.

THE EYE OF JUDGMENT™ ©2007 Sony Computer Entertainment, Inc.