A taxonomy of mixed reality visual display
-
- MILGRAM P.
- Department of Industrial Engineering, University of Toronto
-
- Kishino Fumio
- ATR Communication Systems Research Laboratories
Search this Article
Author(s)
-
- MILGRAM P.
- Department of Industrial Engineering, University of Toronto
-
- Kishino Fumio
- ATR Communication Systems Research Laboratories
Abstract
This paper focuses on Mixed Reality (MR)visual displays, a particular subset of Virtual Reality (VR)related technologies that involve the merging of real and virtual worlds somewhere along the "virtuality continuum" which connects completely real environments to completely virtual ones. Probably the best known of these is Augmented Reality (AR), which refers to all cases in which the display of an otherwise real environment is augmented by means of virtual (computer graphic) objects. The converse case on the virtuality continuum is therefore Augmented Virtuality (AV). Six classes of hybrid MR display environments are identified. However, an attempt to distinguish these classes on the basis of whether they are primarily video or computer graphics based, whether the real world is viewed directly or via some electronic display medium, whether the viewer is intended to feel part of the world or on the outside looking in, and whether or not the scale of the display is intended to map orthoscopically onto the real world leads to quite different groupings among the six identified classes, thereby demonstrating the need for an efficient taxonomy, or classification framework, according to which essential differences can be identified. The 'obvious' distinction between the terms "real" and "virtual" is shown to have a number of different aspects, depending on whether one is dealing with real or virtual objects, real or virtual images, and direct or non-direct viewing of these. An (approximately) three dimensional taxonomy is proposed, comprising the following dimensions : Extent of World Knowledge ("how much do we know about the world being displayed?"), Reproduction Fidelity ("how 'realistically' are we able to display it?"), and Extent of Presence Metaphor ("what is the extent of the illusion that the observer is present within that world?").
Journal
-
- IEICE Trans. Inf. & Sys., D
-
IEICE Trans. Inf. & Sys., D E77(12), 1321-1329, 1994
The Institute of Electronics, Information and Communication Engineers
Cited by: 45
-
1
- A Synchronized Reality System [in Japanese]
-
ASANO Takeo , FUJII Masakazu , ISHII Satoshi , AKATSUKA Yuichiro
Proceedings of the Virtual Reality Society of Japan,annual conference 7, 423-426, 2002-09-18
References (5)
-
2
- Mixed Reality as Networked Media Technology [in Japanese]
-
Yokoya Naokazu
Technical report of IEICE. PRMU 105(533), 51-58, 2006-01-12
References (15)
-
3
- Mixed Reality-based Skill Transfer and Human Resource Development [in Japanese]
-
WATANUKI Keiichi
Journal of Japan Society for Design Engineering 44(2), 77-92, 2009-02-05
References (21) Cited by (3)
-
4
- Past, Present, and the Future of the Physical and Tangible Interaction Environments [in Japanese]
-
井上 智雄
Human interface 12(2), 101-104, 2010-05-25
References (16)
-
5
- Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery
-
SUGIMOTO Maki , YASUDA Hideki , KODA Keiji , SUZUKI Masato , YAMAZAKI Masato , TEZUKA Tohru , KOSUGI Chihiro , HIGUCHI Ryota , WATAYO Yoshihisa , YAGAWA Yohsuke , UEMURA Shuichiro , TSUCHIYA Hironori , AZUMA Takeshi
J Hepatobiliary Pancreat Sci 17(5), 629-636, 2010-09-01
Ichushi Web References (30) Cited by (4)
-
6
- Puppet Eyes : Eye-through HMD(Head Mounted Display) and an Apprication to Face-to-face Communications [in Japanese]
-
MIYASATO Tsutomu
IEICE technical report. Information networks 98(8), 1-8, 1998-04-22
References (28)
-
7
- Puppet Eyes : Eye-through HMD(Head Mounted Display) and an Apprication to Face-to-face Communications [in Japanese]
-
MIYASATO Tsutomu
IEICE technical report. Communication systems 98(10), 1-8, 1998-04-22
References (28)
-
8
- Adapting Color Properties for Augmented Virtuality : Application for Real Time Facial Expression Generation [in Japanese]
-
ONO Kazuyoshi , ISHIZAWA Akira , ADACHI Hiroaki , TANAKA Hiromi T.
Technical report of IEICE. Multimedia and virtual environment 96(605), 53-60, 1997-03-19
References (12)
-
9
- Puppet Eyes : Eye-through HMD(Head Mounted Display) and an Apprication to Face-to-face Communications [in Japanese]
-
MIYASATO Tsutomu
Technical report of IEICE. Multimedia and virtual environment 98(12), 1-8, 1998-04-22
References (28) Cited by (1)
-
10
- A Study for Constructing an Augmented Virtuality Environment Directed to Interaction with Video [in Japanese]
-
MASAKI Toshihiro , YAMAGUCHI Tetsuya , FURUHASHI Hidetoshi , YAMAUCHI Toyoki , KITAMURA Yoshifumi , KISHINO Fumio
Technical report of IEICE. Multimedia and virtual environment 98(616), 85-92, 1999-02-22
References (14) Cited by (3)
-
11
- A study of 3D modeling for the interaction with video contents in augmented virtuality [in Japanese]
-
MASAKI Toshihiro , YAMAGUCHI Tetsuya , KITAMURA Yoshifumi , KISHINO Fumio
Technical report of IEICE. Multimedia and virtual environment 99(102), 105-110, 1999-06-07
References (18) Cited by (1)
-
12
- A Study for Real-time Morphing in Virtual Environment [in Japanese]
-
FURUHASHI Hidetoshi , MASAKI Toshihiro , KITAMURA Yoshifumi , KISHINO Fumio
Technical report of IEICE. Multimedia and virtual environment 99(647), 25-30, 2000-02-21
References (16)
-
13
- 3-D annotation to images captured from a wearer's camera based on object recognition [in Japanese]
-
OKUMA Takashi , KURATA Takeshi , SAKAUE Katsuhiko
Technical report of IEICE. PRMU 100(565), 53-60, 2001-01-11
References (23) Cited by (3)
-
14
- Real-time Morphing of Moving Image for Creating Interactive Video Contents [in Japanese]
-
YAMAMOTO Atsuyuki , MASAKI Toshihiro , KITAMURA Yoshifumi , KISHINO Fumio
Technical report of IEICE. PRMU 101(203), 59-66, 2001-07-12
References (15)
-
15
- Real-time Morphing of Moving Image for Creating Interactive Video Contents [in Japanese]
-
YAMAMOTO Atsuyuki , MASAKI Toshihiro , KITAMURA Yoshifumi , KISHINO Fumio
IEICE technical report. Image engineering 101(201), 59-66, 2001-07-12
References (15)
-
16
- Real-time Morphing of Moving Image for Creating Interactive Video Contents [in Japanese]
-
YAMAMOTO Atsuyuki , MASAKI Toshihiro , KITAMURA Yoshifumi , KISHINO Fumio
Technical report of IEICE. Multimedia and virtual environment 101(205), 59-66, 2001-07-12
References (15)
-
17
- Emphasizing 3D Structure Visually using Coded Projection from Multiple Projectors [in Japanese]
-
NAKAMURA RYO , SAKAUE FUMIHIKO , SATO JUN
情報処理学会研究報告. CVIM, [コンピュータビジョンとイメージメディア] 172, W1-W8, 2010-05-27
References (7)
-
18
- Development of a PDDM : Palmtop Display for Dextrous Manipulation [in Japanese]
-
NOMA Haruo , MIYASATO Tsutomu , NAKATSU Ryouhei
The Transactions of the Institute of Electronics,Information and Communication Engineers. 00081(00005), 906-917, 1998-05
References (19) Cited by (3)
-
19
- Real-time Merging of Real and Virtual Spaces by Dividing Object Space into Multi Layers Using Stereoscopic Chromakey-Imposer System [in Japanese]
-
Minoura Hirohito , Kijima Ryugo , Ojika Takeo
Transactions of the Virtual Reality Society of Japan 4(2), 439-444, 1999
J-STAGE References (13)
-
20
- What is AR?(Questions and Answers) [in Japanese]
-
ITO Minoru
SYSTEMS, CONTROL AND INFORMATION 56(2), 96-97, 2012
J-STAGE References (7)
-
21
- Study on Real Imaging Optical Systems for Multi-layered Floating Images in Mixed Reality Exhibition System MRsionCase [in Japanese]
-
KIM Hanyuool , MAEKAWA Satoshi , NAEMURA Takeshi
IEICE technical report. Image engineering 111(478), 151-156, 2012-03-05
References (6)
-
22
- Mixed Reality : Augmentation and Virtualization of Real World [in Japanese]
-
YAMAMOTO Hiroyuki
Journal of the Society of Mechanical Engineers 102(971), 597-599, 1999
J-STAGE References (4)
-
23
- A Study for Constructing an Augmented Viutuality Environment Directed to Interaction With Video [in Japanese]
-
Masaki Toshihiro , Yamaguchi Tetsuya , Furuhashi Hidetoshi , Yamauchi Toyoki , Kitamura Yoshifumi , Kishino Fumio
ITE Technical Report 23.14(0), 85-92, 1999
J-STAGE References (14)
-
24
- A study of 3D modeling for the interaction with video contents in augmented virtuality [in Japanese]
-
Masaki Toshihiro , Yamaguchi Tetsuya , Kitamura Yoshifumi , Kishino Fumio
ITE Technical Report 23.36(0), 105-110, 1999
J-STAGE References (18)
-
25
- TELEMEETING AT THE VIRTUAL STUDIO
-
Ko Heedong , Kim Laehyun , Park Moonho , Byun Heyran
ITE Technical Report 24.1(0), 59-64, 2000
J-STAGE References (9)
-
26
- A Study for Real-time Morphing in Virtual Environment [in Japanese]
-
Furuhashi Hidetoshi , Masaki Toshihiro , Kitamura Yoshifumi , Kishino Fumio
ITE Technical Report 24.15(0), 25-30, 2000
J-STAGE References (16)
-
27
- Mixed Reality [in Japanese]
-
HIROSE Michitaka , HIROTA Koichi
Journal of The Society of Instrument and Control Engineers 41(9), 620-623, 2002-09-10
J-STAGE References (5) Cited by (1)
-
28
- Projection-Based Assistance for Ultrasonic Diagnosis
-
YASUMURO Yoshihiro , PRAYITONO Agus , KOHYAMA Kazuhiro , IMURA Masataka , MANABE Yoshitsugu , OSHIRO Osamu , CHIHARA Kunihiro
IEEJ Transactions on Sensors and Micromachines 125(4), 176-181, 2005-04-01
J-STAGE References (15)
-
29
- "Mixed reality society" : augmented reality and social camouflage [in Japanese]
-
富田 英典
情報通信学会誌 24(1), 1-7, 2006-05-25
IR References (40)
-
30
- Application of augmented reality with a monocular see-through head-mounted display for VDT work : A study through an experiment simulating the radar monitoring task in air traffic control [in Japanese]
-
NAKANISHI Miwa , OKADA Yusaku
The Japanese journal of ergonomics 41(4), 218-227, 2005-08-15
Ichushi Web References (29) Cited by (2)
-
31
- A Study on Role Support by Monocular See-Through HMD in Cooperative VDT Work : through an Experiment Simulating the Radar Monitoring Task in Air Traffic Control [in Japanese]
-
NAKANISHI Miwa , OKADA Yusaku
ヒューマンインタフェース学会論文誌 8(3), 471-480, 2006-08-25
References (31)
-
32
- Virtual Reality Technology for Data Visualization : Virtual Reality Technical Map [in Japanese]
-
OGI Tetsuro
Journal of the Visualization Society of Japan 27(106), 2-7, 2007-07-01
References (23)
-
33
- A study of 3D modeling for the interaction with video contents in augmented virtuality [in Japanese]
-
MASAKI Toshihiro , YAMAGUCHI Tetsuya , KITAMURA Yoshifumi , KISHINO Fumio
ヒューマンインタフェース学会研究報告集 : human interface 1(2), 105-110, 1999-06-07
References (18)
-
34
- A Study for Real-time Morphing in Virtual Environment [in Japanese]
-
FURUHASHI Hidetoshi , MASAKI Toshihiro , KITAMURA Yoshifumi , KISHINO Fumio
Human Interface 2(1), 25-30, 2000-02-21
References (16)
-
35
- Adapting Color Properties for Augmented Virtuality - Application for Real Time Eye Expression Generation - [in Japanese]
-
ONO Kazuyoshi , ISHIZAWA Akira , TANAKA Hiromi T.
The Transactions of the Institute of Electronics,Information and Communication Engineers. 00080(00002), 497-504, 1997-02-25
References (17) Cited by (6)
-
36
- Real-Time Spatial Data Management for Scalable Networked Augmented Virtual Spaces
-
ARIKAWA Masatoshi , SHIMOJO Shinji , AMANO Akira , MAEDA Kaori , AIBARA Reiji , NISHIMURA Kouji , HIRAKI Kaduo , FUJIKAWA Kazutoshi
IEICE Transactions on Information and Systems 82(1), 99-112, 1999-01-25
References (19) Cited by (1)
-
37
- A Location Registration Method for Augmented Reality Using Computer Display and Camera [in Japanese]
-
KISHINO YASUE , TSUKAMOTO MASAHIKO , SAKANE YUTAKA , NISHIO SHOJIRO
Transactions of Information Processing Society of Japan 44(12), 3188-3196, 2003-12-15
IPSJ References (15) Cited by (1)
-
38
- Mixed Reality : Merging Real and Virtual Worlds : I Introduction [in Japanese]
-
YOKOYA Naokazu
SYSTEMS, CONTROL AND INFORMATION 49(12), 489-494, 2005
-
39
- Mixed Reality as Networked Media Technology [in Japanese]
-
YOKOYA Naokazu
IPSJ SIG Notes. CVIM 152, 53-60, 2006-01-19
References (15) Cited by (2)
-
40
- Mixed Reality as Networked Media Technology [in Japanese]
-
YOKOYA Naokazu
IEICE technical report 105(535), 51-58, 2006-01-12
References (15)
-
41
- Interaction in Mixed Reality Environment by MR RobotPHONE [in Japanese]
-
Shimizu Noriyoshi , Nakamura Toshinari , Sekiguchi Dairoku , Sugimoto Maki , Nii Hideaki , Inami Masahiko
Transactions of the Virtual Reality Society of Japan 11(2), 253-264, 2006
J-STAGE References (23)
-
42
- Lunar Surface Navigation System Using Augmented Reality : Exhibition at National Museum of Nature and Science and the Evaluation [in Japanese]
-
ASAI Kikuo , KONDO Tomotsugu , KOBAYASHI Hideaki , MIZUKI Akira , ARITA Hiroyuki
IEICE technical report 107(391), 63-68, 2007-12-08
References (18) Cited by (9)
-
43
- Virtualizing Outdoor Dynamic Real Environments Using Omnidirectional Video Cameras [in Japanese]
-
YOKOYA Naokazu
IPSJ SIG Notes. CVIM 119, 109-116, 1999-11-17
References (21) Cited by (10)
-
44
- Construction of a Mixed Environment Using Panoramic Stereo Images and Computer Graphics Models [in Japanese]
-
SHIMAMURA JUN , YAMAZAWA KAZUMASA , TAKEMURA HARUO , YOKOYA NAOKAZU
情報処理学会論文誌コンピュータビジョンとイメージメディア(CVIM) 42(SIG06(CVIM2)), 44-53, 2001-06-15
IPSJ References (18) Cited by (5)
-
45
- Multiple View Geometry for Projector Camera Systems and Its Applications [in Japanese]
-
SATO JUN
情報処理学会論文誌コンピュータビジョンとイメージメディア(CVIM) 49(SIG6(CVIM20)), 56-67, 2008-03-15
IPSJ References (15)