6. Augmented Reality

AR-based mountain navigation (AR山ナビ)

https://aryamanavi.com/yama/ https://gyazo.com/b529b6bc178089f9c051e1d1bede55ff

Pokémon GO

https://gyazo.com/930c4b003a89a1f806a29771c53597d2.png

https://www.youtube.com/watch?v=iQWbc5giC-Y

Kamakura AR

The person on the poster starts talking

https://gyazo.com/e76bb416b6da3d416f095f73bb512ea7

Augmented Reality

c.f. Virtual Reality

AR in a narrow sense

Add CG image to real image

CV, CG research

http://gyazo.com/773ae2462931560d4e3b4e93f0c672c5.png

Required Techniques

Add CG image to real image

CG generation

Recognition of real world objects, position recognition

Minimizing latency

3D object recognition

AR in broader sense

Real-world interface

Ubiquitous computing

Integrate real-world info and computer info

With display or without display

Examples of AR in broader sense

Barcode, QR-code,

RFID (e.g. Suica)

Wathing a game with a radio

Car navigation systems

Trend of "Augmented Reality"

https://gyazo.com/84636aa6980f21a4cfba4f4fa7111ece

20-year Trends

Programmers used "AR toolkit"

Got popular by "Den-no Coil" film

Pokémon GO

Revival by HoloLens from MS, MagicLeap from Google

ARKit on iPhone available

How to add CG to real image

HMD(Head Mount Display)

Optical method

Video method

Monitor method

Projector method

Optical method

https://gyazo.com/b01f8f8c7ddb9d9426f34eda788c6832

Video method

https://gyazo.com/f55f7c4f49121ad78b133406b6f85b43

Monitor method

https://gyazo.com/a298cb4d776098abbf76398e5a2cfa0e

Wireing of airplane

https://s3-ap-northeast-1.amazonaws.com/masui.org/3/9/39c05a4ae66f45092a1dd525215ef391.gif

For surgery

https://s3-ap-northeast-1.amazonaws.com/masui.org/1/5/157c254708adac895edb24c8462a8108.gif

https://s3-ap-northeast-1.amazonaws.com/masui.org/9/1/9140463c8b5c1ec4a9e27adb0f0194e5.gif

Olympus system

Endoscope image + tumor, nerve system, etc.

https://gyazo.com/49fb5af7e70a9f81bb543a058f9ac7c7.png

Karma

Printer maintainance system

https://s3-ap-northeast-1.amazonaws.com/masui.org/0/d/0dfe66559ab4ea24246494f11a51adc0.gif

https://s3-ap-northeast-1.amazonaws.com/masui.org/7/8/786c3fa5edca5d3eb41016f2ebfdb05a.gif

NaviCam

Adding computer-generated info to real image

Barcode recognition

https://s3-ap-northeast-1.amazonaws.com/masui.org/5/6/564d19d00095edc9cfaada7154c09189.gif

https://s3-ap-northeast-1.amazonaws.com/masui.org/7/0/70ba9d18856c75a54dedf9e92470306d.gif

Video: NaviCam

http://www.youtube.com/watch?v=S6XKPEexRbU

NaviCam with 2D barcode

https://www.youtube.com/watch?v=cNFwEMkLK4A

Den-no Coil (animation movie)

People got interested in AR

https://gyazo.com/cdbde78694cbedaa95b2a21469c128d0.png]

Video: Den-no Coil

https://gyazo.com/3e131b3ca0d8f4ee9bb0ec30a6b88b97

Prof. Hirokazu Kato, Mark Billinghurst

1999〜

Sunao Hashimoto at Meiji University

http://hondana.org/%E5%A2%97%E4%BA%95/4048673610 https://gyazo.com/8565dd98143823ef91b3032ed02b38fa.png

AR Toolkit

Use a shape in black frame

https://gyazo.com/a4acc4273131921070560aa1ec837987.png

https://gyazo.com/1710f89d0d46dddfbadd43c9fe771335.png

Computer figure ARis

Entertainment using AR

https://gyazo.com/788ed6a2f3313d09ab84acb2894c5b3e.png

Video: ARis

https://www.youtube.com/watch?v=yCCx7zANsGE

by George Klein

https://gyazo.com/3120a2d5f1e29e4093beb90cedadd0d7.png

Video: PTAM

http://www.youtube.com/watch?v=Y9HMn6bd-v8

Walking Hatsune-miku

Prof. Inami

Keio KMD => University of Tokyo (2015/11/1)

Doing research on various AR technologies

https://gyazo.com/998a98607efb92a30a28fbea2a68d5c9.png

Prof. Inami

https://gyazo.com/f4274d9beb4f639c8543542907315abf.png

Video: Bakumon-Gakumon

https://s3-ap-northeast-1.amazonaws.com/masui.org/b/5/b59fa554a6d8d6452a64a9519a6d07f5.mp4

Google Glass

https://gyazo.com/72bc27b1ab8a51cc308edb241a8c2d58.png

Video: Google Glass

http://www.youtube.com/watch?v=9c6W4CCU9M4

Google Glass

Deveopment stopped

AR for interface systems

DigitalDesk

MetaDesk

PingPongPlus

LuminousRoom

DigitalDesk

Projector + Desk

Recognition of fingers and papers

https://s3-ap-northeast-1.amazonaws.com/masui.org/4/0/40b96c944513f8d03e6b26d7ed8b2877.gif

MetaDesk

Projector-based desk + 'phicons'

https://gyazo.com/3e1d1317a050381e784d8b87be83b1b5.png

PingPongPlus

Projection on ping-pong table

Use microphones for position recognition

https://www.youtube.com/watch?v=AZO8sfmpKIQ

Projector + camera

Simulation of light and lens

InFORM

https://www.youtube.com/watch?v=lvtfD_rJ2hE

Video: TRANSFORM

https://www.youtube.com/watch?v=lCARHatJQJA

Pattie Maes

https://gyazo.com/ca690c2e0f39352c0f26457bed4decba.png]

Video: Sixth Sense

https://www.youtube.com/watch?v=YrtANPtnhyg

ARKit

https://www.youtube.com/watch?v=khavGQ7Dy3c

ARKit

https://www.youtube.com/watch?v=GBds_Y9buxY

ARKit3

https://www.youtube.com/watch?v=vkS-VqAss4s

ARKit6

https://www.youtube.com/watch?v=9qoM-DxWXq8

AR by Microsoft

"Windows Holographic" technology

https://gyazo.com/050f36bcdd9bf8956bf40b038f67a1a4

https://www.youtube.com/watch?v=KK42C6OqJvQ

Video: HoloLens

https://www.youtube.com/watch?v=IgtHnCJJUMU

Video: HoloLens

https://www.youtube.com/watch?v=aYdB2xBNFek

Video: HoloLens 2

https://www.youtube.com/watch?v=eqFqtAJMtYE

Soccer On Your Tabletop (HoloLens)

https://www.youtube.com/watch?v=eRGAB4QBS6U

Very light HMD

Supported by Google

Concept Video

https://www.youtube.com/watch?v=kPMHcanq0xM

Magic Leap

https://www.youtube.com/watch?v=Vrq2akzdFq8

https://www.youtube.com/watch?v=q_8g0H4IksU

Video: Magic Leap

https://www.youtube.com/watch?v=kw0-JRa9n94

Video: Magic Leap

https://www.youtube.com/watch?v=kPMHcanq0xM

Oculus Quest (VR)

Inexpensive HMD (〜50000 yen)

https://www.youtube.com/watch?v=Di7dIhUFsbw

Oculus Quest

https://gyazo.com/3f10e55cb87bfc2580b78851eb4c3711

Oculus Quest 2

https://www.youtube.com/watch?v=21VgJDZGPFo

Oculus Quest 2

https://www.youtube.com/watch?v=21VgJDZGPFo

Meta Quest Pro

https://www.youtube.com/watch?v=7UvfmvMU3Vc

https://www.youtube.com/watch?v=FW2cykViDa8

Wikitude

Android

GPS+コンパス

https://gyazo.com/872379f6a5bc710afb7553de2fca0f6d.png

Video: Wikitude

https://www.youtube.com/watch?v=8EA8xlicmT8

金町氏

https://gyazo.com/6493f9a229bf95b4e4d87473ffdf50e7.png

Video: SREngine

https://gyazo.com/6a1baeb130598dc22b3c90313ff1e45d.png

Video: TwittARound

https://www.youtube.com/watch?v=_Vbh7nHalCc

NY地下鉄案内

https://gyazo.com/ba57bf7b06da264c2a111fb54fe6eac7.png

Video: NY地下鉄案内

https://www.youtube.com/watch?v=ps49T0iJwVg

https://gyazo.com/4a730c80d833341dc3475d2b23d812fc.png

ビデオ: 星座表

https://www.youtube.com/watch?v=-mVl5Xd2DAw

https://gyazo.com/27b08ab05c3488f62c43defc365ab150.png

AR magic by Marco Tempest

https://www.youtube.com/watch?v=Mk1xjbA-ISE

Video: AR Magic

https://www.youtube.com/watch?v=ZX8MBBohX3s

KAGE (by Chikamori-san)

https://gyazo.com/1738a0621424d74f36cfb262c8d1500e.png

Video: Kage

https://www.youtube.com/watch?v=7JNk_lXjxQY

Kobito

https://gyazo.com/e13275e04979dfd97b7f9467f6ad85f9.png

Video: Kobito

https://s3-ap-northeast-1.amazonaws.com/masui.org/4/5/454bc755f2534bd46670eac43765759f.mp4

Summary

Everyone can enjoy AR now

Various new applications

AR visualization will become more popular

End