L1 Overview

Technische Universitt Mnchen
Module IN 2018
Introduction to Augmented Reality

Prof. Gudrun Klinker
Introduction and Overview

SS 2016
Fachgebiet Augmented Reality
Overview
Agenda
1. Introduction
2. Organizational Issues: Exercises
3.
4.
5.
6.
Applications
AR-Related Trends/Enablers
Research Issues
Requirements
Introduction to AR: Introduction and Overview
Overview
1. Introduction
1.1 Motivation
1.2 Definition
1.3 Different Approaches
1.1 Motivation
1. Introduction
2005
Gartners Hype Cycle

Of Emerging Technologies
2005
1.1 Motivation
1. Introduction
Gartners Hype Cycle

General Scheme
1. Introduction
1.1 Motivation
2005
Gartners Hype Cycle

2010
Trend for AR
2011
2012
2013
2014
2015
http://www.gartner.com/newsroom/id/3114217
1. Introduction
1.1 Motivation
Annotated Mountains
(Wikitude 2008++)
http://www.youtube.com/watch?v=8EA8xlicmT8
http://www.youtube.com/watch?v=tpaJBu4BEuA
http://www.youtube.com/watch?v=7vfzkFfIK1U
Hotels Now!
(HRS, Layar 2009++)
www.hotels-now.de
1. Introduction
1.1 Motivation
AR at Kiosks in Lego Stores (metaio GmbH, 2003-2015)
AR in SZ Magazin (metaio)
GmbH)
http://www.youtube.com/watch?v=mUuVvY4c4-A
http://www.youtube.com/watch?v=YKN7G9X9pIU
1.1 Motivation
1. Introduction
Card Games
World of Warcraft
http://www.youtube.com/watch?v=UlH8Kv2fOzQ&feature=related
Bundesliga (Topps, Total Immersion 1998++)

http://www.youtube.com/watch?v=PbUWGKDVgoI
http://www.youtube.com/watch?v=eP4TjzUfOeU
Eye of Judgment (Sony, 2007)
1.1 Motivation
1. Introduction
Qualcomm Contest Winner: Paparazzi
http://www.youtube.com/watch?v=MIGH5WGMnbs
10
1. Introduction
1.1 Motivation
TUM: AR Master Praktikum, Bachelor or Master Theses
http://www.youtube.com/AugmentedRealityTUM
ARace 2010
Beat the Troopers 2011
fARm 2011
Towering Defense 2015
Treasure Hunt 2010
AR Paint 2011
Lord of Elements 2014
Capture the Flag 2015
3DUIs 2010
Dodge Ball 2011
Minions 2014
11
Overview
1. Introduction
1.1 Motivation
1.2 Definition
12
1.2 Definition
1. Introduction
Real + virtual
Interactive in real-time
Registered in 3 Dimensions
[Azuma 98]
[ECRC 93]
Mixed Reality Continuum:

[Milgram and Kishino 94]
13
1.2 Definition
History: First HMD by Ivan Sutherland (1968)
[Sutherland 68]
Ivan Sutherland: A Head-Mounted Three Dimensional Display. Proc. Of the Fall Joint Computer Conference, 1968, 354-356.
Ivan Sutherland: The Ultimate Display. Proc. Of the IFIP Congress, 1965, 505-508.
14
1. Introduction
Technology-Oriented Definition of AR
Provides users with computer information within their real
environment
Three-dimensional
Immersive
Interactive
In real-time
Mobile
15
The Human Perspective
1. Introduction
We are surrounded by information.

Information is real, but we cannot always
memorize all of it and/or notice it with our
limited senses.
Information has many dimensions.
Information can relate to many aspects of an object.
Information has many kinds of reference points.
Different people perceive information differently.
Information is not static we need and want to interact with it.
Computers can help us analyze, explore

and understand information.
16
Multimedia Combination of Reality und

Virtuality
System Architecture
Real-Time
Distributed Systems
Wearable Devices
Wireless
Communication
Virtual World
(Computer network)
Real World
Information
Data security
Sensor data
AR-System
Manipulation
of Real
Objects
Dynamic Modelling
Multi-modal HCI
Dynamic Visualization
Simulation
Tracking
User
Ergonomics
Scene Analysis
Adaptation
17
Overview
1. Introduction
1.1 Motivation
1.2 Definition
18
Head-based
On real surfaces
Hand-based
Multi-touch
1. Introduction
Desktop-based
Hybrid and Tangible

19
1.4 HMDs
Trendsetter: Google Glass

(Photo: CHIP)
Trendsetter: Oculus Rift

(Photo: Drew Prindle, Digital Trends)
AR-Rift
(Photo: Manuel Huber,
Frieder Panktratz)
Google Cardboard
(Photo: SLASH GEAR)
Crowd Funding: Meta 2

(Photo: ROAD TOVR)
HTC VIVE
(Photo: ibtimes.co.uk)
20
1.4 HMDs
MagicLeap
(Photo: www.magicleap.com)
Microsoft HoloLens
(Photo: microsoft.com)
21
1.5 Sensors
Optical
Inertial
Radio-based
Acoustic
Mechanical
Inside-out vs. outside-in

Sensor limitations vs. limits of human sensing
22
1. Introduction
Ubiquitous Information Manipulation
MacWilliams, Sandor, Wagner, Bauer, Klinker, Brgge: Herding Sheep: Live System Development for Distributed Augmented Reality. ISMAR 2003,
Sandor, MacWilliams, Wagner, Bauer and Klinker: SHEEP: The Shared Environment Entertainment Pasture. Demo at ISMAR 2002, Darmstadt.
23
Human-Computer Interaction
1. Introduction
Human transfer function

User goals Percepts
Physical World
User
Input
Device
Output
Device
This class
System
Signals System goals
System transfer function
Virtual World
24
Overview
Agenda
1. Introduction
1.
2.
3.
4.
Applications
Research Issues
Requirements
25
2. Organizational Issues
Mondays 10:15 11:45, HS2

Tuesdays 14:15 15:45, HS2
- Sandro Weber, Manuel Huber
- Start: Tuesday, April 19, 2016
Demo Day:
Last week of the semester
Exam:
Written, 90 minutes, end of the semester
- Questions in English, answers in German or English
- 50% of exam questions based on exercises
- 0.3 Bonus for good project presentations
- Repeat exam only if necessary
Credits:
6 ECTS
Office hours:
By appointment (via email)
Further information: http://campar.in.tum.de/Chair/TeachingSs16AugmentedReality
Moodle: https://www.moodle.tum.de/course/view.php?id=25940
Lecture:
Central Exercise:
26
More than 260 Participants:
Informatik (Bachelor, Master)
Informatik: Games Engineering (Bachelor, Master)
Computational Science and Engineering (Master)
Wirtschaftsinformatik
ESPACE
Industrial Design
Robotics, Cognition, Intelligence (Master)
Biomedical Computing (Master)
Techn. U. Management BWL
Maschinenwesen; Ergonomie: Human Factors Engineering (Master)
Elektrotechnik und Informationstechnik
Mathematik
27
Content of this Course
Coordinate systems
Basic computer vision
Camera calibration
PTAM
Trackers
Kalman filters
Sensor fusion
OpenGL
Displays
Display calibration
AR-based user interfaces
28
Overview
Agenda
1. Introduction
3.
4.
5.
6.
Applications
Research Issues
Requirements
29
Mechanical Engineering
3. Applications
Wire Bundle Assembly:

Paul Caudell and David Mizell, late 80ies
30
3. Applications
Assembly and Maintenance
[IGD 97]
[ECRC 94]
31
Mechanical Engineering: Logistics
3. Applications
32
3. Applications
Intelligent welding gun
[BMW, TUM, ART, viception, Tucker, peyclon 2009]

33
3. Applications
Car maintenance on tablets
[Volkswagen, metaio 2013]

34
Building Construction, Maintenance
3. Applications
[IGD 97]
[IGD 97]
35
Architecture, Interior Design
3. Applications
Project Acquisition
[IGD 97]
[IGD 97]
36
Marketing: 3D Projections
3. Applications
[Extend3D 2013]
37
3. Applications
Education
http://ivanpoupyrev.com/e-library/2001/chi2001demo.pdf
Magic Book
Magic Book Projekt, Billinghurst et al 2001, HitLab Washington, US, and New Zealand, http://www.hitlabnz.org/
38
Education
3. Applications
Augmented Chemical Reactions

Example: Design of catalysts for
metal-organic reactions
Problem:
Generally, more than two hands are required
to control the chemical process
Selection of a binding
Committing the action
Maier, Tnnis, Klinker, Raith, Drees, Khn: What Do you Introduction

Do When Two Hands
Are notIntroduction
Enough? Interactive
Selection
of Bonds Between Pairs of Tangible Molecules
to AR:
and
Overview
International Symposium On 3D User Interfaces (3DUI), Waltham, MA, March 2010.
39
3. Applications
Education
Illuminating Light, Tic Tac Toe
http://tangible.media.mit.edu/project/73
[MIT Media Lab 98]
[IGD 97]
40
3. Applications
Games
http://www.youtube.com/watch?v=yNYfkxqiB6g
http://wearables.unisa.edu.au/projects/arquake/
Air Hockey, AR-Quake
[MR-Lab 99]
[UniSA 00]
41
3. Applications
Tourism
http://graphics.cs.columbia.edu/projects/mars/touring.html
MARS and Situated Documentaries projects: S. Feiner, T. Hllerer et al, Columbia University, NY, 1999
http://www1.cs.columbia.edu/graphics/projects/mars/
42
3. Applications
Tourism
http://www.youtube.com/watch?v=DY26p9paxSY
http://www.youtube.com/watch?v=oDiFTIW5e5w
Pompeii
Mira project (EU): Thalman et al, 2004

43
HCI in Cars
2. Applications
TUMMIC project, M. Tnnis, G. Klinker, C. Lange, H. Bubb et al, TU Mnchen, http://ar.in.tum.de/Chair/ResearchAr

44
Virtual Studios
3. Applications
BBC Origami Projekt (EU), 2003, http://www.bbc.co.uk/rd/projects/virtual/origami/indes.shtml

45
3. Applications
Medicine
J. Traub, N. Navab, TU Mnchen, http://campar.in.tum.de/Chair/ResearchIssueMedAR

46
Overview
Agenda
1. Introduction
3.
4.
5.
6.
Applications
Research Issues
Requirements
47
4. AR-Related Trends/Enablers
Wireless Networks
Wearable/mobile Devices
Multi-media (sound & speech, video)
Virtual Reality (3D)
Tracking Systems (GPS, Kinect, leap motion, )
Tele-presence, Tele-manipulation
Tele-collaboration
Games
48
5. Research Issues
Sensor Analysis
Information Presentation
multi-modal interaction
Efficient Algorithms
distributed systems
Wearable Devices (Hardware), Human Factors

HCI
multi-media data; storage, access, data security, visualization
Mobile Communication
user tracking, scene modeling
real-time
Software Engineering
extendable, scalable, efficient system
49
6. Requirements
Efficiency
Flexibility
Quality of Service in Networks
Load Balancing
Adaptive System Behavior
System Security (Datenschutz)
User Safety, Acceptance
50
Multimedia Combination of Reality und

Virtuality
System Architecture
Real-Time
Distributed Systems
Wearable Devices
Wireless
Communication
Virtual World
(Computer network)
Real World
Information
Data security
Sensor data
AR-System
Manipulation
of Real
Objects
Dynamic Modelling
Multi-modal HCI
Dynamic Visualization
Simulation
Tracking
User
Ergonomics
Scene Analysis
Adaptation
51
Thank you!
More Applications
Architecture, Interior Design
2. Applications
Model Design
[IGD 97]
54
Marketing: AR in Kiosks
[Lego, metaio 2013]
Installed in all LEGO brand stores worldwide

Let consumers view the virtually constructed and fully animated LEGO
product by holding the package up to the DIGITAL BOX
Higher brand experience and sales per customer
55
2. Applications
Games
Simulated, Strategic Games (Collaborations)
SHEEP project: M. Bauer, A. MacWilliams, G. Klinker C. Sandor, M. Wagner, et al, TU Mnchen

http://ar.in.tum.de/Chair/ResearchAr
56
2. Applications
Games
Munich Hunt
Location Based Games project: M. Kellerer, B. Schwerdtfeger, G. Klinker, et al, TU Mnchen

http://campar.in.tum.de/Students/SepMunichHunt
57
HCI in Cars
2. Applications
Sensor Visualization
SensorVis project, M. Tnnis,, TU Mnchen, R. Lindl, L. Walchshusl, BMW AG, http://ar.in.tum.de/Chair/ResearchAr

58
HCI in Cars
2. Applications
CAR Simulation Environment
Parent Simulation Environment
59
2. Applications
Medicine
Bone Surgery
[CMU 94]
60
2. Applications
Medicine
Virtual Patient (Preparing for Catastrophic Events)
Nestler, Dollinger, Echtler and Klinker: Design and Development of Virtual Patients,, Gi AR/VR Workshop, Weimar, July. 2007.
61
2. Applications
Medicine
Triaging in Catastrophic Events
Nestler and Klinker: Using Mobile Handheld Computers in Disasters, UbiWell (workshop at UbiComp) Innsbruck, Sept. 2007.
62

L1 Overview

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

L1 Overview

Hochgeladen von

Copyright:

Verfügbare Formate

Technische Universitt Mnchen

Introduction to Augmented Reality

Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Gartners Hype Cycle

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Gartners Hype Cycle

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Gartners Hype Cycle

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Bundesliga (Topps, Total Immersion 1998++)

Eye of Judgment (Sony, 2007)

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Qualcomm Contest Winner: Paparazzi

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Beat the Troopers 2011

Treasure Hunt 2010

Capture the Flag 2015

Dodge Ball 2011

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Mixed Reality Continuum:

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality

Technische Universitt Mnchen

The Human Perspective

We are surrounded by information.

Computers can help us analyze, explore

Introduction to AR: Introduction and Overview

Fachgebiet Augmented Reality