Beruflich Dokumente
Kultur Dokumente
email: mvaloriani@gmail.com
twitter: @MatteoValoriani
linkedin: https://it.linkedin.com/in/matteovaloriani
2
Usage Scenarios
RETAIL THERAPY HEALTHCARE EDUCATION TRAINING
You have to be a
magician…
… or at least a
good illusionist
“Any sufficiently
advanced
technology is
indistinguishable
from magic”
(Arthur C. Clarke)
Sensor Anatomy
Kinect 2 - Specs
Hardware:
Depth resolution:
512×424
RGB CAMERA
RGB resolution:
1920×1080 (16:9)
3D DEPTH SENSOR
FrameRate:
60 FPS
Latency:
60 ms
MULTI-ARRAY MIC
Kinect Adapter
Kinect 2 vs Kinect 1
Version 1 Version 2
Depth range 0.4m → 4.0m 0.4m → 4.5m
Color stream 640×480 1920×1080
Depth stream 320×240 512×424
Infrared stream None 512×424
Type of Light Light coding ToF
Audio stream 4-mic array 16 kHz 4-mic array 48 kHz
USB 2.0 3.0
# Bodies Traked 2 (+4) 6
# Joints 20 25
Hand Traking External tools Yes
Face Traking Yes Yes+Expressions
FOV 57° H 43° V 70° H 60° V
Tilt Motorized Manual
System / Software Requirements
OS Windows 8, 8.1, Embedded 8, Embedded 8.1 (x64)
Kinect Kinect
Driver Driver
Kinect
Service
PC PC
PC PC PC
Hub
Server
DEMO
Display frame in a Windows Store App
Data Source Details
Physical image sensors, ColorFrameSource,
InfraredFrameSource, DepthFrameSource,
BodyIndexFrameSource, BodyFrameSource, AudioFrameSource
Kinect Data Sources
ColorFrameSource
Audio Depth
32 KB/s 13 MB/s
Legend
Record/Play
Record Only
Color
BodyFrame
120 MB/s
BodyIndex
DEMO
Kinect Studio 2.0
Recording | Playback
Gesture Recognition
Your Application
DEMO
Machine Learning Demo
Gesture Recognition
Press
Engagement Targeting
Panning/Zoom
DEMO
Controls Basics – XAML
UserViewer | Engagement | Targeting | Press
Demo
Building ControlsBasics-XAML from Scratch
Grid
Window
Kinect
KinectRegion
UserViewer
Frame
Frame
Page
Page
“Engagement” for hand cursor
System Engagement Manual Engagement
• Hands over head
• In certain location of room
• Etc…
KinectRegion.SetOnePersonSystemEngagement() KinectRegion.SetOnePersonManualEngagement(…)
KinectRegion.SetTwoPersonSystemEngagement() KinectRegion.SetTwoPersonManualEngagement(…)
DEMO
PHiZ (Physical Interaction Zone) & KinectPointerPoint
PHIZ – Physical Interaction Zone
X / Y - For Cursor Rendering
KinectPointerPoint->Position->X
– Between 0.0 and 1.0
KinectPointerPoint->Position->Y
– Between 0.0 and 1.0
Z
KinectPointerPoint->Properties->HandReachExtent (raw)
KinectPointerPoint->Properties->PressExtent (affected by user/UI)
@MatteoValoriani
©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the
U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft
must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after
the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.