Beruflich Dokumente
Kultur Dokumente
Artificial intelligence is a programmed ability to process information
Approved for Public Release, Distribution Unlimited. 2
Handcrafted Knowledge
Statistical Learning
Contextual Adaptation
Approved for Public Release, Distribution Unlimited. 3
Handcrafted Knowledge
Approved for Public Release, Distribution Unlimited. 4
Enables reasoning over
Perceiving narrowly defined problems
Learning
Abstracting No learning capability
Reasoning and poor handling of
uncertainty
Approved for Public Release, Distribution Unlimited. 5
Engineers create sets of rules
to represent knowledge in
well‐defined domains
The structure of the knowledge is defined by humans
The specifics are explored by the machine
Approved for Public Release, Distribution Unlimited. 6
2004 2005
# completed: 0 # completed: 5
Source: DARPA
DARPA Autonomous Vehicle Grand Challenge
140 miles of dirt tracks in California and Nevada
Approved for Public Release, Distribution Unlimited. 7
Source: thrillist.com
Statistical Learning
Approved for Public Release, Distribution Unlimited. 8
Engineers create statistical models
for specific problem domains and
train them on big data
Source: gobelluno.it
Approved for Public Release, Distribution Unlimited. 9
Nuanced classification and
Perceiving prediction capabilities
Learning
Abstracting
Reasoning No contextual capability and
minimal reasoning ability
Approved for Public Release, Distribution Unlimited. 10
Manifold hypothesis
Natural data forms lower dimensional
structures (manifolds) in the embedding space
Approved for Public Release, Distribution Unlimited. 11
Each manifold Understanding data
represents a comes by separating
different entity the manifolds
Approved for Public Release, Distribution Unlimited. 12
…,253,247,228,118,41,38,34,39,147,198,…
Approved for Public Release, Distribution Unlimited. 13
Variation in handwritten digits
form 10 distinct manifolds within the
28x28 dimensional space of pixel values
Approved for Public Release, Distribution Unlimited. 14
Stretching and
Imagine the spiral
squashing the data
arms are each
space separates
clusters of data
them cleanly
Approved for Public Release, Distribution Unlimited. 15
Stretching in a new dimension
enables enclosed manifolds
to be isolated
Approved for Public Release, Distribution Unlimited. 16
Computed
outputs
Each layer stretches and
Data squashes the data space
inputs until the data manifolds
are cleanly separated
Approved for Public Release, Distribution Unlimited. 17
Computed
outputs
Data
inputs non‐linear cell weights cell inputs
function (learned) (from prev layer)
= POS (SUMPRODUCT( W1:W16, V1:V16))
Approved for Public Release, Distribution Unlimited. 18
Each “feature map” performs a local Fully‐connected layers
analysis over the whole input space perform global analysis
convolutions subsampling
approx. 30,000
0 cells in total for
1
>99.5% accuracy
8
9
input 20 feature maps 12x12 1000
each 24x24 feature maps fully
28x28 convolutions subsampling connected
Machine‐learning “programmers” design the network structure
with experience and by trial and error
Approved for Public Release, Distribution Unlimited. 19
Approved for Public Release, Distribution Unlimited. 20
Vision Language
CNN RNN
A group of people
shopping at an
outdoor market
There are many
vegetables at the
fruit stand
Yann LeCun, Yoshua Bengio, & Geoffrey Hinton (2015). Deep Learning, Nature, Vol. 521, (pp. 436‐444)
A deep convolution neural net A language‐generating recurrent
(CNN) produces a set of outputs neural net (RNN) “translates”
(abstract “words”) the abstract “words” into captions
Approved for Public Release, Distribution Unlimited. 21
Code and network flows Electromagnetic spectrum Autonomous platforms
Approved for Public Release, Distribution Unlimited. 22
Statistically impressive,
but individually unreliable
a young boy is holding
a baseball bat
Approved for Public Release, Distribution Unlimited. 23
< 1% “Gibbon”
“Panda” targeted distortion (99.3% confidence)
+ =
Inherent flaws can be exploited
Approved for Public Release, Distribution Unlimited. 24
Internet trolls cause
the AI bot, Tay,
to act offensively
Skewed training data creates maladaptation
Approved for Public Release, Distribution Unlimited. 25
Contextual adaptation
Systems construct contextual explanatory models
for classes of real world phenomena
Approved for Public Release, Distribution Unlimited. 26
I understand why
I understand why not
I know when you’ll succeed
I know when you’ll fail
Source: SPIN South West
I know when to trust you
I know why you made that
mistake
This is a cat:
• It has fur, whiskers, Decision
Learning and claws.
Process • It has this feature:
Explanation
Explainable Explanation
Training Data Model Interface
Approved for Public Release, Distribution Unlimited. 27
Probable number of strokes: 1 – 4
Each stroke: probable trajectory
Each trajectory: probable shift in
shape and location
Seed model Training data
Generative model
Generates explanations of how a test
character might have been created
Approved for Public Release, Distribution Unlimited. 28
perceive abstract
Perceiving
contextual Learning
model Abstracting
Reasoning
learn reason
Approved for Public Release, Distribution Unlimited. 29
Handcrafted Knowledge
Statistical Learning
Contextual Adaptation
Approved for Public Release, Distribution Unlimited. 30