Beruflich Dokumente
Kultur Dokumente
Deep Learnint o
g
M
1-SA ST
2- JU IE
L
3-LA S
4-NA
VISUAL 1
Types of Learning
Supervised: Learning with a labeled training set
Example: email classification with already labeled emails
class A
class A
Anomaly Detecton
Sequence labeling
http://mbjoseph.github.io/2013/11/27/measure.html
…
ARTIFICIAL INTELLIGENCE
The INTELLIGENCE exhibited by machines or software, and the branch of computer
science that develops machines and software with INTELLIGENCE.
MACHINE LEARNING
A branch of artificial intelligence, concerns the construction and study of systems that can
LEARN from data
SOURCE WIKIPEDIA
Machine Learning Basics
Machine learning is a field of computer science that gives computers the ability to
learn without being explicitly programmed
Machine Learning
Labeled Data algorithm
Training
Prediction
https://www.xenonstack.com/blog/static/public/uploads/media/machine-learning-vs-deep-learning.png
Why is DL useful?
o Manually designed features are often over-specified, incomplete and take a long time
to design and validate
o Learned Features are easy to adapt, fast to learn
o Deep learning provides a very flexible, (almost?) universal, learnable framework for
representng world, visual and linguistc informaton.
o Can learn both unsupervised and supervised
o Effectve end-to-end joint system learning
o Utlize large amounts of training data
Actvaton functons
How do we train?
Demo
Hype or Reality?
Quotes
I have worked all my life in Machine Learning, and I’ve never seen one
algorithm knock over benchmarks like Deep Learning
– Andrew Ng (Stanford & Baidu)
Input: Output:
Artificial
Sensors Movement
Data
Intelligence Text
Machine Learning - Basics
Introduction
Machine Learning
Algorithm
Labeled Data
Training
Prediction
Provides various techniques that can learn from and make predictions on data
Machine Learning - Basics
Learning Approaches
Classification Regression
(supervised – predictive) (supervised – predictive)
Our brain has lots of neurons connected together and the strength of
the connections between neurons represents long term knowledge.
1
One learning algorithm hypothesis: all significant mental algorithms
are learned except for the learning and reward machinery itself.
Why Deep Learning?
Applications
DNNresearch
Acquired
Deep Learning - Basics
No more feature engineering
Traditional
Feature
Learning
Engineering
Input Data Algorithm
Deep
Learning
Input Data Algorithm
Deep Learning - Basics
Architecture
Consists of one input, one output and multiple fully-connected hidden layers in-
between. Each layer is represented as a series of neurons and progressively extracts
higher and higher-level features of the input until the final layer essentially makes a
decision about what the input shows. The more layers the network has, the higher-
level features it will learn.
Deep Learning - Basics
The Neuron
Forward it trough
the network to get
Sample labeled data predictions
Learns by generating an error signal that measures the difference between the
predictions of the network and the desired values and then using this error signal
to change the weights (or parameters) so that predictions get more accurate.
Deep Learning - Basics
Usage Requirements
Excels in tasks where the basic unit (pixel, word) has very little meaning
in itself, but the combination of such units has a useful meaning
Deep Learning - Tools
Computing is affordable
Deeper models that can learn from much fewer training cases