Artificial Neural Networks - 10

Dr. Aditya Abhyankar

Last time
SOM
LVQ

Today
ART!!

LVQ (Learning Vector

Quantization)

Supervised classifier
Discriminating surfaces are Bayes surfaces
Weight vector for output = codebook vector
Each output is a known class

LVQ (Learning Vector

Quantization)

LVQ (Learning Vector

Quantization)

LVQ (Learning Vector

Quantization)

LVQ (Learning Vector

Quantization)

Adaptive Resonance Theory

(ART)
User gets to define degree of (relative)
similarity for a given class
Input patterns can be in any order
Single pattern can be learnt multiple times
Dilemma 1: Unstable Nets single pattern
associates with multiple classes
Dilemma 2: Plasticity Ability of Net to
respond to an unseen pattern

Adaptive Resonance Theory

(ART)
ART Nets are designed to be STABLE and
PLASTIC
Vigilance parameter: User defined parameter to
control degree of similarity between patterns of
same class
Learning governed by differential Eqs
Once acceptable cluster unit selected for learning,
signals are maintained for extended time -resonance

Adaptive Resonance Theory

(ART)
ART1: Designed to cluster binary input
vectors
ART2: Designed to cluster non-binary input
vectors
Learning could be FAST or SLOW
depending upon the relative speed of weight
updation

Architecture
Reset

Competitive Layer

Supplementary Units

2/3 rule !!!

F2 Stages:

Learning Stages

Algorithm : ART1

Algorithm

Algorithm

Algorithm

Example
Use ART1 Net to cluster (1 1 0 0), (0 0 0 1),
(1 0 0 0), (0 0 1 1) in atmost three clusters