Aug 2 SOM Labelling On Integer, Zoo and Xray Datasets

Progress Report
August 4
Data considered
• Integers: 1 to 100, uniformly distributed
– Average neighborhood distance
– Quantization and topographic error
• Zoo data: 101 animals, 16 features, 7 categories
– Labeled SOM nodes, SOM+kmeans
• Plain radiographs: 120 samples, 100 features, 3 categories
– Labeled SOM nodes, SOM+kmeans
Data: {1…100}, Uniformly Dist.
6
50 x epoch
100 x epoch
5
500 x epoch
x-axis, normalized to
1000 x epoch display global
4
adjustment
distortion measure
3
neighborhood
2 distance are invariant
wrt to the iterations
1
-1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
training phase
0
50 x epochs
-10 100 x epochs
500 x epochs
-20 1000 x epochs Quantization error
-30
quantization error (in dB)
1 m
-40 EQE = �X p - M c ( p )
m p =1
-50
-60
As the number of
-70 iteration increases,
-80
the quantization error
decreases
-90
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
training phase
1
50 x epochs
0.9 100 x epochs
500 x epochs
0.8 1000 x epochs Topographic error
0.7
1 N ur
ETE = �u ( xi )
topographic error
0.6 N i =1
0.5
As the number of
0.4
training increases,
0.3 topographic error
0.2
decreases
0.1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
training phase
100
98 95 92 83 73 52 50
99
97 96 91 88 66 54
94 93 77 59 47
90 87 84 81 69 53
89 80 45
86 85 82 75 72 63
78
79 61
76 74 64
71 65 39 37
70 68 56 44 33
67 55 42 30 26 25 24
62 21
60 58 41 38 32 19
57 36 17 15 14
34 20 18 13 11
29
51 35 28 22 16 8 7
48 43 12 10 5 3
49 46 40 31 27 23 9 6 4 21
Data: zoo data, Uniformly Dist.
1 carp sole piranha herring tuna porpoise vampire hamster
basspike dogfish dolphin fruitbat cavy
seahorse chub
0.9 haddockcatfish stingray pony reindeer
squirrel goat calf
seawasp seasnake seal wallaby
0.8
slowworm gorilla oryxgiraffe
normalized topographic error
clam pitviper elephant antelope

0.7 sealion girl deer buffalo
slug penguin vole
worm vulture raccoon wolf hare
0.6
skimmer rhea ostrich puma polecat lynx
skua kiwi tortoise boar opossum
0.5
gull mongoose mole
hawk lion leopard
crow tuatara bear
0.4 duck mink cheetah
swan newt pussycat aardvark
0.3
flamingo frog toad platypus
sparrow wren ladybird moth wasp
pheasant lark lobster housefly
0.2 dove parakeet crab crayfish scorpion termite
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
training phase chicken starfish octopus flea gnat honeybee
Major bug: distance

= sqrt(sum((x-mc)^2)) before sqrt(sum(x-mc)^2)
0.9 carp sole piranha herring tuna porpoise vampire hamster
seahorse chub
0.8 haddockcatfish stingray pony reindeer
squirrel goat calf
0.7 seawasp seasnake seal wallaby
0.6 clam pitviper elephant antelope
sealion girl deer buffalo
quantization error
slug penguin vole

0.5 raccoon
worm vulture w olf hare
0.4
gull mongoose mole
hawk lion leopard
0.3 crow tuatara bear
duck mink cheetah
0.2 swan newt pussycat aardvark
0.1 sparrow wren ladybird moth wasp
dove parakeet crab crayfish scorpion termite
0
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 chicken starfish octopus flea gnat honeybee
training phase
0.35 carp sole piranha herring tuna porpoise vampire hamster
seahorse chub
haddockcatfish stingray pony reindeer
0.3 squirrel goat calf
0.25
average neighbor distance

0.2 slug penguin vole
worm vulture raccoon w olf hare
0.15 skua kiwi tortoise boar opossum
gull mongoose mole
hawk lion leopard
0.1
crow tuatara bear
duck mink cheetah
0.05 flamingo frog toad platypus
0
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 dove parakeet crab crayfish scorpion termite
training phase chicken starfish octopus flea gnat honeybee
Labeled SOM nodes
carp sole piranha herring tuna porpoise vampire hamster
seahorse chub
haddockcatfish stingray pony reindeer
squirrel goat calf
slug penguin vole
worm vulture raccoon w olf hare
gull mongoose mole
hawk lion leopard
crow tuatara bear
duck mink cheetah
dove parakeet crab crayfish scorpion termite
chicken starfish octopus flea gnat honeybee
• mammals • amphibians • invertebrates

• fishes • birds • insects • reptiles
'aardvark’ 'antelope’ 'bear’ 'boar’ 'buffalo’ 'calf’ 'cavy’ 'cheetah’ 'deer’ 'elephant’ 'fruitbat’
'giraffe’ 'girl’ feathers
'goat’ 'gorilla’ 'hamster’eggs'hare’ 'leopard’ 'lion’milk
'lynx’ 'mink’ 'mole’ 'mongoose’
hair
rs feathers eggs feathers
eggs milk eggs
milk milk
'opossum’
rs feathers
hair 'oryx’ 'platypus’
eggs feathers
feathers 'polecat’
eggs 'pony’ 'puma’
milk 20 eggs
eggs milk 'pussycat’
milk 'raccoon’
milk'reindeer’ 'sealion’
rs'squirrel’
hair 'vampire’
feathers eggs'vole’feathers
feathers 'wallaby’ 'wolf'
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 milk
eggs milk milk
4
16
ne
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed14predator
toothed
3 toothed toothed
c airborne
ne aquatic predator
aquatic predator
aquatic toothed predator
predator toothed toothed toothed 1
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
toothed toothed toothed
e
c airborne
aquatic aquatic
predator predator
aquatic predator
toothed predator
10
8 7
nebackbone
es breathes vbreathes venomousvenomous
enomousbreathes fins venomous
fins fins fins
es breathes vbreathes
nebackbone enomousbreathes
venomousvenomous
fins venomous
6 fins fins fins
nebackbone venomousvenomous
enomousbreathes fins
fins venomous fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins 6
2
0
legs
tail tail
domestic tail
domestic domestic
catsize domestic
0 catsize
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail Has
catsize domestic
domestic hair Does not
catsize catsize catsize fly Breathes
legs
tail domestic
tail domestic
tail domestic Has no feather
catsize domestic
catsize Does
catsize not swim Not venomous
catsize
tail
legs domestic
tail domestic
tail domestic
catsize domestic
catsize catsize
Has no eggs Hascatsize
teeth No fins
Has milk Has backbone
'bass’ 'carp’ 'catfish’ 'chub’ 'clam’ 'dogfish’ 'haddock’ 'herring’ 'pike’ 'piranha‘
rs feathers
hair feathers eggs
eggs feathers eggs milk'tuna’ milk
eggs
milk'stingray’ milk
rs 'seahorse’
feathers
hair 'seawasp’
feathers 'slug’
eggs feathers
eggs 'sole’
milk 20 eggs
eggs milk 'worm’
milk milk
s feathers
hair feathers
eggs feathers
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 eggsmilk milk milk
4
16
e airborne
c aquatic aquatic
predator predator
aquatic predator toothed
toothed14predator
3 toothed toothed
c aquatic
e airborne predator
aquatic predator
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
e
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed predator
10
8 7
nebackbone
venomousvenomous
fins venomous
6 fins fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins
6
2
0
tail
legs tail
domestic domestic
tail domestic 0 catsize
catsize domestic
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail Has
catsize domestic
domestic no hair Does not
catsize catsize catsize fly Does not breathe
legs
tail domestic
tail domestic
catsize domestic
catsize Swims
catsize catsize Has fins, no tails
legs
tail domestic
tail domestic
tail domestic
catsize domestic
catsize
Has eggs catsize catsize
Has teeth Has tail
Has no milk Has backbone Not domesticated
'crab’ 'crayfish’ 'lobster’ 'octopus'
rs feathers
hair feathers
eggs eggs
feathers eggs
milk eggs milk 'starfish'
milk 'scorpion’ milk
rs feathers
hair eggs
feathers eggs
feathers milk
eggs 20
milk
eggs milk milk
s feathers
hair feathers
eggs feathers
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 eggs
milk milk milk
4
16
e airborne
c aquatic aquatic
predator predator
toothed14predator
3 toothed toothed
c aquatic
e airborne predator
aquatic predator
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
e
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed predator
10
8 7
nebackbone
venomousvenomous
fins venomous
6 fins fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins
6
2
0
tail
legs tail
domestic domestic
catsize domestic
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail Has
catsize domestic
domestic no hair Does not
catsize catsize catsize fly Has not tail
legs
tail domestic
tail domestic
catsize domestic
catsize Swims
catsize catsize Not domesticated
legs
tail domestic
tail domestic
tail domestic
catsize domestic
catsize
Has no teeth Not cat-sized
Has milk No backbone
'chicken’ 'crow’ 'dove’ 'duck’ 'flamingo’ 'gull’ 'hawk’ 'kiwi’ 'lark’ 'ostrich’
rs feathers
hair
'parakeet’ feathers
'penguin’ eggs
eggs feathers
'pheasant’ eggs
milk milk
eggs
'rhea’ 'skimmer’ milk 'sparrow’
'skua’ milk 'swan’ 'vulture'
rs feathers
hair eggs feathers
feathers eggs milk 20 eggs
eggs milk milk milk
'wren'
rs feathers
hair feathers
eggs feathers
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 eggs
milk milk milk
4
16
ne aquatic
c airborne aquatic
predator predator
toothed14predator
3 toothed toothed
c airborne
ne aquatic predator
aquatic predator
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
e
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed predator
10
8 7
nebackbone
venomousvenomous
fins venomous
6 fins fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins
6
2
0
tail
legs tail
domestic domestic
catsize domestic
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail Has
catsize domestic
domestic no hair Flies
catsize catsize catsize Not venomous
legs
tail domestic
tail domestic
tail domestic Has feathers
catsize domestic
catsize Has nocatsize
catsize teeth No fins
legs
tail domestic
tail domestic
tail domestic
catsize domestic
catsize
Has eggs catsize catsize Has tail
Has backbone
Has no milk Breathes Not domesticated
'frog’ 'frog’ 'newt’ 'toad’ 'tortoise'
rs feathers
hair feathers
eggs eggs
feathers eggs
milk eggs milk
milk'tuatara' milk
rs feathers
hair eggs
feathers eggs
feathers milk
eggs 20
milk
eggs milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 eggs
milk milk milk
4
16
ne aquatic
c airborne aquatic
predator predator
toothed14predator
3 toothed toothed
c airborne
ne aquatic predator
aquatic predator
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
e
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed predator
10
8 7
nebackbone
venomousvenomous
fins venomous
6 fins fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins
6
2
0
tail
legs tail
domestic domestic
catsize domestic
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail No hair
catsize domestic
domestic Does not
catsize catsize catsizefly Not venomous
legs
tail domestic
tail domestic
tail domestic No feathers
catsize domestic
catsize Swims catsize
catsize No fins, no tail
legs
tail domestic
tail domestic
tail domestic
catsize domestic
catsize
No backbone Not
No milk Does not breathe domesticated
Not cat-sized
'flea’ 'gnat’ 'honeybee’ 'housefly'
rs feathers
hair feathers
eggs eggs
feathers eggs
milk eggs milk
milk'ladybird’ milk
rs feathers
hair eggs
feathers eggs
feathers milk
eggs milk
eggs milk'moth’ 'termite’ 'wasp'
milk
20
rs feathers
hair feathers
eggs feathers
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 eggs
milk milk milk
4
16
ne aquatic
c airborne aquatic
predator predator
toothed14predator
3 toothed toothed
c airborne
ne aquatic predator
aquatic predator
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
e
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed predator
10
8 7
nebackbone
venomousvenomous
fins venomous
6 fins fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins
6
2
0
tail
legs tail
domestic domestic
catsize domestic
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail domestic No feathers
catsize domestic No fins
catsize catsize catsize
legs
tail domestic
tail domestic
tail domestic No milk catsize catsize
catsize domestic
catsize
legs
tail domestic
tail domestic
tail domestic
catsize domestic
catsize
No teeth catsize catsize
No backbone
'dolphin’ 'pitviper’ 'porpoise'
rs feathers
hair feathers
eggs eggs
feathers eggs
milk milk'seal’ milk
eggs milk
rs feathers
hair eggs
feathers eggs
feathers milk
eggs milk
eggs 'seasnake’
milk 'slowworm'
milk
20
rs feathers
hair feathers
eggs feathers
eggs eggs
milk eggs
milk milk milk
rs feathers
hair feathers
eggs feathers
eggs eggs
milk 18 eggs
milk milk milk
4
16
ne aquatic
c airborne aquatic
predator predator
toothed14predator
3 toothed toothed
c airborne
ne aquatic predator
aquatic predator
ne
c airborne
aquatic predator
aquatic aquatic
predator predator
toothed12predator
e
c airborne
aquatic aquatic
predator aquatic
predator predator
toothed predator
10
8 7
nebackbone
venomousvenomous
fins venomous
6 fins fins fins
4
es
nebackbone
breathes vbreathes
enomousbreathes
venomousvenomous
fins venomous
fins2 fins5 fins
6
2
0
tail
legs tail
domestic domestic
catsize domestic
2 4 catsize
6 8 catsize
10 12 14 16 18 20
tail
legs domestic
tail domestic
tail Has
catsize domestic
domestic no milk Breathes
catsize catsize catsize Has tail
legs
tail domestic
tail domestic
tail domestic Does not fly
catsize domestic
catsize Has nocatsize
catsize teeth Not domesticated
legs
tail domestic
tail domestic
tail domestic
catsize domestic
catsize
Has teeth catsize catsize
Not venomous
No backbone No fins
Plain radiographs
• Cases 1 2 3 4 5 6 7 8 9 10
– Normal, pleural effusion 11 12 13 14 15 16 17 18 19 20
21 22 23 24 25 26 27 28 29 30
and Pneumothorax
31 32 33 34 35 36 37 38 39 40
– 40 samples each
• Features
– 10 x 10 boxes
– Mean gray level
91 92 93 94 95 96 97 98 99 100
Xray: Average neighbor distance
normalnormal pneumopneumo normal
pleural normal pneumonormal normal normalnormal pneumo
10 normal pneumo
normal pneumo normal normal
normal
9 normal pneumo normal pneumo normal
pleural
normalnormal normal normal pneumo
pneumo pneumo
8
normal normal normal
normal normal pneumo
normal normal normal normal
pneumo
average neighbor distance
7
normal pneumopneumopneumo
6 normal pneumo pneumo
normalnormalnormalnormal pneumopneumo
5 pleural pneumo pneumo
4
pneumo
pneumopneumo pneumo
pleural pneumo pneumo
pleural pneumo pneumo pneumo
3
pleural pleural pneumo pneumo
pneumo
2
pleural pleural pleural pleural
1 pleural pleural pleural pleural pleural pleural
0 pleural pleural pleural pleural pneumo pleural
0 2 4 6 8 10 12
pleural pleural pleural pleural pleural pneumo
ksamples
pleural pneumo pleural pleural pleural pleural pleural
pleural pleural pleural
Xray: Quantization Error
normal pneumo
1800 normal pneumo normal normal
normal
normal pneumo normal pneumo normal
pleural
1600 normalnormal normal normal pneumo
pneumo pneumo
1400 normal normal normal normal
pneumo
normal pneumo pneumo
quantization error
1200
pneumo
pneumopneumo pneumo
600 pleural pleural pneumo pneumo
pneumo
400
pleural pleural pleural pleural pleural pleural
200
0 10 20 30 40 50 60 70 80 90 100 pleural pleural pleural pleural pneumo pleural
training epoch pleural pleural pleural pleural pleural pneumo
Xray: Normalized TE
1
normal pneumo
normal
0.9 normal pneumo normal pneumo normal
pleural
pneumo pneumo
0.8 normal normal normal
pneumo
normalized topographic error
0.7
0.6 normal pneumo pneumo
0.5
0.4 pneumo
pneumopneumo pneumo
0.3 pleural pneumo pneumo pneumo
0.2 pneumo
0.1 pleural pleural pleural pleural
0
0 10 20 30 40 50 60 70 80 90 100 pleural pleural pleural pleural pneumo pleural
training epoch pleural pleural pleural pleural pleural pneumo
Labeled SOM nodes
pleural normal pneumonormal normal normal normal pneumo
normal pneumo
normal
normal pneumo normal pneumo normal
pleural
pneumo pneumo
pneumo
normal pneumo pneumo
pneumo
pneumopneumo pneumo
pneumo
pleural pleural pneumopneumo
pleural pleural pleural pleural pneumo pleural
pleural pleural pleural pleural pleural pneumo
SOM + kmeans
20
18
16
1
14
12
1 2 3 4 5 10
2
8
4 3
0
0 2 4 6 8 10 12 14 16 18 20
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
SOM + kmeans
20
18
16
1
14
12
21 22 23 24 25 10
2
8
4 3
0
0 2 4 6 8 10 12 14 16 18 20
26 27 28 29 30
31 32 33 34 35
36 37 38 39 40
SOM + kmeans
20
18
16
1
14
12
41 42 43 44 45 10
2
8
4 3
0
0 2 4 6 8 10 12 14 16 18 20
46 47 48 49 50
51 52 53 54 55
56 57 58 59 60
SOM + kmeans
20
18
16
1
14
12
61 62 63 64 65 10
2
8
4 3
0
0 2 4 6 8 10 12 14 16 18 20
66 67 68 69 70
71 72 73 74 75
76 77 78 79 80
SOM + kmeans
20
18
16
1
14
12
81 82 83 84 85 10
2
8
4 3
0
0 2 4 6 8 10 12 14 16 18 20
86 87 88 89 90
91 92 93 94 95
96 97 98 99 100

Aug 2 SOM Labelling On Integer, Zoo and Xray Datasets

Hochgeladen von

Dokumentinformationen

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Aug 2 SOM Labelling On Integer, Zoo and Xray Datasets

Hochgeladen von

Copyright:

Verfügbare Formate

Progress Report

clam pitviper elephant antelope

Major bug: distance

slug penguin vole

clam pitviper elephant antelope

• mammals • amphibians • invertebrates

Das könnte Ihnen auch gefallen