1

SatelliteImageFusion
SatelliteImageFusion

V.M.I.Chathurange
V.M.I.Chathurange
SriLanka
SriLanka
CSSTEAP
CSSTEAP
21
21stPGCourseinRSGIS
st
PGCourseinRSGIS
 Contents
Contents 2

What?Why?
What?Why?
Categorization
Categorization
FusionProcess
FusionProcess
FusionTechniques
FusionTechniques
WaveletBasedImageFusion
WaveletBasedImageFusion
DiscreteWaveletTransformation
DiscreteWaveletTransformation
DWTStructures
DWTStructures
DWTFusionMethodology
DWTFusionMethodology
Results
Results
QualityIndicators
QualityIndicators
Conclusion
Conclusion
References
References
 WhatisImageFusion?
3
WhatisImageFusion?

Fusionmeansanapproachtoextractionofinformation
Fusionmeansanapproachtoextractionofinformation

acquiredinseveraldomains.
acquiredinseveraldomains.
ImagefusionisasubsetoftheDataFusion.
ImagefusionisasubsetoftheDataFusion.

processofcombiningcomplementaryinformationfromtwo
processofcombiningcomplementaryinformationfromtwo
ormoreimagesintoasingleimage.
ormoreimagesintoasingleimage.
 4
WhyImageFusion?
WhyImageFusion?

Itimprovesthequality,andincreasetheapplicationofdata.
Itimprovesthequality,andincreasetheapplicationofdata.
TermQuality,itsmeaningandmeasurementdependonthe
TermQuality,itsmeaningandmeasurementdependonthe
particularapplication.
particularapplication.

Sothefusionisapplicationdependent.
Sothefusionisapplicationdependent.

Difficulttomakeuniversalmethodapplicabletoallimage
Difficulttomakeuniversalmethodapplicabletoallimage
fusiontasks.
fusiontasks.
 5
ImageFusion
ImageFusion

Multisensor
Multisensor Multitemporal
Multitemporal Multiview
Multiview

In
In

Spatial
Spatial Transform
Transform
And/or
And/or
Domain
Domain Domain
Domain
 ImageFusionFlowChart
ImageFusionFlowChart 6

Image1 Image2
. Imagen

RadiometricCorrection

ImageEnhancement
DataAlignment

GeometricCorrection

FusionLogic/Algorithm

FusedProduct
 ImageFusionTechniques/Algorithms
ImageFusionTechniques/Algorithms 6

SimpleAveraging
SimpleAveraging
SelectMinimum
SelectMinimum
Multiplication
Multiplication
BroveyTransformation
BroveyTransformation
GramSchmidtTransformation
GramSchmidtTransformation
EhlersFusion
EhlersFusion
BandSubstitution
BandSubstitution
ColorSpaceTransformation
ColorSpaceTransformation
PrincipalComponentSubstitution
PrincipalComponentSubstitution
PixelbyPixelAdditionofHighFrequencyData
PixelbyPixelAdditionofHighFrequencyData
WaveletTransformation
WaveletTransformation
 WaveletBasedImageFusion 7
WaveletBasedImageFusion

WhatisWaveletTransform?
WhatisWaveletTransform?

Wavelet
WaveletTransform
Transformis
isaatype
typeof
ofsignal
signalrepresentation
representationthat
thatcan
cangive
givethe
the
frequencycontentofthesignalataparticularinstantoftime.
frequencycontentofthesignalataparticularinstantoftime.

WhatneedWaveletTransform?
WhatneedWaveletTransform?

Wavelet
Wavelet analysis
analysis has
has advantages
advantages over
over traditional
traditional Fourier
Fourier methods
methods in
in
analyzingphysicalsituationswherethesignalcontainsdiscontinuitiesand
analyzingphysicalsituationswherethesignalcontainsdiscontinuitiesand
sharpspikes.
sharpspikes.
 DiscreteWaveletTransform(DWT)
DiscreteWaveletTransform(DWT) 8

Wavelettransformisrelatedtotwofunctions:thescalingfunction
Wavelettransformisrelatedtotwofunctions:thescalingfunction

(x)andmotherwavelet(x).
(x)andmotherwavelet (x).
( x) 2 hi (2 x i )
i

( x) 2 gi (2 x i )
i
gi (1) h i 1
2

hhi,i,ggiarecalledcoefficients(filters).
iarecalledcoefficients(filters).
hhi;Smoothfilters.(Lowpassfilters).
i;Smoothfilters.(Lowpassfilters).
ggi;Detailfilters.(Highpassfilters).
i;Detailfilters.(Highpassfilters).
Eachkindofwavelettransformdefinesitsownfiltercoefficients.
Eachkindofwavelettransformdefinesitsownfiltercoefficients.
E.gDaubechies.
E.gDaubechies.
 9
DWTcanofferamoreprecisewayforimageanalysis.Itdecomposesa
DWTcanofferamoreprecisewayforimageanalysis.Itdecomposesa
image
imageinto
intolow
lowfrequency
frequencyband
bandand
andhigh
highfrequency
frequencyband
bandin
indifferent
different
levels,anditcanalsobereconstructedattheselevels.
levels,anditcanalsobereconstructedattheselevels.

When
When images
images are
are merged
merged in
in this
this method
method different
different frequencies
frequencies are
are
processeddifferently.
processeddifferently.

ImprovesthequalityofthenewimagesinceitworksonFeature
ImprovesthequalityofthenewimagesinceitworksonFeature
extraction.
extraction.

Thefusionalgorithmisperformedatthepixellevel.
Thefusionalgorithmisperformedatthepixellevel.
 DWTSubbandStructure
10
DWTSubbandStructure

Vertical(Columns)
Horizontal(rows) Image
L 2 LL corresponding
toresolution
L 2 LevelR1
Image H 2 LH DetailImage
with corresponding
Resolution L 2 HL toinformation
LevelR visibleatthe
H 2
resolution
H 2 HH LevelR
N*M
N/2*M
L:LowpassFilter N/2*M/2
H:HighpassFilter
2:Downsamplingby2
 11
LL
. LL:HorizontalLow
pass&VerticalLowpass

HLR2
.

HLR1

LH:HorizontalLow
LHR2 HHR2 pass&VerticalHighpass

HL:HorizontalHigh
pass&VerticalLowpass

HHR1 HH:HorizontalHigh
LHR1 pass&VerticalHighpass
 IDWTSubbandStructure
12
IDWTSubbandStructure

Vertical(Columns)
Horizontal(rows)
LL 2 L
2 L

LH 2 H Imagewith
Resolution
HL 2 L
LevelR
2 H

HH 2 H N*M
N/2*M
N/2*M/2

L:LowpassFilter
H:HighpassFilter
2:Upsamplingby2
 WaveletBasedFusionMethodology
13
WaveletBasedFusionMethodology

HighSpectral Resampling
Resolution
Image HistogramMatching

A V

IDWT Fused
H D Image

V
HighSpatial
Resolution DWT
H D
Image

 2DDWTinMATLAB(SquareMode)
2DDWTinMATLAB(SquareMode) 14

IKONOS
IKONOS
Panchromatic
Panchromatic
1m
1m
2DDWTinMATLAB(TreeMode)
2DDWTinMATLAB(TreeMode) 15
WaveletBasedFusioninERDASImagine
WaveletBasedFusioninERDASImagine 16
IKNOS
IKNOS
Panchromatic
Panchromatic
1m
1m
WaveletBasedFusioninERDASImagine
WaveletBasedFusioninERDASImagine 17
IKNOS
IKNOS
Multispectral
Multispectral
4m
4m
WaveletBasedFusioninERDASImagine
WaveletBasedFusioninERDASImagine 18
IKNOS
IKNOS
Fused
Fused
1m
1m
 QualityIndicatorsForAssessingImageFusion
QualityIndicatorsForAssessingImageFusion 19

Qualitative(Subjective)
Qualitative(Subjective)

Accordingtopriorassessmentcriteriaorindividualexperiences,
Accordingtopriorassessmentcriteriaorindividualexperiences,

personaljudgmentorevengradescanbegiventothequalityofan
personaljudgmentorevengradescanbegiventothequalityofan
image.
image.
Thequalitativemethodmainlyincludesabsoluteandtherelative
Thequalitativemethodmainlyincludesabsoluteandtherelative

measures
measures
Quantitative(Objective)
Quantitative(Objective)

UseMathematicalModelstorepresenttheQuality.
UseMathematicalModelstorepresenttheQuality.

SpatialandSpectralbasedStatisticsarecalculated.
SpatialandSpectralbasedStatisticsarecalculated.

Ex:InformationEntropy,CorrelationCoefficientetc.
Ex:InformationEntropy,CorrelationCoefficientetc.
 CorrelationBetweenFused&OriginalMSS
CorrelationBetweenFused&OriginalMSS 20

CorrelationValuesfromLiterature
CorrelationValuesfromLiterature

ImagetoImageCorrelation(OriginalMSSwithFused
images)
Technique
Band1 Band2 Band3 Band4

HIS 0.57 0.19 0.45 0.42

BROVEY 0.71 0.65 0.24 0.45

PCA 0.51 0.68 0.59 0.58

WAVELET 0.86 0.85 0.83 0.85

 Conclusion
Conclusion 21

Advantages
Advantages

WaveletmethodsimprovestheSpatialquantityofthemultispectral
WaveletmethodsimprovestheSpatialquantityofthemultispectral

imagewhilepreservingitsspectralcontenttograterextent.
imagewhilepreservingitsspectralcontenttograterextent.
GivesbestresultsforActiveandPassivesensorimagesharpening.
GivesbestresultsforActiveandPassivesensorimagesharpening.

Disadvantages
Disadvantages
Spatialimprovementiscomparativelylesserthansomeotherfusion
Spatialimprovementiscomparativelylesserthansomeotherfusion

techniques.
techniques.
ComplexityofWaveletMathematicalbackgroundcreatesunderstanding
ComplexityofWaveletMathematicalbackgroundcreatesunderstanding

problems.
problems.
 References
References 22

Shi,
Shi,W.Z.,
W.Z.,Zhu,
Zhu,C.Q.,
C.Q.,Zhu,
Zhu,S.L.,
S.L.,2005.
2005.Waveletbased
Waveletbasedimage
imagefusion
fusion
andqualityassessment.InformationFusionsubmittedforpublication.
andqualityassessment.InformationFusionsubmittedforpublication.

Hussain,
Hussain, A.Z.,
A.Z., 2005.
2005. Using
Using aa Wavelet
Wavelet Based
Based Method
Method for
for High
High
ResolutionSatelliteImageFusion.
ResolutionSatelliteImageFusion.

Leica
LeicaGeosystems
GeosystemsGIS
GIS&
&Mapping,
Mapping,LLC.2003.
LLC.2003.ERDAS
ERDASImagine
Imagine
FieldGuide.Chapter6:Enhancement.ERDASImagineVersion9.1.
FieldGuide.Chapter6:Enhancement.ERDASImagineVersion9.1.

Agrawal,S.,ImageFusion,IIRSLectureSeries
Agrawal,S.,ImageFusion,IIRSLectureSeries

 23

ThankYou