Sie sind auf Seite 1von 13

PFG 2012 / 2, 0115 – 0127 Article

Stuttgart, April 2012

A Process for Radiometric Correction of UAV Image Blocks


Eija Honkavaara, TEEmu Hakala, lauri markElin, Tomi rosnEll, Masala, HEikki
saari & jussi mäkynEn, Espoo, Finland

Keywords: Reflectance, radiometry, geometry, calibration, UAV, hyperspectral


Summary: The objective of this investigation is to Zusammenfassung: Verfahren zur radiometri-
develop and test a radiometric correction process schen Korrektur von UAV Bildblöcken. Das Thema
for UAV image blocks. The phases of the process der vorgestellten Untersuchung ist die Entwicklung
include the laboratory calibration of the sensor and und der Test eines Korrekturverfahrens für die Ra-
the radiometric correction of the campaign image diometrie eines Bildblocks, der mit kleinen unbe-
data. This investigation focuses on developing a mannten Flugzeugen aufgenommen wurde (UAVs
process for radiometric correction of the image = Unmanned Aerial Vehicles). Das Verfahren um-
data collected during a remote sensing campaign. fasst die Laborkalibrierung der Kamera und die
First of all, the orientations for the images are de- radiometrische Korrektur der bei der Befliegung
termined using the self-calibrating bundle block aufgenommenen Bilddaten, und ist vor allem auf
adjustment method and an accurate DSM is gener- fernerkundliche Anwendungen ausgerichtet. Im
ated by automatic image matching. The varying ersten Schritt werden die Bilder über eine Aero-
radiometric level of images due to changes in illu- triangulation verknüpft, wobei die Parameter der
mination and the instability of the sensor are elimi- inneren Orientierung mitgeschätzt werden (Selbst-
nated using a relative radiometric block adjustment kalibrierung). Dann folgt die Ableitung eines digi-
technique. Optional reflectance reference observa- talen Oberflächenmodells. Die radiometrischen
tions can be used to adjust the data to absolute re- Unterschiede zwischen den einzelnen Bildern be-
flectance units. The process was demonstrated and dingt durch Beleuchtungsunterschiede und Instabi-
evaluated by using two UAV imaging systems: a lität des Sensors werden durch ein neues Verfahren
consumer camera-based system and a novel Fabry- zur relativen radiometrischen Blockausgleichung
Perot interferometer-based next generation light- entfernt. Optional können Referenzreflektanzen
weight hyperspectral imaging system. The method eingeführt werden, um auf diese Weise den aufge-
improved the homogeneity of the data, but some nommenen Daten absolute Reflektanzwerte zuord-
drift also appeared in the parameters. The first ex- nen zu können.
periment provided 0.003–0.008 reflectance errors Das Verfahren wurde mit Bilddaten zweier auf
in the areas close to the radiometric control points UAVs betriebener Systeme erprobt. Es handelte
(mostly on the level of 5 % of the reflectance value). sich einerseits um eine Consumer-Kamera und an-
The presented approach provides a general frame- dererseits um eine neue Hyperspektralkamera von
work for rigorous radiometric correction of UAV Fabry-Perot, die sich durch geringes Gewicht und
image blocks, and the novel technology provides die Nutzung der Interferometrie auszeichnet. Die
many possibilities for the further development of Anwendung unseres Verfahrens ließ zwar homoge-
the method. Our results also show that hyperspec- nere Bilddaten entstehen. Gewisse Drifteffekte
tral stereophotogrammetry is now possible with blieben aber bestehen. Die ersten Untersuchungen
UAV imaging sensors weighing less than 500 g. zeigten einen RMS-Fehler von 0.003–0.008 der
Reflektanzeinheit im Bereich der radiometrischen
Passpunkte, meistens in der Größenordnung von
5 % der Reflektanzwerte. Das vorgestellte Verfah-
ren bietet einen Rahmen für eine durchgreifende
radiometrische Ausgleichung von Bilddaten, die
von UAV-Plattformen aufgenommen werden. Neue
Technologien, z. B. der Sensoren, lassen viele wei-
tere Entwicklungen erwarten. Unsere Ergebnisse
zeigen, dass hyperspektrale Stereophotogramme-
trie von UAVs heute möglich ist, wenn die Sensoren
leichter als 500 g sind.

© 2012 E. Schweizerbart'sche Verlagsbuchhandlung, Stuttgart, Germany www.schweizerbart.de


DOI: 10.1127/1432-8364/2012/0106 1432-8364/12/0106 $ 3.25
116 Photogrammetrie • Fernerkundung • Geoinformation 2/2012

1 Introduction mote sensing campaigns; also, other methods


for the anisotropy measurements are currently
Low-cost and low-weight UAV imaging sys- being developed (Grenzdörffer & niemeyer
tems offer great potential for local area remote 2011).
sensing applications, such as applications for The radiometric correction is one step in
agriculture, forestry, the mining industry and the UAV remote sensing process. The cen-
hydrology, as well as for scientific research. tral phases of the image production process
To obtain a good reconstruction of the object, include the laboratory calibration of the sen-
images are collected in a block structure with sor, data collection, orientation of the im-
large forward and side overlaps. The multiple ages, digital surface model (DSM) generation,
observations per image point are of great im- radiometric correction and the calculation of
portance in order to improve the reliability of the final end products, such as radiometrical-
the data processing and interpretation (LeberL ly corrected images and orthophoto mosaics.
et al. 2010). Multiple image overlaps are wide- The corrected images are utilized in the re-
ly used in the geometric processing of images, mote sensing applications.
including the bundle block adjustment meth- The objectives of this investigation are to
ods and surface reconstruction, but there are develop a method for radiometric correction
not yet well-established processes for utilizing and reflectance image generation for UAV im-
the multiple overlaps in radiometric process- aging that utilizes multiple overlaps in the im-
ing for UAV applications. age block and to demonstrate its use with nov-
The idea of radiometric block adjustment el imaging systems. In section 2, the theoreti-
is not new. A rigorous method for combining cal background of the radiometric correction
geometric and radiometric object reconstruc- method is described. In section 3, we describe
tion, called the global object reconstruction the set-up for the empirical investigation; we
method, was already presented by ebner & give the results in section 4 and discuss our
heipke (1988) several decades ago. Unfortu- findings in section 5.
nately, the method turned out to be compu-
tationally laborious, and in practical applica-
tions the geometry and radiometry are pro- 2 Novel Radiometric Correction
cessed separately. Method
Recently, approaches have been established
for the radiometric block adjustment and re- 2.1 Theoretical Background
flectance image generation of image block
data collected by stable, large-format digi- In passive UAV imaging, the elementary
tal photogrammetric cameras (chandeLier & components of radiance entering the sensor
martinoty 2008, coLLinGS et al. 2011, López (Lat_sensor) are the radiance components from
et al. 2011). For photogrammetric images, ap- the object of interest, mainly the surface-
proaches that are based on the radiative trans- reflected solar radiance (Ls), skylight (Lsky),
fer theory and that do not account for the background radiance (Lbg) and the radiance
overlaps in airborne image blocks have also reflected first by the background objects and
been developed (beiSL et al. 2008, r ichter & then by the atmosphere (Lbg_multi); the adjacen-
SchLäpfer 2002). In UAV remote sensing ap- cy effect (Ladj) and atmospheric path radiance
plications, empirical line-based approaches (Latm) are radiance components that do not car-
are typically used (berni et al. 2009), or then ry any information about the object of interest
simple balancing approaches are used (zhou (Schott 2007):
2009); the analysis is carried out using the cen-
tral areas of the images. hakaLa et al. (2010) Lat_sensor = Ls + Lsky + Lbg + Lbg_multi + Ladj + Latm
developed a UAV-based method for accurate (1)
measurement of the reflectance anisotropy of
surfaces, but this method required reflectance The contributions of different radiation com-
reference targets in each image, which is not ponents in (1) are dependent on the flying
appropriate in many practical operational re- height, the atmospheric state, the reflectance
E. Honkavaara et al., A Process for Radiometric Correction 117

properties of the object of interest and the re- where c0 and c1 are the absolute radiometric
flectivity of the surrounding objects; more de- calibration parameters of the sensor when re-
tails can be found in von Schönermark et al. lating the DNs to Lat_sensor. The reflectance can
(2004) and Schott (2007). be solved by physically or empirically based
In this investigation we collected the data in methods (honkavaara et al. 2009). In low-
direct sunshine in a flat and open area, so the altitude applications, a linear approxima-
surface-reflected direct solar radiance is the tion (empirical line method) is a feasible ap-
dominating component: proach for the reflectance product generation
(SchowenGerdt 2007), and this is the basis for
Ls (λ, θi, φi, θr, φr) = the development of the method in this inves-
ρ (λ, θi, φi, θr, φr) τs (λ) τ v (λ) Eλ0 cos θ/π (2) tigation:

where τs and τ v are the atmospheric transmit- ρ (θi , φi , θr , φr) = c0′ DN + c1′, (5)
tance in the solar path and in the path from ob-
ject to sensor, respectively, Eλ0 is the spectral where c0′ and c1′ are modified calibration coef-
irradiance on top of the atmosphere and θ is ficients, which are dependent on illumination,
the solar incidence angle on a surface (cos θ the atmosphere and sensor-related factors ((1)
is given by the vector dot product of the unit and (4)).
vector pointing towards the Sun and the unit
vector normal to the surface). θi and θr are the
illumination and reflected light (observation) 2.2 A Process for UAV Image Block
zenith angles and φi and φr are the azimuth an- Radiometric Correction
gles, respectively. ρ (λ, θi, φi, θr, φr) is the bi-
directional reflectance distribution function The empirical model for the conversion of ob-
(BRDF) (von Schönermark et al. 2004). ject reflectance to DN is
The sensor properties define how the in-
coming radiation is measured. The digital DNj = aabs Rj (θi, φi, θr, φr) + babs (6)
grey value (DN) of a given pixel, after apply-
ing dark pixel subtraction and correcting sen- where Rj (θi, φi, θr, φr) is the bi-directional re-
sor-related radiometric non-uniformities, can flectance factor (BRF) of the object j and a abs
be given as follows: and babs are the parameters of the empirical
line model (a reflectance factor is used be-

cause it is a measurable quantity (Shaepman-
DN = GAd Ωτ ∫ Lat − sensor (λ ) S (λ ) d λ (3)
Strub et al. 2006)).
0
The DN value of the same point is different
where G is the system gain, Ad is the area of in different overlapping images. In an image
the detector, Ω is the aperture, τ is the integra- block, this is partially caused by the anisotro-
tion or exposure time, S (λ) is the system-level pic characteristic of object reflectance, which
spectral response and λ is the wavelength. De- is the physical property of the object. Other
pending on the sensor, the DN value can be important factors causing differences include
controlled by the exposure time, by the ap- the changes in illumination conditions and the
erture and exposure time or by the aperture, inaccuracy of the exposure of the sensor and
by the exposure time and by the ISO setting other sensor inaccuracies. While the anisotro-
(roSneLL et al. 2011). In the following discus- py of the reflectance is modelled by the BRDF,
sion, it is assumed that band-averaged values the relative differences in the overlapping im-
are being used. ages must be estimated. In this study we used
The equation for the reflectance in sun-il- a linear model to model these differences; the
luminated conditions with contributions from extended model for image i and object j is
the path radiance is
DNij = arel_i(a abs Rj (θi, φi, θr, φr) + babs) + brel_i
ρ (θi , φi , θr , φr) = (π (c0 + c1 DN) − Latm)/ = arel_i aabs Rj (θi, φi, θr, φr) + arel_i babs
(τs τ v E0 cos θ) (4) + brel_i (7)
118 Photogrammetrie • Fernerkundung • Geoinformation 2/2012

The corresponding observation equation for lens falloff and CCD detector non-uniformi-
DN of object j in image i, with a correction ty as well as the spectral response (Schowen­
vij, is Gerdt 2007, Schott 2007).

vij = arel_i aabs Rj (θi, φi, θr, φr) + arel_i babs


+ brel_i. − DNij (8) 3 Empirical Testing

The observation equation for the radiometric 3.1 Imaging Systems


control point with a reflectance observation,
Robs_ j (θi, φi, θr, φr) and a correction vj, is The Microdrones MD4-1000 quadrocopter
UAV was used as the platform, allowing for
vj = Rj (θi, φi, θr, φr) − Robs_ j (θi, φi, θr, φr) (9) a maximum payload of 1000 g. The imag-
ing sensors included a hyperspectral proto-
For one of the images, the relative parame- type sensor developed by the VTT Technical
ters are arel_1 = 1, brel_1 = 0, and the other rela- Research Centre of Finland (mäkynen et al.
tive parameters are relative to these parame- 2011, Saari et al. 2011) and a Panasonic Lu-
ters. Various parameterizations can be used: mix GF1 customer micro four-thirds camera
1) a full linear model for absolute and relative (Fig. 1). Both systems are capable of collecting
correction, 2) a linear model for absolute cor- stereoscopic image data.
rection and offset for the relative correction, The Fabry-Perot interferometer (FPI) based
3) only relative parameters and 4) only ab- hyperspectral imaging sensor represents the
solute parameters. Furthermore, it is possi- next generation in imaging technology (Un-
ble to estimate the radiometric object model manned Aerial System Innovations, UASI)
(BRDF). (mäkynen et al. 2011, Saari et al. 2011). When
The radiometric correction process is as the FPI is placed in front of the sensor, the sen-
follows. A network of radiometric tie points sitivity of each pixel is a function of the inter-
is generated in the campaign area in the object ferometer air gap. By changing the air gap, it
coordinate system. Accurate image orienta- is possible to acquire a new set of wavelengths
tion information and DSM are needed in order for each image. With a sequence of images
to determine the DN observations. Observa- captured with different air gaps of the FPI,
tion equations ((8) and (9)) are generated for it is possible to reconstruct the spectrum for
each image DN observation and object reflec- each pixel in the image. In this mode, up to
tance observation. The result is an over-deter- 54 raw images can be saved to buffer memory
mined adjustment task, which can be solved in one image burst. The camera weighs only
using the least squares method. 450 g. The prototype uses the 5 Mpix RGB
The model presented here assumes that the CMOS image sensor MT9P031 from aptina
DNs will be corrected for sensor defects based (2011), and the 4 × 4 binned Video Graphics
on calibration information. Central parame- Array (VGA) was used in the flight campaign.
ters that need to be determined in the labora- Details about the camera are given in Tab. 1
tory calibration include the corrections for the and Fig. 2.

32 GB CompactFlash
memorycard
UASI FPI based
Hyperspectral Imager
GPS receiver
Downwelling
Irradiance sensor

7.4V 850mAh
Li-Po battery

Fig. 1: Left: VTT hyperspectral camera UASI (saari et al. 2011). Right: Panasonic Lumix GF1
cameras.
E. Honkavaara et al., A Process for Radiometric Correction 119

Tab. 1: Parameters of sensors. F: focal length; FOV f, FOV cf: field of view in flight and cross flight
directions.

Sensor F Pixel Columns Rows FOV f FOV cf Weight


(mm) (µm) (º) (°) (g)
UASI 0.0093 8.8 640 480 26 36 450
GF1 0.020 4.5 4016 3016 37 48 448

1.2
1.20
1 1.00
0.8 G 0.80
0.6 R
0.60
RE
0.4 0.40
NIR-1
0.2 0.20
NIR-2
0 0.00
400 600 800 1000 400 600 800 1000 1200
-0.2 -0.20

Fig. 2: Left: selected channels of hyperspectral data (central band width, full width of half maxi-
mum FWHM): G: 568.553 nm, 23.287 nm; R: 658.459 nm, 22.324 nm; Red edge (RE): 739.082 nm,
29.724 nm; NIR-1: 802.868 nm, 38.38 nm; NIR-2: 857.029 nm, 35.601 nm. Right: spectral re-
sponse of the GF1.

Reflectance
0.50
0.45
0.40
0.35
0.30 P05
0.25 P20
0.20
P30
0.15
0.10 P50
0.05
0.00
500 700 900
Wavelength (nm)

Fig. 3: Left: overview of the block: ground control points (red triangles), right: spectra of the reflec-
tance targets for the five selected UASI channels (Fig. 2).

The Panasonic Lumix GF1 camera (Lumix tarps (nominal reflectance: 0.05, 0.2, 0.3, 0.5),
2011) has been modified so that it works as a Siemens star and 11 ground control points
an NIR camera (see details in Tab. 1, Fig. 2). were used as reference targets. The reflectance
In this study, only the pixels stored in the red of the reference tarps was measured using
channel were used. the ASD Field Spec Pro FR spectroradiom-
eter and the measurements were normalized
to a calibrated, white, 30 cm by 30 cm Spec-
3.2 Flight Campaigns tralon reference standard from Labsphere. In
this study, a single image strip from both sen-
The image blocks collected at the MTT Ag- sors was used; the forward overlaps were 81 %
rifood Research Finland agricultural test site and 91 % for UASI and GF1, respectively. The
(N 60° 25′ 21″, E 24° 22′ 28″) on 6 July, 2011 length of the area was approximately 500 m
were used to test the radiometric correction and the width of the image strip was approxi-
method (Fig. 3). Four reflectance reference mately 80 m with UASI and 120 m with GF1.
120 Photogrammetrie • Fernerkundung • Geoinformation 2/2012

Tab. 2: Details on the data collection (S.E: solar elevation, S.Az: solar azimuth)

Sensor Time f-stop T GSD Forward Images S.E. S.Az.


(s) (cm) Overlap (°) (°)
(%)
UASI 9:25 <7.0 1/300 13 81 42 45 132
GF1 11:06 5.0 1/2000 3 91 57 52 166

In the campaigns, the sensors were not oper- The radiometric camera calibration of the
ated simultaneously because a suitable cam- GF1 was carried out at the Finnish Geodetic
era mount was not available. The weather con- Institute’s (FGI) experimental calibration fa-
ditions during the campaign were fine, with cility. The spectral calibration was carried
almost a cloud-free sky and moderate wind out using a stabilized 50 W quartz tungsten
(Tab. 2). halogen lamp (Thermo Oriel 66881), an Oriel
Cornerstone 74125 monochromator and a dif-
fuser. The output of the monochromator was
3.3 Radiometric Calibration in first measured using an ASD Field Spec Pro
Laboratory FR spectroradiometer, which had an FWHM
of 3 nm at a range of 350–1000 nm. The GF1
The spectral and lens fall-off calibration of the was then used to capture a set of images at
UASI were carried out at the VTT’s calibra- 10 nm intervals at a range of 350–1000 nm,
tion facility. The spectral calibration was car- and the spectral response was calculated from
ried out using a Quartz halogen lamp, a mono- this dataset. The lens falloff correction was
chromator (Bentham TMc300) and a beam determined by photographing white isotropic
homogenizer and diffuser module to provide reference (PTFE plane of the size 1 m x 1 m
an evenly distributed narrow bandwidth light, in diffuse illumination conditions in cloudy
which was projected into the hyperspectral weather) and fitting a cosn function (Schott
imager optics. The calibration of the spectral 2007) to 8 images; a value of 5.6 was obtained
radiance was performed with the aid of a Unit- for n.
ed Detector QED-200 absolute radiometer for
the wavelength range of 350–1050 nm using
1 nm steps and a FWHM resolution of 1 nm. 3.4 Data Processing
After this, the UASI hyperspectral imager was
attached to the setup and its signal for each The data processing began by carrying out the
wavelength was recorded at 280 FPI air gap image correction using correction factors de-
values in the range of 100–1500 nm at 5 nm termined by the laboratory calibration. The
intervals. The calibration measurements were further processing was carried out in a pho-
used to calculate the calibration coefficient togrammetric environment consisting of the
matrix. The spectral photon flux entering the BAE Systems SOCET SET photogrammetric
pixels of the hyperspectral imager at a fixed workstation (devenecia et al. 2007, waLker
FPI air gap can be calculated by multiplying 2007) and in-house developed components.
the Red (R), Green (G) and Blue (B) pixel sig- The orientation determination of the GF1
nals by the calibration coefficient matrix for images was relatively efficient. A small
the whole image (mäkynen et al. 2011, Saa­ amount of manual interaction was necessary
ri et al. 2011). The lens falloff calibration of because the GNSS/IMU system did not pro-
the UASI was performed using an integrating vide accurate enough a priori orientation in-
sphere and a Quartz halogen lamp to provide formation for the SOCET SET automatic tie
a uniform, wide-band radiance. The lens fall- point determination method. Orientation de-
off factor was calculated from an average of termination was carried out in two phases:
10 raw images, from which dark images at the in the first iteration, a small number of in-
same exposure time were subtracted. teractively measured tie points were used to
E. Honkavaara et al., A Process for Radiometric Correction 121

provide satisfying approximate orientations, processing them was that the individual chan-
and in the second iteration 121 automatically nels of the spectral data cube were collected
measured tie points per image were comput- within a short period of time (in this set up, ap-
ed using the SOCET SET. In self-calibrating proximately in 1 s). Due to the platform move-
bundle block adjustments, the principal point, ments, the individual channels do not overlap
radial distortions and tangential distortions accurately, as is demonstrated in Fig. 5. In this
were estimated. The Next Generation Auto- study, 5 channels (Fig. 2) were selected from a
mated Terrain Extraction software (NGATE) hyperspectral data cube with 50 channels, and
(devenecia et al. 2007) was used to determine each channel was oriented separately. A fur-
3D point clouds. The point cloud was created ther complication was that the adjustment ap-
with a 10 cm point interval using the default peared to be quite unstable; thus, only the first-
NGATE strategy (ngate.strategy with a corre- order radial distortion parameter was used to
lation window size of 5 × 5 pixels). The plani- model image distortions. Approximately 20
metric and vertical accuracy of the georefer- additional GCPs were extracted using the GF1
encing (image mosaics, point clouds and 3D image block to aid the orientation. It was esti-
point determination) was estimated to be bet- mated that the accuracy of the georeferencing
ter than 0.2 m. Examples of a GF1 image and was better than 0.5 m for all of the coordinate
derived point cloud are shown in Fig. 4. components. The method for the orientation
The orientation processing of the UASI im- processing will be improved in the future.
ages followed the same principles as the pro- The radiometric block adjustments were
cessing of the GF1 images. The challenge in carried out using the methodology described

Fig. 4: Left: GF1 image, centre and right: Different views of the point cloud generated from GF1
images by automated image matching.

Fig. 5: Left: an example of an UASI image with the channels NIR-2, G and R, top-right: UASI-
channels G and R, bottom right: UASI-channels red edge and NIR-2.
122 Photogrammetrie • Fernerkundung • Geoinformation 2/2012

Fig. 6: Radiometric tie points (yellow) and control points (red) in a GF1 image strip.

in section 2.2. In this investigation, the meth- HF (%) = (VCForiginal image − VCFcorrected image)/
od was used to eliminate the radiometric dif- VCForiginal image × 100 (10)
ferences of overlapping images, which could
be due to sensor inaccuracy or illumination The overall HF was calculated as an average
differences, and for reflectance image genera- of the HFs for all radiometric tie points.
tion. A grid of radiometric tie points was cre- The differences in the radiometric control
ated with a 5 m point interval (Fig. 6), and the points were used to evaluate the accuracy of
image coordinates of the tie points were calcu- the reflectance images. The root-mean-square
lated using the orientations and the DSM. DN error (RMSE) was calculated for all of the
observations were taken from all images hav- control points and images with the targets.
ing a view angle to the object point of less than
10°; it was assumed that with small view an-
gles, the BRDF effects were limited so that the 4 Results
BRDF model could be ignored. The average
of DNs in a small image window was used as 4.1 Radiometric Block Adjustments
the DN observation (UASI: 5 × 5 pixels, GF1:
30 × 30 pixels). Different parameterizations We carried out radiometric block adjustments
were tested. Depending on the illumination with different combinations of relative and
situation, different reflectance quantities may absolute parameters (8). The tested models
be obtained (Schaepman-Strub et al. 2006). In were 1) relative offset (brel_1 … brel_n), 2) rela-
this study, with direct sunshine, the approach tive linear model (arel_1 … arel_n, brel_1 … brel_n)
provides BRFs. and 3) absolute linear model and relative offset
(aabs, babs, brel_1 … brel_n).
Fig. 7a shows the impact of correction on
3.5 Performance Assessment the average variation coefficient of the ra-
diometric tie points. The homogenization
The quality of the adjusted model parameters factors (10) were with both sensors approxi-
was evaluated by using the standard deviation mately 20–50 % with both relative correction
estimates provided by the least squares meth- scenarios, which means that grey value dif-
od. ferences decreased with relative radiometric
The variation coefficients (standard devia- correction; the homogeneity was similar with
tion divided by the average value) in each tie single- and two-parameter relative correction
point were used to evaluate the homogeneity models (models 1 and 2). The homogenization
of the data before (VCForiginal image) and after the factors deteriorated in the cases with absolute
correction (VCFcorrected image). The homogeniza- radiometric correction (model 3). An example
tion factor (HF) is (López et al. 2011) as fol- of a successful elimination of the radiometric
lows: differences of images in an image mosaic is
shown in Fig. 7b.
E. Honkavaara et al., A Process for Radiometric Correction 123

a)
Variation coefficient
0.20
0
0.15
1
0.10
2
0.05
3
0.00
G R RE NIR-1 NIR-2 GF1

b)

Fig. 7: a) Average variation coefficients of radiometric tie points for different channels with differ-
ent models. 0: original images; 1: relative offset (brel_1 … brel_n); 2: relative linear model (arel_1 … arel_n,
brel_1 … brel_n); 3: absolute linear model and relative offset (aabs, babs, brel_1 … brel_n). b) An example
of the successful relative radiometric correction in red channel.

Relative offset
5000 G
0 R
-5000 RE
-10000 NIR-1
NIR-2
-15000
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43
Image number

Fig. 8: The relative offset parameter (brel_1 … brel_n) of different images.

The relative offset parameter of different was from the South-East direction, which is
images is shown in Fig. 8. The parameters are about perpendicular to the flight direction.
related to the topmost image in the image strip The darkening of the UASI mosaic towards
(brel_1 = 0). A drift appeared in the offset pa- the North-East direction is most likely due to
rameters. The absolute parameters correlat- problems with the correction parameters and
ed strongly with the reflectance unknowns, the soil properties.
which indicated that the solution was not quite We evaluated the accuracy of the reflec-
controlled. Some constraints would be needed tance images using the reflectance tarps. Two
to eliminate the drift and correlations. cases were evaluated: 1) for the block adjust-
ment, we used absolute and relative param-
eters (aabs, babs, brel_1 … brel_i ), and 2) we cal-
4.2 Accuracy of Reflectance Images culated the empirical line parameters using
one image and used the parameters to cor-
Examples of image mosaics produced from rect the other images (3 images with UASI,
lens-fall-off corrected images and reflectance 4 images with GF1). Reflectance differences
images are shown in Fig. 9. The brightening (RMSE-value) in the reflectance reference tar-
of the mosaics towards the West-North direc- gets are shown in Fig. 10. The RMSEs were
tion is due to the BRDF effects; the sunshine mostly 0.006–0.008 for the reflectance units
124 Photogrammetrie • Fernerkundung • Geoinformation 2/2012

Fig. 9: From left to right: Original and reflectance UASI mosaic, original and reflectance GF1 mo-
saic. (North is up, East is to the right).

BA
RMSE (reflectance)
EL
0.020
0.015
0.010
0.005
0.000
G R RE NIR-1 NIR-2 GF1

Fig. 10: Reflectance error (RMSE) in reflectance images in different channels (BA: radiometric
block adjustment, EL: empirical line method).

and 5–7 % of the reflectance value. With the od has to be further improved in order to con-
empirical line method, larger differences ap- trol the drifts and correlations.
peared in NIR-1 and NIR-2 channels (large
errors in the black target with a nominal re-
flectance of 0.05). In these channels, the block 5 Discussion
adjustment provided better accuracy. Reflec-
tance errors were slightly lower in the GF1 im- We developed a radiometric correction meth-
ages than in the UASI images, which could be od for UAV image blocks which utilizes mul-
the result of several factors: the lower georef- tiple overlaps in an image block and demon-
erencing accuracy of UASI could cause larger strated the use of the method. Images were
standard deviations; the atmospheric condi- collected using two different imaging sys-
tions might have been different (a sun-pho- tems: a next-generation hyperspectral im-
tometer was not used during the campaign); aging system based on Fabry-Perot interfer-
or, higher noise in UASI images (Figs. 4 and ometer and developed by the VTT Technical
5). According to laboratory testing, the UASI Research Centre of Finland (mäkynen et al.
is very stable. This evaluation gives accura- 2011, Saari et al. 2011), and a commercial cus-
cy in the areas close to the reflectance targets. tomer camera, both weighing less than 500 g.
Furthermore, the accuracy assessment is not The results showed that the method im-
independent in the case of block adjustment, proved the homogeneity of an image block.
because the same points were used in the ad- The method is more economic than a meth-
justment and in the evaluation; thus, the result od requiring a reflectance reference target in
mainly validates the processing. every image. The solution is computationally
We made the following conclusions. The efficient because only a limited number of tie
relative radiometric correction was necessary points have to be used.
with the datasets and the offset parameter (brel) There are several possibilities to improve
was sufficient for the relative correction. For the performance of the method. An elimina-
the reflectance image generation the absolute tion method for the outliers needs to be imple-
linear model is required (aabs, babs). The meth- mented; some approaches have been presented
E. Honkavaara et al., A Process for Radiometric Correction 125

in previous literature on the topic (chandiL­ paigns, for example when using dark vegeta-
ier & m artinoty 2008, López et al. 2011). In tion to provide a dark pixel values for correc-
this study, the object was quite homogeneous, tion methods based on dark pixel subtraction
so the outliers were not a serious problem. It is or when using spectral libraries as a reference.
necessary to implement a BRDF model to im- One characteristic of UAV campaigns is that
prove the processing; for example, in order to they will need to be carried out under variable
adjust several image strips together and to pro- conditions, which has to be taken into account
vide radiometrically homogeneous image mo- when developing the correction method.
saics. Simple linear models were used for the The prerequisites for the method are ac-
absolute and relative correction; it is possible curate image orientations and DSM. The re-
to use more rigorous models for atmospheric cent results have shown that the novel image
parameters ((1) and (4)). Number of reflectance matching methods provide sufficiently accu-
unknowns could be decreased in order to elim- rate DSMs for the object surfaces (LeberL et
inate the correlations. It is feasible to collect al. 2010, hirSchmüLLer 2011, roSneLL et al.
additional observations of the imaging condi- 2011), and this is the starting point for devel-
tions during UAV campaigns (for example, by oping novel radiometric processing methods.
using a sunphotometer or by using an irradi- Furthermore, radiometric laboratory calibra-
ance sensor to collect observations of down- tion is required in order to utilize the image
welling radiance, which is a component of the radiometry quantitatively.
UASI) and to use them to constrain the method.
Furthermore, in the case of hyperspectral sen-
sors, it is possible to estimate some atmospher- 6 Conclusions
ic parameters using appropriate channels. Us-
ing radiometric control points with a better dis- Efficient methods are needed for the radio-
tribution would probably decrease the system- metric correction of UAV image blocks. In
atic drift of the correction. It can be concluded this study, we demonstrated the radiometric
that the approach presented here offers a pow- block adjustment of UAV image block. The
erful and flexible framework for rigorous and approach is flexible and the novel sensing
reliable radiometric correction. technology provides many possibilities for
We processed only five channels of the 50 improving the method. Our investigation also
channel hyperspectral data cube in order to shows that hyperspectral stereophotogramme-
prove the concept. The conventional photo- try is now possible with lightweight UAV im-
grammetric workstation SOCET SET was not aging systems.
functional in the orientation determination of
the small-format UASI images with large ro-
tational differences and poor approximate ori- Acknowledgements
entation values. More efficient georeferencing The research carried out in this study was
approach has to be developed. The processing funded by the Academy of Finland (Project
time for the radiometric correction is directly No. 134181).
proportional to the number of channels pro-
cessed.
The radiometric correction of low-altitude References
UAV images has many advantages in compar-
ison to airborne imaging from a higher alti- a ptina Ltd.: http://www.aptina.com/products/im-
tude using large-format cameras. It is feasible age_sensors/mt9p031i12stc/ (13.1.2012).
to install reflectance reference targets and ir- beiSL, u., teLaar, J. & v. Schönermark, m., 2008:
Atmospheric correction, reflectance calibration
radiance sensors in the campaign area because
and BRDF correction for ADS40 image data. –
the operator has to go to the area anyway. At- The International Archives of the Photogram-
mospheric disturbances are much lower due metry, Remote Sensing and Spatial Information
to the shorter distances. On the other hand, Sciences 37 (B7).
many well-established radiometric correction berni, J.a., zarco ­teJada, p.J., Suárez, L. & fer­
methods are not possible in many UAV cam- ereS, e., 2009: Thermal and Narrowband Multi-
126 Photogrammetrie • Fernerkundung • Geoinformation 2/2012

spectral Remote Sensing for Vegetation Moni- López, d.h., García, b.f., piqueraS, J.G. & aöcá­
toring from an Unmanned Aerial Vehicle. – zar, G.v., 2011: An approach to the radiometric
IEEE Transactions on Geosciences and Remote aerotriangulation of photogrammetric images. –
Sensing 47: 722–738. ISPRS Journal of Photogrammetry and Remote
chandeLier, L. & m artinoty, G., 2009: Radiomet- Sensing 66 (2011): 883–893.
ric aerial triangulation for the equalization of Lumix, 2012: Panasonic Lumix GF1. – http://pana-
digital aerial images and orthoimages. – Photo- sonic.net/avc/lumix/systemcamera/gms/gf1/
grammetric Engineering & Remote Sensing 75 specifications.html (13.1.2012).
(2): 193–200. m äkynen, J., hoLmLund, c., Saari, h., oJaLa, k. &
coLLinGS, S., cacetta, p., campbeLL, n. & wu, x., antiLa, t., 2011: Unmanned aerial vehicle
2011: Empirical models for radiometric calibra- (UAV) operated megapixel spectral camera. –
tion of digital aerial frame mosaics. – IEEE Proc. SPIE 8186 (B).
Transactions on Geoscience and Remote Sens- r ichter, r. & SchLäpfer, d., 2002: Geo-atmo-
ing 49 (7): 2573–2588. spheric processing of airborne imaging spec-
devenecia, k., waLker, S. & zhanG, b., 2007: trometry data. Part 2: atmospheric / topographic
New approaches to generating and processing correction. – International Journal of Remote
high resolution elevation data with imagery. – Sensing 23 (13): 2361–2649.
fritSch, d. (ed.): Photogrammetric Week 2007: roSneLL, t., honkavaara, e. & nurminen, k.,
297–308. 2011: On geometric processing of multi-tempo-
ebner, h. & heipke, c., 1988: Integration of digital ral image data collected by light UAV systems.
image matching and object surface reconstruc- – International Archives of the Photogramme-
tion. – International Archives for Photogramme- try, Remote Sensing and Spatial Information
try and Remote Sensing 27 (B11(III)): 534–545. Sciences 38 (1/C22, A).
Grenzdörffer, G.J. & niemeyer, f., 2011: UAV Saari, h., peLLikka, i., peSonen, L., tuominen, S.,
based BRDF-measurements of agricultural sur- heikkiLä, J., hoLmLund, c., m äkynen, J., oJaLa,
faces with PFIFFIKUS. – International Archives k. & antiLa, t., 2011: Unmanned Aerial Vehicle
of the Photogrammetry, Remote Sensing and (UAV) operated spectral camera system for for-
Spatial Information Sciences 38 (1/C22). est and agriculture applications. – Proc. SPIE
h akaLa, t., SuomaLainen, J. & peLtoniemi, J.i., 8174.
2010: Acquisition of Bidirectional Reflectance Schaepman­Strub, G., Schaepman, m.e., painter,
Factor Dataset Using a Micro Unmanned Aerial t.h., danGeL, S. & m artonchik, J.v., 2006: Re-
Vehicle and a Consumer Camera. – Remote flectance quantities in optical remote sensing –
Sensing 2 (3): 819–832. definitions and case studies. – Remote Sensing
hirSchmüLLer, h., 2011: Semi-Global matching: of Environment 103: 27–42.
motivation, development and applications. – Schott, J.r., 2007: Remote sensing: The image
fritSch, d. (ed.): Photogrammetric Week 2011: chain approach. – 2nd ed., 666 p., Oxford Uni-
173–184. versity Press.
honkavaara, e., a rbioL, r., m arkeLin, L., m arti­ SchowenGerdt, r.a., 2007: Remote Sensing, Mod-
nez , L., cramer, m., bovet, S., chandeLier, L., els and Methods for Image Processing. – 3rd ed.,
iLveS, r., k LonuS, S., m arShaLL, p., SchLäpfer, Academic Press Inc., San Diego, CA, USA.
d., tabor, m., thom, c. & veJe, n., 2009: Digi- SuomaLainen, J., h akaLa, t., peLtoniemi, J. & put­
tal airborne photogrammetry – A new tool for tonen, e., 2009: Polarised multiangular reflec-
quantitative remote sensing? – A state-of-the-art tance measurements using the Finnish geodetic
review on radiometric aspects of digital photo- institute field goniospectrometer. – Sensors 9
grammetric images. – Remote Sensing 1 (3): (5): 3891–3907.
577–605. waLker, S., 2007: New features in SOCET SET®.
hunt, e.r. Jr., hiveLy, w.d., fuJikawa, S.J., Lin­ – fritSch, d. (ed.): Photogrammetric Week
den, d.S., dauGhtry, c.S.t. & mccarty, G.w., 2007: 35–40.
2010: Acquisition of NIR-Green-Blue Digital von Schönermark, m., GeiGer, b. & röSer, h.p.,
Photographs from Unmanned Aircraft for Crop 2004: Reflection properties of vegetation and
Monitoring. – Remote Sensing 2: 290–305. soil: with a BRDF data base. – 1st ed., 352 p.,
LeberL, f., irSchara, a., pock, t., meixner, p., Wissenschaft und Technik Verlag, Berlin, Ger-
Gruber, m., SchoLz, S. & wiechert, a., 2010: many.
Point clouds: Lidar versus 3D vision. – Photo- zhou, G., 2009: Near Real-Time Orthorectification
grammetric Engineering & Remote Sensing 76 and mosaic of small UAV video flow for time-
(10): 1123–1134. critical event response. – IEEE Trans. on Geo-
science and Remote Sensing 47: 739–747.
E. Honkavaara et al., A Process for Radiometric Correction 127

Addresses of the Authors: Manuskript eingereicht: November 2011


Angenommen: Januar 2012
Dr. eiJa honkavaara, teemu h akaLa, Lauri
m arkeLin & tomi roSneLL, Finnish Geodetic Insti-
tute, Geodeetinrinne 2, 02430 Masala, Finland,
Tel.: +358-40-192-0835 (Honkavaara), +358-9-
295550 (others), Fax: +358-9-29555200, e-mail:
first name.last name@fgi.fi
Dr. heikki Saari & JuSSi m äkynen, VTT Technical
Research Centre of Finland, P.O. Box 1000, 02044
VTT, Finland, Tel.: +358-40-5891254, +358-20-722
111, Fax: +358-20-7227012, e-mail: heikki.saari@
vtt.fi, jussi.makynen@vtt.fi

Das könnte Ihnen auch gefallen