Beruflich Dokumente
Kultur Dokumente
ARTICLE
Hengyu Li1,*, Jun Luo1, Chaojiong Huang1, Yi Yang1 and Shaorong Xie1
1 School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, China
* Corresponding author E-mail: lihengyu@shu.edu.cn
Received 17 Jan 2014; Accepted 14 Aug 2014
DOI: 10.5772/58988
2014 The Author(s). Licensee InTech. This is an open access article distributed under the terms of the Creative
Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use,
distribution, and reproduction in any medium, provided the original work is properly cited.
1. Introduction
Currently the majority of countries are devoted to focusing
on underwater monitoring. However, the acquisition of
underwater images is performed in noisy environments
with low visibility because natural light is not available and even if artificial light is applied, the visible range is
limited [1]. Acoustic cameras can provide extremely high
resolutions (for sonar) and rapid refresh rates [2]. Therefore,
sonar systems are widely employed to obtain images of the
seabed or other underwater objects.
It is not conducive to monitoring objects or environments
underwater through sonar equipment alone because the
observation angle of high-resolution sonar equipment is so
small that only part of the underwater scene can be observed,
i.e., the horizontal view angle of DIDSON (dual-frequency
identification sonar) is 28.8. Therefore, most sonar
equipment is often installed in rotational mechanism to
obtain different scene information; as such, sonar images are
stitched to expand the monitoring horizon of the underwater
environment [3]. Thus, image mosaicing technology plays a
significant role in underwater monitoring systems.
J Adv
Syst, 2014,
11:166
| doi:
Hengyu Li,IntJun
Luo,Robot
Chaojiong
Huang,
Yi Yang
and10.5772/58988
Shaorong Xie:
An Adaptive Image-stitching Algorithm for an Underwater Monitoring System
i x j y
I (X ) =
I (i, j )
(1)
i =0 j =0
L xy ( X , ) L yy ( X , )
(2)
X 1 = HX 2
(4)
where
(5)
QO (u, v ) =
j ( uxo + vyo )
F1 (u, v ) F2 (u, v )
=e
*
| F1 (u, v ) F2 (u, v ) |
(6)
j ( ux o + vy o )
f 2 ( x , y ) = f1 [ ( x cos + y sin ) xo ,
( x sin + y cos ) y o )]
(7)
F2 ( u , v ) = e
j F2 ( u , v )
2 F1 [ 1
(8)
| F2 ( u, v ) |= 2 | F1 [ 1 ( u cos + v sin ),
( u sin + v cos )] |
1
(9)
f 2 pl ( , ) = 2 f1 pl ( , )
6. Image Fusion
After the above processing, it is necessary to conduct
coordinate mapping in the next step. To avoid black holes,
inverse mapping is adopted in this paper. In addition,
coordinate mapping will lead to an inevitable situation in
which the integral points will be non-integer points after
coordinate mapping. The double linear interpolation
algorithm [19] is introduced to avoid this issue.
If images are fused directly by simple superposition, the
spliced position will produce a conspicuous joint and blur
overlap area. The weighted smoothing algorithm [20] is
introduced to improve it. The idea behind the algorithm
based on weighted smoothing is shown in Figure 6. The
overlap of adjacent images f1 and f 2 is in the interval
[ x1 , x2 ] . W1 ( x) and W2 ( x) are weighted functions whose
relationship is expressed as:
W2 ( x) = 1 W1 ( x) = 1 i / W
(11)
(10)
where = log( ) .
The scale and rotation parameters between two images
can be converted to translation parameters after the above
transformation and then the phase correlation algorithm
can be introduced to calculate translation parameters.
Hengyu Li, Jun Luo, Chaojiong Huang, Yi Yang and Shaorong Xie:
An Adaptive Image-stitching Algorithm for an Underwater Monitoring System
f is
calculated as:
f ( x, y) = f1 ( x, y)W1 ( x) + f 2 ( x, y)W2 ( x)
(12)
(a)
(b)
(c)
(d)
Figure 8. (a) and (b) The original image. (c) The result of image-geometric transformations of scale and rotation. (d) Stitched image.
(a)
(b)
(c)
(d)
Figure 9. (a) and (b) The original image. (c) The result of image-geometric transformations of scale and rotation. (d) Stitched image.
6
The relationship
between original
Images
SIFT algorithm
Phase correlation
algorithm
Translation
parameters: ( 5, 7)
Scale and rotation:
1 and 0
Translation
parameters: (30,
60)
Scale and rotation:
1 and 0
The images
between Figure
9 (a) and (b)
The images
between Figure
10 (a) and (b)
Table 1. The relationship between the original images calculated by different algorithms
0.99863 0.0523360
0.0523360
0.99863
0
0
x0
y0
1
0
0
x0
y0
1
0.98229 0.1873813 x0
0.1873813
y0
0.98229
0
0
1
As to homography, the one from the proposed algorithm
is closer to the standard value than the SIFT algorithm.
However, we cannot determine which is better between
the proposed algorithm and SIFT from Table 1. Naturally,
we switch emphasis to observing stitched images. The
stitched images are shown as Figures 10 and 11.
(a)
(b)
(c)
Figure 10. (a) The image stitched by the algorithm based on SIFT.
(b) The image stitched by the algorithm based on correlation.
(c) The image stitched by the algorithm proposed in this paper.
(a)
(b)
(c)
Figure 11. (a) The image stitched by the algorithm based on SIFT.
(b) The image stitched by the algorithm based on correlation.
(c) The image stitched by the algorithm proposed in this paper.
8. Summary
This paper proposes an adaptive sonar image-stitching
algorithm for an underwater monitoring system which is
based on phase correlation and SURF. It turns out to be
effective and practical after experiments. An alternative
algorithm can be applied to stitch sonar images according
to the number of feature points. In other words, the
algorithm employs SURF for sonar images with enough
feature points while it employs phase correlation for
sonar images lacking feature points. The paper also
proposes a weighted smoothing algorithm based on a
maintained boundary for image fusion which can
enhance the integration of image-stitching. This
algorithm takes advantages of the SURF and phase
correlation algorithms to improve the accuracy and
timeliness of sonar image-stitching.
9. Acknowledgements
This project is supported by the Key Projects of the
National Natural Science Foundation of China (No.
61233010) and the National Nature Science Foundation of
China (No. 61305106). The authors also gratefully
acknowledge the helpful comments and suggestions of
the reviewers, which have improved the presentation.
10. References
[1] K. Kim, N. Neretti, and N. Intrator (2005) Mosaicing
of acoustic camera images. In: Radar, Sonar and
Navigation. 2005; pp. 263-270.
[2] E. Belcher, B. Matsuyama, and G. Trimble (2001)
Object identification with acoustic lenses. In:
OCEANS, 2001. MTS/IEEE Conference and
Exhibition. 2001; pp. 6-11.
Hengyu Li, Jun Luo, Chaojiong Huang, Yi Yang and Shaorong Xie:
An Adaptive Image-stitching Algorithm for an Underwater Monitoring System