A SURVEY ON MULTIVARIATE IMAGE SEGMENTATION USING
SEMANTIC REGION GROWING WITH ADAPTIVE EDGE PENALTY
Authors Name/s per 1st Affiliation (Author)
line 1 (of Affiliation): dept. name of organization
line 2-name of organization, acronyms acceptable
line 3-City, Country
line 4-e-mail address if desired
Abstract- Multivariate image segmentation is a
challenging task, affected by substantial intraclass
variety that reduces class distinguishability and
additionally expanded component space sparseness
and solution space complexity that impose
computational cost and degrade algorithmic
robustness. To manage these issues, a Markov
random field (MRF) based multivariate segmentation
algorithm called multivariate iterative region
developing utilizing semantics" (MIRGS) is
introduced. In MIRGS, the effect of intraclass variety
and computational cost are decreased utilizing the
MRF spatial setting model incorporated with
adaptive edge penalty and applied to regions.
Semantic region growing beginning from watershed
over-division and performed alternatively with
segmentation gradually decreases the arrangement
space estimate, which enhances division viability. As
a multivariate iterative calculation, MIRGS is very
touchy to starting conditions. To suppress
initialization sensitivity, it employs a region-level k-
means (RKM) based introduction strategy, which
reliably gives precise starting conditions at low
computational cost. Tests demonstrate the prevalence
of RKM relative over two generally utilized
initialization techniques. Segmentation tests on a
variety of synthetic and natural multivariate images
exhibit that MIRGS reliably outflanks three other
distributed algorithms.
Technical Keyword: Initialization sensitivity,
Markov random field (MRF), multilevel logistic
(MLL) model, multivariate segmentation, region
adjacency graphs (RAG), semantic region growing,
vector-valued image, watershed.
I. INTRODUCTION
Image segmentation is a procedure that breaks down
a image into disjoint areas and is a principal venture
for some image-processing tasks for example, picture
Authors Name/s per 2nd Affiliation (Author)
line 1 (of Affiliation): dept. name of organization
line 2-name of organization, acronyms acceptable
line 3-City, Country
understanding and content-based image retrieval. PC
vision applications frequently require segmentation
of digital imagery into semantically important areas.
The fragmented locales can give a basis for
subsequent tasks for example, object detection and
recognition, scene understanding and content-based
image retrieval. In this manner, extreme execution
depends upon segmentation precision. Rapid
advances in image innovations prompt to different
types of digital images. Multivariate (vector-valued)
imagery (e.g., color images) depicts each site
utilizing a vector that describes a similar scene from
distinct aspects, where the number of vector elements
is known as the element space measurement.
Univariate imagery (e.g., grayscale images) can be
viewed as an extraordinary multivariate case in which
each site is delineated by a scalar. This paper
concentrates on multivariate 2-D case in which each
site is delineated by a scalar. This paper concentrates
on multivariate 2-D imagery which is defined on a
discrete 2-D rectangular lattice. Multivariate image
segmentation has been generally connected in
different fields. Although theoretically feasible to
extend numerous univariate segmentation systems to
their multivariate partners, functional execution is
impacted by the multivariate nature of the image.
Intraclass variety is regularly showed since
semantically important regions (classes) are often
inhomogeneous because of scene qualities, imaging
environment, and image noise. Large intraclass
variation usually reduces class distinguishability and,
thus, degrades segmentation performance.
III. LITERATURE SURVEY
An image segmentation method named iterative
region growing using semantics (IRGS), which is
characterized by two aspects. First, it uses graduated
increased edge penalty (GIEP) functions within the
traditional Markov random field (MRF) context
model in formulating the objective functions. Second,
IRGS uses a region growing technique in searching
for the solutions to these objective functions. The
proposed IRGS is an improvement over traditional
MRF-based approaches in that the edge strength
information is utilized and a more stable estimation
of model parameters is achieved. Moreover, the IRGS
method provides the possibility of building a
hierarchical representation of the image content and
allows various region features and even domain
knowledge to be incorporated in the segmentation
process. The algorithm has been successfully tested
on several artificial images and synthetic aperture
radar (SAR) images [1]. A joint segmentation and
classification system for SAR sea-ice analysis. The
segmentation algorithm is based on a region-growing
technique, and the classification is a region-based
MRF approach. The two processes are integrated
under the Bayesian framework, with both aiming at
reducing a defined energy. The interactions between
the two are bidirectional by letting the classification
result to have some degree of control on the region-
growing process. Various low level features and high-
level knowledge can hence be efficiently combined,
and the system performs successfully with the tested
SAR sea-ice images. The proposed system performs
the solution searching in a bottom-up manner on the
hierarchical structure established during the process.
More accurate results could also be obtained with a
subsequent top-down searching and adaptive
updating of the structure. Also, the ice-floe-shape
descriptor may be improved by a more general class
of curves [2]. An unsupervised multiscale color
image segmentation algorithm that enables accurate
boundary localization across all scales. The basic idea
is to apply mean shift clustering to obtain an over-
segmentation and then merge regions at multiple
scales to minimize the MDL criterion. Two different
merging algorithms have been proposed, with the
second one enabling the construction of a tree-
structured hierarchy of segmentation results across all
scales. The performance on the Berkeley
segmentation benchmark compares favorably with
some existing approaches [3]. Proposed a unified
framework for video segmentation based on
graphical models. The spatiotemporal consistency of
segmentation is expressed in terms of interactions
among the motion field, the intensity segmentation
field, and the video segmentation field. The solution
is obtained by the MAP estimate, and an optimization
procedure that iteratively maximizes the conditional
probability density of the three fields is proposed.
There are three main contributions within the paper.
The first is building a Bayesian network based
framework that combines both the spatial and
temporal information in the video segmentation
process. The second is formulating the
spatiotemporal constraints by utilizing Markov
random fields, distance transformation, and
multivariate normal distribution. The third is the
theoretical compromise of previous motion based
approaches and region merging approaches. The
approach deals with video segmentation from a
relatively comprehensive and general viewpoint and,
thus, can be universally applied. Our method exhibits
good robustness and spatiotemporal coherence [4].
By introducing a variable weighting parameter to
combine the region labeling component and the
feature modeling component in a simple MRF based
segmentation model, an unsupervised segmentation
can be achieved. Experiments demonstrated that the
new implementation scheme can enable the simple
MRF model to work more consistently than a
constant weighting parameter. The developed
technique can be efficiently applied to SAR sea ice
imagery segmentation, color image segmentation and
segmentation of images with textures [5]. A new
automatic image segmentation algorithm is proposed
in this paper. The color edges are first obtained by an
improved isotropic color-edge detector and the
centroids between the adjacent edge regions are taken
as the initial seeds for region growing. Moreover, the
results of color-edge extraction and SRG are
integrated to provide more accurate segmentation of
images. Application of the proposed image
segmentation algorithm to automatic face detection is
also discussed. Moreover, a novel semantic object
generation scheme is proposed using a seeded region
aggregation procedure. By including a temporal
tracking procedure, semantic video objects can also
be supported. Such a semantic object generation
scheme should be very attractive for content-based
multimedia database applications [6]. novel
hierarchical approach to color image segmentation. In
the first phase, uniform regions are identified via a
thresholding operation on a newly defined
homogeneity histogram. While the homogeneity is
calculated for an image pixel, both local information
and global information are considered. This is
pragmatically helpful in recognizing small objects
and local standard deviation of color images. The
output regions of the color segmentation tend to
include more detailed local information important to
distinguish different objects in a color image. The
quality of the segmentation result is much improved
by identifying significant local information more
efficiently. While performing histogram thresholding,
an effective peak-finding algorithm is employed to
identify most significant peaks in a histogram. The
color feature hue is proved to be more efficient than
RGB color features by this research. RGB requires
more computational time. The advantages and
disadvantages of different color spaces, hue and
RGB, are also given. The proposed approach can be
useful for color image segmentation [7]. Designed a
novel algorithm, region competition, for image
segmentation by minimizing a generalized MDL
criterion. This algorithm combines some of the most
attractive features of snakes/balloons and region
growing. We have successfully demonstrated our
approach on gray level images, color images, and
texture images [9]. An analogy between images and
statistical mechanics systems. Pixel gray levels and
the presence and orientation of edges are viewed as
states of atoms or molecules in a lattice-like physical
system. The assignment of an energy function in the
Fig 1: block diagram
physical system determines its Gibbs distribution.
Because of the Gibbs distribution, Markov random Multivariate image segmentation is a challenging
field (MRF) equivalence, this assignment also task, influenced by large intraclass variation that
determines an MRF image model. The energy reduces class distinguishability as well as increased
function is a more convenient and natural mechanism feature space sparseness and solution space
for embodying picture attributes than are the local complexity that impose computational cost and
characteristics of the MRF. For a range of degrade algorithmic robustness. Multivariate image
degradation mechanisms, including blurring, segmentation has been widely applied in diverse
nonlinear deformations, and multiplicative or fields. Although theoretically feasible to extend many
additive noise, the posterior distribution is an MRF univariate segmentation techniques to their
with a structure akin to the image model. By the multivariate counterparts, practical performance is
analogy, the posterior distribution defines another influenced by the multivariate nature of the image.
(imaginary) physical system. Gradual temperature Multivariate imagery is especially sensitive to large
reduction in the physical system isolates low energy intraclass variation since every component image is a
states ("annealing"), or what is the same thing, the variation contributor. Markov random field (MRF)
most probable states under the Gibbs distribution. based image segmentation is advocated for its
The analogous operation under the posterior intrinsic capability of reducing the impact of
distribution yields the maximum a posteriori (MAP) intraclass variation using spatial context information.
estimate of the image given the degraded A MRF-based multivariate segmentation algorithm
observations. The result is a highly parallel named MIRGS, which extends the applicability of
"relaxation" algorithm for MAP estimation. We IRGS to multivariate images while inheriting the
establish convergence properties of the algorithm and merits of IRGS. To suppress initialization sensitivity,
we experiment with some simple pictures, for which MIRGS uses a RKM-based initialization method,
good restorations are obtained at low signal-to-noise which consistently provides accurate initial
ratios [10]. conditions at low computational cost.

V. CONCLUSION
IV. PROPOSED SYSTEM
Introduce a MRF-based multivariate division calculation
named MIRGS, which extends the appropriateness of IRGS
to multivariate images while inheriting the benefits of
IRGS. To suppress initialization affectability, MIRGS
utilizes a RKM-based introduction technique, which
reliably gives precise starting conditions at low
computational cost. The prevalence of RKM with respect to
two commonly utilized introduction plans has been shown
on images with different feature space dimensions. For a
variety of synthetic and natural multivariate images,
MIRGS reliably accomplishes the most noteworthy
division exactness contrasted with three other distributed
algorithms. Calculation time of MIRGS is closely identified
with the development time of the various leveled RAG.
Subsequently, quick techniques to set up the progressive
RAG are imperative for future examination. Besides, to
consequently decide the quantity of classes as opposed to
prespecifying it as an algorithmic parameter is desirable.
Some past endeavors made with regards to the MRF-based
segmentation deserve being investigated under the MIRGS
system.
REFERRENCES
[1] Q. Yu and D. A. Clausi, IRGS: Image
segmentation using edge penalties and region
growing, IEEE Trans. Pattern Anal. Mach. Intell.,
vol. 30, no. 12, pp. 21262139, Dec. 2008.
[2] Q. Yu and D. A. Clausi, SAR sea-ice image
analysis based on iterative region growing using
semantics, IEEE Trans. Geosci. Remote Sens., vol.
45, no. 12, pp. 39193931, Dec. 2007.
[3] Q. M. Luo and T. M. Khoshgoftaar,
Unsupervised multiscale color image segmentation
based on MDL principle, IEEE Trans. Image
Process., vol. 15, no. 9, pp. 27552761, Sep. 2006.
[4] Y. Wang, K. F. Loe, T. Tan, and J. K. Wu,
Spatiotemporal video segmentation based on
graphical models, IEEE Trans. Image Process., vol.
14, no. 7, pp. 937947, Jul. 2005.
[5] H. Deng and D. A. Clausi, Unsupervised image
segmentation using a simple MRF model with a new
implementation scheme, Pattern Recognit., vol. 37,
no. 12, pp. 23232335, 2004.
[6] J. P. Fan, D. K. Y. Yau, A. K. Elmagarmid, and W.
G. Aref, Automatic image segmentation by
integrating color-edge extraction and seeded region
growing, IEEE Trans. Image Process., vol. 10, no.
10, pp. 14541466, Oct. 2001.
[7] H. D. Cheng and Y. Sun, A hierarchical approach
to color image segmentation using homogeneity,
IEEE Trans. Image Process., vol. 9, no. 12, pp. 2071
2082, Dec. 2000.
[8] M. C. Clark et al., Automatic tumor
segmentation using knowledge- based techniques,
IEEE Trans. Med. Imag., vol. 17, no. 2, pp. 187201,
Apr. 1998.
[9] S. C. Zhu and A. L. Yuille, Region competition:
Unifying snakes, region growing, and Bayes/MDL
for multiband image segmentation, IEEE Trans.
Pattern Anal. Mach. Intell., vol. 18, no. 9, pp. 884
900,
Sep. 1996.
[10] S. Geman and D. Geman, Stochastic relaxation,
Gibbs distributions and the Bayesian restoration of
images, IEEE Trans. Pattern Anal. Mach. Intell., vol.
PAMI6, no. 6, pp. 721741, Nov. 1984.