IEEE Sponsored 2nd International Conference on Innovations in Information Embedded and Communication Systems
ICIIECS’15
A Comparative Study of ANN, K- Means and
Adaboost Algorithms for image classification
Periyasamy. N Thamilselvan. P
Research Scholar Research Scholar
Dept. of CS Dept. of CS
Bishop Heber College, Bishop Heber College,
Tiruchirappalli, TN, India Tiruchirappalli, TN, India
periyasamy16jmc@gmail.com thamilselvan1987@gmail.com
Abstract—Data mining is the method of extracting the valuable
systematic information from huge databases. Image classification
has constantly been a vital task for several applications such as
remote sensing medical field, pattern recognition. It converses to
the task of removing information classes from a multiband raster
image. The resolving of the classification method is to classify all
pixels in a one image class into another class. The target of image
classification is to find the exclusive dark level of images. This
paper concentrates on the study of artificial neural network,
Adaboost and k-means algorithms in image classification.
Index Terms—Data Mining; Image Classification;
Classification Accuracy; Artificial Neural Network; K-Means;
AdaBoost.
I. INTRODUCTION
Data mining is a preparation of extracting or mining
knowledge from enormous quantity of data. It is a process of
extracting hidden techniques within a data warehouse. In data
mining, classification is one of the important data analysis
tasks in pattern recognition, machine learning and business
intelligence. It is frequently used in business decision-making,
such as electronic commerce, financial markets, trend
prediction, and loan approval, among many others. It is also a
well-studied problem. There are different data mining methods
that are involved for in the classification process such as
decision trees, Naive Bayesian model, neural networks, k-
means, adaboost and support vector machines. In particular,
rule-based methods, that induce a minimal rule based concept
reports from training datasets, are backbone of research in
classification as various necessary properties
Image mining deals with the extraction of image designs
from a bulky set of image. This technology allows companies
to effort on the most significant information in their data
warehouses. Data mining techniques can be applied quickly on
existing software and hardware platforms to increase the value
of current information properties, and can be joined with new
products and systems. An earlier data analysis process
frequently involved manual work and during which
explanation of data was slow, costly, and highly inherent. The
data mining tools getting the data, during the machine learning
methods are used for taking conclusions based on the data
together. Classification method is supervised and assigning
objects into sets of predefined classes. There are different types
978-1-4799-6818-3/15/$31.00 © 2015 IEEE
Dr. J. G. R. Sathiaseelan
Head Dept. of CS
Bishop Heber College
Tiruchirappalli, TN India
jgrsathiaseelan@gmail.com
of classification approaches are used in data mining such as
rules trees and function.
The main aim of classification is to accurately calculate the
value of each class variable. This classification method is
divided into two stages i.e. training and testing. The first step is
to build the model from the training set, i.e. casually samples
are carefully chosen from the data set. In the second step the
data values are allotted to the model and validate the model’s
accuracy. Classification is a technique to categorize images
into several categories, based on their resemblances. This paper
focuses on classification process and the study of artificial
neural network, Adaboost and k-means algorithms. The
performance of data mining algorithms calculates based on the
specificity, classification accuracy and processing time.
II. RELATED WORK
Bhuvaneswari et al. [1] Intensive on improving the
classification performance by using genetic algorithm in lung
diseases images. This technique mainly aimed to help the
radiologist in analyzing the digital images to bring out possible
outcomes of the images. This author has taken the medical
images are obtained from different imaging systems such as
MRI scans, CT scans, and ultrasound scans. A brilliant
overview of its technology and applications is given by
Kalender [2]. This work considers only patient’s age ranging
from 15 to 50 comprising of both male and female are taken in
this work. This way used to remove the noise from the images
and enhance the images. This proposed algorithm shows the
91.53% accuracy in image classification.
Mathanker et al. [3] proposed a new AdaBoost algorithm.
In this work attempts to improve pecan defect classification.
The AdaBoost classifier method have appropriate for real time
application. The improved Adaboost algorithms performance is
basically increased like classification accuracy, processing time
and reliability. In this paper, to overcome limitations of the of
water flow technique. The advantages of AdaBoost include less
memory and computation necessities. The real Ada
Boost algorithm gives minor error rates than the diverse
AdaBoost. AdaBoost and Gentle AdaBoost were carried out
using GML AdaBoost Tool Box [4]. In this work accomplish
an image classification accuracy of 92.5% (approximately) the
testing error of the star AdaBoost increased as the accuracy
parameter.
 IEEE Sponsored 2nd International Conference on Innovations in Information Embedded and Communication Systems
ICIIECS’15
Ahmad Taher Azar et al. [5] obtainable a Support vector
machine (SVM). This method represents the performance
analysis of six types of support vector machine for analysis of
the breast cancer problem. This algorithm occupied to the
Breast cancer image data set. This proposed support vector
machine classifiers achieve high accuracy in breast cancer
image classification [6]. LPSVM classifier can be very helpful
to the physicians in their final decision on their patients.
Finally the overall accuracy LPSVM 97.1429 % based on this
accuracy Sensitivity (98.2456%), Specificity (95.082), and
ROC (99.38).
Yudong Zhang et al. [7] presented a feed forward neural
network algorithm. The objective of this paper is to propose a
fruit classification system based on computer vision, with the
aim of solving four short comings to the utmost degree. In this
work captured not only conservative color and shape features,
but also the important full features. It is clearly superficial that Random forests are one of the best accurate learning algorithm,
there are three layers controlled in Feed Forward Neural
Network (FNN) [8] [9]; input layer, hidden layer, and output
layer. Finally the classifier is estimated to have good accuracy
by the FNN. This method shows 89.1% accuracy in image
classification. In this study, 18 types of fruits are included
Principal Component Analysis (PCA).
Emre Celebi et al. [10] proposed k-means algorithm.
In this paper they are presented a machine learning method for
the automatic qualification of clinically important colors in
dermoscopic images. Decrease the number of colors in this
image to a small number K. The objective of KM is to partition
X into K thorough and mutually exclusive clusters by reducing
the sum of squared error. This algorithm to reduce the sum of
color in a dermoscopic image using KM. The proposed method
produced a sensitivity of 62% a specificity of 76% and an
overall accuracy value of 72% to be addressed.
Yang HongLei et al. [11] presented an algorithm
using EM algorithm to improve the classification accuracy.
This proposed algorithm had two main goals of experimental
analysis. To test the robustness of the proposed methodology
for a closing class number and primary centers. Furthermore, in
the case of a large element overlap, the EM algorithm smarts
from slow coming together [12]. It presents some important
advantages over the general EM algorithm used in remote
sensing application. This method not only solves the
originality, but also reduces the noise by using multiple
principal mechanisms. The EM algorithm shows the 83.8%
accuracy in image classification.
Ravi Babu et al. [13] presented a K-NN algorithm.
The main objective of this paper is to provide efficient and
reliable techniques for recognition of handwritten digits. A
MNIST database is used for both training and testing the
system. In this paper proposed a new method for feature
extraction based on the maximum profile distance [14]. In this
work calculating accuracy of the proposed method 5000
images are used for training set and 5000 images are used for
the test set. This work any recognition process the vital
problem is to address the feature mining and correct
classification methodologies. It tries to address both the factors
and well in terms of accuracy and time complexity. The overall
accuracy of 96.94% is archived in the recognition process.
Bárbara Maria Giaccom Ribeiro et al. [15] presented a
C4.5 algorithm. Data mining tools can increase the potential
for the analysis of remote sensing data. Here there are two
classification method has two steps are top-down and bottom-
up [16]. This algorithm removes needless nodes over the
pruning procedure, producing the shortest tree possible. The
overall accuracy from 65-70 % to 85-90% is achieved in this
image classification. The performance of this method is
calculated based on its sensitivity, classification accuracy and
specificity.
Thanh-Nghi Do et al. [17] proposed a Multi – Class
Random Forest - Oblique Decision Trees (MCRF-ODT)
(CART). In this algorithm to find fingerprint identification is
one of the most familiar technique for person identification.
but their output is challenging for humans to interpret [18].
This work to concentrate fingerprint matching which computes
a match score between two fingerprint and fingerprint
classification which assigns fingerprint into one of the
predefined classes Scale Invariant Feature Transform( SIFT)
technique has established very good qualities to represent
images. The proposed algorithm MCRF-ODT shows the
95.89% accuracy in image classification.
Qiang Yu et al. [19] presented a spiking neural
network model. In this paper presents a spiking neural network
of leaky integrate-and-free neurons for pattern recognition.
Spiking neural network (SNN) is reading data into and out of
them, which involves proper encoding and decoding methods
[20]. The dataset is split into two sets and classified used two-
fold cross validation. The main aspects of in this study
considering machine learning as main target. The proposed
approach is benchmarked using the Iris dataset problem, and
the results highlight. Finally the classification accuracy for this
data set 92.55% to be addressed
Begum Demir et al. [21] cultivated to combine standard
SVM with a hierarchical approach to increase SVM
classification accuracy as well as reduce computational load of
SVM testing. In this method support vector machine is applied
for conservative to the unique data to obtain vector of all
classes. The testing classification of SVM is applied to
hyperspectral data. It is the best method in data mining,
especially in text mining. This algorithm provides improved
classification accuracy as well as reduced SVM classification
time. Experimental results show proposed algorithm
significantly improves conventional SVM classification
accuracy and reduce the computational time of testing. This
method shows 97.15% accuracy in image classification.
III. COMPARATIVE STUDY
In this segment, testing datasets and Experimental results
and the evaluation of results for comparison of these
algorithms are to be discussed.
 IEEE Sponsored 2nd International Conference on Innovations in Information Embedded and Communication Systems
ICIIECS’15
A. Data Set
To find an image classification accuracy different data sets
are used to predict classification accuracy. The used data sets
are shown in table 1.
B. Image Classification
Image classification to the task of removing information
classes from a multiband raster image. It is a critical, but a vital
task for many applications occasionally it is very hard to
identify an object in an image. Particularly when it covers,
noise, Background mess or bad excellence. Image
classification is an important field of research in computer
vision. Many researchers apply different style for image
classification such as segmentation, clustering and some
machine learning methodology for the classification of image.
Data Set: The collected data sets are applied in
preprocessing technique.
Pre - processing: Preprocessing is a process of input and
output data that is used to reduce the unwanted noisy data.
Feature Selection: In machine learning technique feature Fig. 1. Example of a figure caption.
selection is a process of selecting relevant features for model
construction.
C. Artificial Neural Network
Data Selected for Training: Testing the input dataset is
divided into training image set and testing image set. Selection The main aim of this concept to make the ANN iteration-
of the exact attributes which best relationships the pattern. free which eventually improves the convergence rate besides
Data Selected for Testing: The classifiers are trained with yielding accurate results. ANN is one of the significant AI
the training images and the classification accuracy only with Techniques which are broadly used for medical image
the test images. Originally the experimental results of the classification. The purpose of feature mining is to reduce the
classification accuracy are analyzed followed by an extensive original data set by calculating certain properties or features
analysis of the merging rate and the computational complexity. that differentiate one input pattern from another pattern [23].
Classification Process: Image classification is a task of The ANN is a computational model based on the functions and
extracting the valuable information. The determination of the structural neural network [24]. This proposed method to reduce
image classification process is to classify the all images based the drawback of the iterative nature of the conventional neural
on the pixels. networks for high accuracy is rejected in this work. This
Output: The output performance measures calculated by method shows the overall classification accuracy of modified
classification accuracy, sensitivity, & specificity. Generally the counter propagation neural network got 98% accuracy,
formulae for calculating particular performance measures are sensitivity 0.95 and specificity 0.98. Convergence time period
given by: (CPU sec) 4-5 seconds.
TP + TN D. K- Means Algorithm
Classification Accuracy (CA) =
K-means algorithm is a machine learning method for the
(TP + TN + FP + FN)
automated qualification of clinically important colors in
Sensitivity = TP / TP + FN
dermoscopic images. The objective of KM is to partition X into
K thorough and mutually exclusive clusters by reducing the
Specificity = TN /TN + FP sum of squared error. This algorithm is used to decrease the
sum of color in a dermoscopic image using KM. The proposed
Finally Classification Measure the quality method produced a sensitivity of 62% a specificity of 76% and
Usually the Accuracy Measure is used an overall accuracy value of 72% to be addressed.
No of Correctly Classified record E. Adaboost
Accuracy = The Adaboost classifier, more appropriate for real time
Total Records in the test set applications, using less features can be built. The selected
AdaBoost classifiers can improve the classification accuracy as
Process of Image Classification: well as reducing processing time and performed reliably better
The classification steps will be made according to the for pecan defect classification. This method to overcome
following steps which shown in figure 1. Various image limitations of the of water flow technique. The advantages of
classification approaches are defined briefly: AdaBoost include less memory and computation necessities.
 IEEE Sponsored 2nd International Conference on Innovations in Information Embedded and Communication Systems
ICIIECS’15
The real Adaboost algorithm gives minor error rates than the
diverse AdaBoost. In this work achieve an image classification
accuracy of 92.5% (approximately) the testing error of the star
AdaBoost increased as the accuracy parameter.
IV. RESULT AND DISCUSSIONS
This Comparison Study Propose classification accuracy of
the Artificial Neural Network, K-Means, AdaBoost Algorithm.
From this study artificial neural network gives the higher
accuracy to compare with other two algorithms. The Artificial
Neural Network correctly classified instances in 98% and
Incorrectly Classified Instances in 2% and the processing time
predict 4-5 seconds. Neural network gives a Sensitivity ratio
0.95% and Specificity 0.98% predict the value of testing test
data samples. In this study, the data mining algorithms are
taken for this review such as Artificial Neural Network (ANN),
K-Means & AdaBoost algorithm. From this study ANN shows
a better accuracy in image classification when compared with
other data mining algorithms. The performance of data mining
algorithms in image classification is shown in following table I.
Fig. 2. Example of a figure caption.
TABLE I. PERFORMANCE TABLE
Figure 3 describes performance of k-means algorithm,
Adaboost and artificial neural network. The performance of
Tab
le 1
Description of the Methods this algorithms are calculated by based on processing time.

Correct Incorre
ly ctly Proc
S. Algorit Dataset Classifi Classifi essin Sensi Speci
No hms s ed ed g tivity ficity
Instanc Instanc Time
es in % es in %

Brain
4-5 0.95 0.98
1 ANN Tumor 98% 2%
sec % %
Image

Dermo
K- 1-2
2 scopy 72% 28% 62% 76%
Means sec
Image

Adabo X-ray (10-

3 92.2% 7.8% 6 - -
ost Images )sec
Fig. 3. Example of a figure caption.

From table I the limitation of artificial neural network to V. CONCLUSION

depend on iterations and do not have the assistance of target
class. The limitation of k-means algorithm is to provide the
highest error signal. The limitation of adaboost method is lower
than the naïve bayesian method. The performance of artificial
neural network, k- means algorithm and Adaboost algorithms
are shown in figure 2. The performance of above algorithms
are calculated by based on its classification accuracy.
This review is aimed to analysis the performance of
artificial neural network, adaboost and naïve bayes algorithm
for image classification which is analyzed based on
classification accuracy, processing time, sensitivity and
specificity. From this study Artificial Neural network shows
98% classification accuracy, 0.95% sensitivity and 0.98%
specificity when compared with K-Means and Adaboost
algorithms. The Artificial Neural Network shows highest
 IEEE Sponsored 2nd International Conference on Innovations in Information Embedded and Communication Systems
ICIIECS’15
accuracy in image classification. It also provides the better [12] Hye Y P, Tomoko O, “Singularity and slow convergence of the
sensitivity and specificity accuracy. Hence, we suggest that
Artificial Neural Network is the one essential algorithms in
image classification. Based on this review artificial neural [13] Ravi Babu U, Venkateswarlu Y, Aneel Kumar Chintha,
network takes long processing time to provide classification
accuracy. It is also measured to make a study of reducing the
processing time using back propagation neural network.
REFERENCES
[1] Bhuvaneswari C, Aruna P, Loganathan D, “A new fusion model
for classification of the lung diseases using genetic algorithm”
Elsevier, Egyptain informatics journal Volume: 15, Issue: 2 pp
69-77, 2014.
[2] Kalender WA, “computed tomography: fundamentals, system
technology, image quality, applications”. 3rd ed. Erlangen:
publics publishing, 2011.
[3] Mathanker S.K, Weckler P.R, Bowser T.J, Wang N, Maness
N.O, “AdaBoost classifiers for pecan defect classification”
Elsevier, computers and electronics in Agriculture, volume: 77,
Issue: 1 pp 60-68, 2011.
[4] Vezhnevets, A. 2006. “GML AdaBoost MATLAB Toolbox
Available” at: <http:// research.graphicon.ru>. Accessed on 2
October, Elsevier, 2009.
[5] Ahmad Taher Azar, Shaimaa Ahmed EI-Said, “Performance
analysis of support vector machines classifiers in breast cancer
mammography recognition”, Springer, Volume: 24, Issue: 5 pp
1163-1177, 2014.
[6] Mangasarian OL “Generalized spport vector machine”. In
Smola A, Bartlett P, Scholkopf B, Schuurmans D (eds)
Advances in large margin classifiers. MIT press, Cambridge, pp
135-146, 2000.
[7] Yudong Zhang, Shuihua Wang, Genlin Ji, Preetha Phillips, “
Fruit classification using computer vision and feedforward
neural network”, Elsevier, journal of food Engineering, Volume
: 143, pp 167-177, 2014.
[8] Amiri, Z.R., Khandelwal, P, Aruna, B.R, Sahebjamnia, N,
“Optimization of process parameters for preparation of synbiotic
acidophilus milk via selected probiotics and prebiotics using
artificial neural network”. Elsevier, J. Biotechnology, Volume:
136, Pages S460, 2008.
[9] Zhang, Y., Wu, L., Wei, G., Wang, S., “A novel algorithm for
all pairs shortest path problem based on matrix multiplication
and pulse coupled neural network”. Digit. Signal Process,
Elsevier, and Volume: 21, Issue: 4, pp 517-521, 2011.
[10] Emre Celebi M, Senior Member, IEEE, and Azaria Zornberg,
“Automated Quantification of Clinically Significant Colors in
Dermoscopy Images and Its Application to Skin Lesion
Classification”, Springer, Volume: 8, Issue: 3, pp 980-984,
2014.
[11] YANG HongLei, PENG JunHuan, XIA BaiRu & ZHANG Ding
Xuan, “An Improved EM algorithm for remote sensing image
classification”, Springer, Chinese science Bulletin Volume: 58,
Issue. 9, pp 1060-1071, 2013.
EM algorithm for gaussian mixtures”, Springer, Neural Process
Lett, and Volume: 29, Issue: 1, pp 45-59, 2009.
“Handwritten Digit Recgnition using K-Nearest Neighbout
Classifier”, IEEE, World Congress on Computing and
Communication Technologies, pp 60-65, 2014.
[14] Dhandra B.V, Benne R.G, Mallikarjun Hangarge, “ Handwritten
kannada Numeral Recognition Based on Structural Features”,
Int. conference on Computational Intelligence and multimedia
Applications, pp 224-228, 2007.
[15] Barbara Maria Giaccom Ribeiro, Leila Maria Garcia Fonseca,
“Urban Land Cover Classification using WorldView-2 Images
and C4.5 Algorithm”, IEEE, pp 21-23, 2013.
[16] Costa G. A. O. P, Pinho C. M. D, Feitosa R. O, Kux H. J. H,
Almeida C. M, Fonseca M. G, Oliveira D, “ InterImage: an open
source paltform for automatic image interpretations”. In:
Proceedings of II Simposio Brasileiro de Gematica and V
Coloquio Brasileiro de Ciencias Geodesicas , Presidente
Prudente, Brazil, IEEE, pp 735-739, 2007.
[17] Thanh-Nghi Do, Philippe Lenca, Stephane Lallich, “Classifying
many-class high – dimensional fingerprint datasets uing random
forest of oblique decision trees”, Springer, Vietnam Journal of
Computer Science Volume 2, Issue 1, pp 3-12, 2015.
[18] Caruana R, Karampatziakis N, Yessenalina A, “An empirical
evaluation of supervised learning in high dimensions.” In:
Proceedings of the 25th International Conference on Machine
Learning, Springer, and pp 96-103, 2008.
[19] Qiang Yu, Huajin Tang, Key Chen Tan, Haoyong Yu, “ A brain
inspired spiking neural network model with temporal encoding
and learning”, Elsevier, Neurocomputing 138, pp 3-13, 2014.
[20] Jonson C, Venayagamoorthy G.K. “Encoding real values into
polychronous spiking networks, in: IJCNN, Elsevier, pp1-7, and
2010.
[21] Begum Demir, and Sarp Erturk, “Improving SVM Classification
Accuracy using a Hierarchical approach for Hyperspectral
Images “, 16th IEEE International Conference on Image
Processing (ICIP), ISSN 1522-4880, pp 2849-2852, 2009.
[22] D. Jude Hemanth, C. Kezi Selva Vijila, A. Immanual
Selvakumar, J. Anitha, “Performance Improved Iteration – Free
Artificial Neural Networks for Abnormal Magnetic Resonance
Brain Image Classification”, Elsevier, pp 98-107 see front
metter 2013.
[23] MJ Nassiri, A Vafaei, A Monadjemi, “Texture feature extraction
using Slant-Hadamard transform, world Academy of Science”,
Engineering & Technology Elsevier, Volume: 17, pp 40-44,
2006.
[24] Dr. M. Durairaj, P. Thamilselvan, “Applications of Artificial
Neural Networks for IVF data Analysis and Prediction”, Journal
of Engineering, Computers and Applied Sciences (JEC and AS)
ISSN No. 2319-5606, Volume 2, No. 9, pp, 11-15, 2013.