Self Generated Fuzzy Membership Function Using

International Journal of Latest Trends in Engineering and Technology (IJLTET)
Self generated fuzzy membership function using ANN clustering technique

Shruti S. Jamsandekar
Department of Computer Studies, SIBER, Kolhapur. (MS), India-416004
Ravindra R. Mudholkar
Department of Electronics Shivaji University, Kolhapur, (MS), India-416004
Abstract: In this paper we have proposed a method for self generating the membership functions using semi unsupervised learning method, We have tried to combine trapezoidal and triangular membership function and generate it by neural network clustering technique. Clustering of underlying data to obtain the cluster with cluster centers. These cluster centers are used to formulate membership function centers. The overlapping membership function end vertex are formulated by approximating boundary values of each cluster obtained. An fuzzy Inference system is created based on membership function generated for classification problem Keywords: fuzzy classification, clustering, neural network membership function
I.
INTRODUCTION
Fuzzy classification systems can be used to deal with classification problems. Todevelop a fuzzy classification system, the most important task is to construct membershipfunctions and to find a set of suitable fuzzy rules in the fuzzy classification system. Thereare two approaches to generate fuzzy membership functions andfuzzy rules. Expert knowledge and data driven, these approaches correspond to either manual or automatically through a machine learning process based on training instances respectively .using expert knowledge can be advantages as it has link with domain knowledge but it can be too subjective with different experts generating different membership functions and rules for same application. Alternatively automatic generation of fuzzy membership functions based on data will convert crisp data into linguistic terms. Most previous attempts in automatic generation of fuzzy membership functions have used evolutionary and statistical methods [1, 3,4,7,11].In this paper, we present a new method for constructing membership functions using semi supervised clustering technique, based on cluster centers and approximation of boundary values of each cluster obtain, we tried to present an data driven approach to generate membership function by clustering algorithm for creation of if then fuzzy classification system to deal with student semester examination data. The rest of this paper is organized as follows. In Section II related work in related field is reviewed. In section III, we briefly review of basic concepts of fuzzy setsand the proposed method to construct membership functions based on clustering is explained. In section IV we compare the experimental results of the proposed method with the existing methods. The conclusions are discussed in Section V. II. RELATED WORK [1] proposed a framework for automatic generation of fuzzy membership functions and fuzzy rules from training data,.The approach is based on finding the near optimal fuzzy membership functions through an optimization process using genetic algorithm In [2] authors have proposed an approach to deal with the classification problem using fuzzy logic,to show how fuzzy logic introduces new elements in the identification process. In [3] use the concept of Interval-Valued Fuzzy Set to deal with the problem of degree of uncertainty in the definition of the fuzzy partitions .and to show the improvement in the performance of linguistic Fuzzy Rule-Based
Special Issue - IDEAS-2013
142
ISSN: 2278-621X
Classification Systems afterward the application of a cooperative tuning methodology between the tuning of the amplitude of the support and the lateral tuning(based on the 2-tuples fuzzy linguistic model) applied to the linguistic labels modeled with Interval-Valued Fuzzy Sets. Roberto R.F. Mendes et.al in [4] proposes a co-evolutionary system for discovering fuzzy classification rules. The system uses two evolutionary algorithms: a genetic programming(GP) algorithm evolving a population of fuzzy rule sets and a simple evolutionary algorithm evolving a population of membership function definitions. The two populations co-evolve, so that the final result of the co-evolutionary process is a fuzzy rule set and a set of membership function definitions which are well adapted to each other. [5] proposed a new scheme to generate fuzzy membership functions with unsupervised learning using selforganizing feature map. [6] Proposed a fuzzy error backpropogation algorithm based on standard BP algorithm with multilayer neural network to learn fuzzy sets and also learn fuzzy rules by reducing hidden neurons from the network. Shyi-Ming Chen et.al [7] proposed a new method to construct membership function for Iris data classification problem by generating fuzzy rules from training instances based on the correlation coefficient threshold value, the boundary shift value and the center shift value. [8] They proposed an idea of using numerical data for generation and reduction fuzzy rules and adjustment of membership function, generated fuzzy rule base using Mendel & Wang method and compute the degree of similarity between each rule for candidate rule selection, used absolute value of the distance between numerical data to compare with base intersection distance of the membership function.[9] Mehmet kaya et.al proposed a clustering approach to solve the problem of interval partitioning to construct and optimize fuzzy membership based on Genetic algorithm . [10] Jonathan M et.al presented a case study in which the introduction of vagueness or uncertainty into the membership functions of a fuzzy system was investigated in order to model the variation exhibited by experts in a medical decision-making context. Xi Che[11] presented a method by combining the recursive least-squares algorithm and membership to overcome the shortcoming of traditional linear regression used in parameter estimation.Bai and Chen [12] presented a new method for evaluating students learning achievement using Fuzzy Membership Functions and Fuzzy Rules. Ma and Zhou [13] presented a Fuzzy Set approach to the assessment of student centered learning.Khairul A. Rasmani and QiangShen [14] have presented a fuzzy rule-based approach for aggregation of student academic performance. The membership values produced by this method were more meaningful compared to the values produced by statistical standardized-score.Oyelade, O. J et.al [15] proposed a method for analyzing students results based on cluster analysis and uses standard statistical algorithms to arrange their scores data according to the level of their performance implemented k-means clustering algorithm for analyzing studentsresult data. III. NEW METHOD TO GENERATE MEMBERSHIP FUNCTIONS BASED ON CLUSTERING A. Overview of Fuzzy logic A fuzzy set A in a universe of discourse X is defined as the following set pairs (1) Where, A (x) :X [0,1] is a mapping called the membership function of fuzzy set A and A (x)is called the degree of belongingness or membership value or degree of membership of x X in the fuzzy set A. wewrite (1) in the following form: (2) For brevity, however, we often equate fuzzy sets with their membership functions i.e. instead of a fuzzy set A characterized by A (x) we will often say fuzzy sets A [4, 8]. Example: Suppose X = {6, 2, 0, 4}. A fuzzy set of X may be given by A = {0.2/6, 1/2, 0.8/0, 0.1/4}. Construction of membership function is based on the system design data and choice of the suitable shape. There are many shapes of membership functions. However, the application context dictates the choice of the suitable shape. For the problem domain addressed in this study, system components have maximum and minimum value that cannot be exceeded. Therefore, any candidate membership function shape should have two extreme bounds with zero and hundred as range values . Triangular and trapezoidal shapes are the simplest MF shapes that meet this requirement.
143
ISSN: 2278-621X
The membership function of the triangularfuzzy set A can be represented by a triple (b; c; a), where \c" is called the center of thetriangular fuzzy set A; \b" is called the left vertex of the triangular fuzzy set A; \a" iscalled the right vertex of the triangular fuzzy set A.
The membership function of the trapezoidal fuzzy set can be represented by a function of a vector, x, and depends on four scalar parameters a, b, c, and d, as given by
Figure 2. Trapezoidal Membership Function
(4) B. Proposed work-
144
ISSN: 2278-621X
The type of membership functions we use in this paper is the triangularand trapezoidal membership function as shown in Figure.1 and Figure.2 respectively . The extreme ends membership functions are trapezoidal and inner membership function are triangular . The construction of triangular membership functions are based on the cluster the data. Referring to Figure.1c ie the center of triangular fuzzy set is calculated based on cluster centers C. The steps carried out to construct membership functions for input variables are as follows1. 2. Clustering is done on student examination data and cluster centers are found . Clustering algorithm used is neural network clustering technique based on SOM,for each subject marks to form 3 cluster based on weight vector obtained . The three cluster center are formed based on mean average method and forms the centers of 3 inner triangular fuzzy membership function The left and right vertex of each of the triangular fuzzy membership function referring to Figure 1. b and a are calculated as follows. 3.1 Find maximum and minimum data value of each cluster formed from weight vectors 3.2 Approximated the maximum by 10% increase to form right vertex of the membership function and minimum by 10% decrease to form the left vertex of the membership function, this is done for overlapping the membership functions. The two extreme end trapezoidal membership functions are constructed as follows 4.1 First extreme membership function according to figure 2 a, b with zero value and c and d is calculated c= Min( Minimum of each clusters) (0.1 * Min( Minimum of each clusters) ) d = Min( Minimum of each clusters) + (0.15 * Min( Minimum of each clusters) ) 4.2 second extreme membership function according to figure 2 c, d with 100 value and a and b is calculated a = max(maximum of each cluster) (0.1 * Max( maximum of each clusters) ) b= max(maximum of each cluster) + (0.05 * Max( maximum of each clusters) )
3.
4.
D. The steps carried out to construct membership functions for output variables are as follows1. The output variable also comprises of 5 membership functions same as input variable the range for triangular membership function is calculated as follows 2. Average of centers of first cluster, second cluster and third cluster for all input variables to form the centers of three triangular membership function respectively 3. To find left and right vertex of 3 triangular membership for output variable 3.1 Left vertex of each of the 3 triangular membership function is Average of minimum Offirst cluster, second cluster and third cluster for input variable(calculated in step 3.1 of input variable) respectively 3.2 To find Right vertex of each of the 3 triangular membership function is Average of maximum of first cluster, second cluster and third cluster for input variable (calculated in step 3.1 of input variable) respectively. 4. The two extreme end trapezoidal membership functions are selected based as follows 4.1 First extreme membership function according to figure 2 a, b with zero value and c and d is c= 20 and d= 35 (as per passing criteria since the domain data is student examination marks ) 4.2Second extreme membership function according to figure 2 c, d with 100 value and a and b is calculated a = max(maximum of each cluster) (0.1 * Max( maximum of each clusters) ) b= max(maximum of each cluster) + (0.05 * Max( maximum of each clusters) )
145
ISSN: 2278-621X
IV. ILLUSTRATION OF PROPOSED METHOD AND EXPERIMENTAL RESULTS The experiment is carried using matlab fuzzy tool and neural network clustering tool. Comparision of the experimental results of the proposed method with the existing methods A. To illustrate the method proposed 1. Accept the student examination data. Student data set for two subject marks in semester exam is shown in Appendix A 2. Clustering the student data using neural network clustering algorithm 2.1 The cluster center for subject 1 data are center of three triangular membership functions of input variable 1 55.26 39.50 71.66
2.2 The cluster center for subject 2data are center of three triangular membership functions of input variable 2 60.95 48.47 28.66
3. The left and right vertex of the 3 triangular membership function 3.1 The maximum and minimum for subject 1 Max 46 63 81 Min 29 48 65
The maximum and minimum for subject 2
Max 36 53 81
Min 20 43 56
3.2 Approximate values calculated for overlapping of membership Left and right vertex of the 3 triangular membership function for input 1
50.6
26.1
146
ISSN: 2278-621X
69.3 89.1
43.2 58.5
Left and right vertex of the 3 triangular membership function for input 2
The following is the membership function generated of input1, input2 variablesfor subject1 and subject 2 respectively using steps of section III
39.6 58.3 89.1

1 very low low
18 38.7 50.4
medium high very high
very low
low
medium
high
very high
0.8
0.8
Degree of membership
0.6
0.6
0.4
0.4
0.2
0.2
0 0 10 20 30 40 50 60 sub1marks 70 80 90 100
0 0 10 20 30 40 50 60 sub2marks 70 80 90 100
(a) The following is the membership function generated classification using steps of section III
(b) for output variables of fuzzy inference system for
147
ISSN: 2278-621X
poor 1
belowavg
avg
aboveavg
good
0.8
0.6
0.4
0.2
0 0 10 20 30 40 50 class 60 70 80 90 100
(c) 3.3 The rule base list for Inference created Input 1 variable value 1 1 1 1 1 2 2 2 2 2 3 3 3 3 4 4 \4 4 4 5 5 5 5 5 5 Input 2 variabe vale 1 2 3 4 5 1 2 2 4 5 1 2 3 4 1 2 3 4 5 1 2 3 3 4 5 Output Weight variable value 1 1 2 1 2 1 3 1 3 1 1 1 2 1 3 1 3 1 4 1 2 1 3 1 3 1 4 1 2 1 2 1 3 1 4 1 5 1 2 1 2 1 3 1 3 1 4 1 5 1 Table 1: Rule List Connection (AND/OR ) 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
B. Experimental Results Snapshot of results obtained by proposed Fuzzy Classification based on Membership function generated by ANN Clustering (FCMANNC) and Fuzzy classification based on membership function constructed using expert domain knowledge. The detail result in shown in Appendix B
148
ISSN: 2278-621X
(a) V CONCLUSION The paper describes a new method of fuzzy classification with membership function generated using semi supervised clustering approach . The method was experimented on student examination data ,when the results in Appendix B are observed the subject values in lower range of 20-30 and higher range of 70-80 in Appendix A, a variations in outcome is seen between the class values that are created based on the fuzzy membership function based on domain expert knowledge and proposed self generated membership functions method for classification. For all middle range values the class values obtained are similar for both the compared methods. REFERENCES
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] MasoudMakrehchia, Mohamed S. Kamelb, An information theoretic approach to generating fuzzy hypercubes for if-then classifiers, Journal of Intelligent & Fuzzy Systems vol. no 22pp: 3352 (2011) Dinesh P.Pitambare, PravinM.Kamde, Fuzzy Classification System for Glass Data Classification, International Journal of Engineering Research (ISSN : 2319-6890)Volume No.2, Issue No.2, pp : 33-37 01 April 2013 J. Sanz, et.al, A Genetic Algorithm for Tuning Fuzzy Rule-Based Classification Systems with Interval-Valued Fuzzy Sets WCCI 2010 IEEE World Congress on Computational Intelligence July, 18-23, 2010 - CCIB, Barcelona, Spain Roberto R.F. Mendes et.al Discovering Fuzzy Classification Rules with Genetic Programming and Co-evolution , LNAI 2168, pp. 314325, Springer-Verlag Berlin Heidelberg 2001 Chih-Chung Yang, N.K. Bose ,Generating fuzzy membership function with self-organizing feature map, Elsevier, Pattern Recognition Letters 27 356365 (2006) DetlefNauck, Rudolf Kruse, Fuzzy NeuralNetwork learning Fuzzy Control Rules and Membership functions by Fuzzy Error Backpropagation,IEEEInt.Conf on Neural Network ICNN 93,san Francisco 1022-1027 Apr 1993 Shyi-Ming Chen Fu-Ming Tsai, A New Method to Construct Membership Functions and Generate Fuzzy Rules from Training Instances,Journal of Information and Management SciencesVolume 16, Number 2, pp. 47-72, 2005 RaoufKetata, HatemBellaaj, Mohamed Chtourou, Mohamed Ben Amer, Adjustment Of Membership Functions, Generation And Reduction Of Fuzzy Rule Base From Numerical Data, Malaysian Journal of Computer Science, Vol. 20(2), pp. 147 169 2007 Mehmet Kaya, RedaAlhajj Utilizing Genetic Algorithms to Optimize Membership Functions for Fuzzy Weighted Association Rules Mining,Applied Intelligence, Springer Science and Business Media vol. 24, pp:715, 2006. Jonathan M. Garibaldi and TurhanOzen, Uncertain Fuzzy Reasoning: A Case Study in Modelling Expert Decision Making,IEEE Transactions On Fuzzy Systems, Vol. 15, No. 1, February 2007 Xi Che,Recursive Least-Squares Method With Membership Functions, Proceedings of the Third International Conference on Machine Learning and Cybernetics, Shanghai, 26-29 August 2004 S. M. Bai and S. M. Chen, "Evaluating students' learning achievement using fuzzy membership functions and fuzzy rules," IEEE Expert Systems with Applications, vol. 34, no. 1, pp. 399-410, 2008. J. Ma and D. Zhou, "Fuzzy set approach to the assessment of student-centered learning," IEEE Transactions on Education, vol. 43, no. 2, pp. 237-241, 2000. Khairul A. Rasmani and QiangShen, Data-Driven Fuzzy Rule Generation and its Application for Student Academic Performance Evaluation, Journal on Applied Intelligence, vol. No.25,pp.305-319, 2006
149
ISSN: 2278-621X
[15] Oyelade, O. J, Oladipupo, O. O, Obagbuwa, I. C, Application of k-Means Clustering algorithm forprediction of Students Academic Performance,(IJCSIS) International Journal of Computer Science and Information Security,Vol. 7, No. 1,pp: 292-295, 2010
APPENDIX A Seat no 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 Subject 1 58 58 51 53 46 49 54 55 59 61 54 57 70 56 58 29 48 58 51 34 73 49 76 53 46 45 59 45 60 55 57 81 72 61 30 63 Subject 2 60 52 49 50 51 47 56 59 52 67 57 58 71 60 53 20 32 60 36 24 81 56 62 59 52 45 60 48 52 56 49 71 64 56 31 57
150
ISSN: 2278-621X
37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
65 54 70 50 58 61 50 50 41 54 73 58 65 51 56
47 44 57 43 57 60 50 44 44 59 60 45 51 29 50
APPENDIX B
Seat no 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21
Fuzzy class using FCMC 69.62347309 69.62347309 55.18495127 61.00549807 40.73463047 47.38790839 63.05024746 64.80762548 70.15167421 70.38158258 63.05024746 67.98971257 70.23469398 66.41664216 69.62347309 33.6341888 44.98225048 69.62347309 55.18495127 33.68989073 70.41632333
Fuzzy class using expert domain 69.41016566 69.41016566 54.1697685 61.01374256 36.20670391 44.875 63.32084691 65.2206443 70.56240231 72.85905554 63.32084691 68.19705015 85.08755154 66.78798403 69.41016566 13.83333333 41.21428571 69.41016566 54.1697685 20.1010453 85.1147541
151
ISSN: 2278-621X
22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
47.38790839 70.61907508 61.00549807 40.73463047 38.52894557 70.15167421 38.52894557 70.26044891 64.80762548 67.98971257 72.87273016 70.35233429 70.38158258 33.65781565 70.66148531 70.56933154 63.05024746 70.23469398 50.23745353 69.62347309 70.38158258 50.23745353 50.23745353 33.62465554 63.05024746 70.41632333 69.62347309 70.56933154 55.18495127 66.41664216
44.875 85.1147541 61.01374256 36.20670391 34.38131313 70.56240231 34.38131313 71.58372067 65.2206443 68.19705015 85.1147541 85.1147541 72.85905554 13.83333333 75.40150129 78.05734074 63.32084691 85.08755154 50 69.41016566 72.85905554 50 50 29.21682243 63.32084691 85.1147541 69.41016566 78.05734074 54.1697685 66.78798403
152
ISSN: 2278-621X

Self Generated Fuzzy Membership Function Using

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Self Generated Fuzzy Membership Function Using

Hochgeladen von

Copyright:

Verfügbare Formate

International Journal of Latest Trends in Engineering and Technology (IJLTET)