Available online at www.sciencedirect.

com

Expert Systems with Applications

Expert Systems with Applications 36 (2009) 21872199 www.elsevier.com/locate/eswa

Application of WignerVille distribution and probability neural network for scooter engine fault diagnosis
Jian-Da Wu *, Peng-Hsin Chiang
Graduate Institute of Vehicle Engineering, National Changhua University of Education, 1 Jin-De Road, Changhua City, Changhua 500, Taiwan, ROC

Abstract An expert system for internal combustion engine fault diagnosis using WignerVille distribution for feature extraction and probability neural network for fault classication is described in this paper. Most of the conventional techniques for fault signal analysis in a mechanical system are based chiey on the dierence of signal amplitude in the time and frequency domains. Unfortunately, in some conditions the performance is limited, such as when analysis signals are non-stationary. In the present study, the WignerVille distribution is proposed for sound emission signal features classication, because it provides high resolution of instantaneous energy density both in time and frequency domains. Meanwhile, the instantaneous power spectrum is presented to obtain high-energy density when the engine fault condition occurs. These features of signals are classied using the probability neural network. To examine the eciency of the probability neural network, both back-propagation and radial basis function neural networks are used in comparison with fault classication. The experimental results showed all three networks can achieve high recognition rate with feature extraction using WignerVille distribution method. It also suggested the probability neural network can complete training in an extremely short time. 2008 Elsevier Ltd. All rights reserved.
Keywords: Fault diagnosis system; Feature extraction; WignerVille distribution; Neural network; Probability neural network

1. Introduction Road vehicles have gradually become indispensable transportation in peoples daily life. The safety and stability of road vehicles has received much attention in recent years. One of the most important road vehicle parts is the vehicle engine, which produces and controls the power for a vehicle. Therefore, monitoring vehicle engine condition is important. The advanced faults diagnosis system can prevent serious damage, so the fault diagnosis system has developed a large amount lately. Formerly, the vehicle faults diagnosis depended on the experience of the technician but the conventional method is not a precise approach because of personal subjectivity. It obviously shows the conventional method is a time-consuming and personnel wasting approach. An ecient and precise faults diagnosis system is set up by automatic and complete computer system.
*

Corresponding author. E-mail address: jdwu@cc.ncue.edu.tw (J.-D. Wu).

The feature extraction from the sound emission signal is one of the important procedures for engine fault diagnosis. In the past, Fourier analysis could present the signal characters in frequency domain but could not show variation of signal characteristic in the time domain. Although short time Fourier transform overcomes the above-mentioned problem that can process signals with a timefrequency window (Baydar & Ball, 2001). Unfortunately, short time Fourier transform cannot describe the instantaneous energy density spectrum of signals. The WignerVille distribution is an acceptable algorithm that can improve the problem and has been widely applied in energy-based features extraction in the timefrequency domain (He, 1998; Loutridis, 2006; Staszewski, Worden, & Tomlinson, 1997). In the present study, WignerVille distribution is used for the sound emission feature extraction in an internal combustion engine fault diagnosis system. The energy density is clearly presented in both the time and frequency domain with WignerVille distribution and the vital features will be extracted from the instantaneous energy density spectrum.

0957-4174/$ - see front matter 2008 Elsevier Ltd. All rights reserved. doi:10.1016/j.eswa.2007.12.012

2188

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

Input data

Results

Input Layer

Hidden Layer

Output Layer

Fig. 1. Architecture of probability neural network.

Research interest in mechanical fault diagnosis using sound emission analysis has developed in the last few decades. In the procedure of data analysis, several algorithms were applied in the fault diagnosis expert system such as the genetic algorithm (Wen & Chang, 1998), fuzzy logic (Ebrahim, 2001) and articial neural networks (Kong & lmez & Dokur, 2003; Yang, Han, & An, Chen, 2004; O 2004). In this study, articial neural network is taken as the classier for the present faults diagnosis system. In the fault classication, three neural networks are used; they are the back-propagation neural network, radial basis function neural network and probability neural network. Among these networks, back-propagation network is the most popular multi-layer perception in an expert system but there are several defects like network structure, local minimum and long training time which limit the network performance (Parvoti & Anandarajan, 2002). Although many improved structures for the back-propagation network have been developed, their eects were restricted. Meanwhile, radial basis function network oers a more ecient training approach that can automatically organize its architecture in the training procedure and its training procedure does not require iteration calculation (Lai, Peter, Zhang, & Shi, 2004; Looney, 2002). Even though radial basis function does not need iteration calculation, the network requires much memory in the training procedure. However, the probability network only needs one training epoch to complete its training procedure. It means the probability network can accomplish convergence in an extremely short time and the network does not have the problem of back-propagation network structure (Cang & Yu, 2005; Hajmeer & Basheer, 2002; Karthikeyan, Gopal, & Vimala, 2005; Rutkowski, 2004).

2. Principle of WignerVille distribution for sound emission signal In this section, the features of sound emission signal are present by using WignerVille distribution. They are used as the inputs of neural networks for training and fault classication. The WignerVille distribution provides a high resolution of instantaneous energy density both in time and frequency domains. For a signal x(t), the denition of WVD is shown as Z 1 xt s=2x t s=2e2pft ds 1 W z t ; f
1

where x*(t) means the complex conjugate of x(t). If x(t) is a real signal, the analytic signal is dened as follows: ~ xt xt jxht t 2

where xht(t) is the Hilbert transform of x(t), which is shown as

Training procedure

Weight value

Network structure

Recall procedure

Recognition result

Fig. 2. Operation procedure of probability neural network.

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

2189

Fiber optical sensor

Engine revolution signal

Testing

Signal extraction (NI DAQ 6024E)

Features extraction (WVD)

Fault diagnosis system (Neural networks)

Micro phone Sound emission signal

Training

Fig. 3. Experimental setup of fault diagnosis system.

Fig. 4. Engine sound emission signal of idle without fault condition. (a) Time domain and (b) WignerVille distribution.

2190

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

Fig. 5. Engine sound emission signal of idle with belt damaged condition. (a) Time domain and (b) WignerVille distribution.

xht t

1 p

x s
1

1 ds ts

The WignerVille distribution results of signal are used as the input of this fault diagnosis system. Obviously, the calculation quality of the system using WignerVille distribution is huge in a practical sound emission application. Therefore, a reprocessing approach is proposed to decrease the computation quantity of diagnosis system; it can be described as Pt2 t1 W z t ; f 4 rf n1 t2 t1 where r(f) stands for the point of time average in Wigner Ville distribution. After reprocessing of WignerVille distribution, the domain of WignerVille distribution data is

lower than a two-dimension data. The values of reprocessing approach will be used as the input to the neural network for training and testing of various neural networks; the principle of proposed neural network will be described in the following section. 3. Fault diagnosis using probability neural network 3.1. Principle of probability neural network The probability neural network (PNN) is a feed-forward neural network with three layers. The architecture of PNN is shown in Fig. 1. The structure of PNN includes one input layer, one hidden layer and one output layer; the output layer contains summation and comparative units. There are several neurons in each layer and these layers are

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

2191

Fig. 6. Engine sound emission signal of idle with intake air leakage condition. (a) Time domain and (b) WignerVille distribution.

connected by weights. The performance of PNN embraces two procedures: training and recall procedure. In the training procedure, PNN utilizes the information of input data to organize network structure and sets weight values. The PNN uses training input data to set up the weights (WIH) between input and hidden layer. When there are m cluster of p training data (Aj) with data length k in the PNN, the denition of WIH is presented as follows: Aj a1 ; a2 ; a3 ; . . . ; ak W IH wij ij ; aj wij 5 where wij is the jth weight value of weight WIH. The PNN will dene the weight among the hidden layer and output layer (WHO) after it establishes WIH. WHO is shown as
t

 wjc

1 0

if the jth sample 2 condition c others

i 1; 2; . . . ; p

if the jth sample and the neuron belong to the same condition c, the weight value is dened as 1 and others are 0. In the recall procedure, the testing data is put into network for classication. At rst, the weight WIH calculates the Euclidean norm (D) of testing and training data. The Euclidean norm equation is described as q X 2 wij ^ xi 7 Dj where ^ xi stands for the testing vector. Then, the Euclidean norm will be sent to the hidden layer for calculating the probability density of each condition. The PNN adopts the Gaussian function as activation function in hidden layer, which is given as

2192

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

Fig. 7. Engine sound emission signal of idle with clutch damaged condition. (a) Time domain and (b) WignerVille distribution.

1 0 q P   2 ^ wij xi Dj A uj exp 2 exp @ 2r2 2r

sity of each condition in the output layer, the criterion is shown as Vc

r X c1 r X Vc 1 P c Pr Pr uj wjc c1 wjc c1 wjc c1

where r is the spread parameter of the Gaussian function, this parameter controls the sensitivity of the Gaussian function. After computing all probabilities of each condition, the weight WHO sends these probabilities to the output layer and estimates the classication result. The output layer contains summation units and comparative units. Summation units assemble all probability densities and transmit them to comparative units for estimating the probability of each condition. Comparative units use winner takes all criterion to compare the probability den-

uj wjc

9 10 11

R Max P c ;

c 1; 2; 3; . . . ; m

where Vc is the input vector of comparative units, Pc denotes the probability of each condition and R stands for the result of comparative units output. Among comparative units, only one unit has the output value 1 with the

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

2193

Fig. 8. Engine sound emission signal of idle with pulley broken condition. (a) Time domain and (b) WignerVille distribution.

maximum probability density, other units are 0. Then, the network will recognize the fault condition according to the result of recall procedure. The operating procedure of PNN is described in Fig. 2. 3.2. Remarks of proposed neural network Back-propagation (BP) neural network is one of the popular multi-layer perceptions and generally be applied in an expert system. Unfortunately, BP network requires iteration calculation in a training procedure that is timeconsuming and has local minimum trouble. Further, the architecture of BP network is another problem. The structure aects the training eciency of network but it is dicult to obtain the ideal structure of BP network.

That demands repeated trial-and-error to get the suitable architecture and it is hard for a beginner. The radial basis function (RBF) network provides a more ecient training approach, which avoids much computation quality and local minimum trouble. Besides, RBF network can automatically establish the ideal network structure in a training procedure. Although the training approach of RBF network does not need a back-propagation procedure, the network still requires a feed-forward procedure that consumes certain time. Moreover, the RBF network demands lots of memory to store all parameters in a training procedure. However, PNN does not need any iteration calculation; it only needs one training epoch to complete training that PNN can be converged with a short time in the training procedure. The PNN can

2194

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

Fig. 9. Reprocess features of WignerVille distribution in idle with various fault conditions. (a) Without fault condition, (b) belt damaged condition, (c) intake air leakage condition, (d) clutch damaged condition and (e) pulley broken condition.

obtain the ideal network structure from the information of training data that PNN does not need use much memory for storing the training parameters. The experimental comparison will be presented in the following section.

4. Experimental investigation of fault diagnosis system In the experimental investigation, the scooter sound emission signals were analyzed to verify the proposed fault diagnosis system as shown in Fig. 3. A scooter with an elec-

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

2195

Fig. 10. Reprocess features of WignerVille distribution in 2000 rpm with various fault conditions. (a) Without fault condition, (b) belt damaged condition, (c) intake air leakage condition, (d) clutch damaged condition and (e) pulley broken condition.

tronic fuel injection system, single-cylinder, four-stroke, 0.125-l internal combustion engine is used in this experiment. The sound emission signals are extracted by the condenser microphone (PCB 130D20) and NI board (DAQ 6024E) with 10 kHz sampling frequency. This experiment comprises ve engine conditions and ve engine rotating

speeds, the ve engine conditions are without fault in engine platform, belt damage, intake air leakage, clutch damaged and pulley broken. The engine rotating speeds are: idle, 2000, 2500, 3000 and 3500 rpm. Each condition of the time domain signal and WignerVille distribution in the idle condition are indicated in Figs. 48.

2196

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

Fig. 11. Reprocess features of WignerVille distribution in 2500 rpm with various fault conditions. (a) Without fault condition, (b) belt damaged condition, (c) intake air leakage condition, (d) clutch damaged condition and (e) pulley broken condition.

In the signal processing, all experiment data are divided into two parts because of the PNN adopting supervised learning. The experiment data are separated into the training and testing part. There are 48 data in each condition, the number of training data is 8 and the testing data is 40. After sound emission extraction, the vital features are extracted by WignerVille distribu-

tion and normalized using Eq. (4). The whole database set is 48 6 of one engine rotating speed condition; as mentioned before, 8 6 data set are taken as training database and others for testing data; all network training vectors are shown in Figs. 913. Obviously, dierent faults in the mechanical system occur with dierent energy in gures. Unfortunately, the conventional inspec-

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

2197

Fig. 12. Reprocess features of WignerVille distribution in 3000 rpm with various fault conditions. (a) Without fault condition, (b) belt damaged condition, (c) intake air leakage condition, (d) clutch damaged condition and (e) pulley broken condition.

tion is not a precise approach for damage diagnosis. In the present study, the energy amplitude gures of scooter sound emission are used for the data bank in the proposed intelligent fault diagnosis system. All recognition rates and training time using dierent network structures

are summarized in Table 1. Although, the result shows the average recognition rates of three networks are over 98%, however, the PNN can complete training in far less than 0.1 s. This means the proposed approach is working and ecient.

2198

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199

Fig. 13. Reprocess features of WignerVille distribution in 3500 rpm with various fault conditions. (a) Without fault condition, (b) belt damaged condition, (c) intake air leakage condition, (d) clutch damaged condition and (e) pulley broken condition.

5. Conclusions In the present study, a prototype of an expert system for fault diagnosis in scooters platform using WignerVille distribution in sound emission signal features classication and faults diagnosis using articial neural network is pre-

sented. The approach improves the conventional method which is performed according to the experience of technicians. The conventional method is not only time-consuming but also a personnel wasting approach. The proposed approach is an automatic and on-line fault diagnosis system that can improve the cost of fault diagnosis system and

J.-D. Wu, P.-H. Chiang / Expert Systems with Applications 36 (2009) 21872199 Table 1 Fault recognition rates using dierent neural network in various engine faults and operation conditions BP Idle Without fault (%) Belt damaged (%) Intake air leakage (%) Clutch damaged (%) Pulley broken (%) Averaged recognition rate (%) Training time (s) 100 97.5 100 97.5 87.5 2000 100 97.5 100 100 95 2500 100 100 95 100 100 98.50 8.109 3000 100 100 97.5 100 100 3500 100 100 100 100 95 RBF Idle 100 92.5 100 100 97.5 2000 100 100 100 100 100 2500 100 97.5 100 100 100 99.40 0.61 3000 100 100 100 100 100 3500 100 97.5 100 100 100 PNN Idle 100 92.5 100 100 97.5 2000 100 100 100 100 100 2500 100 97.5 100 100 100 98.88 0.094 3000 100 100 100 100 100

2199

3500 100 97.5 100 100 100

reduce mistaken recognition. The experimental results show the proposed fault diagnosis system with three dierent neural networks can be eectively used in scooter diagnosis of various faults. However, PNN can accomplish the training procedure in an extremely short time and achieve satisfactory fault recognition rate in the experimental platform. Acknowledgements The work was supported by the National Science Council in Taiwan, Republic of China, under the project number NSC- 96-2622-E-018-001-CC3. References
Baydar, N., & Ball, A. (2001). A comparative study of acoustic and vibrations in detection of gear failures using WignerVille distribution. Mechanical System and Signal Processing, 15(6), 10911107. Cang, S., & Yu, H. (2005). Novel probability neural network. IEEE Transactions on Image Signal Process, 152, 535544. Ebrahim, R. (2001). Fuzzy logic programming. Fuzzy Sets and Systems, 117, 215230. Hajmeer, M., & Basheer, I. (2002). A probabilistic neural network approach for modeling and classication of bacterial growth/nogrowth data. Journal of Microbiological Methods, 51, 217226. He, T. X. (1998). Short time Fourier transform, integral wavelet transform, and wavelet functions associated with splines. Journal of Mathematical Analysis and Applications, 224, 182200.

Karthikeyan, B., Gopal, S., & Vimala, M. (2005). Conception of complex probabilistic neural network system for classication of partial discharge patterns using multifarious inputs. Expert Systems with Applications, 29, 953963. Kong, F., & Chen, R. (2004). A combined method for triplexpump fault diagnosis based on wavelet transform, fuzzy logic and neuro-networks. Mechanical Systems and Signal Processing, 18, 161168. Lai, W., Peter, W. T., Zhang, G., & Shi, T. (2004). Classication of gear faults using cumulants and the radial basis function network. Mechanical Systems and Signal Processing, 18, 381389. Looney, C. G. (2002). Radial basis functional link nets and fuzzy reasoning. Neurocomputing, 48, 489509. Loutridis, S. J. (2006). Instantaneous energy density as a feature for gear fault detection. Mechanical System and Signal Processing, 20, 12391253. lmez, T., & Dokur, Z. (2003). Classication of heart sounds using an O articial neural network. Pattern Recognition Letters, 24, 617629. Parvoti, F. Y., & Anandarajan, M. (2002). Classifying inventory using an articial neural network approach. Computer and Industrial Engineering, 40, 389404. Rutkowski, L. (2004). Adaptive probabilistic neural network for pattern classication in time-varying environment. IEEE Transactions on Neural Network, 15, 811827. Staszewski, W. J., Worden, K., & Tomlinson, G. R. (1997). Time frequency analysis in gear box fault detection using the WignerVille distribution and pattern recognition. Mechanical System and Signal Processing, 11(5), 673692. Wen, F., & Chang, C. S. (1998). A new approach to fault diagnosis in electrical distribution networks using a genetic algorithm. Articial Intelligence in Engineering, 12, 6980. Yang, B. S., Han, T., & An, J. L. (2004). ARTKOHONEN neural network for fault diagnosis of rotating machinery. Mechanical Systems and Signal Processing, 18, 645657.