2008 Congress on Image and Signal Processing

An Early Fire Detection Method Based on Smoke Texture Analysis and Discrimination
Yu Cui Institute of Environment & Municipal Engineering Qingdao Technological University, Shandong, China Email: cuiyureally@163.com Abstract
Texture is an important property of fire smoke, which is a significant signal for early fire detection. This paper describes a method of analyzing the texture of fire smoke combining two innovative texture analysis tools, Wavelet Analysis and Gray Level Cooccurrence Matrices (GLCM). Tree-Structured Wavelet transform is used to represent the textural images and GLCM are used to compute the different scales of the wavelet transform and to extract the features of fire-smoke texture. The smoke texture and the non-smoke texture are classified by neural network classifier. The discrimination performance is related to the quantity of input vectors.

Hua Dong Institute of Environment & Municipal Engineering Qingdao Technological University, Shandong, China Email: dhua@qtech.edu.cn

Enze Zhou Institute of Environment & Municipal Engineering Qingdao Technological University, Shandong, China Email: zhouenze@126.com

1. Introduction
Traditional fire detectors, such as heat fire detector and smoke fire detector, have successfully applied in many specific places for their high sensitivity, but they are not so suitable for large space fire detection because the traditional detectors can only cover with small area. Researchers have attempted to develop a new fire detection system suiting for the large spatial construction. The image fire detection system arises with the development of computer technology and the digital image processing technology. It is a novel tool for fire early warning, which monitors large scale scene and recognize fire according to fire image characteristics. Many researchers have done a fruitful research regarding this. Healey and Drda [1], and Foo [2] presented previous vision-based methods in ideal conditions. Yamagishi and Yamaguchi [3], Homg and Peng [4] developed the enhanced color image processing techniques for real-time fire flame detection. Phillips et al. [5] proposed a flame detection

algorithm based on color and motion information in video. Liu and Ahuja [6] presented spectral, spatial and temporal models of fire regions in visual image sequences. However, the research mainly focus on the recognition to flame, very little comes to fire smoke. Considering smoke is a visible characteristic of most early fire, it is attractive to find an appropriate smoke image detection method. Gray Level Co-occurrence Matrices (GLCM) [7] and wavelet-based analysis are two popular approaches to analyze and extract texture features. GLCM is a statistical method based on the estimation of the second order statistics of the spatial arrangement of gray values. It can be used to depict the change in gray level intensity caused by fire smoke flittering. The method only focuses on the coupling between image pixels on a single scale and has heavy computational burden. Recently, wavelet-based analysis has been successfully used in texture extracting and classification [8]. GLCM in combination with multiresolution analysis is a novel method in recent years which provides more information about the texture character. David A. Clausi [9] studied the texture features for classification of SAR sea-ice imagery with co-occurrence, Gabor filters and MRF. Bartels and Hong Wei [10] proposed a texture-based segmentation approach using wavelet packets, co-occurrence matrices and normalized modified histogram threshold. Mokji and Bakar [11] proposed a method to reduce the computation burden of the original GLCM with Haar Wavelet, which makes the combination of the two tools more attractive. We investigated the smoke texture and the nonsmoke texture with wavelet packet and GLCM. Wavelet packet is used to decompose the images into sub-bands and to extract multi-scales texture features. GLCM is then used to compute from the sub-bands respectively for additional statistical features. A neural

978-0-7695-3119-9/08 $25.00 2008 IEEE DOI 10.1109/CISP.2008.397

95

network is then used for discriminating the textures. The result can be used to judge whether a fire occurs. This paper is organized as follows. In Section 2, theory of wavelet packets and GLCM are briefly reviewed. The methodology of feature extraction and texture discrimination are explained in Section 3. In Section 4, experimental results using neural network with various feature sets are discussed in detail. Finally, concluding remarks are given in Section 5.

2. Reviews of Wavelet Packets and GLCM

2.1. Wavelet Packets
Daubechies [12] and Mallat [13] made the prominent contribution in the theory of wavelet. It is conventional pyramid-structured wavelet transform that decomposes sub-bands only in the low frequency channels. However, since the most significant information of texture appears in the middle and high frequency channels, the conventional wavelet transform may not help much for the texture extraction. The above defect leads naturally to a new type of wavelet transform. Coifman, Meyer, and Wickhauser [14] have optimized the wavelet basis function by including a library of modulated orthonormal bases called wavelet packets or treestructured wavelet transform. The library of wavelet packet basis functions {Wn }=0 can be generated from a given function W0 as n follows [15]:

a certain distance in a given direction [16]. It can be denoted by p (i, j, d, ) where i and j are intensity of the pixels, d is the relative distance between the pixel pair, d measured in pixel number and is their relative orientation. Normally, is quantized in four directions (0, 45,90 and 135) [17]. Haralick, Shanmugan and Dinstein [18] proposed fourteen measures of textural features which could be computed from the cooccurrence matrices, each represents certain properties as coarseness, contrast, homogeneity and complexity of the texture. We use Entropy (ENT) to express the complexity of the image:
ENT = p(i , j ) log p(i, j )
i j

Contrast (CON), which is a measure of the image contrast or the amount of local variations present in an image, is given by
CON = (i j ) 2 p(i, j )
i j

The Angular Second Moment (ASM) is a measure of the homogeneity of an image, defined as
ASM = {p (i, j)}
i j 2

Inverse Difference Moment (IDM) refers to the normalized entry of the co-occurrence matrices by definition as
IDM =
i j

1 p ( i, j ) 1 + (i j ) 2

W2 n ( x) = 2 h(k )Wn (2 x k )
W2 n+1 ( x) = 2 g ( k )Wn ( 2 x k )
k =0

2 N 1

k =0 2 N 1

3. Methodology of Feature Extraction and Discrimination

In this section, we present the experimental design and analytic methods for accomplishing texture extraction using wavelet packet and GLCM, and then discriminate the textures with a neural network.

W0 ( x ) = ( x ) is the scaling function, W1 ( x ) = ( x) is the mother wavelet function. The 2-D wavelet packet basis functions can be expressed by the combine of two 1-D wavelet packet basis functions along the horizontal and vertical directions. The corresponding 2-D filter coefficients can be expressed as: hLL (k , l ) = h(k )h(l ) , hLH ( k , l ) = h( k ) g (l ) hHL ( k , l ) = g ( k )h (l ) , hHH (k , l ) = g (k ) g (l ) The decomposition is applied to any frequency subbands recursively.

3.1. Texture Selection

200 distinct smoke textures were obtained from large spatial experimental environment, the selection criterion is such that each texture pattern should contain as much smoke texture as possible with the aim to extract the general features of smoke texture and to avoid disturbance from other textures. 200 nonsmoke textures were partly taken from large space and natural textures, and some from the Brodatzs texture album [19]. We retain 160 textures for testing the systems discrimination performance. 36 representative textures from the 560 samples are shown in Figure 1. The textures in the first and second row are the smoke textures and the third and fourth row are the non-

2.2. Gray Level Co-occurrence Matrixes

A co-occurrence matrix is a square matrix whose elements correspond to the relative frequency of occurrence of pairs of gray level of pixels separated by

96

Figure 1. Representative textures from 560 samples

smoke textures, the rest are textures for testing. All the texture images are normalized to 512 x 512 pixels.

discrimination performance by means of choosing the energy-dominant nodes. According to above analysis, the identification accuracy is related to the quantity of the feature vectors, we therefore design 4 methods with different feature vector selection standard to get the best smoke texture discrimination accuracy. Method 1: Use the 5 statistical features of original textures as input vectors with the standard of the least vectors and lowest computation load. Method 2: All the 65 feature vectors are input to the neural network, which has the most input vectors and highest computation load. Method 3: Take all the 48 statistical features of complete wavelet packet decomposition at the secondlevel as input vectors. This method excludes the statistical data of original image and the first-level wavelet packets and has medium vector quantity. Method 4: Select 12 energy-dominant nodes from the statistical results of energy distribution of all texture samples. Each node has 3 statistical features computed from GLCM. The 5 features of the original texture are also considered as supplement vectors. The method has total 41 input vectors.

3.2. Feature Extraction

Because a uniform feature extraction tool may not be sufficient to describe a smoke texture, the combination of GLCM and wavelet packet is proposed to have a comprehensive analysis. The mean value of CON, ENT, ASM, IDM, COR of four directions of each texture is computed from the GLCM with gray level 16 as the 5 feature vectors extracted from original images. As the energy of most textures is close to zero at threelevel decomposition, two-level wavelet packet decomposition was carried on. The two-level complete wavelet packets were computed for each texture by D6 wavelet which has the advantage of high texture classification performance, orthonormal and low complexity. A total of 21 wavelet packets (levels 0 through 2) are obtained in this way. The GLCM is then used to compute the average value of ASM, ENT, and IDM of four directions through each wavelet packet. In this method, each texture has altogether 65 feature vectors as input vector for the neural network. As proposed by Chang and Kou [15], the most dominant wavelet packets are good for discriminating textures and the most significant information of a texture often appears in the middle and high frequency channels. We calculated the energy of the second-level wavelet packets, and obtained the statistical results of energy distribution of each node of all texture samples. We can reduce the input vectors and improve the

3.3. Discrimination Using Neural Network Classifier

We use a two-layer back propagation network [20] with resilient back-propagation algorithm for training to distinguish smoke texture and other texture. An object vector is defined as value 1 in the case of the smoke texture and value 0 for non-smoke texture. The number of input nodes was matched to the number of feature vectors. The network topology has one output node that output a value k, which will close to value 1 if more smoke texture appears and to 0 if there is no smoke texture. According to the above definition, we consider there will be smoke texture if |k-1|0.5.

4. Results and discussion

We summarize the discrimination performance of the 4 methods. 160 test images are divided into three categories, the first category is 60 smoke textures, the second is 40 mix-textures of smoke and non-smoke, and the last is 60 non-smoke textures. Some samples of the three categories are shown in Figure 1 from row 5 to row 6. The mix-textures have the common properties of smoke texture and non-smoke texture, which will be helpful to test the performance of the neural network

97

Table 1. The discrimination results of the four methods

Method 1 Method 2 Method 3 Method 4 Smoke textures Correct Error Acc(%) 45 15 75 56 4 93.3 51 9 85 60 0 100 Mix-textures Correct Error Acc(%) 17 23 42.5 27 13 67.5 21 19 52.5 37 3 92.5 Non-smoke textures Correct Error Acc(%) 51 9 85 57 3 95 54 6 90 60 0 100 Total Acc(%) 70.6 87.5 78.8 98.1

The discrimination performance is shown in Table 1. Method 1 has the accuracy of only 70.6%, which suggests that just a statistical method and fewer vectors will not good at identification. The best performance was obtained by method 4, the accuracy is 98.1%. We cannot obtain the best result with all 65 feature vectors in method 2, the accuracy is 87.5%. The accuracy of method 4 is 78.8% in the condition of only take second-level wavelet packets as input vectors. From the statistical data of Table 1, we can also see that the last three methods have good performance on discriminating both the smoke textures and non-smoke

5. Conclusion
An early fire detection method is proposed based on the analysis of fire smoke textures use the tools of wavelet packet and GLCM. The textures are decomposed by tree-structure wavelet, and then statistical features are computed from the GLCM. The combination of the two tools demonstrated enormous superiority in texture feature extraction. The smoke textures and non-smoke textures are discriminated by neural network, the output of which denotes whether

1.6 1.4 1.2 1.0 0.8 0.6 0.4 0.2 0.0 -0.2 -0.4 -0.6 -0.8 0 1 2 3 4 5 6 7 8 Texture samples 9 10 11 12 13

Method 1 Method 2 Method 3 Method 4

The value of k

Figure 2. The output value k of the four methods

textures. However, there is low accuracy in mixtextures discrimination with the first three methods. Because of insufficient of input vectors, method 1 has the worst performance in all the three categories. The output value k of neural network of the four methods is shown in Figure 2 with the test textures in Figure 1 from row 5 to row 6. From Figure 2 we can see that, because of excessively many input vectors, the output of method 2 and method 3 are unstable compared to the other two methods. More importantly, method 4 has the superiority in both the accuracy and stability because of appropriate feature vectors extracted from original textures and wavelet packets use GLCM with the energy-dominant standard.

the fire-smoke appears in the monitoring sites. We test the discrimination performance by 160 textures of three categories. The experimental results indicate that the method with the energy-dominant wavelet packets couples with original texture features has the highest discrimination accuracy of 98.1%. The result shows that the method is promising in early fire detection.

Acknowledgements
This work was supported by State Key Laboratory of Fire Science, University of Science and Technology of China and Henan Key Laboratory of Prevention and

98

Cure of Mine Methane & Fires, Henan Polytechnic University.

6. References
[1] G. Healey, D. Slater, T. Lin, B. Drda, A.D. Goedeke, A system for real-time fire detection, Computer Vision and Pattern Recognition,1993 IEEE Computer Society Conference, New York, NY, USA, 15-17 June 1993, pp. 605-606. [2] S.Y. Foo, A rule-based machine vision system for fire detection in aircraft dry bays and engine compartments, Knowledge-Based Systems, Elsevier, 1995, pp.531-541. [3] H. Yamagishi, J. Yamaguchi, Fire flame detection algorithm using a color camera, Proceedings of 1999 International Symposium on Micromechatronics and Human Science, Nagoya, Japan, 1999, pp. 255-260. [4] W. B. Horng and J. W. Peng, Real-Time Fire Detection from Video: A Preliminary Report, 14th IPPR, Computer Vision Graphics and Image Processing. 2001, pp. 1-5. [5] W. Phillips III, M. Shah, and N. V. Lobo, Flame recognition in video, Pattern Recognition Letters, 2002, pp. 319-327. [6] C. B. Liu and N. Ahuja, Vision based fire detection Proceedings of the 17th International Conference on Pattern Recognition. ICPR 04, 2004, pp. 134-137. [7] R.M. Haralick, K. Shanmugam, and I. Dinstein, Textural Features for Image Classification, IEEE Transactions on Systems, Man, and Cybernetics, 1973, pp. 610-621. [8] B. Kara, N. Watsuji, Using Wavelets for Texture Classification, WSEAS Transactions on Computers, 2003, pp. 920-924. [9] D. A. Clausi, Comparison and Fusion of Co-occurrence, Gabor and MRF Texture Features for Classification of SAR Sea-Ice Imagery ATMOSPHERE-OCEAN, 2001, pp.183194.

[10] M. Bartels, H. Wei, and D.C. MAson, Wavelet packets and co-occurrence matrices for texture-based image segmentation IEEE Conference on Advanced Video and Signal Based Surveillance 2005, 2005, pp. 428- 433. [11] Mokji, Bakar, Gray Level Co-Occurrence Matrix Computation Based on Haar Wavelet Computer Graphics, Imaging and Visualisation (CGIV 2007), 2007, pp.273-279. [12] I. Daubechies, Orthonormal Bases of Compactly Supported Wavelets, Comm. on Pure and App. Mathematics, 1988, pp.909-996. [13] S. G. Mallat, A Theory for Multiresolution Signal Decomposition: The Wavelet Representation, IEEE Trans. on PAMI, 1989, pp.674-693. [14] R. R. Coifman and M. V. Wickerhauser, Entropy-based algorithms for best basis selection, IEEE Trans. Information Theory, 1992, pp.713-718. [15] T. Chang, C.C.J. Kuo, Texture Analysis and Classification with Tree-Structured Wavelet Transform IEEE Transactions on Image Processing, Oct 1993, pp.429441. [16] K.S. Thyagarajan, T. Nguyen, and C.E. Persons, A maximum likelihood approach to texture classification using wavelet transform IEEE International Conference on Image Processing 1994, Nov 1994, pp.640-644. [17] A. Baraldi, F. Parmiggiani, An Investigation of the Textural Characteristics Associated With GLCM Matrix Statistical Parameters, IEEE Transactions on Geoscience and Remote Sensing, 1995, pp. 293-304. [18] R.M. Haralick, K. Shanmugam, and I. Dinstein, Textural Features for Image Classification, IEEE Trans. Systems, Man, and Cybernetics, 1973, pp. 610-621. [19] P. Brodatz, Texture: A Photographic Album for Artists and Designers. Dover, 1966. [20] A. Tirakis, S. Kollias, Efficient Image Classification Using Neural Networks and Multiresolution Analysis, IEEE International Conference on Acoustics, Speech, and Signal Processing 1993, Minneapolis, MN, USA, 1993, pp. 641-644.

99