Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

ABNORMAL CROWD BERAVIOR DETECTION USING BERAVIOR ENTROPY

MODEL
WEI-YA REN, GUO-HUI LI, JUN CHEN, HAO-ZHE LIANG
College of Information System and Management, National University of Defense Technology, Changsha 410072, China
E-MAIL: weiyren.phd@gmail.com.guohli@edu.nudt.cn.ChenjunI666@yahoo.com.cn.lianghaozhe@hotmail.com

Abstract:

Using Behavior Entropy model, we introduce a novel

method to detect and localize abnormal behaviors in crowd
scenes. Our key insight is to estimate the behavior entropy of
each pixel and whole scene by considering defined pixels'
behavior certainty. For this purpose, we introduce information
theory and energetics concept to define pixel's behavior
certainty based on video's spatial-temporal information. Scene
entropy behavior and behavior entropy image can be used to
detect and localize anomalies respectively. We discuss
parameters' setting by analyzing how they influence model's
detecting and localizing abilities, and our model is robust to
parameter setting. The experiments are conducted on several
publicly available datasets, and show that the proposed method
captures the dynamics of the crowd behavior successfully. The
results of our method, indicates that the method outperforms
the state-of-the-art methods in detecting and localizing several
kinds of abnormal behaviors in the crowd.

Keywords:

Detection and localization; Optical flow; Behavior Entropy

1.

INTRODUCTION

Abnormal behavior detection can be viewed as a type of

high-level operation of image understanding [10]. Intelligent
visual surveillance has got more research attention and
funding due to increased global security concerns, and it has
made great progresses in recent years, such as background
model [25], object tracking [26], pedestrian detection [27],
action recognition [28] and crowd counting [7]. While
Anomaly detection plays an important role in airports,
railway stations, shopping malls, military installations, etc.,
crowd scene analysis faces even more challenges like
emergent behaviors and self-organizing activities [1][6].
Monitoring videos of crowded scene is also a very expensive
and tiring task [17][18].
In the field of transportation and public safety, some
well-established models have been developed for describing
the group behaviors in crowded scenes, such as Social Force
9781-467315357/121$31.00 2012 IEEE

Model [2][23], Hybrid methods and some group behaviors

models[3][4][5]. Mahadevan et al. [19] models normal crowd
behaviors by mixtures of dynamic textures. Recently, the
computer vision community has focused on crowd behavior
analysis. Social force model was studied in [20] to analyze
the human interactions in order to detect abnormal events. In
crowd analysis, as one of the measurement of movement,
optical flow compute the velocity of the motion object
between two consecutive frames of an image sequence [21],
which can reflect the change of velocity. And it has got a lot
of achievements for anomaly detection in crowd scenes by
using this method [13]. According to this, optical flow is used
in our model.
Entropy [12] arouses people's attention because it has
significant meaning to detect anomaly events. Yang Cong et
al. [11] compute entropy by formulating the sparse
coefficient as a probability distribution. Guogang Xiong et al.
[9] build histograms on X- and Y-axes respectively, they
obtain probability distribution of the foreground object and
then define crowd entropy. Their foreground entropy denotes
the dispersion of foreground on the horizontal and vertical
directions.
In this paper, we propose a new method to detect both
local and global abnormal events in crowded scenes. Further,
our behavior entropy not only denotes the dispersion on
different directions, but also denotes the individual
movement information and interact information among
individuals. As seen in Fig. 1, several types of abnormal
behavior in crowd scene are analyzed, and we can detect
them by computing their scene behavior entropy (SBE) and
localize them by computing their pixels' behavior entropy
(BE) distribution.

212

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

Figure 1. AnomaBy detection examples. La shows individual converse

walking in crowd, it's pixels' behavior entropy(BE) distribution is
displayed in the right side. Lb shows crowd dispersion, it's pixels'
behavior entropy(BE) distribution is displayed in the right side, it is
clearly that it's scene behavior entropy(SBE) will suddenly become large
when event occnrs.

The organization of this paper is as follows. In the next

section we overview our model. In Section 3 we introduce
Behavior Entropy model for modeling the crowd movement.
In Section 4 we introduce our method to estimate the pixel's
behavior certainty (BC) in the crowd. Section 5 describes the
proposed method to detect and localize abnormal behaviors
in the crowd. In Section 6, we discuss model parameter
setting and demonstrate abilities of the approach to detect and
localize abnormal behaviors on several available datasets.
2.

PROPOSED MODEL

The definition of entropy from information theory imply

us the power of information. Behavior Entropy Model
describes behaviors in crowd scene by regarding the scene as
the result of information driving. It can be assumed that
individual's behavior depends on individual information
obtainment and information interaction among individuals.
Information can be described by certainty, that means
the existence of entropy, and abnormal crowd behavior is
essentially an eccentric state of scene's entropy. Therefore,
we defme behavior certainty (BC) and behavior entropy (BE)
to capture and excavate useful information in scene. Notice
that behavior entropy is different from common entropy
because of its novel thoughts and computing method.
It can be assumed that pixels whose optical flow equal
to zero do not contain useful information. If a pixel's optical

flow is not zero, we named it behavior particle, or particle as

short, and scene's information are all reflected by particles.
We assume that scene's information is all known as a priori
knowledge, however, it is impossible because of the
existence of particles. Particles bring movement information
and somehow mean the loss of scene's information which
reveals behavior in crowd. Therefore, we can represent
scene's behaviors through finding the loss of information out.
In this way, the initial value of Pixels' behavior certainty
is set to 1 and there is only need to update particles' behavior
certainty to scale the scene's loss information. Then, every
frame in video will have a pixels' behavior entropy
distribution, and scene behavior entropy (SBE) can be
calculated by pixels' behavior entropy.
In a crowd scene, we detect abnormal behavior by
analyzing the change of SBE (scene behavior entropy) in
time and localize abnormal behavior by pixels' behavior
entropy distribution.
As seen in Fig. 2. By using Hom-Schunck method [16],
we firstly compute optical flow because it reflects video's
spatial-temporal information, and our model regards it as a
sort of foundation. The most important and key thing is to
compute pixels' behavior certainty, then we compute
behavior entropy which includes pixel's BE (behavior) and
scene's SBE (scene behavior entropy). The last but not the
least, anomalies will be detected and localized through
behavior entropy.
Anomally Detection
and Localization

Figure 2. Proposed model for abnormal behavior detection in the

crowd videos.

This paper aims to present an effective model to detect

both local and global anomalies in public scenes. Even
though our work uses entropy concept, we use a completely
different course by estimating defined behavior certainty in
the crowd and detect anomalies directly without segmentation.
There is no need to acquire a mass of data to depict normal
scene's character and our model has a unified framework for
various anomaly detection and localization.

3. BEHAVIOR ENTROPY MODEL

3.1 Optical Flow
Optical flow is an effective method in detecting and
calculating the motion of each pixel between two frames, and
thus provides a possible way to get the velocities of the
motion objects [22]. By using Hom-Schunck method [16],
two images will be analyzed and the values of the variable u

213

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

and v are produced, where u is the flow in x-axis and v is the

flow in y-axis. In this paper, consider pixel i's u and v are
denoted by Vix and Viy respectively, written Vi =(ViX, Vs).

- - -

3.2 Behavior Particle

We put particles on pixels whose optical flow not equal
zero, then we named these pixels as behavior particles,
"particles" for short. As discussed before, the model's main
task changes to compute particles' behavior certainty instead
of computing all pixels' behavior certainty. It is easy to know
that pixels conclude particles (behavior particles), and
behavior particles are helpful because it means that our model
won't take up too much computing time.

4.1 Interaction Information

Interaction effect among particles can reflect information
of the crowds, it inspires us to consider particles' direction
factor to defme particles' BC at first. We assumed that BC
(behavior certainty) of particle i is related to its own direction
and directions of particles which around it. Particles that
around particle i are limited into an area which we called Di .

Di contains

k,

particles, and its shape can be rotundity,

rectangle or other symmetrical form. The appropriate size of

Di will be discussed in section 6.
In order to simply consider the direction factor, we can
standardize ~x and Viy as follows:

3.3 Defmitions in the Model

(3)

Definition 1 Behavior Certainty (BC) of Pixel i is the

probability of keeping its former state.
The key problem is to understand and compute Behavior
Certainty (BC), we denote it as ~ . In next section, probability

(4)

~ will

be illuminated in detail.
Definition 2 Behavior Entropy (BE) of Pixel i is defined as
follows:

(1)

It is easy to know IVi 1= 1 if we note Vi = (Vix'Viy ) .

Particle's behavior entropy (BE) can be computed
P as formula (1) explains. For lim(-P.log 2 P ) = O ,
P;.....O
thr ough I
1

we can draw fig. 3.a. which is the plot of ~ versus BE The

j

Definition 3 Scene Behavior Entropy (SBE) is according

to the following equation:
M

SBE=- L~IO& ~

(2)

i=1

4. ESTIMATION OF PIXEL'S BEHAVIOR CERTAINTY IN THE

CROWD
As we claimed before, we assumed that we know all
scene's information as a priori knowledge, however, only
particles whose optical flow do not equal 0 contain useful
information which can reflect the loss of information.
Through fmding the loss information, scene's events can be
represented. Since we initialize Pixel's BC (Behavior
Certainty) equal to 1, it is important to fmd a way to update
the BC values. Two main clues are considered, one is the
interaction information, and the other one is state's
evolvement if every particle is regarded as a subminiature
system.

curve helps us fmd the way to compute ~. BE gets largest

j

value when

-1

equals to e . For the reason that we assumed

the behavior certainty should have a lower boundary, we can

make ~ always be more than or equal to

e- 1 It is also

convenient that the curve become monotone decrease.

Particle will make largest contribution to scene behavior
1

entropy (SBE) when it equals to e-

BC of particle i is firstly given by the following equation:

li=e-1+1]-(I-e-1)

O~1]~1

(5)

Where 1] is defined as:

k
k
TJ= 1!:~i 1
i=l

I!:I ~i I,
i=l

I~i 1* 0

(6)

Apparently 0 ~ 1] ~ 1 . Furthermore, equation (6) can

be written as:

(7)

214

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

1]

describes direction factor among particles in area Di .

In area Di ' particles' behavior certainty (BC)

equal to 1

if all particles have the same direction. When particles in Di

have equivalent value in any two opposite directions,

Consider two states i and j of system S, the ratio of their

probabilities is:

Particles' BC PI becomes to e- and particles' BE arrive to

Pj(Tk )

its largest value. However, particle's BC neither equal to 1

~(Tk)

nor e- in most situations, in fact it always fall in between

e- 1 and 1.
Fig. 3.b. show the relationship between particles'
behavior certainty ~ and 1] . ~ shows a linear correlation of
1] ,

and we can infer that e- ~

r: ~ 1.

e~' ------------------1
e

-1

a. The plot of

BEi

versus

Figure 3. Function
between

BE i get

BEi

Pi

curve

b. The plot of
illustration.

" TJ

3.a

and ~ ' BEi=-~I~~

'

-1

Pi

versus

shows

the

e-E/~

(10)

---~n

e-EilTk

L-Ji=l

relationship

and lim(-~.log2~)=O .

its largest value e /ln2 when ~ equal to

BCi=~

~---)()

-1

e . 3.b

E1 = -P)o~ State 1
displays the

E 2 =e-1 /ln2

< P., < 1.

S;

State

E 1 = -P)ogPrState 1

S;

E =e-1 /ln2- - State

2
BC i =e- 1

4.2 State Transition

Particle's behavior certainty can be apprehended as
temporary state of particle, and all possible states of particle
will form a system. With help of the concept of system,
analysis of particle's behavior will be easier. In order to
describe a system in an effective way, concept of state and
annealing process [14] in energetics is borrowed to excavate
the hidden useful information of scene.
Annealing process: Thermodynamic system S has n
states which are limited and discrete, the energy of state i is
Ei , system will go into thermal equilibrium after a while
with temperature
is:

In order to depict the loss of scene's information, we

defmed particles' BC (behavior certainty) in equation (5),
however, it only considers the interaction information among
particles, so it is necessary to consider other information.
Considering particles' former BC value and velocity factor,
we revise particles' BC based on concept of system state. We
assume that system will probably change its state from a
stable one to an unstable one as annealing process.
Each particle is regarded as a subminiature system which
always has two states, as seen in fig.4, state 1 and state 2,
they each correspond to a BC (behavior certainty) value:
~ which is computed by equation (5) and constant value e -1
States' energy equals BE which is calculated respectively
with their corresponding BC value, so we know that their
110ge-1=e-11ln2.
energy are.E, =-~lo~, E 2 = - e -

linear correlative relationship between ~ and 1] , it shows ~ 's value range:

e-

(9)

e-E,ITi

P;(fkF :E:,e-EiIT,

~'

then the probability system being state i

Pi(Tk)~ke-~/~

Consult Boltzmann equation [15], we know that:

(8)

Figure 4. State transition illustration. Subminiature system Si stays in

state 1 at first and then jump to state 2 with probability

Po .

After the

possible transition process, Si evolves into S~ . Solid line in S~ means new

system's state, and dashed line means the state which has been abandoned by
system Si'

Apparently, state 1's energy is always lower or equal to

state 2's. It means state 1 is more stable. We assumed that
subminiature system will stay in state 1 at first and then jump
to state 2 with probability Po. This process can be interpreted
as a possible transition, though particle tends to keep its
previous state in this process for it is more stable, transition
may occurs. Particle's fmal BC will be fmal confrrmed after
this process, for we set particle's BC be the value that

215

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

evolved system

S~

corresponds to. In other words, particle's

BC will probably change to e- 1 as its final value with

probability Po as system evolves.

abnormalities in the abnormal frame by locating the pixels of

high BE value.
5.3 Algorithm Flow

BC ofparticle i is fmally given as follows:

Model's main algorithm is shown as follows:

1
,

e- with probablity Po

(11)

J: ={J:, with probablity I-po

According to equation (10), we let Tk; =;Lez

where

A"r are constants, and % is the average absolute velocity of

particles in areaz, ,written Z = ~ ,i E Z; ,by the way, Z, is
different from D i So we can confirm Po as follows:

Po =e-{E;-~)/J- z'
-{e- 1 _lnr 1- B _1og~.-I)/J-z'

=e

(12)

Main Algorithm
Input: Adjacent frames of video
Output: behavior certainty(BC), behavior entropy(BE), scene behavior
entropy(SBE)
1: Initialize ~ = 1
2: for i=O,1,2,... ,m

4: ~

= e -I

+ 11-(1- e -I)

k,....

k , ....

i=1

;=1

11= I ~ V; I/~ I V;

In fact, Po reflects the degree of the loss of information,

and materializes to the computing of particle's BC. System is
more stable when its energy is lower, from formulae (11) and
(12), we can see state is harder to change when particle's BC
get larger or I Vi Iget smaller.
5. DETECTION AND LOCALIZATION OF ABNORMALITIES

7: end if
M

8: SBE=LBEi=-Lli log21i
i=l

i=1

9: end for

5.1 Anomaly detection

According to defmitions in our model, SBE (scene
behavior entropy) can be calculated and we can get a curve of
SBE versus frame. However, discrete value of SBE is not a
clear evidence of abnormal behaviors, in order to improve
detecting effect, we smooth SBE curve to deal with detecting
task Aiming at specifically scene, threshold value is setting
to make the final decision. It is also easy to get ROC curve
through changing threshold value and AUC can be calculated
which can used to judge model's performance.
5.2 Anomaly Localization
By judging SBE curve, we distinguish abnormal frames
from the normal frames. After that, BE (behavior entropy)
distribution is really helpful to localize regions in the frame
that correspond to the abnormalities. As we discussed earlier,
the BE distribution reveals the useful information in the scene,
which corresponds to the activities in the scene. In an
abnormal scene, we expect the anomalies to occur in regions
with higher BE (behavior entropy). Therefore, we localize

6. EXPERIMENTS AND DISCUSSION

It is significant to detect global and local anomalies with
a union model. Anomalies can be identified as irregular
events from normal ones, thus, behavior entropy model is to
identify abnormal events no matter what kind of it. There are
several parameters in this paper, and they are important
because they may influence the model's performance. We set
Di,Zi's shape squares with center i, square will change to
rectangle when i approaches to image's boundary, other
parameters' setting will be discussed later in detail. In
experiments, we set suitable parameters based on scene's
specialty and detecting demand.
We use UMN and Crowd_PETS09 datasets for global
abnormal events' detection and localization, and then use
UCSD dataset and an internet dataset for local abnormal
events' detection and localization. All videos have to
eliminate noise first, and all experiments in this paper run on
a computer with 4GB RAM and a 2.3--2.9GHz cpu. The

216

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

average computation time is 1.5s/frame for datasets

excluding optical flow computing time.
6.1 Global Anomalies
6.1.1

and high-level analysis, where high-level analysis means

detection of separate flows and specific crowd events. Then
we select a dataset which contains gathering and dispersion
events in dataset S3 \High Level\Time_14-33.

Tests on UMNDataset

The approach is tested on two datasets, one of them is a

publicly available dataset of normal and abnormal crowd
videos from University of Minnesota [24]. The dataset
comprises the videos of 11 different scenarios of an escape
event in 3 different indoor and outdoor scenes, there are 7739
frames at all. Each video consists of an initial part of normal
behavior and ends with sequences of the abnormal behavior.
As seen in fig.5, 5.b is the smoothed video's curve of
SBE (scene behavior entropy). In Fig.5.a and 5.c, we show
several abnormal and normal original frames respectively and
display their BE (behavior entropy) distribution which is used
to localize the abnormal regions. In BE (behavior entropy)
distribution, red pixels correspond to the highly probable
abnormal regions.
With help of SBE curve, we detect abnormal events
earlier than some classic methods [2][29]. For instance, we
first number all 11 scenarios: 1.1--3.3, as seen in fig 5.b, in
scenario 1.1, the abnormal running is detected at the 483th
frame, in scenario 2.6, we detect the abnormal running at
4781th frame, and in scenario 3.2, we detect abnormal
behavior at 6826th frame.
Table 1 provides the quantitative results of the
comparison with the state-of the-art methods. We use Area
under ROC Method to display global abnormal behaviors
detecting performance of our model. It is obvious that our
model can get a high score in detecting global anomalies.
TABLE 1. THE COMPARISON OF THE USE OF THE PROPOSED BEHAVIOR
ENTROPY METHOD AND THE STATE-OF-THE-ART METHODS IN THE UMN
DATASET

6.1.2

Method

Area under ROC

Behavior Entropy

O. 99

Chaotic Invariants[29]

0.99

Social Force [2]

0.96

Pure Optical Flow[2]

0.84

Tests on Crowd PETS09 dataset

In order to observe behavior entropy model's

performance on global abnormal events further, we choose a
famous datasets named PETS 2009 [30]. PETS 2009's theme
is multi-sensor tracking and event recognition in crowded
public areas. It includes low-level analysis, mid-level analysis

Figure s. Some results of experiments. S.c shows several normal frames

and their corresponding BE distribution image. In S.b, video's SBE
curve is illustrated and we use independent threshold value to make
judgement because of different shoot time means different scene, we
first smooth SBE, and the span for the moving average is setting as 10.
S.a shows several abnormal frames and their corresponding BE
distribution image which can be used to localize abnormal behaviors.
Red values represent higher BE(behavior entropy) whereas blue values
represent low BE. The results show that the BE distribution are capable
of locating the abnormalities in the regions that are occupied by the
crowd.

Fig. 6 shows the main experience result, 6.b is the

smoothed video's curve of SBE (scene behavior entropy). In
Fig. 6.a and 6.c, we show several abnormal and normal

217

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

original frames respectively and display their BE (behavior

entropy) distribution images. When gathering and dispersion
happens, the scene' SBE value both rise relative to their
normal scene.

that the proposed method outperforms the state-of-the-art

methods to distinguish abnormal sequences exactly.
By means of SBE(scene behavior entropy), detecting
abnormal events in datasets become simple and feasible, as
seen in fig. 7, we show a sample of UCSD ped_1 video 27
whose abnormal event is a running car in crowd.

Figure 7. A detecting sample. SHE curve of UCSD ped_l video_27.

With the setting of the suitable threshold, it is eay to detect the car fastly.
In this sample, we have not smooth the SHE curve. However, in most
situation, smoothing is necessary.

Figure 6. Some results of experiments. In 6.a, video's SHE curve is

illustrated and we use independent threshold value to make judgement
for gathing and dispersion respective , we first smooth SHE, and the
span for the moving average is setting as 10. In 6.b, gathering and
dispersion scene each have a normal frame and a abnormal frame, their
HE distribution images are shown below them.

The ability of detecting global abnormal events has been

shown by over two datasets. Behavior entropy model can fast
and accurate detect anomalies, and the BE distribution image
are capable of locating the abnormalities in the regions that
are occupied by the crowd.

We compare our method with MDT, Social force etc. as

table 2 shows. It is easy to find that our AUC outperforms
the state-of-the-art methods. Some image results in UCSD
ped_1 are shown in fig. 8, and we compare MDT approach
[19]. And in UCSD ped_2, as seen in fig. 9, bikers, skaters,
small cars, etc. are detecting with high accuracy.

TABLE 2 THE COMPARISON OF THE USE OF THE PROPOSED BEHAVIOR

ENTROPY METHOD AND THE STATE-OF-THE-ART METHODS IN THE UCSD
DATASET.

6.2 Local Anomalies

6.2.1

Tests on UCSD Dataset

UCSD database [19] is used to enable the evaluation of

performance with respect to the ability to localize anomalies.
In the normal setting, the video contains only pedestrians.
Commonly occurring anomalies include bikers, skaters, and
small carts. The data was split into 2 subsets: UCSD ped_l
and UCSD ped_2, each corresponding to a different scene.
To test localization accuracy, detections are compared to
frame level ground truth masks. Area under ROC curves
(AUC) can evaluate the anomaly detection performance, and
it is based on these detection and false positive rates, for
multiple threshold values. The AUC in table 2 demonstrates

Method

Area under ROC

Behavior Entropy

0.7950

MDT [19]

O. 7895

Social Force [2]

O. 7414

Adam et al. [31]

0.6350

Figure 8. Examples in UCSD ped _1. Comparisons of abnormal

localization results from (i) our approach; (ii) MDT approach[19].

218

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

TABLE 3 FOUR ABILITIES WHICH CAN REFLECT ONE MODEL'S PERFORMANCE

ON DETECTING LOCALIZATION VARIOUS ABNORMAL EVENTS.

Abili

Figure 9. Examples in UCSD ped_2. Abnormal objects are detected

with high accurancy and low error with our approach.

6.2.2

Tests on Recessive walking sequence

We download a sequence about recessive walking and use

it as a type of local abnormal event to evaluate our model's
performance. Fig. 10 and fig.I I shows some results of this
experiment. The detecting time and localization effect are
all that could be desired.

A
B
C
D

Illustration
Ability of detecting abnormal interaction information
Ability of detecting abnormal movement information
Ability of reducing false alarm
Ability of reducing false dismissal

Assemble of parameters may be different and it is

influenced by crowd density, shooting angle, camera position
and frame variable rate. There are 4 main parameters in our
model, and assemble of them will embody an integration
capability. As seen in fig.12, through vast of experiments and
control variate method, we get several qualitative curves with
parameters and abilities. So it is really an interesting task to
get a perfect parameters assemble.
D

B
B

o
Figure 10.
Video's SHE curve is illustrated and we use a
situable threshold value to make judgement for recessive walking , we
first smooth SHE, and the span for the moving average is setting as 10.

A-

o,

0
Abilities

Abilities

---.::--

B
C

C
D

Figure 12.
Qualitative curves with parameters and abilities.
There are four parameters and four abilities at all.

Figure 11.
Examples in recessive walking sequence,
Pedestrian who walks in an opposite direction is detected fast and
localized well.

6.3 Parameter analysis and setting

Parameters setting in experiments are revealed in table4.

Special instruction: UNM dataset is of exactly the same
parameter setting as recessive walking dataset. It
demonstrates the model's robustness of parameter setting.
TABLE 4 PARAMETER SETIING IN DIFFERENT EXPERIMENT. THERE ARE
FOUR DATASETS AND FOUR PARAMETERS AT ALL. THE SETTING OF

Zi

IS

UNIFORM IN FOUR DATASETS.

Anomalies include global and local abnormal event, and

anomalies' types are abundant. So it is more important to
analyze what the anomalies detecting requires, we classify
the requirement into four abilities shown in table 3. When
one model gives consideration to these four abilities well, it
will really stand out.

UMN
PETS 2009
Recessive walking

UCSD

219

A-

D; 's side
length(pixels)

Zi 's side
length(pixels)

0.3
0.001
0.3
0.15

1
5
1
5

30
200
30
1

10
10
10
10

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

Fig. 13 reveals that the parameter combination will

influence the model's results. Fig. 13.a is an original frame in
UCSD dataset, and then there parameter combinations are
shown. The first parameter combination detects both skater
and recessive walking individuals. The second combination
just detect skater and the third one just detect recessive
walking.

Figure 13.
A samlpe of parameter combination. 13.a displays
an original frame in UCSD dataset Ped_2. b shows a BE(behavior
entropy) distribution image with one kind of parameter setting, model
detect both skater and recessive walking individuals. 13.c and 13.d
indicate another two different parameter combination, they overlap
between BE distribution image and original frame, and each of them
only detect one kind of the anomalies.

7. CONCLUSION
Experiments reveal frame's SBE (scene behavior
entropy) will rise when running, dispersion, gathering and
regressive walking occurs. Rising of SBE reflects loss of
information, it means abnormal events always wreck normal
scene's information though it brings abnormal information,
so our mission is to know how to calculate the loss of
information. Behavior Entropy Model is effective and
predominant for its well performance on detecting and
locating abnormal events, and the most important thing is still
to construct a uniform framework aiming at various
anomalies.
Manifestation mode of information includes video, voice,
etc. In future, we can compute their behavior entropy
respectively and use their joint distribution to complete the
detecting task.
Acknowledgements
This paper is supported by College of Information System
and Management, National University of Defense
Technology and subsidized by National Natural Science
Foundation of China (Grant No. 61170158).
References
oo,
[1] Dirk Helbin, PeOOter Molna Illeoos J Farka, Kai Bola,
"Self-organizing pedestrian movement". Environment
and Planning B : Planning and Design, 28:361-383,
2001.

[2] R Mehran, A. Oyama, and M. Shah, "Abnormal crowd

behavior detection using social force model". IEEE
Conference on Computer Vision and Pattern Recognition,
pp. 935-942,2009.
[3] Roger L. Hughes. "A continuum theory for the flow of
pedestrians".
Transportation Research
Part
B:
Methodological,36(6):507-535, July 2002.
[4] S. S. Dietmar Bauer and N. Brandle. "Macroscopic
pedestrian flow simulation for designing crowd control
measures in public" transport after special events. SCSC:
Proceedings of the 2007 summer computer simulation
conference,pages 1035-1042,2007.
[5] K. D. Xiaoshan Pan, Charles S. Han and K. H. "Law.
Human and social behavior in computational modeling
and analysis of egress". Automation in Construction,
15(4):448--461, 2006.
[6] P. R. S. V. Beibei Zhan, "Dorothy Monekosso and L.-Q.
Xu. Crowd analysis: a survey". Machine Vision and
Applications,19(5-6), October 2008.
[7] Y. Cong, H. Gong, S. Zhu, and Y. Tang. "Flow
mosaicking: Real-timepedestrian counting without
scene-specific learning". CVPR, pages 1093-1100,2009.
[8] http://www.svc1.ucsd.edu/projects/anomaly.
[9] Guogang Xiong, Jun Cheng, Xinyu Wu,Yen-Lun
Chen,Yongsheng Ou, Yangsheng Xu "An energy model
approach to people counting for abnormal crowd
behavior detection". Neurocomputing , 83, Pages 121135, 2011, SlAT OpenIR
[10] Oluwatoyin P. Popoola, "KejunWang. Video-Based
Abnormal Human Behavior Recognition-A Review".
IEEE Systems, Man, and Cybernetics Society.
ISSN:I094-6977,2012
[11] Yang Cong, Junsong Yuan, Ji Liu "Sparse
Reconstruction Cost for Abnormal Event Detection".
CVPR, pp. 3449-3456, 2011
[12] Wikipedia, [http://en.wikipedia.org/w/index.php?title=En
tropy].
[13] K.Hawari Ghazali, W.N.Azhani W.Samsudin, N.Nabilah
M.Hamid "Motion Detection for PC based on Security
System by using Optical Flow". International Journal on
Advanced Science, Engineering and Information
Technology,2012
[14] Wikipedia,http://en.wikipedia.org/wiki/Simulated_annea
ling]
[15] Wikipedia, [http://en.wikipedia.org/wikilBoltzmann#The
_Boltzmann_equation]
[16] B. Hom and B. Schunck. "Determining optical flow".
Artificial Intelligence,17:185-203, 1981.

220

Proceedings of the 2012 International Conference on Wavelet Analysis and Pattern Recognition, Xian, 15-17 July, 2012

[17]N. Haering, P. Venetianer, and A. Lipton. "The evolution

of video surveillance: an overview". Machine Vision and
Applications, 19(5-6):279-290,2008.
[18]L. Seidenari, M. Bertini. "Non-parametric anomaly
detection exploiting space-time features". ACM
Multimedia, pp.1139-1142, 2010.
[19]V. Mahadevan, W. Li, V. Bhalodia and N. Vasconcelos.
"Anomaly Detection in Crowded Scenes". CVPR , pp.
1975-1981,2010
[20] R. Mehran, A. Oyama, and M. Shah. "Abnormal Crowd
Behavior Detection using Social Force Model". CVPR
2009, pp.935-942.
[21] Yana Momchilova Mileva, "Invariance with Optic Flow",
Mathematical Image Analysis Group, Department of
Computer Science, Saarland University, Master Thesis.
2009
[22] Shuo Liu, " Object Trajectory Estimation Using Optical
Flow", Utah State University, Bachelor Thesis. 2009
[23]D. Helbing and P. Molnar. "Social force model for
pedestrian dynamics". Physical Review E, 51:4282, 1995.
[24] Unusual crowd activity dataset of University of

Minnesota, available from

http://mha.cs. umn.edu/movies/crowdacti vi ty-al1.avi.
[25] Chris Stauffer, W. Eric L. Grimson. "Adaptive
background mixture models for real-time tracking".
CVPR , vol. 2, pp. 2246-2252, 1999
[26] S. Ali and M. Shah. "Floor fields for tracking in high
density crowd scenes". ECCV ,pp. 1-14,2008
[27] N. Dalal and B. Triggs. "Histograms of oriented
gradients for human detection". CVPR, pages 886-893,
2005.
[28] J. Yuan, Z. Liu, and Y. Wu. "Discriminative subvolume
search for efficient action detection". CVPR, pages
2442-2449,2009
[29] S. Wu, B. Moore, and M. Shah. "Chaotic invariants of
Lagrangian par-ticle trajectories for anomaly detection in
crowded scenes". CVPR, pp. 2054-2060,2010
[30] http://www.cvg.rdg.ac.uklPETS2009/index.html
[31]A. Adam, E. Rivlin, I. Shimshoni, and D. Reinitz.
"Robust real-time unusual event detection using multiple
fixed location monitors". IEEE TPAMI , 30(3):555-560,
2008.

221