FALL DETECTION METHOD USING MOTION
HISTORY OF IMAGE IN THE HOME CARE
APLICATION SYSTEM
Sidiq Syamsul H.1, Rizki Aditya C.2, Agus Rochadi 3, Thomas Agung 4, Eddy Triyono 5, dan Suhendro 6
Dept. Electrical Engineering, Telecommunication Engineering, State Polytechnic of Semarang, Indonesia
cuizkye69@gmail.com
Abstract- The growth rate of the elderly in Indonesia is
increasing every year. According of the World Health
Organization (WHO), falls is the second largest of death in the
world, amounting to 646,000 times per year. For this reason, this
study has designed a fall detection system using video (offline),
using the Motion Histoy of Image (MHI) method. The tests were
carried out by inputting the video (offline), falling with a camera
distance of 300cm, 350cm, and 400cm, high cameras 70cm,
100cm and 140cm, and light intensity 310 lux and 959 lux on the
Raspberry Pi 3. Fall detection using Raspberry Pi 3 shows
optimal results at a distance of 300cm - 350cm using the
environment using natural light sources with a light intensity of
959 lux and at a distance of 300cm with a light intensity of 310
lux. The Motion History of Image method produces the
C_Motion parameter value that will be used as a reference for
fall detector. MATLAB R16 software is used to show the
visualization of falling object on the motion history of the
image.The results of this study indicate an accuracy of 82.5%,
sensitivity 80%, and error 17.5% for data on falling or not
falling conditions.
Index Terms—C_Motion, Fall detection, Motion History of
Image, Raspberry Pi 3, MATLAB R16
I. BACKGROUND
The growth rate of the elderly in Indonesia is increasing
every year. BPS projects that by 2045, Indonesia will have
around 63.31 million elderly people or reaching 20 percent
of the population. In fact, the UN projection will also
announce the percentage of elderly people in Indonesia will
reach 25 percent in 2050 or around 74 million elderly [1].
According to the World Health Organization (WHO) the
number is the biggest cause of death in the world,
amounting to 646,000 times per year.
Health care at home (Home care) is the provision of
services and professional equipment for patients or families
at home to maintain health. There is technology for health
services in Indonesia, the Telehealt application. Telehealth
service systems use the internet with video, email, sms, and
cell phone systems [2].
The design of a fall detection surveillance system has
been developed using an accelerometer and gyroscope
sensor but there are weaknesses of the use of the fall
detection device because it requires the user to install or
carry on the body in order to work and has a high risk of
damage or loss is quite high [3].
Other studies in detecting falls are using smartphones.
Sensor data is taken from smart phone users placed on the
left chest. When people fall, the system will detect and
activate the alarm system [4].
Motion History Image (MHI) is one method to detect
someone's movements, the recorded video is divided into
several images, from many of these images will be
processed to find out the movement of objects that are from
changes in the pixel, when the normal movement of image
pixels does not experience large changes, whereas when
abnormal movements such as falling, the movement of
objects changes from standing, sitting or sleeping, then
being quiet, the pixels will change very quickly [5].
There are studies relating to fall detection is to use a
camera [6]. In the fall detector using a camera is a good
solution to be used in detecting falls because the camera
can analyze the condition of objects without touching them
directly.
II. BASIC THEORY
A. Motion History of Image
Motion History Image (MHI) is one method to detect
someone's movements, the recorded video is divided into
several images, from many of these images will be
processed to find out the movement of objects that are from
changes in the pixel, when the normal movement of image
pixels does not experience large changes, while when the
movement is not normal like falling, the movement of an
object changes from standing, then sitting or sleeping, then
being quiet, the pixels will change very quickly [5].
This Motion History Image (MHI) was first introduced by
Bobick & Davis where pixel intensity represents the
novelty of movement in an image or video and in general
Motion History of Image is used for recognition activity[7].
1
Journal of Telecommunication, Electronic and Computer Engineering (JTEC)
To get an MHI, the first step is to extract the binary
sequense motion of object D (x, y, t) from the original
image I (x, y, t).
Then each pixel of Motion History of Image Ht is a
function in the time span t, the equation is :
(1)
Information :
x = pixel position at x coordinates.
y = pixel position in the y coordinate.
𝐻𝜏 (x, y, t) = Motion History Image (MHI).
D (x, y, t) = Binary sequence of object movements.
The result is the value of Figure 1. where the movement
of the object will turn white, the following is the result of
motion history of image (MHI).
Figure 1: Fall detection using MHI
B. Digital Image Representation
Image is a picture, similarity or imitation of an object.
Image as the output of a data recording system can be
digital. Digital images are images that can be processed by
a computer. Digital images are obtained using optical
sensors, after the optical sensors then digital images form a
two-dimensional plane (x, y). The intensity of the sensor
received at each point (x, y) is symbolized by f (x, y),
where x (row) and y (column) are the coordinates of the
position f (x, y) which states the intensity of the color level
of the pixel at the point [8].
The results are in Figure 2. The coordinates of digital
images are M and N, where M is a row and N is a column.
Figure 2. Digital Image Coordinate
C. Confusion Matrix
Confusion matrix is a method used for evaluating
classification models. Know any data classified correctly or
not. One of the benefits of confusion matrix is seeing
whether the system is right or not in classifying between the
two options [9].
confusion matrix which classifies predictive data
comparisons with outcome data into 4 categories: True
positive (number of positive results classified as positive),
false positive (number of negative results classified as
positive), false negative (number of positive results
classified as negative), true negative (the number of
negative results classified as negative). The general
equation of confusion matrix is:
(2)
(3)
(4)
III. SYSTEM PLANNING
Figure 3: Research implementation method
In Figure 3. the fall detection design with motion
history of image requires the installation of raspbian,
python environment and opencv as a library. Then the
test data retrieval is done by adjusting the camera
position and light intensity. Then an analysis is made
and a conclusion is reached.
Then in Figure 4. explains that the design of the fall
detection method system is to use Raspberry Pi 3 model
B as a mini pc, where the object detection process is
done by getting input in the form of video recording
(offline) with a resolution of 640x480 using a digital
camera. The screen resolution of the fall detection
system on the Raspberry Pi is set at 500 x 500 pixels. it
is intended to ease the work of the mini pc. When the
system detects an object, then the system will process a
boundary box and when a fall is detected the system
will do a screenshot.
2
Journal of Telecommunication, Electronic and Computer Engineering (JTEC)
Figure 4: Flow chart system
The focus of this research is to find out the
performance of the fall detection system using
Raspberry Pi 3 Model B with motion history of image
and to know the level of accuracy, sensitivity, and error.
In the use of fall detection the results of fall detection
are then analyzed using a confusion matrix to determine
the value of accuracy, sensitivity and error.
IV. SCENARIO TESTING
Data retrieval phase in this research is to take video
data as fall fall input data using a camera that has been
installed inside the house. Tests related to the fall
detection method are carried out in accordance with the
parameters specified are camera positions with a camera
height of 70cm, 100cm, 140cm and with a camera
distance of 300cm, 350cm and 400cm. As well as the
brightness level in the testing environment in the room
with a light intensity of 310lux and 959lux. The area of
the room used is 3 meters x 4.5 meters.
Figure 5: Test room area
In Figure 5. A deliberate fall is taken with a light
intensity of 310lux and 959 lux. Retrieval of data is
done by observing changes in the value of the object's
falling speed based on distance and height that are
different.
V. RESULTS AND ANALYSIS
In this chapter the researcher will collect data for later
analysis according to the desired parameters. The data
that has been taken at the time of testing is the intensity
of the light, and the position of the camera, by falling in
a standing position, which is then examined the
accuracy of the fall detection method system.
After getting the light intensity and distance of the
camera with good results, then the test was repeated
over and over 20 times with data falling and not falling.
Then from the data taken Accuracy calculations using
equation (2), for sensitivity calculations using equation
(3) and Error with equation (4).
A. Test results at 310lux
The results of testing the fall detection system work
using 310lux light intensity using the lightmeter
application, carried out a trial shifting the position of
the camera with a camera height of 70 cm, 100 cm, 140
cm and a distance of 300 cm, 350 cm, 400 cm.
The results of fall detection sensitivity with 310lux
light intensity are shown in Figure 6. It can be seen that
the fall detection experiment with the camera position
with 310 lux light can be seen that the highest
confidence value is obtained at the height of the camera
140 cm with a distance of 300 cm that is equal to 80%
and at the height of the camera 70 cm with a distance of
350 cm that is equal to 80%, while the lowest
3
Journal of Telecommunication, Electronic and Computer Engineering (JTEC)
confidence value is obtained at the height of the camera
70 cm with a distance of 400 cm, 100 cm at a distance
of 400 cm and at a height of 140 cm with a camera
distance of 400 cm that is equal to 40%, due to the
difficulty of the system in detecting falls if the distance
between the object and the camera is too far away.
Figure 6: Graph of fall detection sensitivity value with
light intensity 310lux
B. Test results at 959lux
The results of testing the fall detection system work
using 959lux light intensity using a lightmeter
application, carried out a trial shifting the position of
the camera with a camera height of 70 cm, 100 cm, 140
cm and the distance of the camera 300 cm, 350 cm,
400cm.
The results of sensitivity fall detection with 959lux
light intensity are shown in Figure 7. It can be seen that
the experiment with the position of the camera with 959
lux light can be seen that the lowest confidence value is
obtained at the height of the camera 140 cm with a
distance of 400 cm that is equal to 40%, due to the
difficulty of the system in detecting fall when the
distance between the object and the camera is too far
away. As for the highest confidence value, namely at a
70 cm camera height with a distance of 350 cm, 100 cm
with a distance of 300 cm and a camera height of 140
cm with a camera distance of 300 cm that is equal to
100%.
Figure 7: Graph of fall detection sensitivity value with
light intensity 959lux
C. Test results using software MATLAB
Tests carried out are by inserting or inputting video
recordings of people falling into the matlab software.
The video used has a resolution of 640 x 480. To
display the movements of people falling, the parameter
used is the Motion History of Image, which is 𝐻𝜏 (x, y,
t - 1).
Figure 8: Display people falling with Motion History of
Image
The parameter for falling person is if the pixel speed
changes (0.6). In the fall detection programming using
MATLAB Software, the parameter value of pixel speed
change (t) can be seen in Figure 9 [10].
Where in the picture there are objects that are
recognized as falling and forming a history in the frame.
The history is pixels that have speeds greater than (t>
0.6).
Figure 9: Motion History of Image detection results
1. Analysis of fall detection test with light intensity
310lux and 959lux
From the test data that has been obtained previously,
an analysis of the fall detection system can be analyzed.
In the fall detection system that has been designed and
tested, camera position and light intensity greatly affect
the detection results of objects produced by the system.
The sensitivity equation indicated for the fall
detection system used in this study can be seen in
formula (3).
4
Journal of Telecommunication, Electronic and Computer Engineering (JTEC)
Figure 10: Comparison sensitivity graph in 310lux and
959lux tests
In figure 10. note that the intensity of light is very
influential in detecting falling objects. In the trial of
falling detection at a distance of 300 cm with a light
intensity of 959 lux has an average value of 100%,
while at a distance of 300 cm camera with a light
intensity of 310 lux only has an average value of falling
detection of 80%.
In experiments using 310 lux light intensity, the
change in distance between the camera and the object
also has an effect on falling detection. This can be seen
by the difficulty of detection by the system at testing
with a distance of 400 cm which is 40%. In addition, in
subsequent tests conducted there were 60% in
experiments at a distance of 350 cm. So that the system
can only detect well at a distance of 300 cm which is
80%. This can lead to the conclusion that the distance
between the cameras
with object testing affect the results of object
detection carried out by the system.
Then with a light intensity of 959 lux there is a high
average detection rate of 100% at a distance of 300 cm
camera. Due to the distance of the camera is not too far
away on the object and is supported by environmental
conditions using natural light with the intensity of light
received by the system of 959 lux.
From the data that has been obtained from testing with
lux 310 or 959, changes in camera height made do not
have an effect on in detecting falls, or it can be
concluded that the height of the camera with 70 cm, 100
cm and 140 cm has no effect on the value of confidence
object detection.
2. Analysis of falling and not falling data testing
Then a test is performed to calculate the accuracy,
sensitivity and error in the fall detection system. Testing
is done by taking a lot of data with different conditions,
namely falling and not falling. The data used are 100cm
camera height, 300cm camera distance and 959lux light
intensity.
The confusion matrix equation that is indicated for the
fall detection system used in this study can be seen in
the formula accuracy (2), sensitivity (3), and error (4)
[11].
Tabel 1
Tabel Hasil Perhitungan
The results of table 1, there are falling movements
detected fall by the system as many as 16 True Positive
data, falling movements but not detected by the system
amounted to 4 False Negative data, then non-falling
movements detected by the system that fall detected
amounted to 3 False Positive data, and no falling
movements detected were not dropped by the system by
17 True Negative data.
Tests presented in tabular form show real data. Where
in the fall detection system the results of testing with 40
data show that the Accuracy of the system is 82.5%,
80% sensitivity and 17.5% Error.
VI. CONCLUSIONS AND SUGGESTION
A. Conclusion
From the experimental results and the manufacture of
systems in this study can be taken some conclusions as
follows:
1. The fall detection performance using Raspberry Pi 3
shows the maximum detection result at a distance of
300cm with a value of 100% and the state of the
environment using a natural light source with a light
intensity of 959lux
2. The fall detection performance using raspberry pi 3
shows the maximum detection result at a distance of
300cm with a value of 80% as well as the state of
the environment using a natural light source with a
light intensity of 310lux
3. The intensity of light is very influential in detecting
falling objects
4. Tests with changes in camera height carried out at
70cm, 100cm and 140cm did not have an effect on
the detection of falls
5. In this dall detection study, it has an accuracy of
82.5%, sensitivity 80%, and error 17.5% using trial
data falling and not falling.
5
Journal of Telecommunication, Electronic and Computer Engineering (JTEC)

B. Suggestion [11] X. Kong and L. Meng, “Fall Detection for

In this research study, in order to become more Elderly Persons Using a Depth Camera,” vol.
leverage then given suggestions as follows: 13, pp. 269–273, 2017.
1. The system used still has a low accuracy of the
movement does not fall or fall movement. It is
recommended that further research improve the
system that has better accuracy than this research.
2. Necessary to improve the ability of hardware to be
able to detect falling people accurately and faster.
3. The hope is to be able to give an early warning if
the occupants of the house are falling, so that
residents can get help as soon as possible using an
email-based home care system application.

REFERENCES
[1] BPS, “Statistik Penduduk Lanjut Usia,” 2018.
[2] R. Istifada, “PADA PERAWAT DI
LAYANAN HOMECARE sangat luas ,
sehingga akses antara satu belum diaplikasikan
pada layanan,” vol. 5, no. 1, pp. 51–61, 2017.
[3] S. Norhabibah, W. A. K, and D. Risqiwati,
“Rancang Bangun Sistem Monitoring Deteksi
Jatuh untuk Manula dengan Menggunakan
Accelerometer,” JOINCS (Journal Informatics,
Network, Comput. Sci., vol. 1, no. 1, pp. 43–52,
2017.
[4] Rakhman, “Fall Detection System Using
Accelerometer and Gyroscope Based on
Smartphone,” pp. 99–104, 2014.
[5] S. Ishikawa, “Motion history image : Its
variants and applications,” no. June 2014, 2010.
[6] Mohd Brado frasetyo, “Comparison of Motion
History Image and Approximated Ellipse
Method in Human Fall Detection System,”
2019. [Online]. Available:
https://id.wikipedia.org/wiki/Ponsel_cerdas.
[7] A. F. Bobick and I. C. Society, “The
Recognition of Human Movement Using
Temporal Templates,” vol. 23, no. 3, pp. 257–
267, 2001.
[8] M. B. Frasetyo, J. T. Elektro, F. T. Industri, and
U. I. Indonesia, “Sistem pendeteksi jatuh pada
manusia berbasis pengolahan citra,” 2018.
[9] IPB, “CONFUSION MATRIX,” pp. 2–5, 2011.
[10] E. S. Wahyuni, M. B. Frasetyo, and H.
Setiawan, “Combination of motion history
image and approximated ellipse method for
human fall detection system,” Int. J. Simul.
Syst. Sci. Technol., vol. 19, no. 3, p. 13.1-13.6,
2018.