Sie sind auf Seite 1von 19

J Med Syst (2017) 41:7

DOI 10.1007/s10916-016-0645-8

MOBILE & WIRELESS HEALTH

Variability Analysis of Therapeutic Movements


using Wearable Inertial Sensors
Irvin Hussein López-Nava1 · Bert Arnrich2 · Angélica Muñoz-Meléndez1 ·
Arzu Güneysu2

Received: 23 May 2016 / Accepted: 19 October 2016


© Springer Science+Business Media New York 2016

Abstract A variability analysis of upper limb therapeu- classification and variability using features and distances
tic movements using wearable inertial sensors is presented. calculated previously. The classification analysis was made
Five healthy young adults were asked to perform a set of to determine if the movements performed by the test sub-
movements using two sensors placed on the upper arm and jects of both groups are distinguishable among them. The
forearm. Reference data were obtained from three thera- variability analysis was conducted to measure the sim-
pists. The goal of the study is to determine an intra and ilarity of the movements. According to the results, the
inter-group difference between a number of given move- flexion/extension movement had a high intra-group variabil-
ments performed by young people with respect to the move- ity. In addition, meaningful information were provided in
ments of therapists. This effort is directed toward studying terms of change of velocity and rotational motions for each
other groups characterized by motion impairments, and it individual.
is relevant to obtain a quantified measure of the quality
of movement of a patient to follow his/her recovery. The Keywords Therapeutic movements · Acceleration
sensor signals were processed by applying two approaches, signals · Quaternions · Wearable sensors · Inertial sensors
time-domain features and similarity distance between
each pair of signals. The data analysis was divided into
Introduction

This article is part of the Topical Collection on Mobile & Wireless Quantitative measures of human movement are important
Health. for distinguishing both, healthy and pathological conditions
as well as for expressing the outcomes and changes that
 Irvin Hussein López-Nava are clinically important in the functional state of persons
hussein@inaoep.mx [1]. In general, an important element in rehabilitation is to
Bert Arnrich obtain a quantified measure of the quality of movement of a
bert.arnrich@boun.edu.tr patient to follow his/her recovery and select the most appro-
Angélica Muñoz-Meléndez priate therapeutic treatments. An objective quantification of
munoz@inaoep.mx human movements contributes to better understanding the
Arzu Güneysu patient condition, and might serve as a measure of efficacy
arzu.guneysu@boun.edu.tr of the rehabilitation treatment [2].
Recent approaches that involve repetitive training of
1 Department of Computer Science, Instituto Nacional de the upper limb on task-oriented activities give evidence
Astrofı́sica, Óptica y Electrónica, 72840, Tonantzintla, of efficacy for actively improving the motor functions of
Mexico
rehabilitation patients [3]. These repetitive training activ-
2 Department of Computer Engineering, Bogazici University, ities or therapeutic movements have to be provided by a
34342, Istanbul, Turkey therapist with the aim that rehabilitation patients perform
7 Page 2 of 19 J Med Syst (2017) 41:7

the same movement, following visual instructions, based on impairments to assess their mobility relative to reference
repetition and practice [4]. data. This intermediate group might be composed of healthy
The most frequently used instruments for the upper people who are non therapists and who do not have mobility
limb functional assessment are clinical scales, that have impairments either.
been standardized and validated previously. However, these For that, this study can contribute to understand how
instruments have a high subjective component depending on young persons perform therapeutic movements using com-
the observer who scores the test [1, 2]. Automated systems putational techniques applied to sensor signals. This effort
for measuring human motion could provide to the therapist is directed toward studying in the future other groups char-
numerical metrics to assess the patient’s recovery process acterized by motion impairments.
and potentially allow physiotherapists to assess the effec- The rest of the paper is organized as follows.
tiveness of various treatment protocols over a population of Section “Related work” addresses related work. Sec-
patients [5]. tions “Experimental setup” and “Data processing” describe
However, patient data analysis for progress assessment the experimental setup and data processing applied in this
and monitoring is a challenging task because of the com- study. Sections “Inter-group classification analysis” and
plexity of human motion [6]. Human movement consists “Intra and inter-group variability analysis” give details
mainly of continuous time variations of multiple degrees of the classification and variability analysis. Finally,
of freedom (DoF), making single DoF comparisons incom- Sections “Discussion” and “Conclusions” close with the
plete and unreliable [7]. Also, human motion shows signifi- discussion about the results, trends and applications of this
cant temporal and spatial variability for different repetitions study.
of the same therapeutic movement. Additionally, human
characteristics such as age, gender, height, and weight,
increase the difficulty in the measurement and evaluation of Related work
such movements.
To investigate the feasibility of measuring and assessing There are some techniques to measure and assess the upper
functional upper limb motion, we analyze five therapeutic limb movements of patients in rehabilitation, robot-based
movements performed by asymptomatic young persons in systems [8–11], vision computer methods [12–15], among
contrast to reference data from therapists. It is important others. Also in recent years, there has been an increasing
to remark that the motion analysis of healthy persons is a interest in designing wearable devices to monitoring and
first step towards studying the mobility of patients in reha- training rehabilitation [16–18, 20].
bilitation. This research addresses the following research Concerning the wearable sensors approach, Uswatte
questions: et al. [16] evaluated the reliability and validity of accelerom-
etry for measuring upper limb rehabilitation outcome. 10
1. How similar are the movements of young persons with
patients with stroke were asked to wear an accelerometer
regard to movements of therapists?
on each arm, the chest and the more affected leg, before
2. What is the variability of the subjects of the same group
and after the treatment. Also, 10 volunteers with stroke par-
performing a set of movements?
ticipated in the study as control group. In the treatment
3. Which of the studied movements have greater and lesser
group, there was a significant increase from pre- to post-
intra and inter group variability?
treatment, while in the control group the change was not
In this study the therapeutic movements are provided significant. The movement recorded by each accelerometer
by a group of therapists, whose movements can be used was used for assessing whether or not rehabilitation has an
as base of comparison for several study groups. The ulti- effect on arm function outside the laboratory. Moreover, the
mate objective is establishing a comparison of movements cited study suggests that just two accelerometers are ade-
performed by rehabilitation patients against movements per- quate for assessing whether rehabilitation has an effect on
formed by therapists. However, patients on rehabilitation arm function outside the laboratory.
may present greater movements variability due to different Van der Pas et al. [17] studied the validity of accelerom-
factors including the individual effect of physical therapies, etry in the assessment of arm activity of patients with
or the widely dispersed intra group range of motions. Is impaired arm function after stroke. They placed two
expected that the intra and inter therapist’s variability will accelerometers on the wrists of 45 patients for measuring
be lower than any other group because they are specialists the amount of upper extremity activity in daily life. The
trained in methods for treating mobility impairments. In this magnitude of the vector of acceleration was calculated and
regard, it is necessary to evaluate the mobility of an interme- used as representation of the movement intensity across
diate group between specialists and patients with mobility time. Clinical scales were used as external criterion to test
J Med Syst (2017) 41:7 Page 3 of 19 7

Fig. 1 Sequence of a movement


performed by a test subject with
the two sensors placed on the
upper limb. The movement is
touching with the hand the
posterior neck. Figs. (a) and (c)
show a subject in the initial
position with the right upper
limb static, and Fig. (b) shows
the situation when the subject
reaches the posterior neck with
the hand

the concurrent validity of arm accelerometry data. The cited Zhang et al. [19] proposed an approach using inertial
study revealed that both unilateral (activity of the affected sensors to quantitatively evaluate the motor function of
arm) and bilateral (ratio between the activity of the affected the patients with stroke. The sensors were placed on the
and non-affected arm) accelerometry are valid methods to forearms of 3 persons, including 1 healthy subject, during
assess arm activity after stroke. 5 motor task for capturing detailed patterns and intrinsic
Parnandi et al. [18] worked on wearable sensor-based characteristics exhibited in their movements. Acceleration
assessment of motor function in post stroke individuals. In and angular velocities signals were used for extracting fea-
this study 1 participant wore a sensor on the wrist in order tures and for comparing motion trajectories. The results
to estimate the functional ability (FA) score of a clinical show the effectiveness in capturing the detailed patterns
test and compared it to the assessment given by a therapist. that standard clinical scores fail to reflect. This is useful to
Then, statistical features were extracted from acceleration clinicians for tracking the progress of the patients during
signals and a classifier was used for the estimation of the rehabilitation.
functional ability scale. The results showed that the affected Recently, Strohrmann et al. [20] investigated changes
arm has more information content at higher frequencies as in the movement capacity during defined motor tasks.
compared to the unaffected arm, which corresponds to the They used 10 wearable sensors placed on the body and
involuntary motion. Also, the automated system is able to conducted experiments involving 4 children with motor
compute the FA score to a good level of accuracy. function impairments. Data analysis consisted in extracting
features from the sensor data, linear acceleration and angu-
lar velocity, and applying a regression analysis to assess the
motor function in comparison with the assessment of the
experts. The results achieved in this research show a low
error and a good correlation between estimated values and
the experts’ ratings. The sensors that provide the most valu-
able information were those placed on each wrist and the
hip.
In this study, we propose the use of wearable inertial sen-
sors to characterize the movements of upper limbs in five
therapeutic movements, using time-domain features and
similarity distances from linear acceleration and orientation
signals. The purpose of this study is to analyze the variabil-
ity of healthy young subjects, as a particular case study, with
respect to reference movements of therapists. This research
is oriented to comprehend the basis that enable later the
Fig. 2 Configuration of the two Exel sensors on the upper limb of
subjects, x-axis of both sensors are aligned with the sagittal plane of
study of the movements of specific pathological groups.
the subject, y-axis and z-axis are both aligned with the transverse and It will also serve as basis for a subsequent comparison of
frontal plane, respectively groups of healthy and non-healthy subjects.
7 Page 4 of 19 J Med Syst (2017) 41:7

Fig. 3 Graphical representation of data analysis. Data flow: A and time-series features of each segmented signal used for inter-group clas-
B are acceleration and orientation signals from sensors placed on sification analysis; E is only the feature mean of each segmented signal
the upper arm and the forearm, respectively; C are normalized sig- used for inter and intra-group variability analysis; and F are distances
nals segmented by each repetition of the five movements; D are nine between each pair of segmented signals using DTW algorithm that are
used for inter and intra-group variability analysis

Experimental setup 5. Touching with the hand the opposite shoulder.


The movement 3 consisted in performing the complete
Therapeutic movements and subjects
range of motion of pronation of the forearm, and then return
to the initial position performing the supination, whereas
Five movements were selected by three therapists since
the movement 4 consisted in the flexion of the arm verti-
these movements are focused on physiotherapy actions to
cally up and then return to the initial position performing
increase functionality of the upper limbs of persons [21].
the extension. Movements 1, 2 and 5 consisted in mov-
The five therapeutic movements are listed below:
ing the upper limb from the initial position up to touching
1. Touching with the hand the lower back. the lower back, the posterior neck or the opposite shoulder,
2. Touching with the hand the posterior neck. respectively, and then returning the upper limb to the initial
3. Pronation and supination of the forearm. position. An example of a movement sequence (movement
4. Flexion and extension of the arm. 2) is illustrated in Fig. 1. Figure 1a and c show the situation

Table 1 Classification results of the five movements and three data treatments using J48 algorithm

Movement Data TPR (sensitivity) TNR (specificity)

Touching the lower back Acc 0.93 0.93


Quat 0.97 0.97
Acc+Quat 0.95 0.93

Touching the posterior neck Acc 0.81 0.81


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Pronation/supination of the forearm Acc 0.96 0.96


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Flexion/extension of the arm Acc 0.99 0.99


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Touching the opposite shoulder Acc 0.83 0.82


Quat 0.99 0.99
Acc+Quat 0.99 0.99
J Med Syst (2017) 41:7 Page 5 of 19 7

Table 2 Classification results of the five movements and three data treatments using Naı̈ve Bayes algorithm

Movement Data TPR (sensitivity) TNR (specificity)

Touching the lower back Acc 0.99 0.98


Quat 0.99 0.98
Acc+Quat 0.99 0.98

Touching the posterior neck Acc 0.88 0.89


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Pronation/supination of the forearm Acc 1.00 1.00


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Flexion/extension of the arm Acc 0.88 0.92


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Touching the opposite shoulder Acc 0.80 0.83


Quat 1.00 1.00
Acc+Quat 1.00 1.00

when a subject is in the initial position with the right upper For this study data from two groups was considered.
limb static and Fig. 1b shows the situation when the subject Therapists group: data captured from movements of three
reaches the posterior neck with the hand. therapists, that was used as reference (from now on referred

Table 3 Classification results of the five movements and three data treatments using Logistic regression algorithm

Movement Data TPR (sensitivity) TNR (specificity)

Touching the lower back Acc 0.99 0.99


Quat 0.97 0.96
Acc+Quat 0.99 0.98

Touching the posterior neck Acc 1.00 1.00


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Pronation/supination of the forearm Acc 1.00 1.00


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Flexion/extension of the arm Acc 1.00 1.00


Quat 1.00 1.00
Acc+Quat 1.00 1.00

Touching the opposite shoulder Acc 0.94 0.94


Quat 1.00 1.00
Acc+Quat 1.00 1.00
7 Page 6 of 19 J Med Syst (2017) 41:7

Fig. 4 F-measure result of


classification of five movements
in both groups: therapists and
non-therapists, from the three
classifiers

as T 1, T 2 and T 3), and Non-therapists group: data captured Sensors and data
from movements of five subjects without mobility prob-
lems, mean age 32 ± 2.3 years (from now on abbreviated Two EXLs3 sensors (EXEL srl, Bologna, Italy) were used
as NT 1 to NT 5). All subjects have a dominant right arm. in this study to measure upper limb motions. The EXLs3 is a
Each movement was repeated ten times by each subject of miniaturized electronic device with the function of real-time
both groups. Inertial Measurement Unit. It features a complete MEMS

a b
Fig. 5 Intra and inter group variability analysis from mean feature of acceleration signals of (a) the upper arm, and (b) the forearm, of both
groups: non-therapists group (dashed lines) and therapists group (solid lines)
J Med Syst (2017) 41:7 Page 7 of 19 7

sensor set, which is composed by a tri-axial accelerometer, Data processing


gyroscope and compass, a 32-bit microprocessor for data
processing and a Bluetooth radio to send real-time data. In order to analyze the variability of data recorded from iner-
The size of the module is 54mm × 33mm × 14mm and its tial sensors in both groups, two approaches were used for
weight is 22g. data processing. In Fig. 3 a graphical representation of data
Sensors were placed on two anatomical references of the analysis is presented. Acceleration and orientation signals
upper limbs of the test subjects. The first anatomical ref- of the sensors placed on the upper arms and forearms (A and
erence was located 10 cm up to the right elbow joint, in B, respectively) were segmented and normalized according
the lateral side of the upper arm aligned the x-axis and to the number of repetitions, from a total of ten repeti-
z-axis of the sensor with the sagittal and frontal plane of tions for each movement. Segmented signals (C) are used
the subject, respectively. The second anatomical reference as input of both data processing approaches: time-domain
was located 10 cm up to the right wrist joint, in the pos- features extraction and distance calculation between signals.
terior side of the forearm following the coordinated system Time-domain feature extraction consists in calculating a
of the sensor fixed on the upper arm. The sensors were measure that represents each segmented signal, see Section
firmly attached to the upper limb segments using elastic vel- “Extraction of time-domain features”. Distance calculation
cro straps. The coordinated system of the sensors is shown consists in estimating a similarity measure between pair
in Fig. 2. of segmented signals, see Section “Calculation of distance
From each sensor: linear acceleration data (AccX, AccY , measure” for a detailed explanation. Then, the features
AccZ) and orientation data (QW , QX, QY , QZ) in quater- extracted (D) were used for classifying data into thera-
nions were recorded. The sampling rate of the sensors was pists and non-therapists, see Section “Inter-group classifi
100 Hz. cation analysis” for a detailed explanation; and one feature

a b
Fig. 6 Intra and inter group variability analysis from mean feature of orientation signals of (a) the upper arm, and (b) the forearm, of both groups:
non-therapists group (dashed lines) and therapists group (solid lines)
7 Page 8 of 19 J Med Syst (2017) 41:7

Fig. 7 DT W mean distances of


acceleration signals for
therapists and non-therapists
subjects of the movement:
touching the posterior neck with
the hand

(E) and distances (F) were used for variability analysis, Warping (DTW) algorithm. DTW is an algorithm capable of
see Section “Intra and inter-group variability analysis”. A measuring similarity between two temporal sequences that
detailed description of these steps is presented below. vary in time [22]. DTW matches two time signals by com-
puting a temporal transformation aligning the signals. This
Extraction of time-domain features alignment is optimal in the sense that a cumulative distance
measure between the aligned samples is minimized [23].
In the first data processing approach, nine time-domain For each pair of segmented signals, X and Y , of length m
series features were calculated for each segmented signal. and n, respectively, where X = {x1 , x2 , ..., xi , ..., xm } and
These features are divided into two groups: central tendency Y = {y1 , y2 , ..., yj , ..., yn } a matching cost DT W (X, Y )
and dispersion features. Central tendency features include: is required. The matching cost was computed based on
arithmetic mean and median. Dispersion features include: dynamic programming using Eq. 1.
standard deviation, variance, root mean square, interquartile ⎧ ⎫
range, mean absolute deviation, minimum and maximum. ⎨ (i − 1, j − 1) ⎬
D(i, j ) = d(xi , yj ) + min (i − 1, j ) (1)
Further details are listed in the Appendix. ⎩ ⎭
(i, j − 1)
Calculation of distance measure where the distance function d(·, ·) is the Manhattan distance
(L1 -norm) used as cost measure and is defined in Eq. 2.
For the second data processing approach, a distance was
measured from segmented signals using Dynamic Time d(xi , yj ) = |xi − yj | (2)
J Med Syst (2017) 41:7 Page 9 of 19 7

Fig. 8 DT W mean distances of


orientation signals for therapists
and non-therapists subjects of
the movement: touching the
posterior neck with the hand

and consequently the dynamic time warping distance based on the Bayes’ theorem using the joint probabilities
between a pair of signals is DT W (X, Y ) = D(m, n). of sample observations to estimate the conditional prob-
abilities of classes given an observation [24]. J48 is an
implementation of the C4.5 decision tree classifier [25], that
Inter-group classification analysis builds a binary classification tree. Determined by a split-
ting criterion, attributes are selected as branching points
For the classification analysis based on the nine features that separate the two classes in the training dataset. Finally,
extracted, three algorithms were used to classify the data Logistic Regression is a generalized linear model to apply
into two classes: therapists and non-therapists. The objective regression to categorical variables. Generalizations of logis-
of this analysis was to evaluate if the movements performed tic regression apply to multi category responses and assume
by the test subjects of both groups are distinguishable a multinomial distribution [26]. The selection of the algo-
among them. rithms was based on the main classification approaches used
The classification algorithms selected were J48 classi- in the field.
fier, Naı̈ve Bayes and Logistic regression models. Naı̈ve The inter-group classification was performed for each
Bayes, a statistical classifier, has been shown to be success- movement individually, dividing data into three treat-
ful and simple for classification purposes. This algorithm is ments: acceleration data (9 f eatures × 3 acceleration
7 Page 10 of 19 J Med Syst (2017) 41:7

Table 4 DT W acceleration mean distances of the five movements from both groups: therapists and non-therapists

Movement Sensor Therapist group mean (sd) Non-therapist group mean (sd)

Touching the lower back Upper arm 0.24 (0.03) 0.30 (0.09)
Forearm 0.63 (0.21) 0.45 (0.05)

Touching the posterior neck Upper arm 0.28 (0.05) 0.46 (0.09)
Forearm 0.62 (0.05) 1.61 (0.56)

Pronation/supination of the forearm Upper arm 0.08 (0.02) 0.10 (0.03)


Forearm 0.56 (0.35) 0.28 (0.14)

Flexion/extension of the arm Upper arm 0.32 (0.11) 1.77 (1.77)


Forearm 0.58 (0.17) 0.66 (0.19)

Touching the opposite shoulder Upper arm 0.24 (0.03) 0.30 (0.09)
Forearm 0.63 (0.21) 0.45 (0.05)

signals × 2 sensors = 54 attributes), orientation data Specificity is the True Negative Rate (T NR) and mea-
(9 f eatures × 4 orientation signals × 2 sensors = sures the proportion of negatives which are correctly identi-
72 attributes), and a combination of both (54 + 72 = fied, Eq. 4.
126 attributes). The number of instances of the ther-
apists group was 150 (3 subj ects × 5 movements × T rue negatives
T NR = (4)
10 repetitions) and of the non-therapists group was 250 T rue negatives + F alse positives
(5 subj ects×5 movements× 10 repetitions). For a model
evaluation, a 10 cross-fold validation was used. F-measure (F) is the harmonic mean of recall and preci-
Three metrics were calculated from the classification sion and is calculated applying Eq. 5.
results:
2 (T P R ∗ P )
Sensitivity is the True Positive Rate (T P R), also called F = (5)
TPR + P
Recall, and measures the proportion of positives which are
correctly identified as indicated in Eq. 3. The result of classification from the three algorithms are
shown in Tables 1, 2 and 3. The columns show the metrics
that were calculated: true positive rate TPR and true nega-
T rue positives tive rate TNR for each classifier; the rows show the three
TPR = (3)
T rue positives + F alse negatives data treatments for each therapeutic movement. In general,

Table 5 DT W acceleration mean distances of the three axis from both groups: therapists and non-therapists

Acceleration signal Sensor Therapist group mean (sd) Non-therapist group mean (sd)

X-axis Upper arm 0.27 (0.13) 0.45 (0.30)


Forearm 0.75 (0.13) 0.82 (0.60)

Y-axis Upper arm 0.21 (0.10) 0.95 (1.60)


Forearm 0.40 (0.12) 0.70 (0.75)

Z-axis Upper arm 0.21 (0.07) 0.35 (0.16)


Forearm 0.66 (0.11) 0.55 (0.26)
J Med Syst (2017) 41:7 Page 11 of 19 7

Fig. 9 Intra a inter group


variability analysis from DT W
distances of acceleration signals
according to the movement
performed

the results of both metrics are consistent among them for angular orientation measures, how the movements were
all movements. Logistic regression models can discrimi- performed by each subject.
nate data of both groups using data of all treatments. J48
and Naı̈ve Bayes have the poorest results using acceleration
data. Intra and inter-group variability analysis
Figure 4 plots mean scores of the F-measure using
the three classifiers for all treatments for the five move- The variability analysis was divided into two subsections
ments studied in our research. The movements that can according to the data used. First, the time-domain feature
be classified more easily are touching the lower back and ‘arithmetic mean’ was used for the comparison of both
pronation/supination of the forearm, which indicates a high groups from linear acceleration and orientation data of the
variability of the inter-group data. In other words, these five movements. This analysis permit a visual difference
two movements performed by the subjects of non-therapists between all test subjects, and give us information about how
group did not come close to those made by the thera- the movements are made with respect to the coordinated
pists. The next step was to conduct an intra-group analysis system presented in Section “Sensors and data”. In the sec-
to determine the variability of the movements within each ond analysis an intra and inter-group variability analysis
group, and thus to assess, through linear acceleration and was performed using the DTW distances of the movements
7 Page 12 of 19 J Med Syst (2017) 41:7

performed by the subjects. This analysis allows to mea- Variability analysis using the feature mean
sure the similarity of the movements in two parts, the first
was evaluating which group has a major similarity inter- In this analysis a comparison between subjects of both
group, and the second was evaluating which group has a less groups was performed using the time-domain feature ‘arith-
similarity intra-group. metic mean’ of linear acceleration and orientation signals,
recorded from sensors attached on the upper arm and
the forearm of the persons. Linear acceleration provides
information about the corresponding change in velocity
(speed increasing or decreasing over time) in one of 3 axis
(AccX, AccY, AccZ). Orientation provides information about
the rotational motion expressed in quaternions that are com-
prised by four scalars (QW, QX, QY, QZ), the vector part
(QX, QY, QZ) represents the orientation axis and the scalar
part (QW) corresponds to the rotation angle [27].
In Figs. 5 and 6 the means of linear acceleration and
quaternion signals of each subject are shown according
to the five movements. In particular, very short move-
ments were recorded from upper arm data for prona-
tion/supination of the forearm for both acceleration and
quaternions, because the upper arms of the subjects were
mainly static, as expected.
From acceleration data (see Fig. 5), touching the lower
back movement presents low variability intra and inter
group. Touching the posterior neck and touching the oppo-
site shoulder movements have similarity intra and inter
a group for upper arm data; however, forearm data of
therapist T 2 show fewer acceleration than for the other
two therapists (T 1 and T 3) of two movements. Concerning
forearm data of touching the posterior neck movement,
the non-therapist group presents a high variability intra
group, only data of subjects NT 3 and NT 4 present low
variability with respect to to the data of therapist T 2.
Forearm data of touching the opposite shoulder move-
ment, data of subjects NT 1 to NT 4 present low vari-
ability with respect to the data of therapists T 1 and T 3.
Forearm data of flexion/extension of the arm and prona-
tion/supination of the forearm movements present similar
values intra group. Forearm data of pronation/supination
of the forearm movement present high intra-group simi-
larity as well as high variability inter-group. In particular,
upper arm data of flexion/extension of the arm move-
ment, data of subjects NT 1 and NT 3 have very high vari-
ability with respect to the other subjects non-therapists and
therapists.
From orientation data (see Fig. 6), the angular motion
recorded by the upper arms presents, in general, less
variability than the angular motion performed by the
b forearms of test subjects, and only data of subjects NT 1
and NT 4 present a high variability, as it was the case for
Fig. 10 Intra a inter group variability analysis from DT W distances the acceleration signals. Only forearm data of touching
of acceleration signals according to the acceleration signals the posterior neck, pronation/supination of the forearm and
J Med Syst (2017) 41:7 Page 13 of 19 7

Table 6 DT W orientation mean distances of the five movements from both groups: therapists and non-therapists

Movement Sensor Therapist group mean (sd) Non-therapist group mean (sd)

Touching the lower back Upper arm 0.01 (0.01) 0.01 (0.00)
Forearm 0.05 (0.03) 0.07 (0.03)

Touching the posterior neck Upper arm 0.02 (0.01) 0.02 (0.01)
Forearm 0.03 (0.01) 0.17 (0.06)

Pronation/supination of the forearm Upper arm 0.00 (0.00) 0.00 (0.00)


Forearm 0.02 (0.02) 0.02 (0.00)

Flexion/extension of the arm Upper arm 0.02 (0.00) 0.13 (0.08)


Forearm 0.03 (0.02) 0.09 (0.05)

Touching the opposite shoulder Upper arm 0.01 (0.01) 0.02 (0.01)
Forearm 0.11 (0.11) 0.09 (0.06)

flexion/extension of the arm movements have low variabil- subject) the DT W algorithm was applied to each pair of
ity intra group. Forearm data of touching the lower back sequences of the same type of signal, i.e. each movement
movement present low values of rotation and a high inter was performed 10 times per each subject, then 50 sequences
subject variability. In the forearm data of touching the were exhaustively evaluated using DT W .
posterior neck movement, only data of subjects NT 1 and Figures 7 and 8 illustrate examples of the mean distance
NT 5 present low variability with respect to the data of ther- of ten repetitions of acceleration and orientation signals for
apist group. Forearm data of pronation/supination of the the movement: touching the posterior neck with the hand.
forearm movement, non-therapist group present very low DT W distances from Upper arm and forearm data of
rotation values, indicating a high inter group variability. In both groups are presented using diagonal matrices. In these
particular for forearm data of flexion/extension of the matrices, low distances represent big similarity, the bigger
arm movement, only data of subject NT 1 is closed to the the similarity, the darker the cell. It is also worth to remark
therapist group. Finally for forearm data of touching the that in these matrices the groups corresponding to the intra
opposite shoulder movement, data of subject NT 2 is simi- and inter group analysis are gathered.
lar to the therapists T 1 and T 2, the rest of individuals of the Figure 7 indicates that a general high intra subject sim-
non-therapist group present very low variability with respect ilarity was found, except for the AccX acceleration signal
to the therapist T 3. of the upper arm of the subject NT 3 and the forearm
of the subjects T 2 and T 3. There are three cases in which
Variability analysis using DT W distances a very low similarity of a subject from the rest is esti-
mated: AccY acceleration signal of the upper arm for
In this section, a variability analysis using data of the NT 3, AccY acceleration signal of the forearm for NT 5,
second processing approach (see Section “Calculation of and AccZ acceleration signal of the forearm for NT 5 too.
distance measure”) is described. This variability analysis Only AccX acceleration signal of the upper arm for the
shows the similarity of the movements made by the test therapist group present high intra group similarity.
subjects, according to the acceleration and orientation sig- In Fig. 8 a high intra subject similarity from orientation
nals. In contrast to the analysis based on the feature mean, signals can be observed in general. There is only one case in
the DT W algorithm estimates a similarity measure between which a very low similarity of a subject to the rest is deter-
two signals for comparing the motion magnitudes (linear mined, for the QZ signal of the forearm for NT 2. The
acceleration and orientation) along time. four signals of the upper arm and QZ of the forearm
In order to measure the similarity between the 7 differ- present a high intra group similarity for therapist group,
ent signals (3 acceleration: AccX, AccY and AccZ, and 4 which means that this movement was performed similarly
orientation: QW , QX, QY and QZ, acquired from the sen- by the upper arm of the three therapists. In one case the
sors placed on the upper arm and the forearm of each subject NT 1 had high similarity with respect to the therapist
7 Page 14 of 19 J Med Syst (2017) 41:7

Table 7 DT W orientation mean distances of the quaternions from both groups: therapists and non-therapists

Orientation signal Sensor Therapist group mean (sd) Non-therapist group mean (sd)
QW Upper arm 0.02 (0.01) 0.05 (0.04)
Forearm 0.08 (0.08) 0.11 (0.10)

QX Upper arm 0.01 (0.01) 0.03 (0.03)


Forearm 0.05 (0.03) 0.06 (0.04)

QY Upper arm 0.02 (0.01) 0.06 (0.05)


Forearm 0.03 (0.02) 0.09 (0.09)

QZ Upper arm 0.01 (0.01) 0.02 (0.01)


Forearm 0.02 (0.01) 0.10 (0.09)

group, QX signal of the upper arm. In particular there of touching the posterior neck and upper arm data of
was only one signal indicating a high intra group similar- flexion/extension of the arm with low similarity of non-
ity for non-therapist group, QZ signal of the upper arm; therapist group with respect to the other group. These results
additionally an important inter group difference was deter- are presented in box-plots in Fig. 11; note also that a low
mined, which means that the movements were performed similarity of the forearm data of flexion/extension of
uniformly by the subjects within both groups, even though the arm of non-therapist group, with respect to the thera-
were performed different by the groups. pist group, can be observed. In particular two movements
The matrices of the other four movements were also cal- present high variability within both groups, forearm data
culated. After that, the mean and standard deviation (sd) of touching the lower back and touching the opposite shoul-
were calculated for both groups from all the matrices in two der which means that this anatomical segment was rotated
dimensions: by the five movements and by the sensor sig- differently by the subjects of both groups.
nals, for a total of three signals for acceleration and four According to Table 7, three signals present high inter
for orientation. Tables 4 and 5 show the DTW accelera- group variability, and two of them also have high intra group
tion mean distances of the five movements and of the three variability too. These signals are upper arm data of QX,
acceleration signals from both groups, respectively. and forearm data of QY and QZ with a low similarity
According to Table 4, three movements present not only of non-therapist group with respect to the therapist group.
high variability intra group, but also an inter group dif- The last two signals present a high intra group variabil-
ference. These movements were forearm data of touch- ity as is shown in the box-plots of Fig. 12. In general, the
ing the posterior neck and upper arm data of flex- non-therapist group have a greater dispersion values in all
ion/extension of the arm with low similarity of non-therapist orientation signals, resulting in a wider range of motion of
group, and forearm data of Pronation/ supination of the the subjects of this group in comparison to the therapist
forearm with low similarity of therapist group with respect group. In only one case the dispersion value of therapist
to the other group. These results are presented in box-plots group was grater than one for the non-therapist group, that
in Fig. 9. According to Table 5, only one signal presents was forearm data of QW.
an inter group difference, corresponding to upper arm
data of Y-axis with low similarity of non-therapist group
with respect to the other group. However, the box-plots Discussion
of Fig. 10 show a low intra group variability for all sig-
nals, including the signal Y-axis of the upper arm data, The goal of this study was to measure and analyze the
meaning that one of the therapists moved the upper arm at therapeutic movements made by a young persons group
different speed in comparison to the other two therapists. (non-therapists) with respect to reference data (therapists
Tables 6 and 7 show the DT W orientation mean dis- group). First, a classification study was presented in order to
tances of the five movements and of the four orientation know if the movements performed by the subjects of these
signals from both groups, respectively. groups are easily distinguishable. The classification results
According to Table 6, two movements present a high inter show high F-measure values, 0.96 from J48 algorithm,
group difference. These movements were forearm data 0.97 from Naı̈ve Bayes and 0.99 from Logistic regression
J Med Syst (2017) 41:7 Page 15 of 19 7

Fig. 11 Intra a inter group


variability analysis from DT W
distances of orientation signals
according to the movement
performed

models. These values indicate that the measured move- and only the subject NT 1 performed three movements:
ments of the afore mentioned groups are distinguishable, touching the lower back, touching the posterior neck and
and that the movements made by non-therapists group are flexion/extension of the arm as the therapists T 1 and T 2
not similar to the movements of reference data. For that rea- with the forearm, from linear acceleration data. These last
son a detailed variability analysis was required, in order to results are related to the speed with which the requested
determine which subject properly performed the movements movements were performed. From orientation data, subjects
according to the reference data, as well as knowing what NT 2 and NT 5 performed the movements as the three ther-
movements were executed correctly according to the linear apists with the upper arm, and only the subject NT 1
and angular measurements. rotated the forearm such as at least one therapist, except
Two variability analysis were performed based on two for touching the posterior neck. In this last movement even
different approaches, the first using the feature ‘mean’ cal- one subject rotated the forearm as the therapists. For touch-
culated from segmented linear acceleration and orientation ing the opposite shoulder movement, the five non-therapist
signals, and the second using both segmented signals. subjects rotated the forearm on two ways identified on the
According to the results of the first approach, the three therapist group.
non-therapist subjects NT 2, NT 3 and N5 performed the According to the results of the second approach, from
movements as the three therapists with the upper arm, linear acceleration data of upper arm, flexion/ extension
7 Page 16 of 19 J Med Syst (2017) 41:7

Fig. 12 Intra a inter group


variability analysis from DT W
distances of orientation signals
according to the orientation
signals

of the arm movement had a high intra group variability subjects of this group while the movement was performed;
for non-therapist group; from data of forearm touching from orientation data of forearm touching the lower back
the posterior neck and pronation/supination of the forearm and touching the opposite shoulder movements presented a
movements presented high intra group variability for non- high variability inside both groups, so that the execution of
therapist and therapist group, respectively, indicating that these two movements was different for all subjects in both
these movements were performed with different changes groups.
of speed over time. From orientation data of upper arm, In general, therapist group present a lower intra-group
flexion/extension of the arm movement had a high intra variability than non-therapist group according to the results
group variability for non-therapist group, this variability of both approaches. This intra-group variability can be
was caused by the rotation of the upper arm of some caused by the physiology of people, even inside the therapist
J Med Syst (2017) 41:7 Page 17 of 19 7

group, e.g., the size of muscles, flexibility and restriction knowledge provide valuable feedback that can be used by
of the joints, and the position of the sensors. Further- clinicians and therapists to customize rehabilitation therapy
more, results of inter-group variability can be caused by to the very specific needs of patients.
misunderstanding of the verbal instructions or by the incom- This study aims to analyze aspects of the motion of peo-
prehension of the therapeutic movements shown by the ple without movement problems as a basis for subsequently
therapists. analyzing other groups characterized by limited movement,
In addition, acceleration and orientation signals provide such as elderly or patients in rehabilitation. Furthermore,
meaningful information when comparing how the therapeu- we plan to increase the sample size of healthy test subjects,
tic movements were performed by each subject with respect as well as selecting and applying appropriate clinical scales
to the reference data from therapist group, in terms of the scores to our experiments to provide more significance to
change of velocity and the rotational motions, respectively. our findings.
Moreover, for clinicians and therapists information about A further advantage of the use of wearable sensors in
both the rotational motions reached by patients and the this area is their portability, so they can be used outside
velocity of these movements is crucial for determining how controlled laboratories for health monitoring and remote
therapeutic movements are actually performed by different medical care in daily living environments. Finally, wearable
groups of patients. These particularities might be associated inertial systems enable data collection in the wild, for appli-
to fatigue, discomfort or even unwillingness experienced by cations such as healthcare ecosystem, ambient intelligence
patients during their therapy [28]. and smart environments, providing a convenient service for
Consequently, the information of variability provides patient-centric healthcare [29, 30].
therapists meaningful information to analyze the variation
of particular therapeutic movements, and study if specific
known variations are associated to specific impairments, or Acknowledgments This work is supported by the Mexican National
even if transitions in these variations can be established and Council for Science and Technology, CONACYT (grant number
associated to the evolution of the patients. 271539/224405); and by the UBIHEALTH project, FP7-PEOPLE-
2012-IRSES, European Commission (grant 316337).

Conclusions
Appendix: Time-domain features
An analysis of five upper arm therapeutic movements made
The time-domain features are divided into two groups: cen-
by young persons without mobility problems with respect to
tral tendency (Eqs. 6 and 7) and dispersion (Eqs. 8–12), as
reference data of therapists, was presented. The movements
described below.
were measured using two inertial sensors placed on upper
In all the formulas detailed below: n is the size of the
arms and forearms of the subjects. Two type of data were
signal X, x is a value of X, th indicates the th-term of the
used for the analysis, linear acceleration and orientation.
ordered time serie X, and Q1 and Q3 are the lower and
The linear acceleration and the orientation represent the
upper quartile of X.
speed increasing/decreasing and the range of motion of the
movements performed by the test subjects. From these mea- – Arithmetic mean (x̄):
sures two approaches based on computational techniques
were applied in order to made an intra subject, and an intra x1 + x2 + ... + xn
x̄ = (6)
and inter group variability analysis. n
These approaches and techniques can help to quantify
and compare objectively the motion of the patients with – Median (f (x)):
respect to reference data for rehabilitation applications. In ⎧
th
some rehabilitation tasks it is important to measure the ⎪
⎨ n+1 term when n is odd
2
progress of the range of motions of the upper limb seg- f (x) =
th (7)

⎩( )
n th
2 term+ n+1
2 term
ments achieved by patients over time. In this regard, when n is even
2
this study contributes to gain knowledge on two important
aspects of rehabilitation. First, to quantify how the move- – Standard deviation (σ ):
ments performed by patients using their upper limbs are
similar to reference movements. And second, to know how 1
σ = (x1 − x̄)2 + (x2 − x̄)2 + ... + (xn − x̄)2
these movements are actually performed by patients with n
respect to each one of reference individuals. Both pieces of (8)
7 Page 18 of 19 J Med Syst (2017) 41:7

– Variance (σ 2 ): 10. Lo, A.C., Guarino, P.D., Richards, L.G., Haselkorn, J.K.,
Wittenberg, G.F., Federman, D.G., and Peduzzi, P., Robot-assisted
1  therapy for long-term upper-limb impairment after stroke. New
σ2 = (x1 − x̄)2 + (x2 − x̄)2 + ... + (xn − x̄)2 England J. Med. 362(19):1772–1783, 2010.
n 11. Wei, X.J., Tong, K.Y., and Hu, X.L., The responsiveness and cor-
(9) relation between Fugl-Meyer assessment, motor status scale, and
the action research arm test in chronic stroke with upper-extremity
– Root mean square (rms): rehabilitation robotic training. Int. J. Rehab. Res. 34(4):349–356,
2011.
1 2  12. Quintana, G.E., Sucar, L.E., Azcarate, G., and Leder, R.: Qual-
rms = x + x22 + ... + xn2 (10) ification of arm gestures using hidden Markov models. In: 8th
n 1
IEEE International Conference on Automatic Face & Gesture
– Interquartile range (iqr): Recognition, 2008. FG’08, pp. 1–6, 2008.
13. van Andel, C.J., Wolterbeek, N., Doorenbosch, C.A., Veeger,
iqr = Q3 − Q1 (11) D.H., and Harlaar, J., Complete 3D kinematics of upper
extremity functional tasks. Gait Post. 27(1):120–127,
2008.
– Mean absolute deviation (mad): 14. Butler, E.E., Ladd, A.L., Louie, S.A., LaMont, L.E., Wong, W.,
and Rose, J., Three-dimensional kinematics of the upper limb dur-
1 ing a reach and grasp cycle for children. Gait Post. 32(1):72–77,
mad = [| x1 − x̄ | + | x2 − x̄ | +...+ | xn − x̄ |]
n 2010.
(12) 15. Jaspers, E., Feys, H., Bruyninckx, H., Harlaar, J., Molenaers, G.,
and Desloovere, K., Upper limb kinematics: Development and
– Minimum is the smallest value of the sample reliability of a clinical protocol for children. Gait Post. 33(2):279–
285, 2011.
– Maximum is the largest value of the sample 16. Uswatte, G., Foo, W.L., Olmstead, H., Lopez, K., Holand, A.,
and Simms, L.B., Ambulatory monitoring of arm movement using
accelerometry: An objective measure of upper-extremity rehabil-
References itation in persons with chronic stroke. Arch. Phys. Med. Rehab.
86(7):1498–1501, 2005.
17. van der Pas, S.C., Verbunt, J.A., Breukelaar, D.E., van Woerden,
1. de los Reyes-Guzmán, A., Dimbwadyo-Terrer, I., Trincado- R., and Seelen, H.A., Assessment of arm activity using triaxial
Alonso, F., Monasterio-Huelin, F., Torricelli, D., and Gil-Agudo, accelerometry in patients with a stroke. Arch. Phys. Med. Rehab.
A., Quantitative assessment based on kinematic measures of func- 92(9):1437–1442, 2011.
tional impairments during upper extremity movements: A review. 18. Parnandi, A., Wade, E., and Matari, M.: Motor func-
Clin. Biomech. 29(7):719-7-27, 2014. tion assessment using wearable inertial sensors. In: 2010
2. Kostić, M.D., and Popović, M.D., The modified drawing test for Annual International Conference of the IEEE of Engineer-
assessment of arm movement quality. J. Autom. Control 21(1):49– ing in Medicine and Biology Society (EMBC), pp. 86–89,
53, 2013. 2010.
3. Wolf, S.L., Winstein, C.J., Miller, J.P., Taub, E., Uswatte, G., 19. Zhang, M., Lange, B., Chang, C.Y., Sawchuk, A.A., and Rizzo,
Morris, D., and et al., Effect of constraint-induced movement A.A.: Beyond the standard clinical rating scales: Fine-grained
therapy on upper extremity function 3 to 9 months after stroke: assessment of post-stroke motor functionality using wearable iner-
the EXCITE randomized clinical trial. JAMA 296(17):2095–2104, tial sensors. In: 2012 Annual International Conference of the IEEE
2006. of Engineering in Medicine and Biology Society (EMBC), pp.
4. Gama, A.D., Chaves, T., Figueiredo, L., and Teichrieb, V.: Guid- 6111–6115, 2012.
ance and movement correction based on therapeutics movements 20. Strohrmann, C., Labruyère, R., Gerber, C.N., van Hedel, H.J.,
for motor rehabilitation support systems. In: 2012 14th Symposium Arnrich, B., and Tröster, G., Monitoring motor capacity changes
on Virtual and Augmented Reality (SVR), pp. 191–200, 2012. of children during rehabilitation using body-worn sensors. J.
5. Houmanfar, R., Karg, M., and Kulic, D., Movement analysis of Neuroeng. Rehab. 10(83), 2013.
rehabilitation exercises: Distance metrics for measuring patient 21. Guneysu, A., Arnrich, B., and Ersoy, C.: Children’s rehabilita-
progress. IEEE Systems Journal PP(99):1–12, 2014. tion with humanoid robots and wearable inertial measurement
6. Mancini, M., and Horak, F.B., The relevance of clinical balance units. In: 2015 9th International Conference on Pervasive Com-
assessment tools to differentiate balance deficits. Eur. J. Phys. puting Technologies for Healthcare (PervasiveHealth), pp. 249–
Rehab. Med. 46(2):239–248, 2010. 252, 2015.
7. Guerra Filho, G.B.: A sensory-motor linguistic framework for 22. Muda, L., Begam, M., and Elamvazuthi, I.: Voice recognition
human activity understanding. Ph.D. Dissertation. University of algorithms using mel frequency cepstral coefficient (MFCC)
Maryland at College Park, College Park, MD, USA, 2007. and dynamic time warping (DTW) techniques. arXiv preprint
8. Lum, P.S., Burgar, C.G., Shor, P.C., Majmundar, M., and Van der arXiv:1003.4083, 2010.
Loos, M., Robot-assisted movement training compared with con- 23. Keogh, E., and Ratanamahatana, C.A., Exact indexing of dynamic
ventional therapy techniques for the rehabilitation of upper-limb time warping. Knowl. Inf. Syst. 7(3):358–386, 2005.
motor function after stroke. Arch. Phys. Med. Rehab. 83(7):952– 24. Han, J., Kamber, M., and Pei, J.: Data Mining: Concepts and
959, 2002. Techniques: Concepts and Techniques. Elsevier, 2011.
9. Kutner, N.G., Zhang, R., Butler, A.J., Wolf, S.L., and Alberts, J.L., 25. Quinlan, J.R.: C4. 5: Programs for Machine Learning. Elsevier,
Quality-of-life change associated with robotic-assisted therapy to 2014.
improve hand motor function in patients with subacute stroke: A 26. Agresti, A., and Kateri, M.: Categorical Data Analysis. Springer
randomized clinical trial. Phys. Ther. 90(4):493–504, 2010. Berlin Heidelberg, pp. 206–208, 2011.
J Med Syst (2017) 41:7 Page 19 of 19 7

27. Brückner, H.P., Krüger, B., and Blume, H., Reliable orientation 29. Zhang, Y., Qiu, M., Tsai, C., Hassan, M.M., and Alamri, A.,
estimation for mobile motion capturing in medical rehabilitation Health-CPS: Healthcare cyber-physical system assisted by cloud
sessions based on inertial measurement units. Microelectron. J. and big data. IEEE Syst. J. PP(99):1–8, 2015.
45(12):1603–1611, 2014. 30. Chen, M., Zhang, Y., Li, Y., Hassan, M.M., and Alamri, A.,
28. Wise, C.: Orthopaedic Manual Physical Therapy From Art to AIWAC: Affective interaction through wearable computing and
Evidence. F.A. Davis, 2015. cloud technology. IEEE Wire. Commun. 22(1):20–27, 2015.

Das könnte Ihnen auch gefallen