Beruflich Dokumente
Kultur Dokumente
KEYWORDS
Abstract graphics, facial expression recognition,
emotion, visual image, Chinese dragon, FaceReader.
1 BACKGROUND
Abstraction is the process of reducing an image
or object to a simpler form [1]. It is a stylized
136
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
137
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
138
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
3 METHODS
The researchers designed an emotion
experiment based on the theory of facial
expression recognition to understand the
subjects emotional reactions on different types
of abstract graphics. The purpose was to
evaluate the possibility of applying facial
recognition as a method to understand the
subjects emotions in order to build a bridge
between the viewers and the designers.
3.1 Experimental Design
The experiment required a quiet and cozy space
to keep the experimental subjects from being
interfered with by exterior surrounding
elements so as to affect the correctness of the
experiment. The experimental site was set at a
classroom in National Taiwan University of
Science and Technology, where there were no
noises around. It was a one-to-one experiment
in which light was sufficient and the subjects
sat in comfortable posture, facing the screen
center with field of vision from 10-20 degrees
to take the test. The distance between the
subject and the screen was about 50-60 cm,
depending on different subjects needs to make
slight adjustments. There was a clapboard
between the subject and the researchers, so the
subject could take the experiment alone while
the researchers observed and controlled the
process. The whole experiment was recorded
by video and audio for further analysis. For the
convenience of organizing and analyzing files,
the video resolution was set at 640480 pixels.
3.2 Stimuli
The researchers used thematic abstract graphics
with different design elements as stimuli.
Chinese dragon graphics were chosen because
the dragon is an iconic virtual animal in
Chinese culture. It is presumed that the subjects
may have various imaginations on the dragon in
abstract graphic designs. The researchers
collected and numbered 204 Chinese dragon
graphics from books and online databases. The
backgrounds of the images were unified in the
sampling process. After the images were filed,
a focus group discussed and shared their
opinions on certain issues, then they
categorized the images. Seven experts in the
design field with more than two years of
working experience were invited to the focus
group to categorize the sample images by visual
similarity. The focus group used the KJ method
to categorize the images and chose the final
samples for the experiment. The procedures
were as follows.
1. The resolution of each image was
standardized to 300dpi for the printing
process and the height was set at 12cm.
Each image was color-printed at the center
of a 1015cm card. Each card was labeled
with a number from 001 to 204.
2. The researchers provided the information
of abstraction in design from the literature
review including definitions, related
139
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
3.
and
applications.
Any
images
disagreement was further discussed until a
consensus was reached.
The focus group categorized the abstract
graphics by visual similarity into ink
paintings, geometric figures and color
blocks. Images with similarity to the
others were eliminated. Finally, six
representational abstract graphics of each
category were classified for the
experiment (see Table 1).
Geometric figures
Color blocks
140
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
Happy
Sad
Anger
Surprise
Scare
Disgust
Ink
paintings
0.731
0.331
0.105
0.066
0.008
0.066
Geometric
figures
0.502
0.29
0.106
0.078
0.008
0.055
Color
blocks
0.507
0.329
0.236
0.122
0.009
0.048
Means
Std. Deviation
Mauchlys test of
sphericity (sig.)
Tests of withinsubjects effects (GG) (sig.)
Ink
Geometric
paintings
figures
0.731
0.502
0.217
0.339
Color
blocks
0.507
0.343
0.037*
0.000***
N/A
0.000*** 0.000***
0.000***
N/A
0.858
0.000***
0.858
N/A
Note: Differences are considered as significant at p <
0.05. * denotes p < 0.05, ** denotes p < 0.01, ***
denotes p < 0.001.
Pairwise
comparisons (sig.)
4.2 Sadness
The subjects did not have notable changes in
sad emotion while viewing the three types of
abstract graphics (see Table 4). Mauchlys test
of sphericity shows that p=0.751>0.05, which
indicates that the sphericity assumption is not
violated. The test of within-subjects effects
indicates that p=0.083>0.05, which suggests
that there are no significant differences in the
subjects sad emotion.
4.1 Happiness
The values of happiness have noticeable
changes in the facial expression recognition
result. Mauchlys test of sphericity shows that
p=0.000<0.05, which indicates that the
sphericity assumption is violated. GreenhouseGeisser correction shows that p=0.000<0.05,
which indicates that there are significant
Means
Std. Deviation
Mauchlys test of
sphericity (sig.)
Tests of withinsubjects effects
(Sphericity
assumed) (sig.)
Ink
Geometric
paintings
figures
0.331
0.290
0.262
0.239
Color
blocks
0.329
0.267
0.751
0.083
141
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
4.3 Anger
Means
Std. Deviation
Mauchlys test of
sphericity (sig.)
Tests of withinsubjects effects (GG) (sig.)
Ink
Geometric
paintings
figures
0.105
0.106
0.140
0.138
Color
blocks
0.236
0.219
0.000***
0.000***
N/A
0.928
0.000***
0.928
N/A
0.000***
0.000*** 0.000***
N/A
Note: Differences are considered as significant at p <
0.05. * denotes p < 0.05, ** denotes p < 0.01, ***
denotes p < 0.001.
Pairwise
comparisons (sig.)
4.4 Surprise
The values of surprise do not have noticeable
changes as shown in Figure 2. However,
Mauchlys test of sphericity shows that
p=0.000<0.05, which indicates that the
sphericity assumption is violated. GreenhouseGeisser correction shows that p=0.007<0.05,
which indicates that there are significant
differences in the subjects surprise emotion.
Pairwise comparisons indicate that color blocks
make the subjects values of surprise apparently
Means
Std. Deviation
Mauchlys test of
sphericity (sig.)
Tests of withinsubjects effects (GG) (sig.)
Ink
Geometric
paintings
figures
0.066
0.078
0.138
0.168
Color
blocks
0.122
0.194
0.000***
0.007**
N/A
0.310
0.002**
0.310
N/A
0.037*
0.002**
0.037*
N/A
Note: Differences are considered as significant at p <
0.05. * denotes p < 0.05, ** denotes p < 0.01, ***
denotes p < 0.001.
Pairwise
comparisons (sig.)
4.5 Scare
Scare stays at the lowest values during the
experiment, as refer to Figure 2 and Table 7.
The subjects did not have notable changes in
scare emotion. Mauchlys test of sphericity
shows that p=0.010<0.05, which indicates that
the sphericity assumption is violated.
Greenhouse-Geisser correction shows that
p=0.895>0.05, which indicates that there are no
significant differences in the subjects scare
emotion.
Table 7. The result of scare running repeatedmeasures one-way ANOVA.
Ink
Geometric
paintings
figures
0.008
0.008
0.026
0.032
Color
blocks
0.009
0.031
Means
Std. Deviation
Mauchlys test of
0.010**
sphericity (sig.)
Tests of withinsubjects effects (G0.895
G) (sig.)
Note: Differences are considered as significant at p <
0.05. * denotes p < 0.05, ** denotes p < 0.01, ***
denotes p < 0.001.
142
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
4.6 Disgust
Disgust emotion has the second lowest values
in the experiment. According to the result, the
subjects disgust emotion did not have notable
changes. Mauchlys test of sphericity shows
that p=0.000<0.05, which indicates that the
sphericity assumption is violated. GreenhouseGeisser correction shows that p=0.391>0.05,
which indicates that there are no significant
differences in the subjects disgust emotion.
Please refer to Table 8.
Table 8. The result of disgust running repeatedmeasures one-way ANOVA.
Means
Std. Deviation
Mauchlys test of
sphericity (sig.)
Tests of withinsubjects effects (GG) (sig.)
Ink
paintings
0.066
0.172
Geometric
figures
0.055
0.148
Color
blocks
0.048
0.117
0.000***
0.391
4.7 Discussion
Facial expressions are a way of emotional
communication. They can represent not only a
persons current emotional status, but also
express emotions to the other people in bilateral
communication. According to previous research,
over half of human communication depends on
facial expressions, which indicates that the
verbalized content is actually a supplement in
communication. However, when the subjects
viewed the sample images, they only received
information unilaterally. The researchers
observed that the subjects seldom had notable
facial expressions at the stage of viewing the
sample images. On the contrary, when the
subjects verbalized their feelings to the sample
images, there were distinctive facial
expressions and the line chart produced by
FaceReader showed that different emotions
crossed with each other. The situation
143
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
144
Proceedings of The Fourth International Conference on Informatics & Applications, Takamatsu, Japan, 2015
[20]
[21]
REFERENCES
[1]
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[22]
[23]
[24]
[25]
[26]
[27]
[28]
[29]
[30]
[31]
[32]
[33]
145