You are on page 1of 18

The CT Face:

A New Paradigm for the Fashion Business

DaeHyeon Wi, MyoungUk An SeungSin Yang, GunWoo Yoon and DaHam Park

2008-2 Culture Technology ProjectⅠ

Graduate School of Culture Technology

KAIST, 335 Gwahangno, Youseong-gu, Daejeon 305-701 Korea

AR Vending Machine is a Vending Machine which sells clothes and accessories, in which potential
purchasers are able to try on virtually, via the AR display and also embroider patterns on one‟s clothes
by digital sewing machine. This project titled 'AR vending machine' consists of 3 main parts. One is a
vending machine. Another is digital vending machine. The other is a AR display screen which can
function as a mirror at a clothing shop.
We initiated this project under 2 casual motives. Some people get annoyed and feel hidden pressure
by sales person at a clothing shop or don't want to try on many real clothes. Our goal is to get rid of
these stresses and build store automation systems and be skillfully devised for convenient use to wear
clothes or accessories.

Keywords: AR, AR technology, vending machine, fashion, AR mirror, digital sewing machine

1. Introduction Final Plan for Film

2. Related Work 3.3.2. Commercial Music
3. AR vending machine 3.4. Etc.
3.1. AR mirror 4. Analyze questionnaire
3.2. Digital sewing machine 5. User Scenario
3.3. Advertisement 6. Conclusion
3.3.1. Film 7. References The Origin Plan for Film
1. Introduction fashion item‟. It has been a long time since
Recently, interest of Augmented Reality is channel of shopping expanded off-line to on-line.
increasing in the field of virtual reality and Key point is that not shopping channel has
three-dimensional graphics (Kolbe, 2004). AR is transferred off-line to on-line but both channels
derived from virtual reality that provides have done a role actively.
combined images of what users are watching In this study, the reason why we proposed the
and what computers are producing to improve vending machine is to make up for the
the understanding of reality. Established in weaknesses of off-line and on-line shopping.
virtual reality, the user who is immersed in Customers become under stress when a clerk
virtual reality which is created by computer is interfere in their shopping, and they also feel
intercepted with external environment. On the inconvenience during their off-line shopping
other hand, AR is a technology which improves because they should hang around store to find
understanding and awareness about reality by what they like. Changing clothes to purchase
providing these things; spot images which them can be the strength of off-line shopping,
changes by view of users who are always but it usually annoys people at the same time.
moving in the three-dimensional space and On the other hand, customers who buy clothes
expiations of letters and graphic matrixes. This generally want to look whether clothes are good
subsidiary information intertwined, helps on them or not. The technology that helps
understand the real world phenomenon .In people see how they look like with clothes they
addition, it is becoming core user interface in selected using 3D body scanner is currently
the people-oriented service society as it helps developed, but people tend to dislike it because
improve sense of reality and understand, rather they worry about the exposure of their body size.
than replaces real world. So, nowadays many The vending machine we propose is free from a
people have interest at AR. (Zlatanova, 2001; clerk‟s interference because it is a self-service
Kealy, 2006). machine. In addition, it reduces the price of a
The purpose of this research is present a device product since it does not include personal
how the increase reality technique, a new part of expense. People can print the marker and check
cyber reality, can apply to shopping. For this, we their fit, so they don‟t have to be annoyed to
analyze a research trend and technique of AR change their clothing. Also, there is no risk for
from literature study. And then, we suggested the leak of personal information because this
the banding machine, medium of marketing, as a system only have data for the clothing not the
device which an application to shopping. personal body.
Among much kind of shopping items, we Additionally, we suggest the customize service
choose a fashion item which is the most interest which is customer can embroider on their T-
to young people. The word „shopping‟ which shirts by using Digital Sewing Machine.
will appear in this paper means „purchasing In this study we think about the commercial
using of AR Technology by proposing the
vending machine using AR Technology.

2. Related Work
AR(Augmented Reality) is a variation of
Virtual Environments or Virtual Reality as it‟s
more commonly called. VR technologies
completely immerse a user inside a synthetic
Picture 1 AR Cast
environment. While immersed, the user cannot
see the real world around him. In contrast, AR
Another work, a handheld virtual mirror, is more
allows the user to see the real world, with virtual
similar with our project. A handheld virtual
objects superimposed upon or composited with
mirror is a device to simulate a real mirror on a
the real world. As interacting with users through
computer screen, images of the observed world,
live imagery, it can improve usability and
consistent with the viewer‟s position, must be
usefulness of information. In short, AR is a
synthesized and displayed in real-time. The
Combination of real-world and 3D graphics in
system is build around a flat LCD screen
manipulated by the user, a single camera fixed
In 2002 World cup, TV stations carried a live
on the screen, and a tracking device. The
broadcast of the football games using AR
continuous input video stream and tracker data
technology. You could watch flags and score on
is used to synthesize, in real-time, a continuous
the real stadium. Also it showed us the distance
video stream displayed on the LCD screen. The
from penalty spot to goal line by using AR
synthesized video stream is a close
Technology in the scene of a penalty kick. It
approximation of what the user would see on the
helped people understand more about the
screen surface if it were a real mirror.
football game. The name of the system is AR-
CAST that is inserting system virtual images or
movie clips into each kind of broadcast such as
sports game in real-time. It induces viewer to
have fun and create new value as inserting
information of a match or a virtual
Picture 2 Handheld virtual mirror device

Also, Mark Fiala who is one of ARTag

developer made a Magic Mirror System using
ARTag. The Magic Mirror System is an AR system in this class. In virtual environment, user
system where a camera and display device act as can try fitting on cloth virtually using user‟s
a mirror where on can see a reflection of oneself actual body data. User has to get scan data of
and virtual objects together. Fiducial markers user‟s body before got started. But, we will use
mounted on a number of hand geld and just user‟s image from camera to try fitting
wearable objects allow them to be recognized by system, and overlap cloths. In a word, our
computer vision, different virtual objects can be system is an AR version of Oh‟s work added a
rendered relative to the objects depending on the concept of selling method.
chosen theme. a series of theoretical an practical
problems were overcome to produce a working
system suitable for educational and
entertainment for the public.

Picture 4 Interactive Cloth Simulation

3. AR vending machine

Picture 5 Core System Architecture

Picture 3 the Magic Mirror, some with AR vending machine is composed with AR
augmented suits or hand-held objects mirror fitting system and actual vending
machine part. In our work, we implemented AR
In Virtual Reality, there are many studies of mirror part only because making actual vending
virtual clothing fitting system. We already took machine required too large budget and
a seminar of Seungwoo Oh about virtual fitting sofiscated hardware technology. Moreover, they
are not important part of our project which
proposes new creative fashion vending machine
business process.

Picture 6 AR Vending Machine prototype

Our AR mirror part has 3 parts; Image receiver,

process unit and display. The image receiver
captures a video image of customer and markers.
Webcam, CCTV, or camcorder can be used as
image receiver. We choose firewire camera
which has large bandwidth for data
communication. So we could have get a higher
frame rate and better capture quality than other
The captured data are sent to the process unit.
These units are composed with 3 sub units. The
first sub unit is marker recognition unit. This
unit searches predefined marker from input
video image source. Some image processing
techniques and software developer kits for
image receiver was used to implement the
marker recognition unit. The second sub unit is
marker matching unit. In the previous sub unit,
positions and images of markers are obtained.
Marker matching unit selects an appropriate following:
virtual object for the recognized marker from 1. ARMUSEMENT AREngine
predefined object database system. The last sub 2. Artag
unit is synthesis unit. The virtual object from 3. ARToolKit and ARToolKit Plus
second unit stage is synthesized into the original 4. Studierstube Tracker, Studierstube ES
source video from the image receiver unit. As a 5. DARTGoblin XNA (based on ARTag)
result, a mixed video of real-world and virtual 6. HP mscape
object is generated and displayed on screen. 7. Metaio UnifEye
Whole process unit was achieved by ARTag 8. Point & Find (Nokia Research on AR)
SDK and OpenGL was used to display and 9. ToTal Immersion
Synthesis. 10. YDreams SimVideo
11. Linceo VR3.0
3.1. AR mirror 12. FLARtoolkit
The AR Mirror paradigm is an augmented As you can see that, AR users have a high
reality system where a camera and display act as opinion of ARTag more than ARToolKit another
a mirror where one can see a reflection of the most commonly used software. Mark Fiala,
oneself and virtual objects together. In the AR a developer Artag, refers to that Artag has the
Mirror system, users and onlookers can see lower possible inter-marker confusion rate and
themselves wearing virtual clothing to fit it. A false positive compared with ARToolKit at his
horizontally flipped video camera image, paper [13]. So, another team who make their
merged with computer graphic clothing, is seen project using ARToolkit alters their program to
on the AR Vending Machine providing the use Artag by my recommendation.
illusion of a mirror. The AR Mirror is composed Our system uses 2 markers to improve the
of a 19” LCD touch monitor, a 1394 camera, recognition rate and solve a problem blocking a
and ARTag(a open source program) that is an marker by user‟s hands, because the marker
open source program to recognize the markers should be held by user in working. Then user
and superimpose 3d models matching with the can block one of them and the system can
marker on the images from the camera. recognize the markers well. When user takes
ARTag is the most commonly used software this marker and hold it in front of the prepared
engine for augmented reality. Ori Inbar who is camera, user can see 3D object such as clothing
the founder of Pookatak Games posted an article or accessory on the marker. Therefore, user can
on his blog “Games Alfresco” that the famous try to fit on clothing using the AR system.
blog for AR Games. The article brings the
unofficial roundup of the top 10 best augmented
reality. And he ranked them based on the
feedback from visitors at his blog. The ranks are
Picture 7 Marker

The 3D T-shirt using in prototype was made by

3DMAX program. To make the 3D object, first I
take a picture of real clothing that want to show
people. Second, I get the path line from the
picture. I made a 3D object using the path line in
3DMAX program and covered the object with a
texture form the picture. Finally, to use in the
ARTag program, I converted the 3D file to OBJ
Picture 8 Working process
The AR mirror is completed by matching the
OBJ file and the marker in the ARTag program,
and switching horizontally objects and movie
clips of camera source.

Picture 9 Implementation of AR Mirror

3.2. Digital sewing machine

We use Husquvarna VIKING(Designer SE)
for creating customized embroidery design
when customer select the beautiful design at AR
vending machine.
Before we start to embroider the design, we
should make some sample design (e.g. THE CT
FACE emblem) files by using Adobe Photoshop
CS3 or Adobe illustrator CS3. 3.3. Advertisement
This commercial film contains two kinds of
contents. The first one is a film, and the other
one is a commercial music. So, this commercial
film, which lasts roughly 30 seconds, is complex
in terms of information contained in it. To
Picture 10 the CT Face logo produce the commercial film, our groups
analyze information on AR vending machine
And we have to use 4D software such as 4D (concept, characteristics, appeal points, etc.),
organizer for adding a whole new dimension to consumers (target, characteristics, needs, etc.)
personal embroidery. In this part, we can make a We make full use of our sensitivity to produce
beautiful design and care some unbalanced line advertising storyboards and commercial film.
of the design and reduce the loss of threads. Because this commercial film should not only
Then we convert the file form to vp3 for the fulfill its concept and class communication, but
machine to codify our design. it should also work as cultural contents.
Next, we carry our design file by USB stick and Although the original intention of this
insert the stick in the upper USB port on the commercial film was to use the Motion Control
right side of the sewing machine (Designer SE). Camera and Nuendo (digital audio workstation)
And touch the toolbar, load from USB which we had learned about in class, we decided
embroidery stick. At this moment, we can to take professional advice according to an
choose hoop size, placing part, color of threads expert on Film.
and resize and retain fill type.
When the entire machine, threads, design are 3.3.1. Film
prepared, we can operate the sewing machine The Origin Plan for Film
and embroider our „THE CT FACE‟ logo on T- 1) Planning
shirts. The concept of this film is transforming
oneself in a conspicuous way. The topic of this
film is „Magical AR vending machine‟. There
are two casts for this film. One is a girl who
changes soiled clothes into stylish ones. The
other is a boy in rags. We target on twenties.

Picture 11 Embroidered T-shirt

Concept transforming oneself in a
conspicuous way
Characteristics Girl – Cool
Boy - Comic
Appeal points Magical AR vending
Target Twenties

Table 1

2) Storyboard

Picture 12 storyboard1
-Description Final Plan for Film
A ragged girl walk toward the AR vending 1) Planning
machine – After getting out from AR vending Taking all scenes at same angle to make special
machine, her way to dress is totally changed. effects as Motion Control Camera
She is turned into a stylish girl – One guy who The topic of this film is „The life of 4 stylish
stole a glance at her get into the AR vending girls‟. We focus on variety of fashion and target
machine, and then he is changed, as well. – 4 Women in twenties.
people show up in a one scene. (By using Concept 4 Stylish girl‟s life
Motion Control Camera) Characteristics Girl – Stylish, Cute
Appeal points Varity of fashion
3) Film-taking Target Women in twenties
Daehyun Wi (Model, Handling the MCC) and
Table 3
Daham Park(Director, Model, Handling the
MCC) take this film Using Motion Control
Camera at the MCC tent on Dec. 8th 2) Storyboard
There was a problem to abstract the AR vending
machine from the blue screen in film. Our plan
fails the reason why color of the AR vending
machine is blue.
Who Daehyun Wi (Model, Handling
the MCC) & Daham
Park(Director, Model, Handling
the MCC)
Where MCC tent
When Dec. 8th. 2008
How Using Motion Control Camera
Result Fail
Reason The color of the AR vending
machine is blue. There was a
problem to abstract the AR
vending machine from the blue
screen in film.
Solution Taking 4 scenes at same angle
with HDV camera

Table 2
The AR vending machine automatic door is
open - 4 stylish girls pose themselves as a
model- One girl point out the camera with big
smile – Walking to the AR vending machine –
Pose as an actress with waving hands

3) Film-taking
Seungsin Yang (Shooting) and Daham Park
(Director, Model) took this film together at
MCC tent Using HDV camera on Dec. 11th.
Who Seungsin Yang
(Shooting)& Daham
Park (Director,
Model, Handling the
Where MCC tent
When Dec. 11th. 2008
How Using HDV camera
Result Success

Table 4

4) Editing
Daham Park was in charge of editing by using
Adobe Premere, After Effects.
Every scene is taken at the same angle. The
function of „Mask‟ which allows you to cut out
objects from a non-green screen environment
and place other objects behind them is mainly
used on each scene. Then, combine the scene
Picture 13 storyboard2
into one shot.
Who Daham Park How Using Cubase and
Where Equipment room Nuendo
When Dec. 12th. 2008 Main tool LM-7, Draw, Pitch
How Using Adobe Premere, Shift …
After Effects
Main Tool Mask(allow you to cut
out objects from a
non-green screen
environment and place
other objects behind
Main point While shooting, take
all scenes at same
angle. Then, give the
function of mask on
each scene. Combine
Picture 14
the scene into one

3.4. Etc.
3.3.2. Commercial Music
We used Firewire Camera
1) Music in fast tempo such as rock, hip-hop,
and symphonic numbers are usually
receiver. It was fast enough to implement our
produced for the energetic and exciting film.
idea, but resolution was lower than our
We decided to compose „house music‟,
expectation. LCD Touch Monitor 19TS-RT was
because this commercial film targets on a
stand for main vending machine display and
stylish and active girl.
input device. ARTag was very useful to
implement process unit of vending machine and
2) Composition
OpenCV was proper choice to get video from
This Backbround music is composed by
camera. Some GUI interface was implemented
Daham Park by using „Cubase‟ and „Nuendo‟.
by using VC++ and OpenGL.
The tool of LM-7, Draw and Pitch Shift are
To make CF, We used MCC for image and
mainly used for this song.
Nuendo for background music mixing.
Who Daham Park
Digital sewing machine was used to show how
Where Da Vinci Lab
our work could support customization of
When Dec. 1st~ 3rd 2008
Picture 15 GUI

4. Analyze questionnaire
We conduct simple survey to estimate our
target market and analyze potential customer
needs. We make three parts of questions (consist
of sixteen single questions) which contain
demographic issues, customer‟ purchasing
pattern issues, customer‟ demand issues
Our statistical sample size is 47 (students) that
participate the culture technology project 1 class.
(2008. 10. 28)
We analyze our questionnaires and finally
confirm several facts from the results.
First of all there are 2 major shopping patterns
in our potential customers, on-line shopping
(27.7%) and off-line shopping (department store
36.2%, whole sale store 8.5%, retail sore 6.4%).
So we focused on segmentation our potential
market between on-line and off-line shopping
place. Our AR vending machine should look
after their advantages.
Graph 1 convenience of offline shopping Graph 3 inconvenience of offline shopping

Graph 2 convenience of online shopping Graph 4 inconvenience of online shopping

As a consequence of the questionnaire, our And depending on our consequence, our

potential customers are very sensitive at price potential customers feel uncomfortable with
and reliability of the product. So we have to use physical distance, limit of time, annoying sales
AR technology and its use to AR mirror for person when they buy something by off-line
enhancing our products reliability and to set low shop. Also they feel nervous when they
product price strategy. shopping at on-line because of lack of reliability
and distrust.
So we can conclude our AR vending machine
should keep it for reference. There are two main
implication of this issues, one is we should
materialize our AR vending machine to make The user steps into the AR vending machine.
customer feel free and win public confidence. Click to start. Select gender of user. Select the
And other thing is we should lift physical item (outfit, accessories). Choose the design,
restriction (time, distance) and allow our size, and color of the item. Print the item‟s
customer to access any time for our AR vending marker. Put user's marker on his or her outfit.
machine which is operating 24 hours nearby, Try on via AR mirror. If the user wants to
close to our customer. customize one‟s clothes, select patterns to
embroider. Print the marker again. Try on via
AR mirror. Pay in Cash or Credit Card.
5. User Scenario

Picture 16 User scenario

Reality, IEEE Computer Graphics and
Applications, 2001
6. Conclusion
[4] Alexandre Francois, Elaine Kang and
We proposed our new whole business process
Umberto Malesci: A Handheld Virtual Mirror,
for new fashion marketing. It was a form of
vending machine. For the business process, we
[5] Mark Fiala: Comparing ARTag and
had done market research and analysis. So we
ARToolKit Plus Fiducial Marker System, IEEE
could get some demographical data of customer
International Workshop on Haptic Audio Visual
and It said our product was good enough for
Enviroments and their Applications, 2005
them. For marketing, We had taken a short CF,
[6] Seungwoo Oh: Interactive Garment
and it had been very successful to give
Animation, KAIST, 2001
impression to customers. A prototype for
[7] Stephen Cawood, Mark Fiala: Augmented
vending machine were also made. We applied
Reality - A Practical Guide, The Pragmatic
current AR technology to implement our idea,
Programmers, 2007
So it turned out that it could be new way to sell
[8] Carles E. Hughes: Mixed Reality in
clothes. But current AR technology was not
Education, Entertainment, and Training, IEEE
enough to make high quality result of AR mirror.
computer Society, 2007
And automization of custom embroider might
[9] Derek Bradley, Gerhard Roth, Prosenjit
be impossible currently because digital sewing
Bose: Augmented Clothing, 2005
machine require too much man power. If
[10] Kolbe, T.: Augmented panorama and videos
technology about AR and sewing machine
for pedestrian navigation. Poc. 2nd Symposium
advances in later, our proposal of AR vending
on. Location Based Services and
machine will be realize easily and give big
TeleCartography, 2004.
impact to the market.
[11] Kealy, A. and Stephen Scott-Young: A
technology fusion approach for augmented
reality applications. Transactions in GIS 10(2):
7. References 279-300, 2006
[1] Mark Fiala: Magic Mirror and Hand-held [12] Zlatanova, S. and F. van den Heuvel: 3D
and wearable Augmentations, IEEE Virtual city modeling for augmented reality applications,
Reality, 2007 in: Proceedings of the International Symposium
[2] N Navab, M Feuerstein, C Bichlmeier: on architectural photogrammetry, 8-21
Laparoscopic Virtual Mirror New Interaction September, Postdam, Germany, pp. 152-159,
Paradigm for monitor Based Augmented Reality, 2001
IEEE Virtual Reality Conference, 2007
[13] 우운택: 유비쿼터스 세상 앞당기는 증
[3] Ronald Azuma, Yoan Baillot, ReinHold
강현실, 동아사이언스, 2007
Behringer: Recent Advances in Augmented
[14] 정성한: 오픈소스 OpenCV를 이용한
컴퓨터 비전 실무 프로그래밍 기본편, 홍
[15] ARTag:
[16] AR Vision Inc.:
[17] Games Alfresco in pursuit of the ultimate
augmented reality game: