CHAPTER 1

INTRODUCTION
Interactive raspberry pi is programmed using python and connects to a monitor with inbuilt
speaker so as to provide an onscreen interface and voice assistance as well. Section 2 focuses
computing, with wirelessly connected embedded devices that are being used in various day–to–
day activities, are changing and improving the standards of the quality of life. Based on this
interactive computing and communication technologies, many devices/products are now emerging
and with this multimedia intelligence it is providing comfortable, secure and convenient personal
services everywhere whether it is home or various industries and making a lot of users comfortable.
We look at the mirror daily and interact with it psychologically to find out how we look and how
our attire is. The interactive mirror is a development effort to augment the mirror with proper
embedded intelligence for offering enhanced features such as weather of the city, latest updates of
news and head-lines and local time corresponding to the location. The Smart Mirror would help in
developing smart houses with embedded artificial intelligence, as well as finding its applications
in industries. The remainder of this paper is organized as follows. Briefly comments on theory
and some related works. This is followed by the description of the smart mirror including the
design and architecture of the proposed Smart Mirror in Conclusion and some thoughts on future
work are presented at last. Smart mirrors are straight from science fiction. They’re part of an
optimistic vision of the future that imagines a world where screens and data are everywhere, ready
to feed you whatever information you need at a moment’s notice. Basically, the mirror is looks
like normal mirror but when someone stand in front of it the scene changes. The mirror provides
a functional, user friendly and interactive UI to its user for accessing their social sites, messengers,
etc. It has widgets for displaying the current whether conditions, Time, Events, Latest news
headlines The Smart Mirror would help in developing smart houses with embedded artificial
intelligence, as well as finding its applications in industries. Switching home appliances becomes
easy with mirror. Virtual dressing, a smart way of having trials with your fashion sense makes
things quite easy in malls. Having such intellectual mirror will only surge the beauty of home. The
raspn Design of mirror. The working while making Smart Mirror is covered under Section 3.
Section 4 comments on the Functional Overview of mirror. Section 5 covers problems and issues
that may occur while development.

Department of ECE-SISTK Page 1

1.1 OVERVIEW:
1.1.1 Needs Statement:
Over 1 million #selfies are taken every day with 30% of photos taken by people between the ages
of 18 and 24 being#selfie1. In total, 28% of time spent online is on social media2. According to a
TODAY/AOL survey, women spend an average of 6.4 hours/week while men spend 4.5
hours/week working on their appearances3. The Smart Mirror is a system that combines these
tasks in an efficient and enjoyable way to provide time savings for the user.
1.1.2 Objective Statement:
The objective of this project was to design and prototype a device that acted as a “Smart Mirror”
by displaying the user’s image and providing customizable information on the display. A “Smart
Mirror” is a device that acts as a traditional mirror while also superimposing informational data,
which can be customized by the user. The mirror also allows for touch free user interaction with
some of the data displays. Users are able to create a profile and customize the visual interface to
display what specific data feeds they want.
1.1.3 Product Description:
The “Smart Mirror” consists of an electronic display along with a one-way mirror for the
informational display. It uses a camera to track movement and provide facial recognition with the
use of an embedded computer. Users can create their customized display through a smartphone
interface. Some informational displays contain information aggregated from third party APIs, such
as social media feeds, news feeds, and weather updates. See Figure 1 for conceptual design and
implemented design.

Department of ECE-SISTK Page 2

 CHAPTER 2
PROPOSED SMART MIRROR
The mirror is eventually a technologically augmented interaction device. The objective of
designing the mirror is to provide a natural interface in the ambient home environment for
accessing various services such as location based weather, time, calendar etc. as well as provide
access YouTube, Sound cloud, maps etc. The project includes downloading the Raspbian operating
system based on Darian and extracting the image on SD card, inserting t ocard in the Raspberry
PISD slot an then performing the required steps. We plan to deliver a working prototype i.e. design
and development of a futuristic Smart Mirror on Raspberry Pi 3 for the ambient home environment
a well as for commercial uses in various industries .Most people have mirrors at home, so the
concept of a smart mirror that you can interact with is attractive and can be fantasized by anyone.At
times no one has time to read the newspaper or switch on the TV right in the morning to check the
news headlines or the weather forecast. If a mirror serves to this purpose, one can imagine the
amount of time it will save and be of such a great use. The device was to look like a regular mirror
but would have a screen inside. The project which would collect real world machine data such as
location based latest news and headlines, weather reports, and as well as show us the local time.
The data would be transmitted from the machine and would be managed in a central database .We
have also worked on including Artificial Intelligence in th e Smart Mirror wherein a Voice enabled
assistant will cater to the needs of the user.

Fig1 :Circuit daigram

Department of ECE-SISTK Page 3

 Fig2: Block diagram of transmitter

Fig3: Block diagram of receiver

2.1 SOCIAL IMPACT OF PROPOSED
It is useful to see the latest update, headlines in less time there is no need to start a television also
we get the information about the weather of the city .
Also by using smart mirror we can able to see the videos.

Department of ECE-SISTK Page 4

2.2 INNOVATIVENESS OF PROPOSED SOLUTIONS:
These smart mirror peripherals such as microphone ,smart mirror , cpu , raspberry pi led monitor
with provide features such as weather of the city, and headlines to the locations,latest updated
news.

Fig4: Flow chart of transmitter

2.3 REQUIRED SPECIFICATIONS
 The system has the ability to display widgets.
 The system has the ability to detect the presence of the user.
 The system has the ability to navigate the UI based on user motion.
 The system has a relatively lower cost than existing designs.

Department of ECE-SISTK Page 5

  The system functions as a mirror.
 The system looks aesthetically appealing.
 The system has a customizable UI.
 The system has a means to store user accounts and preferences.
The system has a separate means to begin usage

Fig 5: Flow chart of receiver

Department of ECE-SISTK Page 6

2.4 SOFTWARE REQUIREMENTS:
2.4.1 SD Formator:
SD Formatter is designed specifically for SD/SDHC/SDXC memory cards. The utility differs from
operating system format utilities that are meant to format a variety of storage media SD Formatter
works with a number of Windows and Mac operating systems. It can be used with the following
devices Secure Digital slot on computer – Important for SDXC card users: contact your computer
manufacturer to confirm the SD slot on your computer is compatible with SDXC cards and for
availability of the SDXC driver.
USB Secure Digital memory card reader PC Card, Card Bus or Express Card SD adapter
2.4.2. Etcher:
Etcher is software which is used to burn the OS image to make it compatible to install into storage
disk, here we installed raspbian.
2.4.3 Raspbian:
Raspbian is the main and basic software for RPi devices, officially supported by the Raspberry Pi
Foundation. In fact, it is an operating system, based on Debian and optimized for Raspberry Pi
hardware.
It comes with lots of pre-installed pieces of software appropriate for most of ARM users
and developers. And in this blog post, I am going to look through almost all possible operating
systems, as well as the Raspberry Pi images, compare and review major types of other software
you can use for your complicated Raspberry Pi Projects. But the main operating system, ready-to-
use and optimized to the needs of the most developers and makers is Raspbian. So, first thing
firstly, let’s dig deeper this type of OS for RPi.
2.5 RELATED WORK
The Smart Mirror Represents A Natural Interface That Facilities Access To Personalized Services.
This Is An Attempt To Contribute To This Design Of A Smart Mirror Like Interface As Well As
The Smart Environment In Which The Interface Is Used For Interaction On The Following.
Phillips Home lab Is A Test bed For Creating Perspective And Context-Aware A Home
Environments Interactive mirror in the bathrooms to provide personalized Care Environment Uses
An Interactive Preferences. For Example, Children Can Watch Their Favorite Cartoon While
Brushing Their Teeth. The Mirror Can Provide Live TV Feeds Monitor The Latest Weather And
Soon. The Mirror Is A Combination Of One Or More Lcd Flat Screen Display Specifically

Department of ECE-SISTK Page 7

Combined With A Mirror Surface And Connected With A Central Processor To Provide The
Intended Services. The Interactive Mirror Service As A Provide Ambient Feeling In The Home
Environment.
The Work In Propose A Magical Mirror As An Interface To Provide Basic Services. The
Intended Services To Offer Are Interactive Tv, Specific Weather, Date And Searches. Unlike Our
Work, It Promotes The Use Of Ontology To Personalize The Services. However Conceptually,
Our Work Has Similar Objectivity To What The Magical Mirror Intends To Perform, Except That
We Present A Working Prototype, Whereas Some Of The Functionalities In The Magical Mirror
Are Presented Only The Simulation. In Addition, We Use Open Standard Like Web Services To
Communicates With The Devices And Customize Various Personalized Services For Users. This
Is Not Present In Design Of The Magical Mirror. In Comparison To The Works Described Above,
Our Works Is Different In That We Aim To Develop A Working System For Providing Services
In The Ambient Home Environment Based On Open Stands And Off The Self-Technology, Where
The Smart Mirror Is The Interface To Access/Control Various Data Feeds, Various Information
evinced.

Department of ECE-SISTK Page 8

 CHAPTER 3

DESIGN
Table 1 shows basic required objects for building mirror and their functionality.

Table: Required Objects and their Functionality

3.1.LEVEL 1 DESIGN:
Power connection, microphone for voice input, camera for image processing forms the basic input
devices for the mirror. The monitor and speakers forms the output devices of the mirror. Fig 1
depicts the basic structure of the smart mirror.

Department of ECE-SISTK Page 9

 Fig 6:Basic structure of smart mirror
3.2. LEVEL2 DESIGN:
Smart Mirror doesn’t fully show the all the equipment that are to be connected to raspberry pi, but
covers all major functional units. The IR frames are connected over mirror but still they work fine
because it’s a co-ordinate based touch detection by the IR sensors placed at the side of frames and
doesn’t require the frame to be directly having contact with monitor behind mirror. The
microphone is connected via sound card on USB port of Pi. The camera can be connected to USB
port or the Pi camera can be connected to camera slot on Pi. The 8-channel relay is connected to
GPIO pins on Pi for controlling the home appliances. To access the internet the Pi is connected to
home Wi-Fi network. The programming of the Pi for displaying the UI on the screen is done using
Python, the total description of how coding is implemented is described in Section 3 of the
document.

Department of ECE-SISTK Page 10

 CHAPTER 4
WORKING
The working of each component in smart mirror is explained in this section. Let’s talk
about them one by one:

Figure 7: Design of smart mirror

4.1 TWO-WAY GLASS MIRROR:
The two-way mirror is what gives the mirror its real identity. It’s really magic mirror as it has
reflective surface at one side and also its transparent for light with good intensity. The mirror stays
at the front where the user can watch himself/herself in the mirror at the same time the allows the
light from monitor to pass through it and make available the UI [4] [5].
4.2 MONITOR:
The monitor is directly connected to Raspberry Pi via HDMI interface thus providing display as
well as voice output. For providing touch ability to monitor IR frames are used which are explained
further in next sub-section.

Department of ECE-SISTK Page 11

4.3 IR- FRAMES:
While research on internet we didn’t found any sign of how to give the mirror touch ability, so we
found a way ourselves to do so. The IR-frames provides the touch interface to the smart mirror.
The IR -Frames has IR sensors on its siding and connect to Pi via USB interface. Thus making
smart mirror touchable.
4.4 RASPBERRY PI 3 MODEL:
The raspberry pi is the most vital part of the mirror, it forms the processing unit of the mirror. The
Pi is like motherboard having all the required constituents which forms a great CPU. Its size of a
credit card and still it can perform like a full-fledged computer. The programming of Pi is done
using Python language. The programs can be first developed and compiled on windows or any
other platform and then can run on Pi. The Pi also has its own inbuilt IDE to program in languages
like C++, Python, C, Java, etc. Installation of OS on Raspberry Pi is quite a simple process. First
you have to download NOOBS along with raspier which is great OS of Raspberry Pi for beginners.
The Raspier is just a flavor of Debi an OS .There are many IDEs available to do programming for
Python but what we found was Pilchard Community is free and good among them who serves our
requirements .Designer is amazing tool to make UI of Python .Figure 3 shows a fully functional
calculator wrote in Python script.The GPIO pins on Raspberry Pi controls the 8-Channel relay
which is explained in next sub-section. The Raspberry Pi has inbuilt Wi-fi and Bluetooth for
connectivity purpose as well as it allows 4 USB devices to be plugged

Figure 8: Functional Calculator wrote in Python script

Department of ECE-SISTK Page 12

4.5 8-CHANNELS RELAY:
The 8-Channel relay connects directly to high voltage input source of power and low power GPIO
pins on Raspberry Pi. The GPIO pins cannot control the Home appliances directly as they have
very less output power that is about 5V, So we require 8-Channel relay circuit board which close
the circuit of home appliances when given a high of 5V [10].
4.6 CAMERA:
The Camera is input device for the mirror, its used for face recognition as well as body. A concept
called Virtual Dressing can be implemented using Image Processing. We roam in malls in search
of various clothes, we cannot practically try all dressings that we like. So Virtual sorts this problem
out, Images of this clothing’s are saved in memory of mirror, whenever user stands in front of
mirror and selects the dress, the mirror fits the dress on our body reflection in mirror. So, no need
for doing trials every time. Face Recognition based authentication is another use of the camera, it
customizes the profile of different users on same mirror.
4.7 MICROPHONE:
The microphone is used to give voice input to the mirror. Along with touch capability a voice input
makes the system very reliable and robust in working. A sensitive microphone takes voice
command from the user and processes it to do corresponding action

Department of ECE-SISTK Page 13

 CHAPTER 5
FUNCTIONAL OVERVIEW
On start after giving power supply to mirror the raspberry loads the OS and directly runs
the UI of the mirror, it may take while to load the weather and other internet based widgets to
display the information completely depending on the speed of the home Wi-Fi network. A power
saving mode is also provided to the mirror by attaching a ultrasonic range detector sensor on the
top of the mirror. The ultrasonic sensor activates the mirror and awakes it when someone comes
close enough. Thus, improving the functionality and power efficiency of the system. On fully
loading the information required the mirror now shows notification from different social sites as
per the user has logged in. The events are loaded from calendar and reminded to the user.
The user can plan route to his destination before leaving home on the mirror. A mass of
entertainment is also loaded on the mirror, as its connected to home Wi-Fi YouTube can be
completely streamed on it and a music app is preloaded to beat your favorite music directly.
Besides several other applications like gallery is also installed to view your pictures on mirror. The
has a greeting pane which automatically prints greeting message according to events and time of
the day. You can book a cab before leaving home using Uber cab booking interface made using
Uber public API. Not only that, a user who knows the working of system well can extend the
ability of the system by adding more feature to it. The Home automation embedded in this mirror
is very easy to use, as you have to simply connect the pins of the appliances to mirror’s slots and
then you can enjoy the control of appliances by touch interface.
5.1 IMPLEMENTATION
STEP 1:
Turn on the supply of both raspberry and LED Monitor
STEP.2
Turn any Hotspot and connect it with raspberry Pi
STEP.3
Now to Monitor the raspberry pi connect your device to raspberry through VNC Viewer it requires
an IP address so we have to enter the correct IP address of raspberry pi so it will be get connected
5.2 TESTING STRATEGY :
5.2.1 Embedded Computer: The embedded computer tests were designed to determine the overall
performance of the device in the system. There are few tests that were run to ensure that the optimal

Department of ECE-SISTK Page 14

functionality is achieved. Kinect functionality was tested by simply installing freelibnect2, an
open-source driver for the Kinect, and running the provided test programs. There are open-source
GPU and CPU benchmarks that were ran on Ubuntu that gave statistics to compare. Simply
installing those benchmarks on the different embedded computers and comparing the numerical
values was the easiest and most straightforward way to confirm that the embedded computer was
running close to the manufacturer specified rates.
Determining that the system met the marketing requirements was as simple as developing
the device and testing overall functionality.
5.2.2 Camera :
To verify that the camera subcomponent was working correctly with the rest of the overall system,
the camera was connected to the embedded computer to validate that the camera produced images
of resolution 640x480 at 30 fps from the RGB and depth cameras and sent the frames over USB
to the embedded computer without any frame loss. After verifying that there was no frame loss
between the embedded computer and the camera, it was verified that the embedded computer could
process the images to perform facial recognition and gesture recognition. Verifying these two tests
proved that the embedded computer has enough USB throughput to handle receiving the frames
adequately, as well as, having enough processing power to interpret the images to perform the
tasks needed to meet the overall requirements. The camera tests can be seen in the Appendix under
Camera/Embedded Computer Tests.
5.2.3 Web Application:
Unit testing the features and components of the web application was done to ensure correct
functionality. The server side shall be tested on overall UI navigation, while the mobile client was
tested considering the interactions with the server side. This includes registering for a user account
and uploading photos for the facial recognition software. The communication between the server
and client was also tested. The database was analyzed to ensure that information, such as user login
credentials and the associated account preferences, is written and pulled properly. The web
application tests can be seen in the Appendix under Web Application Tests.
5.2.4 APIs :
API testing was completed for each API in priority order. Testing was first done in the API console
provided by the third-party company. All API calls necessary for the widget were tested in the
console. Next, all API calls were made from a simple JavaScript program on a computer with an

Department of ECE-SISTK Page 15

internet connection. Once all calls are validated, the JavaScript program was run from the
embedded computer and all of the outputs are then validated. The API calls were then integrated
into widgets that were first tested on the computer, and then the embedded computer. Development
was always completed on the computer first because more robust development tools are available,
and it left the embedded computer available for other testing. The API tests can be seen in the
Appendix under API Tests
5.3 RISKS :
5.3.1 Embedded Computer :
The number of risks involving an embedded computer is relatively low. Long-term stress testing
of the device was performed. The XU4 showed no degradation of performance even after being
on for over a week at a time. As a precautionary measure, a daily Cron job to restart the XU4 was
implemented. High-humidity testing was not performed. Testing would put the hardware at risk
for damage, and was determined to be outside the scope of this development cycle.
5.3.2 Long Term Usage:
Before obtaining the embedded computer, not much testing has been done on long-term usage of
the XU4 due to how new the device is. The cooling system for the CPU actually utilizes a fan, and
the processor generates quite a bit of heat. Long term computing strain was monitored once a solid
working prototype was created and no issues were observed.
5.3.3 Environment Resistance:
The development and prototyping environment of the device was significantly different from
actual user usage. Due to the fact that it is a mirror, it might show up in bathrooms. Depending on
the mirror’s placement in the room and how well the frame is waterproofed, the embedded
computer could be exposed to high levels of humidity on a daily basis. Waterproofing was not
tested due to the high risk of damaging the various components.
5.3.4 Camera :
The embedded computer used in the project design was directly related to the camera component
and was constrained to which camera is selected. Motion detection cameras, like the Microsoft
Kinect, require about 50% of the available throughput on USB 2.0 so it is critical that an embedded
computer is selected to meet this requirement, as well as have enough processing power to interpret
the images and detect gestures.

Department of ECE-SISTK Page 16

The Microsoft Kinect was considered and chosen to be used as the camera. This was selected based
on the open-source availability of support with examples, as well as, the availability of the Kinect
(already owning one). The Kinect was initially paired with the Raspberry Pi. Upon selecting the
Odroid-XU4, the USB throughput concern was eliminated and no frame loss was observed.
However, processing power and USB throughput was continuously tested as a concern that there
could potentially become a bottleneck when more resources are needed.
Humidity would be an issue for the camera if there was no casing to protect it. For now, it would
be recommended that the smart mirror not be placed in an area with high humidity, such as a
bathroom. A means to protect the camera and all the hardware for the smart mirror would be
considered for later releases.
5.3.5 Web Application :
There are not many risks regarding the development of the Smart Mirror’s web application.
Although the development team is proficient with Python programming, getting familiar with the
tools provided by the Django framework took some time. In addition, the chosen embedded
computer to host the web application needed high processing power to process the web page
requests made by the user.
5.3.6 APIs :
It was difficult to implement all desired of the API functionality within the scope of this project.
If many widgets were developed in parallel, there was a risk that none will be completely integrated
into the Smart Mirror within the timeframe of the project. To mitigate this risk, development was
done in short cycles, implementing each desired widget completely before beginning development
on the next. This ensured that functionality was developed in the priority order and successfully
integrated into the Smart Mirror.
Relying on support from third-party applications creates the risk that the third party will change or
end support for core functionality used in the mirror. It is impossible to remove this risk unless
there are no external APIs used. This is an unreasonable solution because social media interaction
is a core design requirement.To mitigate this risk the high priority functionality such as sharing
photos should implemented using multiple APIs and social media networks so that it is less likely
that all photo sharing functionality is lost at once ,however ,in scope of this project only one API
was used for photo sharing.

Department of ECE-SISTK Page 17

5.3.7 Reflective Surface :
The reflective film is not intended for use as a Smart Mirror surface. If the display is brightly lit
the widgets will be displayed more clearly, but the effectiveness of the mirror will decrease.

After the reflective surface was installed, the brightness of the LCD display was calibrated to
optimize the clarity of the widgets versus the effectiveness of the surface as a mirror. There was
also some risk that air bubbles would form under the reflective film when it was applied to the
acrylic pane. Air bubbles would create a less professional look to the surface. Extra reflective film
was purchased and the film was applied several times until the film looked bubble free.

Department of ECE-SISTK Page 18

 CHAPTER 6
APPLICATIONS&ADVANTAGES
6.1 APPLICATIONS:
 Smart mirror is used in the industries.
 It is useful in home automations and hospitals.
6.2 ADVANTAGES:
 Less time required to see the news.
 It offering features such as weather of the city ,news, headlines.
 It makes day to day easier and features.

Department of ECE-SISTK Page 19

 CHAPTER 7

CONCLUSION
While starting the project we cannot contribute all money that’s required for buying a
monitor and a Pi at same time so solution was to connect the Pi to laptop using LAN or WLAN.
When we tried to connect the Raspberry Pi over network using SSH on putty software it
continuously gave error for not able to connect to Pi. We solved that error by manually creating a
ash file on boot drive of the pi .

Department of ECE-SISTK Page 20

 CHAPTER 8
FEATURE SCOPE
In our future work we will investigate how the surroundings context of the user and the
environment can be utilized in order to provide optimal service experience in the home
environment .the system can be made much more useful to the users by adding more functionality
like integrating light settings, speech processing .

Department of ECE-SISTK Page 21

REFERENCES
[1] Jane Jose, Raghu Chakravarthy, “Home Automated Smart Mirror as An Internet Of Things
(Iot)”, Issu3, Vol. 6, Issue 2, February 2017.
[2] Daniel Bessemer, Johannes Burley, “Fit Mirror: A Smart Mirror For Positive Affect In
Everyday User Mornings Routines”, November 12-16-2016.
[3] Derrickgold, Davidsollinger, And Indorman, “Smart Reflect: A Modular Smart Mirror
Application Platform”, 2016 Ieee.
[4] Pi Vaibhav Khanna, Yash Vardhan, Design And Development Of Smart Mirror Using
Raspberry Pi, Volume-5, Issue-1, And Jan-2017
[5] Narayan Sharma, Mirror: A Glance Into The Future

Department of ECE-SISTK Page 22