Bluetooth-Aided Brainport Technology for Visual

Representation of the Blind

by

Marimar L. Auditor
Jason R. Cirio
Karyl Denise G. Magpayo
John Allen L. Taganahan

A Research Report Submitted to the School

in Partial Fulfillment of the Requirements for the Degree
Program
(Electronics Engineering)

Mapa Institute of Technology

March 2015

Chapter 1
INTRODUCTION
Different forms of technology nowadays became an essential part of the human lives.
Innovation as such has done great impacts not only to the world, but also to each individual
using them. Wireless technology that helps people communicate has become a most sought
devices in todays generation. Wireless communication has paved its way to advance
technology and made interaction between two devices at different location possible. Since
new types of technology keeps on increasing every day, implementation of wireless
operation instead of the wired technology will become a more convenient type of
communication. Such as using the human tongue as a direct path of sight to the blind. A kind
of device will be made that by using a camera to see their surroundings, wireless
communication will take place between the transmissions of the signal, wherein converted
electric signal familiar to our brain will be sent to the device connected to the tongue and
letting the user see a spatial representation of its environment through pixilated images.
Different researches are now being held in order to invent technologies that uses
electronic devices in performing an alternative way of sensing. Since different researchers
conclude that humans see through their brain and not in their eyes, technology that lets
people see and perceive their surrounding other than their eyes will be very helpful and
useful in the long run. Some recent studies also shows that while the process of learning this
type of mechanism will be very handful and takes time in getting used to the device, the
output result is still worth the trade.
While the device is a promising option to those who have lost their sense of sight, one
must not overlook the fact that these technology may not function well as accurate as what

the human body parts can do. Since these devices were only made of technology design to
imitate the function of a humans action, there is no certainty that this type of technology will
performed as indicated and not harmed the user in the process. Further need of study must be
done to ensure the safety of those that will benefit from this device.
The focus of the research paper is through innovation, by means of replacing
handheld wired devices with a smartphones that is capable of wireless communications.
Since the camera will store digital signals, an application in the smartphone that will convert
digital to electrical signal will be done in the research. Also, the transmission of signal must
be observe to avoid a data signal being distorted or corrupted in the process of sending from
one device to another. The device will also undergo different test and will be evaluated
according to the following criteria: response time of signal, accuracy of image received,
effectiveness to the user, and lifespan of device. The main purpose of this is to compare its
operation with a wired device and see their advantages with respect to each other. Lastly, a
simplex communication must be implemented to each device per stage of transmission to
avoid mixing of the signals.
By implementing a new type of technology that can help the visually impaired
individual through wireless means, a more convenient and user-friendly device will be
observed, making it easier for the user to adapt to the technology. The device is also less
expensive compared to the wired technology, which makes it money efficient. The study also
gives a number of advantages to the user as it does not require a surgery or implant of the
device to the body which may cause direct death when not properly done.
The research covers a common form of wireless communication, which is
transmission of data using a Bluetooth. Using a smartphone, it will receive the signals via

Bluetooth, convert it to electrical signals, and transmitting the signal in the device connected
to the tongue. We will also observe the users response when using the device, since the see
and talk relationship will be dependent upon the processing of the technology. The study
however, limits itself to the following operation: it will not tackle the operation of the tongue
to brain transmission of the signals, how the brain receive and perceive the signals.

Chapter 2
REVIEW OF RELATED LITERATURE

A device that aids the blind with their tongue using wireless technology as well as the
utilization of a phone application is the main focus of this study. Brainport is a device that
has been invented to enable blind people to see through the use of their tongue. This device
involves a pair of sunglasses wired to an electric lollipop and a handheld devices used to
operate the camera [1]. ]. When released in the market, Brainport will cost $10 000 [8].
Bluetooth technology is reviewed wherein it will be used as a substitute to the wired device.
Also, a certain phone application will serve as the control element thus lessening the burden
of carrying so many devices.
Bluetooth is commonly used nowadays in the field of wireless technology. It is
defined as a standard of exchanging data over a short range with the use of UHF radio waves
in the ISM band from 2.4 to 2.485 GHz [2]. This technology is commonly used on portable
devices such as cellphones, laptops and etc. [3]. When Bluetooth is utilized, it uses the same
radio frequency band. Unlike infrared, Bluetooth do not require line of sight between the
devices. Its range is based on the radius that it can cover [4]. Commonly, the maximum range
of a Bluetooth device is 10 meters thus uses low power. The range is directly proportional to
the power consumption. Bluetooth operates in such a way that when devices enters in the
radius that is required the so called electronic conversation will take place in which they will
learn from one another the message that they need to perform whether control each other or
send data from one another [5]. The good thing about Bluetooth is that it operates
automatically. Once the devices have been already connected, Personal-Area Network (PAN)

or also known as the piconet is established. After the process, the devices connected with one
another will be stayed connected without the interruption of any other devices [6]. The
concept of the piconet is that all devices connect with each other by the use of a certain range
of network address. Devices whose programmed address is not in the range will not be
connected.
Smartphones are commonly used nowadays in every aspect of our lives. From the
device named Brainport, it involves the use of a certain handheld device that could operate
the overall function and converts the digital signal into an electrical signal that will be sent to
the lollipop. We thought of replacing it with a smartphone that is Bluetooth capable and with
a programmed application that will serve as the control element.
The tongue is used in this system even though the process involves the sense of touch
because the mouth is consist of the most sensitive muscles and tissues in our body thus can
process the image more effectively and accurately [7].

Chapter 3
METHODOLOGY

INPUT

Camera captures images

Captured image in a form of digital signal is transmitted

to a smartphone via Bluetooth

P
R
O
C
E
S
S

Digital signal is converted into an electrical signal

Electrical signal is sent to a lollipop that is placed above a

tongue via Bluetooth

Electrodes of the lollipop make pulses

The tongue feels the image

Brain decodes information

OUTPUT

User sees a spatial representation

Conceptual framework on how the device would work.

OVERALL ASSEMBLY
The proposed bluetooth-aided device uses the same components of Brainport
technology, except that the handheld signal converter is scrapped and to be replaced by
smartphones. Communication between camera to phone, and phone to lollipop is enabled by
bluetooth. That is why, a Bluetooth dongle will be added to the camera and the lollipop.
The overall system will work in such a way that everything is in the wireless form.
The smartphone will be used and network connections will then be established. Once the
process is complete, the camera will now capture images and will consider it as the input.
The image will be sent to the smart phone, which is the new control unit, and it will convert
the image to a low-resolution black and white greyscale picture. The lollipop is a device
made up of 400 electrodes and once the picture is converted to electrical signals, the signal
will be sent through Bluetooth going to the lollipop then the electrodes will make pulses.
This pulse is dependent to the intensity of the light in every area of the converted picture. The
tongue will eventually feel the image and the brain will decode the information. Then, the
user now sees a spatial representation.

Different methods will be tailored to achieve the objectives of this proposal, which
are focused on replacing the handheld device of existing Brainport technology. The main
purpose of this is to determine possible errors that may occur during testing and will be
properly addressed to avoid device failure in the future.
ASSESSING THE SPEED OF RECOGNITION
The time of transmission between devices is an interesting part of the study. A slow
transmission of the signals to the user could cause accidents; for example a late transmission

may cause a blind person to fail to recognize an incoming object that is about to hit to
him/her. Of course, having a fast transmission is the favorable response of the wireless
communication that this paper proposes.
Random pictures are shown to the blind person. A previously prepared timer is laid
out in front of the respondent. He/she will be asked to press the timers stop button as soon as
he/she recognizes the image.

DETERMINING THE ACCURACY AND DETAIL OF IMAGE RECEIVE

Another point to consider is that whether Bluetooth communication fully delivers the
signals received by the camera to the user. Making a sample of blind people to recognize
some images that will be prepared will test this out. There will be three tests in this section:
Firstly, the blind will be asked recognize simple letters, and sentences. Second,
colored images of animals and sceneries will be shown; and lastly, pictures of camouflaged
animals and people will be shown. These three tests will determine how accurate and detailed
are the visual representations that the blind will receive.
For detail testing, data will be collected through survey.
Test 1: Simple Letters and Simple Sentences
USER

Very Blurry

Blurry

Clear

Very Clear

1
2
3
4
5

For accuracy testing, the respondent will answer the questions:

Test 2: Colored Images of Animals and Sceneries
1. What colors are the images?
2. From previous images before blindness, how would you describe the colors that
are shown?
3. What animals are on the pictures?

Test 3: Camouflaged people and animals

Commonly circulating on the internet are pictures such as soldiers among leaves and
cats that look like throw-pillows. The blind will be asked to locate these camouflaged beings.
Frequency testing is the statistical method that will be used to collect and interpret the
data collected.

ACQUIRING FEEDBACKS FROM THE BLIND

Feedbacks and comments from the respondents are welcome. The researchers
plan to organize these data by conducting a survey.
Great Good Fair
1. Is the device convenient for regular movements?
(eg walking, standing, sitting)
2. Does the device make fast visual representations?
3. Does the device allow the ability to read?
4. Does the device present colors that are similar to
memory (before blindness)?

10

Poor

REFERENCES:

[1] Scientific American, Tasting the Light: Device Lets the Blind "See" with Their Tongues,
http://www.scientificamerican.com/article/device-lets-blind-see-with-tongues/(August 13,
2009)
[2] Franklin, Curt., Layton, Julia.,How Bluetooth Works,
http://electronics.howstuffworks.com/bluetooth2.htm
[3]What is Bluetooth Technology, http://www.bluetooth.com/Pages/what-is-bluetoothtechnology.aspx
[4] Franklin, Curt., Layton, Julia.,How Bluetooth Works,
http://electronics.howstuffworks.com/bluetooth2.htm
[5] Franklin, Curt., Layton, Julia.,How Bluetooth Works,
http://electronics.howstuffworks.com/bluetooth2.htm
[6] Franklin, Curt., Layton, Julia.,How Bluetooth Works,
http://electronics.howstuffworks.com/bluetooth2.htm
[7] Smith, Dana. Science for the Curious Discover. Blind Sight: The Next Generation of
Sensory Substitution Technology.
http://blogs.discovermagazine.com/crux/2014/04/28/blind-sight-the-next-generation-ofsensory-substitution-technology/#.VXR_eM-qqkr/(April 12, 2014)

11

12