Braille script to voice conversion

CHAPTER 1

INTRODUCTION

Mobile technology has assumed an important role in everyone’s day to day life, yet their
complexity and design has often them difficult for visually impaired people . visually
impaired people can learn science and technology with little effort but they face difficulty
in handling this technology at ease. Though technological development has been a
blessing to many, visually paired persons are yet to enjoy it with ease. Mobile phone is
not an exception .It has become vital in the lives of almost every individual. But visually
impaired person is unable to use it at ease. There are many works being carried out to
make their life a breeze .“For most of us, technology makes things easier; however, for a
person with disabilities, it makes things possible”. 285million people are estimated to be
visually impaired worldwide : 39 million people are blind and 246 million have low
vision. About 90% of the world’s visually impaired people live in low income setting .So,
conversion of Braille script to voice is one way that makes easy for the visually impaired
person communicate with other people.

Braille language helps the blind visually impaired to gain education. Braille refreshable
displays help them to operate systems. Braille keyboardable input device, helps blind
people to input the information. The keyboard consists of smooth keys for input and LCD
display for output. It offers few or no tactile clues to allow a person with a visual
impairment to orient him or herself to the keypad. Due to this, it is of little use to those
who are visually impaired. This was the primary motivation of this project. The aim of
this project is to explore alternatives which can improve the computational facilities of
the visually impaired. This project aims at finding a viable solution for this problem.
Braille is a tactile writing language of raised dots widely used by the visually impaired
and is suitable for this purpose. For output, we use speakers to spell out the inputted text
data and the result respectively.

DEPT. OF ECE - 1- MIT MYSORE

Braille script to voice conversion

FIG 1.1: SAMPLE BRAILLE REPRESENTATION OF CHARACTER

Fig 1.1 shows the sample representation of English Braille alphabet .The raised dot
system is known as Braille. It was established by a Frenchman Louis Braille in 1824 who
lost his eyesight due to a childhood accident at the age of 15. Braille is derived Latin
word which is albeit indirectly. Braille letters are made up of six raised dots arrange in
group called a cell. Each letter of the alphabets is made up of different combination of
these six dots Which make up word. This Braille system is developed for our haptic
perception, a combination of the sense of touch, movement and finger pressure. Braille
characters are small rectangular blocks called cells that contain tiny palpable bumps
called raised dots. Each cell is made up of six raised dots arranged in a 3x2 membrane
that ate to a letter, number or character. These dots are raised roughly 0.9 mm by pressure
from a cylindrical pin, causing faction underneath the thick paper Numbers are written in
Braille using the number sign dots 3, 4, 5 and 6. The following diagrams show sample
Braille representations of numbers.

DEPT. OF ECE - 2- MIT MYSORE

Braille script to voice conversion

CHAPTER 2

LITERATURE SURVEY
1. Real Time Data Acquisition and Actuation via Network for Different Hand
gestures using Cyber glove

Subash chandar, Vignesh Kumar and Willson Amalraj

Real time data acquisition from a cyber-glove based hand gesture recognition system and
data transmission through internet is proposed in this paper. The joint angles of the
fingers are recognized for different gestures using a Cyber glove. Data from cyber glove
is obtained in real time by a Client module developed using Windows Application
Program Interface (WINAPI), from Virtual Hand Suite (VHS). TCP protocol is used for
transmission of extracted data to the Server. Microcontroller (AT89S52) is used to
control the speed of the motor depending upon the real time data received at the server
end. Real time working of the prototype is demonstrated with successful data tapping,
transmission, reception and speed control.

2. A Survey of Glove-Based Systems and Their Applications

Laura Dipietro, Angelo M. Sabatini

Hand movement data acquisition is used in many engineering applications ranging from
the analysis of gestures to the biomedical sciences. Glove based systems represent one of
the most important efforts aimed at acquiring hand movement data. While they have been
around for over three decades, they keep attracting the interest of researchers from
increasingly diverse fields. This paper surveys such glove systems and their applications.
It also analyses the characteristics of the devices, provides a road map of the evolution of
the technology, and discusses limitations of current technology and trends at the frontiers
of research. A foremost goal of this paper is to provide readers who are new to the area
with a basis for understanding glove systems technology and how it can be applied, while
offering specialists an updated picture of the breadth of applications in several
engineering and biomedical sciences areas.

DEPT. OF ECE - 3- MIT MYSORE

Braille script to voice conversion

3. A Survey on Advance Technology for Communication between Deaf/Dumb

People Using Eye Blink Sensor and Flex sensor

Dr.S.Karthikeyan, Merin Mary Koshy

The problem that our society faces nowadays is that people with disability are finding
hard to grapple with fast growing technology. The access to communication technologies
has become essential for the handicapped people. Normally deaf/dumb people use hand
gesture for exchanging information and they find hard to deal with people who can’t
grasp the ideas of sign language. And therefore they can’t communicate with normal
people. The project deals with an advanced two way communication system which can
give the ability to speak in the public domain through EOG technology. In this scenario
they are two users, one user uses eye blink sensor to communicate a sentence or word
through EOG technology and the other user flex sensor their by communication between
each other occurs.

DEPT. OF ECE - 4- MIT MYSORE

Braille script to voice conversion

CHAPTER 3

BULIDING BLOCKS OF SYSTEM

3.1 DESIGN OF SPECIAL BRAILLE KEYBOARD

A keyboard which is similar to the Braille keyboard is made using these push buttons .
The push buttons used here are based on switching mechanism which means if the push
button is pressed ,it will connect the two points in a circuit. Here 9v battery is used as an
input to these push buttons .The 9v power supply is converted into 5v using IC7085.

.3.2 BLOCK DIAGRAM

Serial monitor
Power supply

Arduino Board
Voice
output

Voice module

FIG 3.1: BLOCK DIGRAM OF PROPOSED SYSTEM

DEPT. OF ECE - 5- MIT MYSORE

Braille script to voice conversion

Initially one has to take six push buttons for collecting analog output from them .A
keyboard which is similar to the Braille keyboard is made using these push buttons which
will make physically challenged people to understand easily as they are very much used
to that. The push buttons used here are based on switching mechanism which means if the
push button is pressed ,it will connect the two points in a circuit.
Here 9v battery is used as an input to these push button .The 9v power supply is
converted into 5v using IC7805.Afterpressing any button ,the output from it will be given
to the Arduino board and depending on the input given ,it gets converted . The output will
be displayed on the serial monitor. The output from the Arduino is given to the voice
module, here we get the voice output.

3.3 ARDUINO:
ARDUINO is an open source, computer hardware and software company, project and
user community that designs micro controlling digital devices that can control and sense
objects. Arduino boards use a variety of microprocessors and controllers. These are
equipped with sets of digital and analog input/output pins that may be interfaced to
various circuits. It features USB (universal serial bus) on some models. It is used in
programming languages like c and c++..
The Arduino project started in 2003 at the interaction design institute in Italy. It mainly
aims low cost and easy way for novices and professionals to create devices that interact
Fig 3.1: Sample Braille representation of Characters with their environment using sensors
and actuators. Common example are simple robots, thermostats and motion detectors.

DEPT. OF ECE - 6- MIT MYSORE

Braille script to voice conversion

FIG 3.3: ARDUINO BOARD

3.4 SERIAL MONITORING:

Serial monitoring is a feature that is provided in Arduino IDE software to check the
required output. Generally, we can check the output by using the statement Serial.println.
in this topic we are using the serial monitoring statement to display the characters and
check the output according to the given user braille input.

FIG 3.2: ARDUINO IDE SERIAL MONITOR

3.5 VOICE MODULE(WTV020-SD):

FIG 3.3 : VOICE MODULE(WTV020-SD)

DEPT. OF ECE - 7- MIT MYSORE
Braille script to voice conversion

This module with MP3 mode, key mode (control 3 group of voice with volume
adjustment or 5group of voice),two line serial mode, and Loop play mode(after power on
,the module play loop, with memory function in the mode) They optional. Customers can
choose one of the modes in a module. Also can be customized.
MP3 mode: With play/stop, next, previous, vol+, vol- functions
Key mode (3 group of voice): One key trigger one group of voice, and with vol-, and
vol+ . all keys default trigger modes are edge retrigger
Key mode (5 group of voice): One key trigger one group of voice, trigger mode can be
follows: 1. All keys are edge triggered,
2.All keys are ON/OFF(voice will not cycle after finished ) 3. All keys are
ON/OFF(voice will not cycle after finished )
Loop play mode: After power on, it will play the voices automatically. it doesn’t need to
trigger the I/O. and with memory function (when you playing voice 2, power was cut off,
next time power on it will start from voice 2 or voice 3.(Can be customized) Two line
serial mode: WTV020-SD controlled data sending through CLK and DI . Can play voices
in any address, also voices (include mute) can combined to play in this mode.

This module is used for processing and playing audio files stored in the memory card.
The files stored in the Micro SD card are stored in the .ad4 format. This module can be
configured by sending commands via serial port. The product supports plug maximum
the 1G capacity of the SD card. Supports playback of 4Bit ADPCM format files.
Automatically recognize the voice files.

Loadable 6KHz to 32KHz, 36KHz sampling rafileD4 audio. Loadable 6KHz ~16KHz
sampling rate WAV audio.16bit DAC and PWM audio output. Can store up to 512 voice.
WTV020-SD-20S, WTV020-SD-16P are two types modules. Support micro-processor
and key control. Voice playback can call any paragraph. Power-down save operation data
capabilities. Loaded voice without software assistance to the SD card can be placed
directly on the voice. Support file combination play, including mute combination.
Operating voltage: DC 2.5 ~ 3.6V. Quiescent Current: 16uA.

DEPT. OF ECE - 8- MIT MYSORE

Braille script to voice conversion

CHAPTER 4
RESULT AND DISCUSSION

Fig4.1 : voice output from voice module based on Braille keyboard

DEPT. OF ECE - 9- MIT MYSORE

Braille script to voice conversion

Fig 4.2: Character Output on Serial Monitor in Arduino IDE

Based on the Braille Keyboard Input

• Blind use these special keyboard to convert Braille script to voice.

• The Braille script to voice conversion explores a wearable messaging device that
uses embedded technology for visually impaired person.
• It has a special keyboard that is integrated with the braille for the use of blind .
• It converts the message that the person wants to communicate to other person into
a voice and text, so that he understands what the blind and dumb intend to say.
• After pressing any button ,the output from it will be given to the Arduino board
and depending on the input given to it gets converted into text.
• The output will be displayed on the serial monitor.
• The output from the Arduino is given to the voice module, here we get the voice
output.

DEPT. OF ECE - 10- MIT MYSORE

Braille script to voice conversion

CHAPTER 5

CONCLUSION

This project is done in order to provide a platform for specially abled people (Blind and
dumb). It is a convenient method to communicate with the help of Braille keyboard where
the output is displayed on LCD. It enables normal people to understand Braille script and
at the same time we will get voice output through speaker with the help of SD card based
voice module which helps blind and deaf person to understand what specially abled
person want to convey.

DEPT. OF ECE - 11- MIT MYSORE

Braille script to voice conversion

REFERENCES
[l] electric speaking glove for speechless patient , Syed Faiz Ahmed, Syed Muhammad
Baber Ali, Sh. Saqib Munawwar Qureshi ,2010

[2] Design and implementation of deaf and mute people interaction system , Fadia Noori
Hummadi Al-Nuaimy ,2017

[3] Braille script to voice conversion , K.Krishna Kishore , G. Prudhvi , M. Naveen 2017

DEPT. OF ECE - 12- MIT MYSORE