Future Black Board

Using Internet Of things with Cognitive Computing

(Machine Learning Aspects )

Narendra Santhosh N
3rd Year, ECE Department
Sri Sairam Institute Of Technology
Chennai India
IEEE Member , Madras Chapter
santhoshnarendra@gmail.com

"In the next century, planet earth will don an electronic skin.
It will use the Internet as a scaffold to support and transmit its sensations. - Neil Gross 1999

Abstract In an era of Digital computing , where people are
more concerned in developing products to get there job done
soon and also benefit them in all parameters , came Internet Of
things to Solve. After Embedded Systems, there was a void left to
be filled to solve automation .By the introduction of Internet,
everyone started to visualize the things in a different way, Thus
the Arrival of Internet of Things and now It is said to be the
future for next few years. On the other side its Cognitive
Computing thats making the Big data to the next level , which is
a branch Of Artificial Intelligence .In a similar way , The notes
given by the teacher each and every day are taken by the students
, but there is no forum yet to save those so to use them again ,
with help of Internet Of Things this could be possible where
Sensors talk to the Chalk piece and gets the data to save .By
analyzing ( Pattern Recognition ) the data obtained we can make
a mini augmented reality system , where students can ask board
the questions so the board answers , at end of the day its the kids
who will be benefited through this. Henceforth we have come to
change the way you look at the Blackboard!!!
Keywords - Internet of things , Speech Recognition , Word by
Word Analyzing , Sensors in Future Board Framework ,MIT-
Sketch Project , Connecting the dots , Artificial Intelligence ,
MIMIO Smart Tech ,Communication module , Grid Computing ,
Pattern Recognition ,Connected Boards and Internet Of
everything.
I. INTRODUTION : INTERNET OF THINGS
Internet of things: the boon of the next era is what the whole
world is talking about. It is the field where right from
researchers to the scholars is so curious to know and also build
products. The vision of the Internet of Things has evolved due
to a convergence of multiple technologies, ranging from
wireless communication to the Internet and from embedded
systems to micro-electromechanical systems (MEMS).Indeed
there are many new hack-able hardware available in stores to
start Prototyping .[1] This means that the traditional fields of
embedded systems, wireless sensor networks, control
systems, automation (including Environmental and
Machinery automation), and others all contribute to enable the
Internet of Things (IOT). This is a good proposal which has
given us a rough Solution of the Internet of Things'
architecture. The Scope of this technology has a greater
potential to serve the Community Better , so [8] Big Players
like Intel , Samsung , Facebook , PTC ,Google , etc are But
there are some further important issues that makes IoT to be a
tough call . The first is if every object is connected and things
can exchange information by themselves, then the traffic and
Storages in the network will increase very rapidly with an
exponential way. Does today's Internet really can bear this?
Do we need a new backbone? Connecting every object and
make them can communicate independently is a very
attractive vision, and yes we can imagine many cases in future
that a thing needs to "talk" to another thing, but is it real
necessary that an object "talks" to all the other objects? Why a
toothbrush needs to "talk" to a fridge? In fact, the main
connections of an object are with those objects which are in
the same the Internet of Things application system as it. And it
is could be seen that the Internet of Things is made up of many
Hardware Embedded System. When the Internet Of things
data is given to a Cognitive Algorithm the data is analyzed in
a way Brain analyze it . Cognitive is that part in Brain which
takes care of the Problematic Issue whenever a human faces .
So similarly here Cognitive does the same by multiple
recognition of the data and making it available in our
Knowledge Base , which will be discussed later in our Paper .
II. TECHNOLOGY AND WORKING OF FUTURE BOARD
A. The Concept and its link with the IOT
Black Board of future totally works on the View of IOT. This
traces the strokes or the scribbles made by your teacher and
records it automatically so you can note down it later and
spend your lecture hour to just listen whatever has been
covered. The Idea came out since the SMART Board used
now days are not frequently used or pretty much technical and
since its software that runs on it there are many chances of
bugs or errors. The most important part of it was pretty much
costlier and needs a technical team to maintain it.
B. The Pre-existing Product in a Smaller Version
Wacom - Inkling Digital Sketch
[3].The basic idea used in the Wacom inkling digital sketch
pen is an Infrared Sensor to detect the location of the pen and
to monitor its flow. The ultrasonic sensor is used to confirm
the flow of pen and a sensitive sensor to detect whether the
sketch pen is on work or at rest. Waco inkling pen is suitable
for a task of a paper of range 20cmX11cm. But in the case of a
black board the usage of same technology is quite difficult. So
the making it possible is what the IOT is all about. In this case
a large grid matrix of (x, y, h) co-ordinates of 10000000 cells
for average of 3mX1m Black board.
MIMIO Smart Tech
[9] MIMIO is a smart board technology which works on a
basis of Software created by MIMIO , which works along with
their Hardware , that uses three Sensors to determine the axis
and point the boundaries , so it would trace the actions easily .
This as a whole works with a projector by MIMIO , MIMIO
Smart Tech Hardware (Sensor Hardware ) and MIMIO Digital
Pen .
C. Technology Behind it
The technology behind the Black Board is to have a chalk
piece holder which will consist of a transmitter and a receiver
at the tip of the writing side of chalk piece so that the error of
marking wrong place while teacher uses the chalk to point
some trace . A sensitive touch sensor is made to confirm the
usage of chalk piece. A long structure of IR sensor along with
the RFID scanner is placed at the two vertical planes on the
rectangle black board. the RFID chip placed on the chalk piece
holder makes sure the detection of the object (i.e.) the chalk
piece which transmits the co-ordinates to the RFID sensor and
which is confirmed by the IR sensor makes sure that the signal
are read without any manual error . once done this gets send
to the microprocessor or some other controlling unit in order
to convert the analog data to a digital output which first gets
saved and viewed later by the application that come with the
product or website . Radio frequency identification (RFID) is
seen as one of the pivotal enablers of the Internet of Things.
Objects should be indentified so that they could be connected.
RFID, which Use radio waves to identify items, can provide
this function. Sometimes RFID has been labeled as a
replacement of bar code, but RFIO system can do much more
than that. In addition to identify items it also can track items in
real-time to get important information about their location and
status. RFID has already had some valuable applications in
retail, health-care, facilities management [5], etc.
D. Algorithms in making this possible
As said above, the concept at a whole deals with a bunch of
sensors connected in series to detect each and every stroke
made by the teacher on the Board. The traces are taken by the
following steps: -
a is the position of the sensor.
x1 is the distance at which the sensor sensed.
(x1 ,a )= is taken to be as a point
x The graph becomes
a
x1
x distance .
a the position of the sensor.
Fig 1.1 The Sensor Detection Process
By the help of RFID chip on the chalkpiece provided , we can
make sure and also confirm that the object is chalkpiece along
with the distance given by the same .
E. Sensors and Communiation Module .
The normal sensors used to detect an object is utilized here ,
along with the RFID chip provided on the chalkpiece holder
for confirming the position of the trace or stroke . Similarly ,
the role of the duster plays an important rule in Making this
Board more User Friendly . The Duster here gets its IOT
digitalization by analyzing the trace , Reset , new , edit also
highlight options and the connection of the Recording Device .
At a whole the Duster communicates with the Board ,
Recording device also the main controller . The
communication between recording and controller is done by
wires ( Intra connection ) where as with others are done by
Xbee Frequency Transmitter and Reciver . The
microcontroller used here gets the data and passes the points
for each and every stroke to the device or cloud . Where as the
software reads the data at the other end and makes it readable
to user.
This Python or any Java related Framework code can be used
in any platform , user is famliar of by the Software provided .
In addition to the traced stroke , this provides even the Voice
note , said by the teacher on that particular Hour . By Using
Python along with Raspbeery Pi , We can get the values from
sensors and frame it out using the techniques of Sensing the
motions and forming it to words as we see in stylus .[17]
III. ARTIFICIAL INTELLIGENCE IN BLACK BOARD
[6].If its Internet of Things thats booming on Electrical and
Technical Field then its Artificial Intelligence doing it on the
other side. Artificial Intelligence generally works on the
History of a particulars work. By going into a deep Analysis
, it finds the answers for a problem based on the problem faced
earlier .Which is divide as Cognitive Computing ,where the
system does a Computing work on the given problem and
provides the user with the Answer by node wise Analytics
As similar to the IBMs Watson.
A. Cognitive Computing in Future Board Concept
Here Cognitive Computing plays one of the vital roles to
make the user feel the Board, talk to them as a friend as we do
with our mobile. As we Analyze the Trace, We get to know
the data used on the board which gets added to our history and
thus by making a rough analytics and dividing the data as
Questions and Answers by the commonly used parameters or
also by giving a highlight option on Questions and Answers
whenever written on the board .So whenever the user ask for a
Question from the Stored history, Board will give the reply
through Speakers provided.
B. Cognitve Computng working process
1. RECOGNIZING THE CHARACTERS
[15] Words obtained are initially uploaded to the Knowledge
base .As we know each Artificial Intelligence needs is own
Entities so it could respond soon based on the Intent pushed .
the Knowledge base is constantly updated for each and every
entry . Words in Knowledge base are Analyzed and are
classified based on the Vocabulary and arranged in accordance
to the Entities that are again fetched from the words obtained .
This works similar to the way Newtons pad did a long back;
this technology analyzes the scribbled input by user and makes
it readable for the user depending on the characters in
Character Recognition engine which is the base of this
technology. Character Recognition works on the basis of
Neural Networks, which identifies the character by Image
Processing and makes an entry to the Character Engine.
2. ANALYZING THE CHARACTERS
The Characters Obtained from the user through Black Board is
made to Computer readable form, with help of the Neural
Networks. Thus the Readable Characters are analyzed by the
following parameters:
x Nouns
x Verbs
x W type Questions
x Proverbs
This makes the black board to analyze the basic
content of a given question , based on which it
takes a Rapid Search Techniques from the data
received previously to respond with the Answer .
Mt. Everest is the worlds Highest Peak at 8,848
m above sea level.
From the above Sentence its clear that, based
on the Vocabulary the pattern recognizes the
sentence and breaks it down with many words
3. THE SPEECH RECOGNIZATON TECHNIQUES
for analyzing it. Red Noun; Blue Verb;
Green Adjective; Brown Preposition
This is a quite Challenging factor but a one that would give
life to the whole board. This is the most important part in
order to make The Future Black Board Scalable. This works as
the regular Google Now. The Receiver is the Same Recorder
the one we have discussed for the IOT. The Structure Block
deals with the controller connected with the Recorder and
Receiver gets the question and sends t to the local device kept
for a floor which analyzes the question and provides the
answer back to the User. This is structured by the following
the block diagram (Fig 1.2) .For The AI a Bot can be used as
real-time easy implementation as how [16] Alexa of Amazon
or any other Bot like Jasper is used . There is also a [10] [11]
MIT Sketch product where in they use [12]LADDER Logic to
detect the Lines , shapes drawn on the board from the
Projection and Software Used .
IV. PERSPECTIVE VIEW
This Future Board aims to transform the way children learn
each and every Concepts and also makes them to be intractive
with the Board by providing answers even from Online , At
end of the day , if a student misses some notes he can acess it
whenever he wants , this makes the students to listen well and
understand more .We are plannng it to make a Screenshot
Video using the same Technology .
V.GRID COMPUTING
[13] [14] The whole world is connected to Internet these days .
Really 200Billion Devices are expected to be connected to the
cloud by 2020 . But this will lead to generate a large amount
of big-data which could cause major trouble in maintaining
servers though cloud is preferable . In order to overcome this
grid computing is preferable option . Grid computing will
allow access to use device's data in many device . Bringing the
Idea of Grid Computing and making each class boards to talk .
to each other will make this technology grow even more better

Fig 1.2 Block Diagram Explaining the Entire Process

V. PREDICTABLE FLAWS
The overall System may work secure in all ways and the
Security is well packed as we use the Grid Computing to make
sure the data is with us . The Flaws may occur in sensing the
most Typical Hand writing Process , so initially we will try to
make it to train with many Hand-written Detections .

VI. REFERENCES

[1].Internet of things (Wikipedia.org).

[2]. Lu tan and Neng Wang IEEE paper on the topic Future Internet: Internet
Of things.
[3]. Article on Wired.co about Wacom Technologies.
[4].Electronics For You The smart world edition July 2015.
[6].Cognitive Computing Seminar by Senthil Ramasamy of IBM Watson
Team.
[7].Neural Networks, Wikipedia.org
[8]. Most Powerful Internet Of Things Companies By
Brandon Butler of Network World
(http://www.networkworld.com/article/2287045/wi-fi/wireless-153629-10-
most-powerful-internet-of-things-companies.html )
[9]. MIMIO Smart Tech Company , Research on Detection of the interactions
made in board . Link :
(http://www.mimio.com/en-AP/Support/Mimio-Product-Documentation.aspx)
[10].MIT Sketch product Working of it is given in this Video
(https://www.youtube.com/watch?v=NZNTgglPbUA).
[11]. MIT Sketch is under the MIT Scholarly Article
(https://dspace.mit.edu/handle/1721.1/46512 )
[12]. LADDER Logic is the basic framework on which the whole MIT Sketch
works .
(https://www.idec.com/language/english/manual/FT1A-Ladder-
Programming.pdf)
[13] . IEEE Paper on Distributed Computing by Shao-Yi Chien , Wei-Kai
Chan, Yu-Hsiang Tseng, Chia-Han Lee, V. Srinivasa Somayazulu, Yen-
Kuang Chen Published in Design Automation Conference (ASP-DAC), 2015
20th Asia and South Pacific on 19-22 Jan. 2015 . ISBN 978-1-4799-7792-5