Binary

SMART INDIA HACKATHON - 2020

Bombers
2020

Organisation Name - Bajaj Fin Serv

Problem Statement -Design an app to write
formatted prescriptions based on dictation
from doctor.The app should provide facility to
sign the prescription and also send to the
patient directly on his phone and email id. The
method of storing the medical records (EHR)
should follow relevant compliance laws like
HIPAA.
 Idea

Ideas/Approach Our Idea is based on using speech recognition techniques to

understand the speech of doctor, then apply NLP to extract few 

Details
importants points in that description, then give doctor right to do
final edits and then send it to the patient via email in pdf form

Approach
We have used speech recognition api to ensure that we are
How are WE handling this voice getting high quality output text from input audio in real time. After
prescription problem that we applied clustering using networkX to rate each sentences

BINARY BOMBERS - 2020

and find the most useful sentences.

Approach - continue
After that we simply provide web interface to doctor, who cna see
if there is any error in the automated precription genrated and
finally he can send the pdf of this prescription by just one click

Technology stack
keras, re, nltk, pdfrw, google web api, flask, python, HTML/CSS,
pretty tables, etc.
USE CASES
Helps to reduce writing errors
and to provides detailed
prescriptions

This product helps in removing the human errors, there are

cases where doctor handwriting is poor which leads to
misunderstandings, patients get wrong medications due to
poor sloppy handwriting. Bad handwriting by doctors is
responsible for 7000 deaths every year in INDIA alone. This
is a very serious problem. This product can be very useful in
these cases. You have a PDF which is written in standard
format and font. Moreover, it provides convenience to the
chemist as well. BINARY BOMBERS - 2020
Future Plans
and
Improvements
How are we planning to make this
tool even better
We are planning to add more interactive GUI in this
project.
We are also planning to use the extracted medicine
names and provide dealers for it on the PDF itself.
Today, we have limitations of funds, but in future we
will use google speech API to make the audio to text
even more accurate and faster.
We are planning to integrate this tool into a proper
database so that hospitals can acccess the reports
easily BINARY BOMBERS - 2020