Sie sind auf Seite 1von 31

S J M INSTITUTE OF TECHNOLOGY, CHITRADURGA

SEMINAR ON:
ELECTRONIC MEDICAL RECORD SYSTEM BASED ON
AUGMENTED REALITY
PRESENTER NAME: Amith Rahul Priyank
DATE: 01/03/2018
USN:4SM14EC004
Dept. of E&C, SJMIT, Chitradurga.
Under the guidance of:
1. Sri. Siddesh K B M.Tech , Asso.Professor, Dept. of E&C, SJMIT, Chitradurga.
2. Sri. Chetan S M.Tech , Asst.Professor, Dept. of E&C, SJMIT, Chitradurga.
Remember, your work may be only to sweep a railway crossing,
But it is your duty to keep it so clean that no other crossing in
the world is as clean as yours.
-Sir M Visveswaraiah
OVERVIEW
• INTRODUCTION

• BACKGROUND

• METHODOLOGY

• ADVANTAGES AND DISADVANTAGES

• APPLICATIONS

• CONCLUSION AND FUTURE SCOPE


INTRODUCTION
• Medical Record

• Electronic Medical Record (EMR), is the systematized collection of

patient’s medical records electronically-stored in a digital format.

• Augment is a latin word means ‘to make something greater by adding

to it’.

• Augmented Reality is a synthetic, computer simulated reality or

recreation of a real-time environment where a user can interact with

the replicated real environment.


• The environment around us provides a wealth of information that is

difficult to duplicate in a computer.

• User can not only check the relevant medical information on the

Android device, but also operate the 3D organ model based on AR

through gestures.

• In addition, users can also wear AR/VR glasses and data gloves to

operate the 3D organ model in order to get a stronger sense of

immersion.
BACKGROUND
• In order to achieve the

benefits that EMRs can

provide, physician adoption

rates must be increased

substantially.

• Implementing the right

system the right way is

essential for ensuring project

success and protecting patient


Fig. Electronic Medical Record system
safety.
METHODOLOGY
Electronic
Medical Record

Liver CT image 3D Liver model


Server

Data gloves AR glass

Fig. EMR based on AR system architecture

• Taking user to the hospital to do liver CT.


• The data will be stored on the server.
• User can access to the server through the Android device, and obtain
medical records data.

• 3D model is provided by using automatic segmentation and


reconstruction algorithm based on CT scan data.

• User can also wear the AR/VR glasses loaded with Android phone, and
use the data gloves based on Bluetooth Low Energy (BLE) technology
which is a wireless personal area network technology to operate the 3D
model.
AUTOMATIC LIVER SEGMENTATION AND RECONSTRUCTION
FROM CT IMAGES
• Liver segmentation is a very challenging
task.
• We use single-block linear detection
algorithm (SBLDA) forliver extraction
from CT images.

The three major parts are:


1. Image pre-processing.
2. Liver edge extraction with SBLDA
3. Image post processing

Fig. Flowchart of SBLDA


1. 2. Liver edge extraction
Image
preprocessing • During single-block linear detection, we
first select the input image as seeds,
initialize the confidence matrix with zero,
Setting window and then update the confidence matrix with
Noise
width and SBLDA.
suppression
window location

• The window width (400) and


window location (40) are chosen
to better display the original 3. Post processing
image.

• The noise in the images may lead • Removing the ring artefacts in abdominal
to false update. CT.
• Noise on segmentation can be • Reconnecting structures disconnected from
reduced by smoothing the original the liver.
images with filtering.
Fig. The segmentation and reconstruction result

• By retaining the maximum connected region and smoothing with a Gaussian


filter, the liver edge is extracted.
THE OPERATION PROCEDURE

• User needs an android device with BLE (Bluetooth Low


Energy) connected to the Internet.

• Android device can search for the user’s medical record


from the server through the given QR code.

• Android device can show the 3D model and text


message using AR style.

• Android device can automatically connect with data


gloves through BLE.

• User can use hands to control the 3D model, such as


translation of any position, rotation of any angle,
arbitrary size scaling and so on.
Fig. Operation flow
SERVER
• A server is an instance of a computer
program that accepts and responds to
requests made by another program, known as
a client.

• Servers are used to manage network


resources.

• Servers can provide various functionalities,


often called "services“, such as sharing data
or resources among multiple clients.

 Dedicated server
Fig. Client-server model
 Shared server
AR GLASSES • In augmented reality applications, a user will
see both synthetic and natural light.

• This is done by overlaying projected images


on top of a pair of see-through goggles or
glasses.

• Vuzix Blade AR glasses are the next-gen


Google Glass.

• AR becomes a part of your entire field of


Fig. AR glass
view, preparing for more life-like AR
experiences - almost feels like Ironman with
the help of the intelligent system.
WORKING OF AR

• A mobile phone's camera identifies and


interprets a marker, often a black and white
barcode image.

• The software analyses the marker and creates


a virtual image overlay on the mobile phone's
screen, tied to the position of the camera.

• This means the app works with the camera to


interpret the angles and distance the mobile
phone is away from the marker.
Fig. AR working
DATA GLOVES

• A data glove is an input device.


• It contains various electronic sensors that monitor the
hand's movements.
• It contains a motion tracker such as an magnetic
tracking device that captures the position and rotation
of the glove.
• Movements are then interpreted by a driver or
software made specifically for the glove.
• The gestures can be converted into an input for AR
programs for controlling purpose.
• Flex sensors that will produce change in resistance
depending on the amount of the bend on the sensor.
Fig. Data gloves
ADVANTAGES
AND
DISADVANTAGES
ADVANTAGES

 It can potentially be used by anyone who needs it at any time.

 It should serve as a permanent record of an individual’s interaction with the health


care system.

 A well-implemented, high-functioning EMR should ultimately lead to better patient


care, improved efficiency.

 It allows doctors to view 3D model of the organs for better diagnose and treatment
for the patients.
DISADVANTAGES

 Lack of standards.

 Threats to confidentiality.

 Cost.

 AR may provide new ways for people to communicate, but they could also possibly
take away an important aspect of our social life that involves around human
interaction.
APPLICATIONS
SimX SIMULATION SOFTWARE

Fig. Anatomy of eye developed using scan data Fig. Meta 1 AR glasses

 SimX’s software replaces your physical simulation mannequins with a customizable,


high-definition, 3D virtual patient that can be projected anywhere.

 Expressing any number of other physical signs and symptoms.


ECHO PIXEL

 Most doctors view CT scans in 2D.

 With EchoPixel and 3D glasses, internal


organs pop off the screen like holograms.

 System allows doctors to peer into every


corner and crevice of your body.

Fig. Echo pixel with AR


CONCLUSION
AND
FUTURE SCOPE
 EMRs have brought about a host of benefits for clinical research.

 However, the privacy issues associated with the EMR need to be better understood
and individual patient confidentiality needs to be protected.

 As said by Wayne Dyer “If you change the way you look at things, the things you
look at change.”
REFERENCES
1) Lianfen Huang, Minghui Weng and Fenglian Gao, “Automatic Liver Segmentation from CT
Images Using Single-Block Linear Detection,” BioMed Research International, vol. 6, pp. 1-11,
July 2016.
2) Christoph Anthes, Rubén Jesús García,” State of the art of virtual reality technology”,
Aerospace Conference, IEEE 2016.
3) Yi-Ting Liao, Chih-Hung Yu & Cheng-Chih Wu, “Learning Geometry with Augmented Reality
to Enhance Spatial Ability”, International Conference on Learning and Teaching in Computing
and Engineering, IEEE 2015.
4) Health Information Technology Policy Committee. Meaningful use workgroup request for
comments regarding meaningful use stage. http://www.healthit.gov/policy-researchers-
implementers/ meaningful-use-stage-2. Accessed December 1, 2013.
THANK YOU FOR YOUR KIND
ATTENTION !

Das könnte Ihnen auch gefallen