Image Analysis and Computer Vision in Medicine

Sonu Iqbal

S7 CSE B
Guide: Mr. Anil Jacob
MESCE

November 13, 2010

Outline
Background
Digital Imaging and Computer Vision
Why Computer Vision
Examples

2 of 28
Outline
Background
Digital Imaging and Computer Vision
Why Computer Vision
Examples
Medical Imaging
Pipeline
Preprocessing
Segmentation
Recognition

2 of 28
Outline
Background
Digital Imaging and Computer Vision
Why Computer Vision
Examples
Medical Imaging
Pipeline
Preprocessing
Segmentation
Recognition
Trends
Techniques
Tools

2 of 28
Outline
Background
Digital Imaging and Computer Vision
Why Computer Vision
Examples
Medical Imaging
Pipeline
Preprocessing
Segmentation
Recognition
Trends
Techniques
Tools
Summary

2 of 28
Outline
Background
Digital Imaging and Computer Vision
Why Computer Vision
Examples
Medical Imaging
Pipeline
Preprocessing
Segmentation
Recognition
Trends
Techniques
Tools
Summary
References
2 of 28
Digital Imaging and Computer Vision

All types of image processing techniques are collectively known as

digital imaging.

3 of 28
Digital Imaging and Computer Vision

All types of image processing techniques are collectively known as

digital imaging.

3 of 28
Digital Imaging and Computer Vision

All types of image processing techniques are collectively known as

digital imaging.

Computer Vision aims at designing computer systems mimicking the

human sense of sight.
3 of 28
Why Computer Vision?
Computer Vision is concerned with the theory behind artificial
systems that extract information from images.

4 of 28
Why Computer Vision?
Computer Vision is concerned with the theory behind artificial
systems that extract information from images.

 Computer Vision can

1. Organize information.

4 of 28
Why Computer Vision?
Computer Vision is concerned with the theory behind artificial
systems that extract information from images.

 Computer Vision can

1. Organize information.
2. Model objects or
environments.

4 of 28
Why Computer Vision?
Computer Vision is concerned with the theory behind artificial
systems that extract information from images.

 Computer Vision can

1. Organize information.
2. Model objects or
environments.
3. Estimate Pose.

4 of 28
Why Computer Vision?
Computer Vision is concerned with the theory behind artificial
systems that extract information from images.

 Computer Vision can

1. Organize information.
2. Model objects or
environments.
3. Estimate Pose.
4. Morphometry.

4 of 28
Why Computer Vision?
Computer Vision is concerned with the theory behind artificial
systems that extract information from images.

 Computer Vision can

1. Organize information.
2. Model objects or
environments.
3. Estimate Pose.
4. Morphometry.
5. Accurate interpretation
and prediction.

4 of 28
Examples

5 of 28
Medical Imaging
Technique and process used to create images of the human body to
reveal and diagnose diseases.

6 of 28
Pipeline
The image analysis and computer vision pipeline is composed of the
following steps:
1. Image Acquisition.
2. Preprocessing.
3. Segmentation.
4. Reconstruction of data.
5. Matching.
6. Recognition.

7 of 28
Preprocessing

Preprocessing aims at enhancing the image for visualization from:

 High-frequency acquisition noise

 Background luminance variations
 Camera geometrical distorsions.
8 of 28
Preprocessing
1. Photogrammetric methods
Known spatial or luminance characteristics.
Real time in the display memory for visualization purpose.

9 of 28
Preprocessing
1. Photogrammetric methods
Known spatial or luminance characteristics.
Real time in the display memory for visualization purpose.
2. Filtering methods
Known spectral characteristics.
Low-pass filters are used for decreasing noise,
Band-pass filters to eliminate periodical perturbations,
High-pass filters to enhance and sharpen edges

9 of 28
Preprocessing
1. Photogrammetric methods
Known spatial or luminance characteristics.
Real time in the display memory for visualization purpose.
2. Filtering methods
Known spectral characteristics.
Low-pass filters are used for decreasing noise,
Band-pass filters to eliminate periodical perturbations,
High-pass filters to enhance and sharpen edges
3. Geometric corrections
Required when images are geometrically distorted.

9 of 28
Segmentation

Segmentation involves extracting primitive elements that will then be

approximated by some models.

 Isolating regions.
 Contours.
10 of 28
Segmentation
1. Thresholding methods.
Simplest method of image segmentation.
Used to create binary images from grayscale.

11 of 28
Segmentation
1. Thresholding methods.
Simplest method of image segmentation.
Used to create binary images from grayscale.
2. Edge extraction.
Delineation of regions by locating their contours.
Extracted using first derivative operators, Laplacian Masks, etc.

11 of 28
Segmentation
1. Thresholding methods.
Simplest method of image segmentation.
Used to create binary images from grayscale.
2. Edge extraction.
Delineation of regions by locating their contours.
Extracted using first derivative operators, Laplacian Masks, etc.
3. Region extraction.
Yields parts of the image that satisfy a given uniformity criterion.

11 of 28
Segmentation

12 of 28
Recognition
Identification of elements present in the scene.

13 of 28
Recognition
Involves two phases:
1. Learning
Typical characteristics of the objects to be recognized
are determined.
Supervised, the user identifies which are the relevant.
2. Exploitation
Unknown objects are passed through the same pipeline
The object characteristics are measured.

14 of 28
Recognition

15 of 28
Recognition
The most classical recognition paradigm is statistical. Techniques
includes:

 Neural networks
 Advocated as excellent
classifiers.
 Ability to define
non-linear decision
surfaces.
 Back-propagation
learning mechanism.
 Need for large training
sets.

16 of 28
Recognition
 Structural and symbolic approaches
 Describe the objects by means of symbolic structures.
 Compare the observed structure to a model.
 Graph matching, or using grammars.

Problem: How to extract symbolic information from numeric data?

17 of 28
Trends

18 of 28
Techniques
Several medical imaging techniques are employed today.
 Medical Ultrasonography.
 Radiology.
 Thermography.
 And more.

19 of 28
Medical Ultrasonography

20 of 28
Radiology

21 of 28
Radiology
Brain CT Scan, MRI of Knee

22 of 28
Thermography

23 of 28
Thermography

Multiple sclerosis detection. A Dog

24 of 28
Tomography
Is the basic technique of imaging deployed in above methods. It is the
method of imaging a single plane, or slice.

25 of 28
Open Source Tools
 ImageJ
Java-based image processing program developed at the National
Institutes of Health
 3DSlicer
Used in a variety of medical applications, including autism,
multiple sclerosis etc.
 MicroDicom
Free DICOM viewer for Windows.
 OsiriX
Image processing application dedicated to DICOM images.

26 of 28
Summary
Is there any motivation for incorporating computer vision algorithms
for physicians?
 In order to help the physician interpret, predict and plan.
 They provide tools and methods for extracting the necessary pieces
of knowledge.
 Recent progress in computer vision has improved new models in
medical imaging.
 Fast. Easy. Efficient.

27 of 28
References
 Image Analysis and Computer Vision in Medicine, Thierry Pun,
Guido Gerig and Osman Ratib.
 IEEE Transactions on Medical Imaging. Journal. 2008.
 Tomographic Reconstruction in the 21st Century, Clackdoyle, R.;
Defrise, M.; IEEE.
 Medical Imaging on Wikipedia.

28 of 28