Computational Modeling

of Visual Attention
Attention is the cognitive process
of selectively concentrating on
one aspect of the environment
while ignoring other things.

Presented By :
Rahul Agrawal(1265EC65R11)
Soumyajit Gupta(12EC65R14)
Under Guidance of :
Dr. Jayanta Mukhopadhyay
Dr. Ritwik Kumar Layek

What is Attention ?
Attention is the set of mechanisms that
optimize/control the search processes inherent
in vision.
1. Select
1. Spatial region of interest.
2. Temporal window of interest
3. World/Task/Object/Event model.
4. Gaze/Viewpoint
2. Restrict
1. Task relevant search space pruning.
2. Location cues.
3. Fixation points.
4. Search depth control.
3. Suppress
1. Spatial/Feature surround inhibition.
2. Inhibition of return.
Computational Modelling of Visual
Attention

Factors governing
Attention
Bottom-Up

Cues.Top-Down Cues.

Whichisbar catches
Where
your attention first ?
Launchpad
Mcquack ?

Fig. 2

Fig. 1
Computational Modelling of Visual
Attention

Retinal Structure
120 million rods (intensity)
7 million cones (color)
Fovea: 2 degrees of visual field

Fig. 3

Computational Modelling of Visual

Attention

Psychophysical Models of
Attention
Wolfes
Guided
search
model.
Treismans
Feature
integration

theory.

Fig. 5

Fig.Computational
4
Modelling of Visual
Attention

General flow of computational

models
Extraction

of feature maps.
Activation map of features.
Normalization of activation maps.

1.
2.
3.
4.
5.
6.
7.
8.

Intensity
Color
Orientation
Foveation
Motion
Shape/Size
Location
Foreground/Background

Fig. 6

Computational Modelling of Visual

Attention

Image pyramids
3
83/8
1
1 1/4
1/16 4
16

1/4

1
1/16
16

Where, O is orientation map at scale n and orientation alpha.

Computational Models of
Attention
No
.

Model

Year

Ap
.

Resolution

1.

Koch & Ullman [ ]

1985

w/16 x
h/16

2.

NVT by itti et al. []

1998

w/16 x
h/16

3.

VOCUS by frintrop et al.[]

2005

w/4 x h/4

4.

Saliency Toolbox []

2006

w/16 x
h/16

5.

GBVS by harel et al. []

2006

wxh

6.

Spectral Residual []

2007

64x64

7.

Judd et al.

2009

Wxh

8.

Achanta

9.

Sir

10. Context aware

Computational Modelling of Visual

Attention

Koch & Ullman

Computational Modelling of Visual

Attention

NVT by itti et al./Saliency Toolbox

Computational Modelling of Visual

Attention

10

Spectral Residual

Computational Modelling of Visual

Attention

11

Achanta

Computational Modelling of Visual

Attention

12

DIVOG

Computational Modelling of Visual

Attention

13

VOCUS : Bottom-Up part

(Visual Object detection with Computational attention System)
Three different feature dimensions
are computed independently.
Compute image pyramids of
corresponding features.
Scale maps I,O,C are computed
using center surround mechanism.
Scale maps are then fused to get
different feature maps(I,O,C).

Computational Modelling of Visual

Attention

14

Computational Modelling of Visual

Attention

15