Sie sind auf Seite 1von 19

chapter

15
Image Quality in
Nuclear Medicine
Image quality refers to the faithfulness with usually involves a tradeoff of decreased colli-
which an image represents the imaged object. mator efficiency (see Chapter 14, Section C)
The quality of nuclear medicine images is and, hence, decreased counting rates and
limited by several factors. Some of these increased image statistical noise.
factors, relating to performance limitations of The second method for characterizing or
the gamma camera, already have been dis- evaluating image quality is by means of
cussed in Chapter 14. In this chapter, we human observer performance studies using
discuss the essential elements of image images obtained with different imaging
quality in nuclear medicine and how it is systems or under different imaging condi-
measured and characterized. Because of its tions. Although observer performance can be
predominant role in nuclear medicine, the characterized objectively, and certainly is
discussion focuses on planar imaging with the related to the physical measures of image
gamma camera; however, the general con- quality described earlier, the relationships
cepts are applicable as well to the tomographic are not well established because of the com-
imaging techniques that are discussed in plexity of the human visual system and other
Chapters 17 to 19. complicating factors, such as observer experi-
ence. Hence, the two methods, though related,
are somewhat independent.
A related approach, known as computer
A. BASIC METHODS FOR observer performance studies, uses a mathe-
CHARACTERIZING AND EVALUATING matical model that under appropriate condi-
IMAGE QUALITY tions predicts the performance of a human
observer and can be used as a surrogate for
There are two basic methods for characteriz- actual human observer studies. Because
ing or evaluating image quality. The first is human observer studies require large numbers
by means of physical characteristics that can of images and therefore are very time consum-
be quantitatively measured or calculated for ing, computer observers often are more practi-
the image or imaging system. Three such cal. Details regarding computer observer
characteristics that are used for nuclear med- models are beyond the scope of this text and
icine image quality are (1) spatial resolution the interested reader is referred to reference
(detail or sharpness), (2) contrast (difference 1 for further information.
in image density or intensity between areas
of the imaged object containing different con-
centrations of radioactivity), and (3) noise B. SPATIAL RESOLUTION
(statistical noise caused by random fluctua-
tions in radioactive decay, or structured noise,
e.g., resulting from instrument artifacts). 1. Factors Affecting Spatial Resolution
Although they describe three different aspects Spatial resolution refers to the sharpness or
of image quality, these three factors cannot be detail of the image, or to the ability of the
treated as completely independent parame- imaging instrument to provide such sharp-
ters because improvements in one of them ness or detail. The sample images presented
frequently are obtained at the expense or in Chapters 13 and 14 already have demon-
deterioration of one or more of the others. strated that nuclear medicine images have
For example, improved collimator resolution somewhat limited spatial resolution, at least
233
234 Physics in Nuclear Medicine

in comparison with photographic or radio- lengthy imaging times required in nuclear


graphic images. A number of factors contrib- medicine and the relatively great excursions
ute to the lack of sharpness in these images. in distance (2-3cm) that are possible in these
Collimator resolution is perhaps the prin- instances. Gated-imaging techniques (see
cipal limiting factor when absorptive collima- Chapter 20, Section A.4) have been employed
tors are used for spatial localization (Chapter to minimize motion blurring, especially in
14, Section C). Because collimator hole diam- cardiac studies. Breath-holding also has been
eters must be relatively large (to obtain rea- used to minimize blurring caused by respira-
sonable collimator efficiency), there is blurring tory motion.
of the image by an amount at least as great Nuclear medicine imaging systems acquire
as the hole diameters (Equation 14-6). Colli- data on a discrete matrix of locations, or
mator resolution also depends on source-to- pixels, which leads to pixelation effects in the
detector distance (Figs. 14-16 through 14-22). image. As discussed in Chapter 20, the size of
Note that collimator resolution is not a the discrete pixels sets a limit on the spatial
factor in positron emission tomography (PET) resolution of the image. In general, it is desir-
imaging, which uses annihilation coincidence able to have at least two pixels per full width
detection for spatial localization (Chapter 18, at half maximum (FWHM) of system resolu-
Section A). tion to avoid creating distracting pixelation
A second factor is intrinsic resolution of the effects and possible loss of image detail.
imaging detector. With the gamma camera,
this limitation arises primarily because of
statistical variations in the distribution of 2. Methods for Evaluating Spatial
light photons among the photomultiplier Resolution
tubes (Chapter 14, Section A.1). Intrinsic Spatial resolution may be evaluated by sub-
resolution is a function of -ray energy with jective or objective means. A subjective evalu-
the gamma camera, becoming poorer with ation can be obtained by visual inspection of
decreasing -ray energy (Fig. 14-2). For images of organ phantoms that are meant
imaging devices with discrete detector ele- to simulate clinical images (e.g., the brain
ments, such as many PET systems (see phantom in Fig. 15-1). Although they attempt
Chapter 18, Section A.3), the size of the indi- to project what the physician wants to see,
vidual detector elements largely determines organ phantoms are not useful for quantita-
the intrinsic resolution of the device. tive comparisons of resolution between differ-
Image sharpness also can be affected by ent imaging systems or techniques. Also,
patient motion. Figure 15-1 shows images of because of the subjective nature of the evalu-
a brain phantom obtained with and without ation, different observers might give differ-
motion. Respiratory and cardiac motion can ent interpretations of comparative image
be especially troublesome because of the quality.

Stationary With motion


FIGURE 15-1 Images of a brain phantom obtained with phantom stationary (left) and with random translations
(several mm) and rotations (several degrees) (right) during the imaging procedure, demonstrating motion-blurring
effects. (Adapted from Fulton R etal: Accuracy of motion correction methods for PET brain imaging. 2004 IEEE Nuclear
Science Symposium Conference Record, 4226-4230.)
15 Image Quality in Nuclear Medicine 235

A phantom that can be used for more objec- A still more quantitative approach to eval-
tive testing of spatial resolution is shown in uating spatial resolution is by means of the
Figure 15-2. Bar phantoms are constructed of point-spread function (PSF) or line-spread
lead or tungsten strips, generally encased in function (LSF). General methods for record-
a plastic holder. Strips having widths equal ing these functions were described in Chapter
to the spaces between them are used. For 14, Section E.2. Examples of LSFs are shown
example, a 5-mm bar pattern consists of in Figure 17-8 for a single-photon emission
5-mm-wide strips separated edge to edge by computed tomography (SPECT) camera and
5-mm spaces. The four-quadrant bar phantom in Figure 18-5 for a PET system. Although the
shown in Figure 15-2 has four different strip complete profile is needed to fully character-
widths and spacings. To evaluate the intrinsic ize spatial resolution, a partial specification
resolution of a gamma camera, the bar is provided by its FWHM (Fig. 14-15). The
phantom is placed directly on the uncollimated FWHM is not a complete specification because
detector and irradiated with a uniform radia- PSFs or LSFs of different shapes can have the
tion field, typically a point source of radio same FWHM. (Compare, for example, the dif-
activity at several meters distance from the ferent shapes in Figs. 18-5 and 18-7). However,
detector. To evaluate the resolution with a col- the FWHM is useful for general comparisons
limator, the phantom is placed directly on the of imaging devices and techniques. Roughly
collimated detector and irradiated with a point speaking, the FWHM of the PSF or LSF of an
source at several meters distance, or with a imaging instrument is approximately 1.4-2
sheet source of radioactivity placed directly times the width of the smallest resolvable
behind the bar phantom. Spatial resolution is bar pattern (Fig. 15-3). Thus an instrument
expressed in terms of the smallest bar pattern having an FWHM of 1cm should be able to
visible on the image. There is a certain amount resolve 5- to 7-mm bar patterns.
of subjectivity to the evaluation, but not so In most cases, multiple factors contribute
much as with organ phantoms. to spatial resolution and image blurring. The
To properly evaluate spatial resolution method for combining FWHMs for intrinsic
with bar phantoms, one must ensure that the and collimator resolutions to obtain the
thickness of lead strips is sufficient so that overall system FWHM is discussed in Chapter
they are virtually opaque to the rays being 14 , Section C.4 and in Appendix G. In general,
imaged. Otherwise, poor visualization may if a system has n factors or components that
be due to poor contrast of the test image each contribute independently to blurring,
rather than poor spatial resolution of the individually characterized by FWHM1,
imaging device. For 99mTc (140keV) and FWHM2, . . ., FWHMn, the FWHM for the
similar low-energy -ray emitters, tenth-value system is given by
thicknesses in lead are approximately 1mm
or less, whereas for 131I (364keV), annihila- FWHMsys
tion photons (511keV), and so on, they are on FWHM12 + FWHM22 + + FWHM2n
the order of 1cm (see Table 6-4). Most com-
(15-1)
mercially available bar phantoms are designed
for 99mTc and are not suitable for use with This equation provides an exact result when
higher-energy -ray emitters. all of the components have gaussian-shaped

FIGURE 15-2 Design (left) and gamma camera image (right) of a four-quadrant bar phantom used for evaluation of
spatial resolution.
236 Physics in Nuclear Medicine

Radiation intensity
at detector

Total counting
rate
Radiation intensity
or counting rate

Individual bar
pattern counting
rates

Distance
FIGURE 15-3 Counting-rate profiles obtained on a bar pattern phantom with an imaging system having FWHM reso-
lution approximately 1.6 times the width of individual bars and spaces.

blurring functions, but it is an approximation varies with distance (cycles per centimeter or
when nongaussian shapes are involved. Note cycles per millimeter). This is called the
that if the FWHM for any one factor is signifi- spatial frequency of the test pattern, custom-
cantly larger than the others, it becomes the arily symbolized by k.* The modulation of the
dominating factor for system FWHM. Thus, test pattern, which is a measure of its con-
for example, if FWHM1 >> FWHM2, it makes trast, is defined by
little sense to expend substantial effort toward
improving FWHM2. Min = ( Imax Imin ) / ( Imax + Imin ) (15-2)
The most detailed specification of spatial
resolution is provided by the modulation where Imax and Imin are the maximum and
transfer function (MTF). The MTF is the minimum radiation intensities emitted by the
imaging analog of the frequency response test pattern. Min is the input modulation for
curve used for evaluating audio equipment. the test pattern and ranges from zero (Imax =
In audio equipment evaluations, pure tones of Imin, no contrast) to unity (Imin = 0, maximum
various frequencies are fed to the input of contrast). Similarly, output modulation Mout is
the amplifier or other component to be tested, defined in terms of the modulation of output
and the relative amplitude of the output image (e.g., image density or counting rate
signal is recorded. A graph of relative output recorded from the test pattern).
amplitude versus frequency is the frequency
response curve for that component (Fig. 15-4). Mout = (Omax Omin ) / (Omax + Omin ) (15-3)
A system with a flat curve from lowest to
highest frequencies provides the most faithful
sound reproduction.
By analogy, one could evaluate the fidelity *Technically speaking, the notation k is used in physics
of an imaging system by replacing the audio to denote cycles per radian, and the notation k or k-
bar is used to denote cycles per distance. Mathemati-
tone with a sine-wave distribution of activ- = k/2, because there are 2 radians per cycle.
cally, k
ity (Fig. 15-5). Instead of varying in time For notational simplicity, we use k for cycles per distance
(cycles per second), the activity distribution in this text.

Input signals Output signals Audio frequency


response curve
Frequency
Medium

Low
Relative output

Audio
Medium
Low

High

component

High
Frequency
FIGURE 15-4 Basic principles for generating frequency response curves for an audio system.
15 Image Quality in Nuclear Medicine 237

Input Output

Radiation intensity, I
Imax

Counting rate or
image density
Imaging Omax
system

Omin
Imin
1/ k

Distance Distance

ImaxImin OmaxOmin
M in  M out 
ImaxImin OmaxOmin

FIGURE 15-5 Basic principles for determining the modulation transfer function of an imaging instrument. Input
contrast is measured in terms of object radioactivity or emission rate. Output contrast is measured in terms of count-
ing rate, image intensity, etc. Spatial frequency is k.

The ratio of output to input modulation is the but sometimes also for larger objects because
MTF for the spatial frequency k of the test of the importance of edges and sharp borders
pattern, for detection of low-contrast objects and for
accurate assessment of their size and shape.
MTF(k) = Mout (k) /Min (k) (15-4) Figure 15-6 illustrates some typical MTF
curves for a gamma camera collimator. The
The usefulness of the MTF (or frequency MTF curves have values near unity for low
response curve) derives from the fact that any frequencies but decrease rapidly to zero
image (or audio signal) can be described as a at higher frequencies. Thus the images of a
summation of sine waves of different frequen- radionuclide distribution obtained with this
cies. For audio signals, the sound pitch is collimator show the coarser details of the dis-
determined by its basic sine-wave frequency, tribution faithfully but not the fine details.
whereas superimposed higher frequencies Edge sharpness, which is a function of the
create the unique sound characteristics of the high-frequency MTF values, also is degraded.
instrument or human voice producing it. An This type of performance is characteristic of
audio system with a flat frequency response virtually all nuclear medicine imaging systems.
curve over a wide frequency range generates Note also that the MTF curve at higher fre-
an output that matches faithfully the sound quencies decreases more rapidly with increas-
of the instrument or voice producing it. Inex- ing source-to-collimator distance.
pensive audio systems generally reproduce The MTF curve characterizes completely
the midrange audio frequencies accurately and in a quantitative way the spatial resolu-
but have poor response at low and high fre- tion of an imaging system for both coarse and
quencies. Thus they have poor bass response fine details. Images of bar patterns and similar
(low frequencies) and poor sound quality test objects are quantitative only for specify-
(high frequencies). ing the limiting resolution of the imaging
An imaging system with a flat MTF curve system, for example, the minimum resolvable
having a value near unity produces an image bar pattern spacing. Bar-pattern images and
that is a faithful reproduction of the imaged MTF curves can be related semiquantitatively
object. Good low-frequency response is needed by noting that the spatial frequency of a bar
to outline the coarse details of the image and pattern having bar widths and spaces of x cm
is important for the presentation and detec- is one cycle per 2x cm. Thus a 5-mm bar
tion of relatively large but low-contrast pattern has a basic spatial frequency of one
lesions. Good high-frequency response is nec- cycle per centimeter (one bar and one space
essary to portray fine details and sharp edges. per centimeter). Roughly speaking, bar pat-
This is of obvious importance for small objects terns are no longer visible when the MTF for
238 Physics in Nuclear Medicine

1.0
Source-to-collimator
distance
0.8

2.5 cm
0.6
MTF

5 cm
0.4

0.2
10 cm

0
0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6
Spatial frequency (cm1)
FIGURE 15-6 Modulation transfer function curves for a typical parallel-hole collimator for different source-to-colli-
mator distances. (Data from Ehrhardt JC, Oberly LW, Cuevas JM: Imaging Ability of Collimators in Nuclear Medicine.
Publication No. [FDA] 79-8077. Rockville, MD, U.S. Department of Health, Education, and Welfare, 1978.)

their basic spatial frequency drops below a tomographic instruments in all three spatial
value of approximately 0.1. MTF curves thus directions. Note that in all cases the diameter
can be used to estimate the minimum resolv- or width of the source should be much smaller
able bar pattern for an imaging system. than resolution capability of the imaging
In practice, MTFs are not determined using device (d FWHM/4). Additional discussions
sinusoidal activity distributions, as illus- about the measurement of MTFs and their
trated in Figure 15-5, which would be difficult properties can be found in references 2 and 3.
to construct. Instead, they are obtained by Another useful feature of MTFs is that
mathematical analysis of the LSF or PSF. they can be determined for different compo-
Specifically, the MTF of an imaging system nents of an imaging system and then com-
can be derived from the Fourier transform bined to determine the system MTF. This
(FT) of the LSF or PSF.* The one-dimensional feature allows one to predict the effects of the
(1-D) FT of the LSF is the MTF of the system individual components of the system on the
measured in the direction of the profile, that MTF of the total system. For example, one
is, perpendicular to the line source. Similarly, can obtain the MTF for the intrinsic resolu-
the 1-D FT of a profile recorded through the tion of the Anger camera detector, MTFint(k),
center of the PSF gives the MTF of the system and another for the collimator, MTFcoll(k). The
in the direction of the profile. Alternatively, a system MTF then is obtained by point-by-
2-D FT of the 2-D PSF provides a 2-D MTF point multiplication of the intrinsic and col-
that can be used to determine the frequency limator MTFs at each value of k:
response of the system at any angle relative
to the imaging detector. This sometimes is MTFsys (k) = MTFint (k) MTFcoll (k) (15-5)
useful for imaging systems that have asym-
metrical spatial resolution characteristics, In general, the MTF of a system is the product
such as detector arrays with rectangular ele- of the MTFs of its components.
ments. Some PET detector arrays have this If two systems have MTF curves of the
property (see Chapter 18, Section B). same general shape, one can predict confi-
It also is possible to obtain a 3-D represen- dently that the system with the higher MTF
tation of the MTF from a complete 3-D data values will have superior spatial resolution;
set for the PSF. This is potentially useful for however, the situation is more complicated
characterizing the spatial resolution of when comparing two systems having MTF
curves of different shapes. For example,
Figure 15-7 shows MTF curves for two colli-
*More specifically, the MTF is the modulus, or amplitude,
mators, one of which would be better for visu-
of the FT, the latter generally being a complex number. alizing large low-contrast structures (low
See Appendix F for a more detailed discussion of FTs. frequencies), the other for fine details (high
15 Image Quality in Nuclear Medicine 239

1.0

0.8

MTF 0.6

0.4

0.2

0
0.2 0.4 0.6 0.8 1.0
Spatial frequency (cm1)
FIGURE 15-7 Modulation transfer function (MTF) curves for two different collimators. One has better low-frequency
resolution for coarse details (blue line), whereas the other is better for fine details (orange line). (Data from Ehrhardt
JC, Oberly LW, Cuevas JM: Imaging ability of collimators in nuclear medicine. Rockville, MD, U.S. Department of
Health, Education, and Welfare, Publ. No. [FDA] 79-8077, 1978, p 20.)

frequencies). To gain an impression of com- interest, such as a lesion, relative to the signal
parative image quality in this situation, one level in surrounding parts of the image. Thus
would probably have to evaluate organ phan- if Ro is the counting rate over normal tissue
toms or actual patient images obtained with and R is the counting rate over a lesion, the
these collimators. contrast of the lesion is defined as
R Ro
C = 
C. CONTRAST Ro
(15-6)
R
Image contrast refers to differences in inten- =
Ro
sity in parts of the image corresponding to
different levels of radioactive uptake in the where R is the change in counting rate over
patient. In nuclear medicine, a major compo- the lesion relative to the surrounding back-
nent of image contrast is determined by the ground.* Contrast sometimes is expressed as
properties of the radiopharmaceutical. In a percentage, for example, C = 0.1 = 10%
general, it is desirable to use an agent having contrast.
the highest lesion-to-background uptake or Perhaps the major factor affecting contrast
concentration ratio. Some aspects of radio- is added background counting rates that are
pharmaceutical design that affect this issue superimposed more or less uniformly over the
were discussed in Chapter 5, Section F. Phys- activity distribution of interest. For example,
ical factors involved in image formation also suppose that in the absence of background
can affect contrast. In general, factors that counts a certain object (e.g., a lesion) has
affect contrast in nuclear medicine also affect
the statistical noise levels in the image. More
specifically, they affect the contrast-to-noise *This equation is related to, but not the same as, the
ratio (CNR), which is discussed in detail in equations for modulation given in Equations 15-2 and
the next section. Here we focus only on some 15-3. The definition used here has the disadvantage that
it does not apply when Ro = 0. However, this situation
factors that affect contrast. rarely, if ever, applies in nuclear medicine, and the defini-
A general definition of contrast is that it is tion in Equation 15-6 is more straightforward for the
the ratio of signal change of an object of analysis of contrast and CNR.
240 Physics in Nuclear Medicine

1
C = 0.2
R   Rb 1 + ( R b / R )
o
Counting rate

1
R = 0 .2
1 + 1
Ro  Rb
1
Rb = 0.2 = 0.1 (10%)
Ro 2

A Distance B Distance Thus contrast is reduced by 50% by the added


FIGURE 15-8 Effect on image contrast of adding a back- background.
ground counting rate Rb.
Example 15-1 illustrates that added back-
ground can reduce image contrast substan-
tially. It should be noted again that background
intrinsic contrast as defined by Equation counting rates also add to the noise levels in
15-6. Suppose then that a uniform back- the image, just as they add to the noise levels
ground counting rate Rb is superimposed on in counting measurements (see Chapter 9,
the image (Fig. 15-8). Then the lesion contrast Section D.4). This is discussed in more detail
becomes in Section D.
Background counting rates can arise from
( R + Rb ) ( Ro + Rb )
C = a number of sources. Septal penetration and
Ro + Rb scattered radiation are two examples. Another
R would be inadequately shielded radiation
= sources elsewhere in the imaging environ-
Ro + Rb
ment. Septal penetration is avoided by using
R 1 (15-7) a collimator that is appropriately designed for
=
Ro 1 + ( Rb / Ro ) the radionuclide of interest (Chapter 14,
1 Section C.2). Scattered radiation can be mini-

= C mized by pulse-height analysis; however,
1 + ( R /bR ) o sodium iodide [NaI(Tl)] systems cannot reject
all scatter, and rejection becomes especially
Comparing the last line of Equation 15-7 with difficult for -ray energies below approxi-
Equation 15-6, it can be seen that contrast is mately 200keV, as illustrated by Figure
decreased by the additional factor Rb/Ro in 10-10. Using a narrower analyzer window for
the denominator. scatter rejection also decreases the recorded
counting rate and increases the statistical
EXAMPLE 15-1 noise in the image. A reasonable tradeoff
Suppose that under ideal conditions, a certain between counting efficiency and scatter rejec-
radiopharmaceutical produces lesion and tion for imaging systems using NaI(Tl) detec-
normal tissue counting rates given by Ro and tors is obtained with a 15% energy window
R = 1.2Ro, respectively. Suppose further that centered on the -ray photopeak. There has
a background counting rate Rb = Ro then is been continuing interest in applying semicon-
added to the image. Calculate the image con- ductor detectors to nuclear medicine imaging
trast with and without the added background to take advantage of their superior energy
counting rate. resolution for discrimination against scat-
tered radiation by pulse-height analysis (see
Answer Figs. 10-14 and 10-15).
Using Equation 15-6 for the intrinsic contrast Figure 15-9 shows the effect of scattered
without the added background radiation on images of a phantom. With a
very wide analyzer window, there is virtually
(1.2 Ro Ro )
C = no rejection of scattered radiation and a
Ro noticeable loss of image contrast. The loss of
= 0.2 (20%) contrast can result in degraded visibility of
both large low-contrast objects and fine details
When background amounting to Rb = Ro is in the image. Figure 15-10, for example, illus-
added, according to Equation 15-7 trates the effects of scattered radiation (or
15 Image Quality in Nuclear Medicine 241

True activity Unscattered 20% energy 50% energy


distribution photons only window window

250

200

150

100

50

0
10 20 30 40
Voxel Number
True activity distribution 20% energy window
Unscattered photons only 50% energy window
FIGURE 15-9 Effect of scatter and pulse-height analysis on image contrast. The images were generated by Monte
Carlo simulations mimicking a clinical study of myocardial function using the radiotracer 201TlCl. Count profiles
through the images also are shown. These profiles are taken along the line shown in the image of the true activity
distribution. The images also demonstrate blurring of the activity distribution caused by the finite camera resolution.
(Courtesy Dr. Hendrik Pretorius and Dr. Michael King, University of Massachusetts Medical School, Worcester, MA).

septal penetration, which has similar effects) that may already be near the borderline of
on the LSF and MTF of an imaging system. detectability. These effects are apparent in
The addition of long tails to the LSF results Figure 15-9, which demonstrates a percepti-
first in the suppression of the MTF curve at ble loss of image sharpness as well as overall
low frequencies. This is reflected in poorer image contrast when the added background
contrast of large objects that would make is present.
large low-contrast objects more difficult to An important contributor to background
detect or characterize. The high-frequency radiation in conventional planar imaging is
portion of the MTF curve also is suppressed, radioactivity above and below the object of
which has the effect of shifting the limiting interest. Image contrast is improved in emis-
frequency for detection of high-contrast sion computed tomography (SPECT and PET)
objects (e.g., bar patterns) to lower frequen- (see Chapters 17 and 18) because it permits
cies. Thus the contrast-degrading effects of imaging of an isolated slice without the super-
added background decrease the visibility of imposed activities in overlying and underly-
all structures in the image, particularly those ing structures. Tomographic techniques offer
242 Physics in Nuclear Medicine

With
Relative counts scatter

Without
scatter
Scatter only

A
6 4 2 0 2 4 6
Distance (cm)

1.0

0.9

0.8

0.7
Without
scatter
0.6

With
MTF

0.5 scatter

0.4

0.3

0.2

0.1

B
0 0.2 0.4 0.6 0.8
Spatial frequency
FIGURE 15-10 Illustration of effects of scatter and septal penetration on line-spread function (LSF) (A) and modula-
tion transfer function (MTF) (B) of an imaging system. The long tails on the LSF have the effect of suppressing the
MTF curve at both low and high spatial frequencies.

significant improvements for the detection of The preceding discussion relates to the
low-contrast lesions. Figure 15-11 illustrates effects of various types of background radia-
this effect. Details of emission computed tomo- tion on input contrast to the imaging system.
graphic imaging are presented in Chapters 16 It is possible with computers to apply back-
to 18; however, even at this point, the benefits ground subtraction or contrast enhance-
of removing the interfering effects of overlying ment algorithms and thereby restore the
and underlying activity should be evident. original contrast, at least in terms of the
15 Image Quality in Nuclear Medicine 243

Planar image

SPECT images

FIGURE 15-11 Planar (upper left) and single-photon emission computed tomographic (SPECT) (center) images of a
thoracic phantom. Note the improved contrast and visibility of the voids in the cardiac portion of the phantom when
overlying and underlying activity are removed in the SPECT images. (Courtesy Dr. Freek Beekman, Delft University
of Technology, Netherlands.)

relative brightness levels between a lesion Structured noise also can arise from
and its surrounding area. However, these imaging system artifacts. Nonuniformities in
techniques also enhance the statistical noise gamma camera images (see Fig. 14-10) are
levels in the image as well as the contrast of one example. Various ring or streak arti-
any underlying artifacts, such as gamma facts generated during reconstruction tomog-
camera image nonuniformities. Thus the crit- raphy are another (e.g., see Figs. 16-11 and
ical parameter to consider regarding com- 16-13).
puter enhancement techniques is their effect
on CNR. This concept is discussed in the fol- 2. Random Noise and
lowing section. Contrast-to-Noise Ratio
Random noise, also called statistical noise or
quantum mottle, is present everywhere in a
D. NOISE
nuclear medicine image. Even when the size
of an object is substantially larger than the
1. Types of Image Noise limiting spatial resolution of the image, sta-
Image noise generally can be characterized as tistical noise can impair detectability, espe-
either random or structured. Random noise cially if the object has low contrast. The
refers to the mottled appearance of nuclear critical parameter for detectability is the
medicine images caused by random statistical CNR of the object in the image. In the follow-
variations in counting rate (Chapter 9). This ing discussion, we present an analysis and
is a very important factor in nuclear medicine some illustrations of the effects of CNR on
imaging and is discussed in detail in this detectability of objects in 2-D planar nuclear
section. images.
Structured noise refers to nonrandom vari- Suppose that a 2-D image contains a circu-
ations in counting rate that are superimposed lar lesion of area A having contrast C (Equa-
on and interfere with perception of the object tion 15-6) against a uniform background
structures of interest. Some types of struc- counting rate, Ro (cps/cm2). The number of
tured noise arise from the radionuclide distri- counts recorded in a background area of the
bution itself. For example, in planar imaging, same size as the lesion during an imaging
uptake in the ribs may be superimposed over time, t, is
the image of the heart in studies to detect
myocardial infarction with 99mTc-labeled pyro- No = Ro A t
phosphates. Bowel uptake presents a type of
structured noise in studies to detect inflam- (15-8)
= Ro d2 t
mation or abscess with 67Ga. 4
244 Physics in Nuclear Medicine

where d is the diameter of the lesion. The Equation 15-12 applies to somewhat idealized
statistical variation of counts in background conditions of more or less circular objects
areas of size A is against a relatively uniform background of
nonstructured noise. Such conditions rarely
No = No apply in nuclear medicine. Nevertheless, this
equation can be used to gain some insights
d2 (15-9)
= Ro t into lesion detectability and the factors that
4 affect it.
EXAMPLE 15-2
Thus the fractional standard deviation of
counts due to random statistical variations is Estimate the minimum contrast for detec-
tion of circular objects of 1-cm and 2-cm
No diameter in an area of an image where the
Cnoise =
No background information density is IDo = 400
1 counts/cm2.
= (15-10)
d2 Answer
Ro  t
4 Rearranging Equation 15-12 and inserting
the specified information density,
As indicated by the notation in Equation
15-10, this factor can be considered as the 4 4 0 .2
C = =
noise contrast for a circular area of diameter d IDo 400 d d
d in background areas of the image. The ratio
of lesion-contrast to noise-contrast is defined Thus for a 1-cm diameter object, the minimum
as its CNR. contrast required for detectability is approxi-
C mately 0.2 (20%), whereas for a 2-cm diame-
CNR  = ter object it is approximately 0.1 (10%).
Cnoise
C d Ro t (15-11) Example 15-2 shows that, all other factors
being the same, the contrast required for
C d IDo detectability is inversely proportional to
object size.
where we have used the approximation
/4 1. The quantity IDo = (Ro t) is the EXAMPLE 15-3
background information density of the image Estimate the minimum diameter for detec-
and has units (counts/cm2). The absolute tion of an object that has 10% contrast, |C|
value of contrast, |C|, is used in Equation = 0.1, in an area of the image where the back-
15-11 to indicate that it applies to either posi- ground information density is 100 counts/cm2.
tive or negative contrast.
To detect a lesion or other object in an Answer
image, the observer must be able to distin- Rearranging Equation 15-12 and inserting
guish between the lesion or object and noise- the specified parameters,
generated contrast patterns in background
areas of the same size in the image. A sub- 4 4
d = = 4 cm
stantial amount of research has gone into this C IDo 0.1 400
subject. The conclusion is that, to be detect-
able, an objects CNR must exceed 3-5. This Examples 15-2 and 15-3 illustrate that the
factor is known as the Rose criterion, after the minimum size requirement for object detect-
individual who did basic studies on this ability decreases inversely with the square
subject.4 The actual value depends on object root of information density, from 2cm with
size and shape, edge sharpness, viewing dis- IDo = 400 counts/cm2 in Example 15-2 to 4cm
tance, observer experience, and so forth. with IDo = 100 counts/cm2 in Example 15-3.
Choosing a factor of 4, the requirement for At first glance, it would seem that adding
detectability becomes CNR 4, and Equation background radiation to an image would
15-11 can be written as improve lesion detectability, by increasing
C d Ro t 4 information density, IDo. However, as illus-
(15-12) trated by Example 15-1, background radiation
C d IDo 4 also degrades lesion contrast. The following
15 Image Quality in Nuclear Medicine 245

example illustrates the overall effect of back- an imaging time of 1min. Ignore the effects
ground radiation on object detectability. of attenuation and source-to-detector distance
for this comparison.
EXAMPLE 15-4
Example 15-3 indicates that a 4-cm diameter Answer
object with 10% contrast should be detectable In both cases, the uptake in normal tissues
against a background information density of would generate a background counting rate of
IDo = 100 counts/cm2. Suppose that back- Ro = 10cm 10cpm/cm2 per centimeter thick-
ground radiation with the same information ness = 100cpm/cm2. For the 1-cm diameter
density, (IDb = 100 counts/cm2) is added to the lesion, the count rate over the center of the
image. Estimate the minimum detectable lesion is
lesion size after this is done.
(9 cm 10 cpm/cm 2 per cm)
Answer + (1 cm 20 cpm/cm 2 per cm)

According to Example 15-1, the addition of
background radiation with IDb = IDo decreases = 110 cpm/cm 2
contrast by a factor of 2, from C = 0.1 to C = Thus the contrast of the 1-cm diameter lesion
0.05. At the same time, the background infor- is (110 100)/100 = 0.1 (10%). For a 1-min
mation density increases from 100 counts/cm2 imaging time, its CNR (Equation 15-11) is
to 200 counts/cm2. Rearranging Equation
15-12 and inserting these values, one obtains CNR1 cm = 0.1 1 100 1 = 1
4 4 For the 2-cm diameter lesion, the counting
d = 5.7 cm
C IDo 0.05 200 rate over the center of the lesion is

Example 15-4 illustrates that the minimum (8 cm 10 cpm/cm 2 per cm)


detectable object size becomes larger (from + (2 cm 20 cpm/cm 2 per cm)
4cm to 5.7cm in the example) when back-
= 120 cpm/cm 2
ground radiation is added. This example
illustrates that the effect of background on Thus the contrast of the 2-cm diameter lesion
degradation of object contrast more than is (120 100)/100 = 0.2 (20%). For a 1-min
offsets its effect toward increasing the infor- imaging time, its CNR is
mation density of the image.
These examples and analyses assume that CNR 2 cm = 0.2 2 100 1 = 4
object size (d) and contrast (C) are indepen-
dent variables. This may be true for computer- According to Equation 15-11, when the
generated test images; however, in planar diameter of a planar object is doubled, its CNR
nuclear medicine imaging these parameters increases by a factor of 2 as well. However,
often are intimately linked. In many cases, Example 15-5 shows that when the object is
lesions are somewhat spherical in shape so spherical, so that its thickness is doubled as
that their thickness varies linearly with their well, its CNR increases by another factor of 2,
diameter. Thus a larger lesion not only has a that is, the total change in CNR is a factor of
larger diameter but generates greater con- 4. This example illustrates the strong depen-
trast as well. The following example illus- dence of lesion detectability on lesion size
trates how these two factors operating when its contrast increases with its size. In
together affect lesion CNR and detectability. essence, CNR increases as the square of spher-
ical lesion diameter, not as the first power as
EXAMPLE 15-5 implied by Equation 15-11. Going in the oppo-
Suppose that a certain radionuclide concen- site direction, this factor becomes a significant
trates in normal tissue to a level that provides impediment for the detection of smaller and
a counting rate of 10 cpm/cm2 per cm of tissue smaller lesions in nuclear medicine.
thickness. Suppose further that it concen- Finally, Equations 15-11 and 15-12 and
trates in a certain type of lesion to a level that the discussion thus far assume that detect-
is twice this value, that is, 20cpm/cm2 per ability is the same for positive (hot spot) and
centimeter of lesion thickness. Compare the negative (cold spot) contrast. Indeed, if two
contrast, CNR and detectability of 1-cm diam- objects generate identical levels of contrast,
eter versus 2-cm diameter lesions embedded this is a valid assumption. Again, however,
in normal tissue of total thickness 10cm and additional factors come into play in nuclear
246 Physics in Nuclear Medicine

medicine imaging. Specifically, the intrinsic Thus the contrast of the cold lesion is (91
contrast of a lesion can depend on whether its 100)/100 = 0.09 (9%), in which the minus
contrast is generated by preferential uptake sign indicates negative contrast. For a 1-min
or by preferential suppression of uptake rela- imaging time, the CNR for radiopharmaceuti-
tive to surrounding normal tissues. The fol- cal B is
lowing example provides an illustration.
CNR B = 0.09 1 100 1 = 0.9
EXAMPLE 15-6
Suppose that two radiopharmaceuticals are which is well below the threshold of detect-
available for a study. Radiopharmaceutical A ability specified by the Rose criterion.
generates contrast by selective uptake in a
lesion that is 10 times higher than the uptake Example 15-6 illustrates the basis for the
in surrounding normal tissue, whereas radio- generally held (and generally accurate) belief
pharmaceutical B generates contrast by sup- that cold lesions are more difficult to detect
pression of uptake in the same lesion, to a than hot ones. One way to overcome this
level that is 1/10 (10%) of the uptake in sur- deficit is to inject more radioactivity for
rounding tissue. Thus the uptake ratio is cold lesions; however, the specified levels of
10:1 in both cases. Assume that a 1-cm thick uptake in normal tissue in this example leads
lesion is present in a total thickness of 10cm to comparable radiation doses in both cases
of tissue. Ignoring the effects of attenuation and thus the higher level of radioactivity
and source-to-detector distance, calculate the required for radiopharmaceutical B would
CNR generated by the two radiopharmaceu- presumably lead to greater radiation dose.
ticals. For both radiopharmaceuticals, assume Specific comparisons of radiopharmaceuticals
that the uptake in normal tissue generates a vary, depending on details of the uptake dis-
counting rate of 10cpm/cm2 per centimeter tribution and properties of the radionuclides
thickness of tissue and that imaging time is involved.
1min in both cases. These examples illustrate that contrast
and information density can be limiting factors
Answer for lesion detection, even when the size of the
For both radiopharmaceuticals, the uptake lesion easily exceeds the spatial resolution
in normal tissues generates a background limits of the imaging system. Figure 15-12
counting rate of Ro = 10cm 10cpm/cm2 per further illustrates this point for images of a
centimeter thickness = 100cpm/cm2. For heart phantom. Although spatial resolution
radiopharmaceutical A (hot lesion), the and contrast are the same for all the images
uptake of the lesion is 10 times greater and the shown in this figure, there are marked differ-
counting rate over the lesion is ences in lesion visibility because of differences
in information density and noise.
(9 cm 10 cpm/cm 2 per cm) Although not specifically included in the
+ (1 cm 100 cpm/cm 2 per cm) analysis of CNR presented earlier, spatial
resolution of the imaging system also affects
= 190 cpm/cm 2 the detectability of small, low-contrast objects.
As shown in Figure 15-13, high-resolution col-
Thus the contrast of the hot lesion is (190 limators (or imaging detectors) provide better
100)/100 = 0.9 (90%). For a 1-min imaging image contrast and improved visibility for
time, its CNR (Equation 15-11) is fine details, even for smaller numbers of
counts in the image. In essence, sharpening
CNR A = 0.9 1 100 1 = 9 the edges of lesions lowers the CNR required
for detectability (Rose criterion) specified in
This value easily exceeds the requirement for Equation 15-12.
detectability given by the Rose criterion. Nevertheless, the tradeoff between improved
collimator resolution and decreased collima-
For the cold lesion, the uptake by the lesion tor sensitivity (see Equations 14-7 and 14-8),
is 1/10 of the uptake in normal tissue. Thus as well as the requirement for greater infor-
the counting rate over the lesion is mation density, eventually establishes a
(9 cm 10 cpm/cm 2 per cm) point of diminishing returns in the effort to
detect smaller and smaller lesions by improve-
+ (1 cm 1 cpm/cm 2 per cm) ments in imaging resolution. In the end,
= 91 cpm/cm 2 detectability in nuclear medicine is limited by
15 Image Quality in Nuclear Medicine 247

True activity 1106 counts 4106 counts 16106 counts


distribution (~clinical level)
FIGURE 15-12 Example of effects of information density on visibility of a low-contrast lesion (arrow) in a computer-
simulated cardiac phantom. The simulation assumes a 99mTc radiotracer imaged on a gamma camera with a 15% energy
window. Note the region of reduced radiotracer uptake in the myocardium (arrow) that can be clearly visualized only
with the highest information density. (Courtesy Dr. Hendrik Pretorius and Dr. Michael King, University of Massachu-
setts Medical School, Worcester, MA).

impediments to improvements in nuclear


medicine information densities and are the
reason why photographic or radiographic
image quality are unlikely to ever be achieved
in nuclear medicine.
In general, the rules regarding image CNR
and object detectability are the same for
planar images and tomographic images;
however, the approaches for calculating CNR
are different. This is discussed further in
Chapter 16, Section C.3.

E. OBSERVER PERFORMANCE
STUDIES

The physical measures of image quality dis-


cussed in the preceding sections are helpful
for comparing different imaging systems, as
well as for preparing purchase specifications,
FIGURE 15-13 Demonstration of effects of improved establishing quality assurance parameters,
resolution on contrast and detectability of small objects. and so forth. They also can in some cases
Improved spatial resolution results in improved contrast provide useful estimates of minimum detect-
(lower right), providing improved visibility in spite of
fewer counts in comparison with the other images.
able object size and contrast, as in Examples
Decreased sensitivity of high-resolution collimators ulti- 15-2 through 15-6. In most cases, however,
mately sets practical limits for high-resolution imaging object detectability is determined more accu-
in nuclear medicine. (From Muehllehner G: Effect of reso- rately by direct evaluation, using human
lution improvement on required count density in ECT observers. The general name for such evalu-
imaging: A computer simulation. Phys Med Biol 30:163-
173, 1985.) ations is observer performance studies. They
test both the ability of an imaging device to
produce detectable objects as well as the
information density rather than image reso- ability of individual observers to detect them.
lution. Information densities in planar nuclear Two types of experiments commonly used for
medicine images are typically in the range this purpose in nuclear medicine imaging are
of 100 to 3000 counts/cm2. This is well below contrast-detail (C-D) and receiver operating
the levels encountered in radiography and characteristic (ROC) studies.
photography, in which information densities
(x-ray or visible light photons detected to 1. Contrast-Detail Studies
form the image) are on the order of 106 events A contrast-detail, or C-D study is performed
per mm2. Practical limitations on imaging using images of a phantom having a set of
time and the amount of activity that can be objects of different sizes and contrasts. Typi-
administered safely to patients are serious cally, the objects are graded in size along one
248 Physics in Nuclear Medicine

axis of the display and in contrast along the to bias and other sources of differences in the
other. An example is the Rollo phantom, observers detection thresholds in different
shown in Figure 15-14A. This phantom con- experiments. This is especially true for phan-
sists of solid spheres of four different diame- toms having a design similar to the one illus-
ters immersed in four different thicknesses of trated in Figure 15-14, because the observer
a radioactive solution of uniform concentra- has a priori knowledge of the locations of the
tion. Images of this phantom thus contain simulated lesions. Thus such a phantom does
cold lesions of different sizes and contrasts not test for the possibility of false-positive
(Fig. 15-14B). results, that is, the mistaken detection of
To perform a C-D study with this or a objects that actually are not present in the
similar phantom, images are obtained using image. This is particularly important for
the different imaging systems or techniques noisy images in which noise not only can
to be evaluated. An observer then is given the mask the presence of real objects but also can
images, usually without identification and in create apparent structures that masquerade
random order to avoid possible bias, and as real objects. Finally, C-D phantoms gener-
asked to indicate the smallest diameter of ally are lacking in clinical realism.
sphere that is visible at each level of contrast.
Borderline visibility may be indicated by 2. Receiver Operating Characteristic
selecting a diameter between two of the diam- Studies
eters actually present in the image. The Some of the deficiencies of the C-D method
results then are presented on a C-D diagram outlined earlier are overcome by the ROC
as illustrated by Figure 15-15. A C-D study method. For an ROC study, a set of images is
can be helpful for comparing detectability of obtained with the different imaging systems
both large low-contrast lesions as well as or techniques to be tested. Phantoms contain-
small high-contrast lesions. For example, in ing simulated lesions can be used, but it also
Figure 15-15, system A would be preferred for is possible to use actual clinical images. In the
the former and system B for the latter. simplest approach, each image contains either
Because of the subjective nature of C-D one or no lesions. The former are called posi-
studies, the use of multiple observers is rec- tive images and the latter are called negative
ommended. Also, because observers may images. The images are given to the observer,
change their detection threshold from one who is asked to indicate whether a lesion is
study to the next or as they gain familiarity present or absent in each image, as well as
with the images, it usually is helpful to repeat where it is and his or her confidence that
the readings for verification of results. it actually is present. Usually the confidence
C-D studies have a number of limitations. levels are numbered and four different levels
Because they are subjective, they are susceptible are permitted; for example, 1 = definitely present,

Lesion diameter
(inches)
1.0 0.75 0.50 0.375

0.66

0.44

0.33

0.22

A B
FIGURE 15-14 Example of a phantom, the Rollo phantom, which can be used to obtain images for a contrast-detail
study. A, Phantom. B, Example image. (From Rollo FD, Harris CC: Factors affecting image formation. In Rollo FD
[ed]: Nuclear Medicine Physics, Instrumentation, and Agents. St. Louis, 1977, CV Mosby, p 397.)
15 Image Quality in Nuclear Medicine 249

Minimum detectable object contrast

Minimum detectable object size


FIGURE 15-15 Hypothetical results of a contrast-detail study comparing two imaging systems, A and B. Reading
horizontally, one can estimate the minimum size of an object that can be detected for a specified level of object contrast.
Reading vertically, one can estimate the minimum contrast required for detection of an object of a specified size.
In this example, system A provides better detectability for large low-contrast objects, suggesting perhaps a better
lesion-to-noise contrast ratio, whereas system B is better for small high-contrast lesions, suggesting perhaps better
spatial resolution.

2 = probably present, 3 = probably not present, ROC curves are shown in Figure 15-16. The
and 4 = definitely not present. Then the fol- ROC curve should lie above the ascending
lowing results are calculated for each confi- 45-degree diagonal, which would represent
dence level: guessing. The farther the curve lies above
the 45-degree line, the better the performance
True-positive fraction (TPF) = fraction of of the imaging system and observer.
positive images correctly identified as posi- An ROC curve shows not only the true-
tive by the observer positive detection rate for an observer or an
imaging system or technique but also its rela-
False-positive fraction (FPF) = fraction of tionship to the false-positive detection rate.
negative images incorrectly identified as Thus it is relatively immune to the sources of
positive by the observer observer bias that can occur in C-D studies,
for example, a tendency to over-read to
Two other parameters that are calculated avoid missing a possible lesion or test object.
are the true-negative fraction (TNF) = (1 It also is applicable to other types of detection
FPF), and the false-negative fraction (FNF) = questions, such as the presence or absence of
(1 TPF). The TPF is sometimes called the disease, which might be indicated by a general
sensitivity and TNF the specificity of the test pattern of uptake within an organ, as opposed
or the observer. to the simple detection of individual lesions.
The ROC curve then is generated by plot- As with C-D studies, the interpretation of
ting TPF versus FPF for progressively relaxed ROC results sometimes can be challenging.
degrees of confidence, that is, highest confi- For example, the ROC curves for two different
dence = level 1 only, then confidence levels 1 imaging systems can cross, leading to some
+ 2, then confidence levels 1 + 2 + 3, and so ambiguity in the results. One approach to sim-
forth. An example of data and the resulting plifying the interpretation is to report the
250 Physics in Nuclear Medicine

1.0

0.8

True-positive fraction (TPF)


Fitted
0.6 curve

Data Guessing
0.4

Area under fitted


0.2
curve = Az

0.0
0.0 0.2 0.4 0.6 0.8 1.0
False-positive fraction (FPF)
FIGURE 15-16 Example of results from an ROC study. , data points; orange line, fitted curve; blue line, 45-degree
line, which is equivalent to guessing. Area under the curve (shaded in darker blue) is Az, which is one measure of
detection accuracy.

results of an ROC study as a single number. verification of truth when clinical images
Most commonly the parameter calculated is are used.
the area under the ROC curve, usually denoted Another potential problem is the possible
by Az. This number can range from zero (all presence of multiple lesions on a single image.
readings wrong) to 1 (all readings correct). A Conventional ROC methodology allows only
value of 0.5 indicates an overall accuracy of for a single yes-no interpretation of each
50%, which is equivalent to guessing. image. This allows straightforward calcula-
An extensive amount of theoretical and tions of false-positive rates. However, if mul-
experimental work has been done on the prop- tiple lesions are possible, as in many clinical
erties of Az, including such issues as statisti- images, the potential number of false positives
cal comparisons of values obtained from is virtually infinite, making the calculation of
different ROC studies. References 5 to 7 false-positive rates difficult, if not impossible.
present detailed analyses of these and other Alternative methods, called the free-response
practical issues in ROC studies. Az also has operating characteristic, that allow for the
an interesting practical interpretation: It is presence of multiple lesions have been devel-
the probability that, given a side-by-side pair oped and are discussed in reference 9.
of images, one of which has a lesion or test Finally, even a perfect image evaluation
object and the other does not, the observer will technique with a clearly defined outcome
correctly identify the image with the lesion.8 might not provide the final answer regarding
Despite their power and potential useful- the merit or value of an imaging device or
ness, ROC studies also have a number of limi- technique. Even after the physician or scien-
tations. Perhaps the most challenging is the tist has demonstrated that he or she has
verification of absolute truth for images developed a truly better device or technique
obtained from clinical studies. Ideally, the in terms of lesion or disease detectability,
outcome of the ROC study itself (i.e., the there is still the bottom-line question: So
tested images) should not be used for this what? Does the improved detectability alter
determination. This means that other equally the care of the patient or the outcome of that
or even more reliable information about the care? Does it improve the patients quality of
presence or absence of disease in the patient life? In an age of cost-consciousness, what are
must be available. Often nonimaging tests the cost-benefit tradeoffs? For example, from
(e.g., surgical results) must be obtained for a public health perspective, is it really worth
15 Image Quality in Nuclear Medicine 251

spending a small fortune to detect the next 3. Vayrynen T, Pitkanen U, Kiviniitty K: Methods for
smaller size of lesion, as compared with measuring the modulation transfer function of
gamma camera systems. Eur J Nucl Med 5:19-22,
directing those funds toward simpler health 1980.
measures, such as education and behavior 4. Rose A: Vision: Human and Electronic. New York,
modification? These are difficult questions to 1973, Plenum Press, pp 21-23.
answer, but efforts are being made to develop 5. Swets JA, Pickett RM: Evaluation of Diagnostic
methodology for answering them in a quanti- Systems: Methods from Signal Detection Theory, New
York, 1982, Academic Press.
tative and objective manner. The general 6. Metz CE: ROC methodology in radiologic imaging.
term for these investigations is efficacy Invest Radiol 21:720-733, 1986.
studies. Additional discussion of this topic can 7. Metz CE: Fundamental ROC analysis. In Beutel J,
be found in reference 10. Kundel HL, Nan Metter RL, editors: Handbook of
Medical Imaging, Bellingham, WA, 2000, SPIE,
Chapter 15.
REFERENCES 8. Hanley JA, McNeil BJ: The meaning and use of the
area under the receiver operating characteristic
1. Barrett HH, Yao J, Rolland JP, Myers KJ: Model (ROC) curve. Radiology 143:29-36, 1982.
observers for assessment of image quality. Proc Natl 9. Chakraborty DP: The FROC, AFROC, and DROC
Acad Sci 90:9758-9765, 1993. variants of the ROC analysis. In Beutel J, Kundel
2. Cunningham IA: Introduction to linear systems HL, Nan Metter RL, editors: Handbook of Medical
theory. In Beutel J, Kundel HL, Nan Metter RL, Imaging, Bellingham, WA, 2000, SPIE, Chapter 16.
editors: Handbook of Medical Imaging, Bellingham, 10. Fryback DG, Thornbury JR: The efficacy of diagnos-
WA, 2000, SPIE, Chapter 2. tic studies. Med Decis Making 11:88-94, 1991.

Das könnte Ihnen auch gefallen