Beruflich Dokumente
Kultur Dokumente
4, JULY 2012
obtained by the ILSF that has the form of distance function [27].
the window central voxels would be 6.0 and 5.0, respectively.
The numbers in Fig. 6(a) are the distance from an arbitrary
The mean wall thicknesses would be 6.5 and 5.0, which were
voxel to the nearest voxel on the inner border. The black arrows
computed by averaging all numbers inside the windows. There-
indicate the gradient directions at the three voxels. A possible
fore, the central voxel thickness and the mean thickness both
condition is shown by Fig. 6(a) that a window locates at the foot
have the potential of distinguishing these two windows.
of a tumor. J is a voxel on the normal bladder wall and K lies on
the other side of the tumor. Since J and I are on different tissues
B. Window Radius Determination (wall and tumor) and I is the window center, then voxel J should
All the features used for tumor candidate detection and FP be excluded from this window. In other words, the window shall
reduction were captured from the windows, which are the ba- represent the tumor surface that the voxel I belongs to. The voxel
sic elements for tumor surface segmentation. If a window is K should also be excluded from the window. If K is included, not
detected as a tumor window, then the region inside the win- only the tumor surface, but also the bladder wall and the central
dow is considered as tumor region. Therefore, the window size part of the tumor would contribute to the window features. More
should be properly set. We used structure to denote a continu- specifically, as mentioned earlier, the bladder tumor emerges on
ous region on the bladder wall. One structure should include only the inner border and then invades toward the muscle layer. The
one tissue type, and this guarantees the inner geometry/intensity texture features inside the tumor are considered to be different
property varies smoothly. The tumor and the bladder wall are layer by layer. Suppose both I and K are inside one window, then
different structures. Furthermore, the region including the same delicate texture variation among layers would be diminished.
tissue but with prominent geometry variations also belongs to To distinguish the voxels belonging to different structures,
different structures. If a window includes more than one struc- the gradient of the distance function was used. As shown in
ture, the window radius should be reduced. Fig. 5 shows an Fig. 6(a), the gradient direction at J and K are distinctly different
example that two structures are inside one window. from that at voxel I. Suppose the angle between the gradient
The red cross A is at the window center, B and C are voxels directions at center voxel I and another voxel J is angle (I,J),
within the same window. A is on the tumor while B and C are (0 angle (I, J) ), with a predefined angle 0 , a labeling
on the bladder wall. The gap between A and B/C is the bladder function L(angle(I,J)) is obtained, which is
lumen. The current window radius should be reduced to exclude
1 angle (I, J) < 0
B and C as well as all other voxels on the bladder wall. Then, L (angle (I, J)) = . (1)
0 otherwise
the features extracted from this window represent the bladder
tumor, as the same the features from the window central voxel. If L = 1, then I and J are considered to be in the same struc-
On the other hand, even if voxels A, B, and C are of the same ture, otherwise J is excluded. Let the voxels with L = 1 be the
tissue type, they also belong to different structures due to their effective voxels. If the number of effective voxels is too small
discontinuous geometry properties, such as the intensity gradi- with respect to the total voxel number in one window (smaller
ent. Therefore, the voxels B and C should be excluded from this than a predefined ratio re ), it means the window is close to the
window as well. Generally, the window radius would be set to boundary of two adjacent structures and a smaller window is
include enough voxels from the same structure to guarantee the needed. Fig. 6(b) gives an example to depict this concept. The
features that are statistically reliable, while excluding as much windows cover the inner border one by one. The bigger win-
as possible the unconcerned structure voxels. In other words, a dows are aligned with the smoother border sections such as the
bigger window would likely include unrelated structures inside, normal bladder wall, while the small windows are located on
while a smaller window could be more vulnerable to the im- the region with mixed structures, such as the tumor foots. Since
age noise. A simulative bladder tumor image and the adaptive the windows overlap each other, the overlapped regions are
window radius selection scheme are depicted in Fig. 6. considered as the tumor if it is covered by at least one tumor
As shown in Fig. 6, the protrusion represents the emerging window. Fig. 7 illustrates the flowchart of the window radius
tumor. I, J, and K are three voxels on and inside the inner border. determination procedure. The windows should cover the whole
The red circle is the boundary of a 3-D window on this slice. region of the bladder wall inner border. The procedure includes:
As mentioned earlier, the inner border of the bladder wall was 1) an initial and stop window radii were defined as Ri and Rs .
724 IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, VOL. 16, NO. 4, JULY 2012
B. Volumetric Features for False Positive Reduction includes those voxels x where 1.5 1 (x) < 0.5, and
As described earlier, a group of predefined thresholds of the l (x) =0 includes those voxels x where 0.5 1 (x) < 0.5.
SI and NWT features were used to select candidates in order The layer-based features were computed by
to guarantee all the tumor windows are picked up. In conse-
dev l, f j = o1 (l (x)) f j (l (x)) (7)
quence, the candidates may include FP windows. Various rea-
sons, such as the extrusion of the prostate, may lead to the
where o1 was defined in (2) as the first derivative operator. By
geometry changes of the bladder wall and produce the FP win-
using l (x) instead of x as the variable, (7) is 1-D derivative,
dows. Therefore, FP reduction is necessary. Additional features,
which reflects the feature variation among layers.
especially texture information from the windows, which can
For each raw feature j, seven statistics plus one layer-based
reflect the differences between the FP windows and the true
features were computed, which means totally 24 features were
tumor windows, are needed. Comparing with the CT images,
generated from the three raw features. Together with the SI and
the MR images provide more delicate textural information for
NWT, there are totally 26 features extracted from each window.
the soft tissue such as the bladder wall and the tumor. Further-
more, considering the fact that the tumor invades gradually from
the mucosa layer toward the muscle layer, the feature variation C. Segmentation of the Entire Tumor Surface
among layers should be able to distinguish the tumor surface In this section, the description goes to the reduction in FPs
from the normal bladder wall inner border. Therefore, in ad- and the use of the final windows to construct the tumor sur-
dition to the SI and the NWT, other two groups of features face regions. As mentioned in the last section, 26 features from
were considered. One is the window statistics, and the other one window i have been extracted and will be used to perform the
is the layer-based features. These two groups of features were discrimination. These features
generated from three voxel-based raw features, which are the construct a 26-D feature vector
Fi = Fi1 , Fi2 , Fi3 , Fi26 .
intensity value I, intensity gradient GI , and distance function The quadratic discriminant analysis (QDA) [34] was used
gradient G . Let wi represent the ith candidate window, |wi | to classify the windows as either true positive (TP) or FP. The
be the number of voxels in the window, and f j (j = 1, 2, 3) windows were separated into two groups, the training group and
represent I, GI and G together, where the gradient values GI the testing group. The tumor regions were labeled by experts in
and G were generated from the first order neighborhood, G advance, i.e., each voxel was labeled as either normal bladder
was the gradient value of the ILSF 1 (x), and f j of each voxel wall or tumor. The window type in the training group is the same
was computed in advance. Seven window statistics for each raw as its central voxel. The candidate windows with the central
feature f j in window wi are computed as follows: voxel labeled tumor are the TP while the windows with the
f j (x) central voxel labeled wallare the FP. The mean and covariance
mean wi , f j = ij = matrices of the TP (TP , TP ) and FP (FP , FP ) samples
|wi |
xw i in the training group were computed.
1 2 In the testing group, a feature vector Fi was extracted from
var wi , f j = ij
2
= f j (x) ij window i. The quadratic discriminant function was applied to
|wi | 1 xw
i classify TPs and FPs and has the form of
j
j
4
1 f j (x) ij The decision boundary is a hyperquadratic surface in the feature
j
kurt wi , f = 3
|wi | xw ij space where g (x) = t. The final decision is based on which side
i
the feature vector is located in the feature space. The discrimi-
j
min wi , f j nant is given by
contrast wi , f = (6)
max (wi , f j )
TP, if g (Fi ) t
where ij and j window i = (9)
ij are the mean and standard
deviation of f FP, if g (Fi ) < t
in wi , min wi , f j and max wi , f j are the minimum and
maximum f j values in wi .Other statistics were calculated by where t is a predefined constant.
using ij , ij , min wi , f j , max wi , f j , f j and |wi |. It is noted that the datasets generated a large amount of de-
The layer-based features were computed by using the ILSF tecting windows. Each dataset could result in far more than one
1 . While the OLSF 2 represents the bladder wall thickness, 1 feature vector. Furthermore, a tumor could be covered by sev-
divides one window into several layers. As shown in Fig. 6(a), eral detecting windows. Therefore, a large amount of abnormal
the layer with index l (an integer) includes voxel x, where windows were generated for training from a relatively small
l (x) 0.5 1 (x) < l (x) + 0.5. For example, l (x) = 1 number of patients datasets.
726 IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, VOL. 16, NO. 4, JULY 2012
TABLE I
DATA INFORMATION AND IMAGE ACQUISITION PARAMETERS
TABLE II
NUMBERS OF DETECTING WINDOWS
Fig. 8. Example images to illustrate the window arrangement. The first, second
and third rows show the original T1 -weighte MR images, the segmented results
by the coupled level set method and the window arrangement, respectively.
Each column is from the same slice of the same dataset. The left column is the
image from a volunteer. The middle and right columns are two patient cases
with a tumor in each case. The segmented inner and outer borders of the bladder
wall on images (d)(f) are highlighted by yellow curves. The black regions on
VI. RESULTS AND DISCUSSION images (g)(i) are the overlapping windows. Picture (g) shows the window on
the normal bladder wall. Pictures (h) and (i) show the windows covering the
A. Data Acquisition tumor surfaces.
Ten T1 -weighted MR image datasets, five patients and five
volunteers, were used to test the segmentation method presented
earlier. All subjects were asked to empty the bladder and drink all TP windows, indicating that 100% tumor surface is covered.
a cup of water about a half hour prior to the scanning so that the The FP window numbers are also listed in the table.
bladder was full of the urine when scanning started. The whole To generate the windows (listed in the upper or first two rows
imaging procedure is noninvasive. The image data were acquired in Table II), the predefined angle 0 and ratio re in Section IV
in DICOM format by using a clinic whole body 3.0-T scanner. were set to be /6 and 0.65 by experiments. The initial and
The original DICOM datasets were reformed to self-defined stop window radii Ri and Rs were set to be 8 and 2 voxel units,
raw volumes with the subjects private information being re- respectively. Then, four window radii were selected which are
moved. Considering the anisotropic resolution of the images, a 8, 6, 4, and 2. In fact, both 0 and re have influence on the
linear interpolation was performed. Then, the coupled level set window radius distribution. For a window centered at the same
framework was applied to segment the inner and outer borders place and with fixed radius, a smaller 0 or a larger re means
of the bladder wall automatically. The patients datasets were more voxels are excluded from this window. In consequence, the
inspected by experts, and the tumors were labeled manually in window radius tends to turn smaller, and vice versa. The overall
advance by the experts for comparison and evaluation purposes. effect is to guarantee most of the voxels inside the window are
Table I lists the scanning protocols, the repetition time and the the effective voxels (belong to the same structure). Therefore,
echo time for acquiring the ten datasets. 0 and re values are allowed to vary in reasonable ranges. As
shown in Table II, most windows have radii ranging from 2 to
6. Only a few windows radii are 8. Therefore, it is proper to set
B. Window Arrangement
the longest window radius to be 8. The shortest radius was set
Although we have limited number of datasets, the amount to be 2, because the features extracted from the window, whose
of detecting windows is large enough for training and testing. radius shorter than 2, are vulnerable to the image noise.
The final results were given by the remaining windows. Table II Fig. 8 gives an example of the window arrangement. As ex-
lists the window numbers from the ten datasets at each step. pected, the windows with longer radii were assigned on the
The upper two rows show the numbers of the total wall and smoother borders. The intersections of the tumor and the nor-
tumor windows. The middle two rows show the numbers of the mal bladder wall, where complex structures are present, were
candidate windows. The lower two rows are the numbers of the covered by smaller windows. The windows (appear as disks
windows finally detected on the tumor surfaces after QDA. In in 2-D slices) overlapped each other, constructing an irregular
this case, the decision boundary of QDA was chosen to include band-shaped region around the inner border. The radius of disks
DUAN et al.: ADAPTIVE WINDOW-SETTING SCHEME FOR SEGMENTATION OF BLADDER TUMOR SURFACE VIA MR CYSTOGRAPHY 727
TABLE III
THRESHOLD VALUES OF THE OPERATORS FOR CANDIDATES DETECTION
TABLE V
CONFUSION MATRIX OF THE FINAL WINDOW DISTRIBUTION
TABLE VI
EXPERTS SCORES
VII. CONCLUSION
the true tumor surface covered by the detecting windows, 1.0 This paper proposed an adaptive window-setting scheme to
means the tumor surface labeled by the experts were completely segment the entire bladder tumor surface with acceptable FP
covered by the windows. The FP per dataset is the FP number numbers. T1 -weighted MR images were used for that purpose
averaged to one dataset. One FP here means a region that consists due to its better bladder wall contrast, which provided the tex-
of connective FP windows. Generally, we removed the regions tures information for delicate analysis. Our previous coupled
smaller than 2 mm that are considered as being generated by level set framework was employed to segment the inner and
image noise [18][21]. Fig. 11 shows that 90% of the tumor outer borders of the bladder wall simultaneously. Detecting
surface was covered by the windows while 1.6 FPs per dataset windows with different radii were arranged on the inner bor-
were detected by mistake, and 100% surface was covered with der of the bladder wall. The window radius was adaptive to
4.4 FPs per dataset. The areas under the windows were also different bladder wall structures. The candidate windows were
measured. The average FP to TP surface area ratio is 0.38, selected by using SI and NWT with predefined thresholds on
where the surface area was computed by the inner border or the an application-specific range. Statistics-, geometry- and layer-
tumor surface covered by the windows. The lower two rows in based features were extracted from the candidate windows. The
Table I show the remaining FP window numbers after the QDA QDA classifier was applied in the feature space to reduce the
discrimination. FP windows. Both ROC and fROC curves were generated to
In Table V, more details were provided about the final results. evaluate the performance of the classifier, feature combina-
The terms Tumor D and Wall D indicate the numbers of tions and the detection, and segmentation procedure. This study
windows on the tumor and the normal bladder wall, respectively, was tested by ten clinical image datasets including five patients
as detected by our method. The Tumor L and Wall L show and five volunteers. Throughout the result report and associated
DUAN et al.: ADAPTIVE WINDOW-SETTING SCHEME FOR SEGMENTATION OF BLADDER TUMOR SURFACE VIA MR CYSTOGRAPHY 729
discussion in the previous section, it can be observed that the [14] J. R. Fielding, L. Hoyte, S. A. Okon, A. Schreyer, J. Lee, K. H. Zou, S.
bladder wall thickness and geometry features, such as the SI, are Warfield, J. P. Richie, K. R. Loughlin, M. P. OLeary, C. J. Doyle, and R.
Kikinis, Tumor detection by virtual cystoscopy with color mapping of
efficient for tumor detection, and the statistics of the in-window bladder wall thickness, J. Urol., vol. 167, pp. 559562, 2002.
features are effective for classifying the tumor surface and the [15] S. Jaume, M. Ferrant, B. Macq, L. Hoyte, J. R. Fielding, A. Schreyer,
normal bladder wall surface. The layer derivatives add more R. Kikinis, and S. K. Warfield, Tumor detection in the bladder wall with
a measurement of abnormal thickness in CT scans, IEEE Trans. Biomed.
necessary information for the classification. These features to- Eng., vol. 50, no. 3, pp. 383390, Mar. 2003.
gether provide the potential of detecting small and flattening [16] D. J. Vining, R. J. Zagoria, K. Liu, and D. Stelts, CT cystoscopy: An
tumors, which are hardly detected by the geometrical features innovation in bladder imaging, Amer. J. Roentgenol., vol. 166, pp. 409
individually. In summary, the results showed the effectiveness 410, 1996.
[17] Z. Liang, D. Chen, T. Button, H. Li, and W. Huang, Feasibility studies on
of the proposed method in detecting the bladder tumors and extracting bladder wall from MR images for virtual cystoscopy, in Proc.
segmenting the whole surface of the detected bladder tumors. Int. Soc. Magn. Reson. Med., 1999, vol. 3, pp. 2204.
In our future work, much effort will be devoted to acquire [18] T. M. Bernhardt and U. Rapp-Bernhardt, Virtual cystoscopy of the blad-
der based on CT and MRI data, Abdominal Imag., vol. 26, pp. 325332,
new clinical datasets from both patients and volunteers. The 2001.
effectiveness and robustness of the current method need to be [19] M. Lammle, A. Beer, M. Settles, C. Hannig, H. Schwaibold, and C. Drews,
tested by more patient datasets including smaller tumors with Reliability of MR imaging-based virtual cystoscopy in the diagnosis of
cancer of the urinary bladder, Amer. J. Roentgenol., vol. 178, pp. 1483
different types. Based on the segmentation of the entire tumor 1488, 2002.
surface, to further dig out the exact tumor regions inside the [20] T. M. Bernhardt, H. Schmidl, C. Philipp, E. P. Allhoff, and U. Rapp-
bladder wall and extract quantitative parameters from the tumor Bernhardt, Diagnostic potential of virtual cystoscopy of the bladder:
volume for CAD are under development. To integrate this study MRI versus CT. Preliminary report, Eur. Radiol., vol. 13, pp. 305312,
2003.
into a VCys system, further improvement on the accuracy of the [21] R. F. Browne, S. M. Murphy, R. Grainger, and S. Hamilton, CT cystogra-
detection and segmentation and the efficiency of computation phy and virtual cystoscopy in the assessment of new and recurrent bladder
will be needed and are under progress. neoplasms, Eur. J. Radiol., vol. 53, pp. 147153, 2005.
[22] L. Li, Z. Wang, D. Harrington, W. Huang, and Z. Liang, A mixture-based
computer aided detection system for virtual cystoscopy, in Proc. Int. Soc.
ACKNOWLEDGMENT Magn. Reson. Med., 2003, vol. 11, p. 1466.
The authors would like to thank the assistance of Z. Li for [23] H. Zhu, C. Duan, R. Jiang, L. Li, Y. Fan, X. Yu, W. Zeng, X. Gu, and
Z. Liang, Computer-aided detection of bladder tumors based on the thick-
data processing. ness mapping of bladder wall in MR images, Proc. SPIE Med. Imag.,
vol. 7623, pp. 76234H-176234H-8, 2010 [CD-ROM],.
[24] C. Duan, Z. Tian, Z. Liang, S. Bao, and K. Yuan, Segmenting bladder wall
REFERENCES and estimating wall thickness for magnetic resonance virtual cystoscopy,
J. Tsinghua Univ., vol. 50, no. 9, pp. 14451448, 2010.
[1] K. T. Bae, J. S. Kim, Y. H. Na, K. G. Kim, and J. H. Kim, Pulmonary
[25] C. Duan, K. Yuan, S. Bao, and Z. Liang, Bent rate based bladder lesion
nodules: Automated detection on CT images with morphologic matching
enhancement with application to MR cystography, ICIC Exp. Lett.,
algorithm-preliminary results, Radiology, vol. 236, pp. 286294, 2005.
vol. 4, no. 6B, pp. 24252429, 2010.
[2] S. A. Taylor, S. Halligan, D. Burling, M. E. Roddie, L. Honeyfield, J. Mc-
[26] C. Duan, K. Yuan, F. Liu, P. Xiao, G. Lv, and Z. Liang, Volume-based
Quillan, H. Amin, and J. Dehmeshki, Computer-assisted reader software
features for detection of bladder wall abnormal region via MR cystog-
versus expert reviewers for polyp detection on CT colonography, Amer.
raphy, IEEE Trans. Biomed. Eng., vol. 58, no. 9, pp. 25062512, Sep.
J. Roentgenol., vol. 186, pp. 696702, 2006.
2011.
[3] S. Halligan, S. A. Taylor, J. Dehmeshki, H. Amin, X. Ye, J. Tsang, and M.
[27] C. Duan, Z. Liang, S. Bao, H. Zhu, S. Wang, G. Zhang, J. Chen, and H.
E. Roddie, Computer-assisted detection for CT colonography: External
Lu, A coupled level set framework for bladder wall segmentation with
validation, Clin. Radiol., vol. 61, pp. 758763, 2006.
application to MR cystography, IEEE Trans. Med. Imag., vol. 29, no. 3,
[4] F. Liu, C. Duan, K. Yuan, Z. Liang, and S. Bao, Detecting bladder
pp. 903915, Mar. 2010.
abnormalities based on inter-layer intensity curve for virtual cystoscopy,
[28] L. Li, Z. Wang, X. Li, X. Wei, H. Adler, W. Huang, S. Rizvi, H. Meng,
in Proc. MICCAI Workshop: Virtual Colonoscopy Abdominal Imag., 2010,
D. Harrington, and Z. Liang, A new partial volume segmentation ap-
vol. 9, pp. 97103.
proach to extract bladder wall for computer aided detection in virtual
[5] Z. Wu, Z. Shi, G. Zhang, and H. Lu, Detection of the invasion of blad-
cystoscopy, Proc. SPIE Med. Imag., vol. 5369, pp. 199206, 2004.
der tumor into adjacent wall based on textural features extracted from
[29] L. Li, Z. Liang, S. Wang, H. Lu, M. Wagshul, M. Zawin, E. Posniak,
MRI images, in Proc. MICCAI 2010 Workshop: Virtual Colonoscopy
and C. Lee, Segmentation of multi-spectral bladder MR images with
Abdominal Imag., 2010, vol. 9, pp. 97103.
inhomogeneity correction for virtual cystoscopy, Proc. SPIE Med. Imag.,
[6] P. A. Wingo, T. Tong, and S. Bolden, Cancer statistics, A. Cancer J.
vol. 6916, pp. 69160U-169160U-5, 2008 [CD-ROM].
Clin., vol. 45, pp. 830, 1995.
[30] S. Osher and J. Sethian, Fronts propagating with curvature dependent
[7] D. L. Lamm and F. M. Torti, CA: Bladder cancer, A. Cancer J. Clin.,
speed: Algorithms based on Hamilton-Jacobi formulation, J. Comput.
vol. 46, pp. 93112, 1996.
Phys., vol. 79, pp. 1249, 1988.
[8] A. Jemal, A. Thomas, T. Murray, and M. Thun, Cancer statistics, A
[31] T. Chan and L. Vese, Active contours without edges, IEEE Trans.
Cancer J. Clin., vol. 52, pp. 2347, 2002.
Image Process., vol. 10, no. 2, pp. 266277, Feb. 2001.
[9] A. Jemal, R. Siegel, E. Ward, Y. Hao, J. Xu, T. Murray, and M. J. Thun,
[32] O. Monga and S. Benayoun, Using partial derivatives of 3D images to
Cancer statistics, A Cancer J. Clin., vol. 58, pp. 7196, 2008.
extract typical surface features, Comput. Vision Image Understanding,
[10] American Cancer Society. Cancer Facts & Figures 2008. At-
vol. 61, no. 2, pp. 171189, 1995.
lanta: American Cancer Society, 2008[Online]. Available:
[33] H. Zhu, C. Duan, P. Pickhardt, S. Wang, and Z. Liang, Computer-aided
http://www.cancer.org/acs/groups/content/@nho/documents/document/
detection of colonic polyps with level set-based adaptive convolution
2008cafffinalsecuredpdf.pdf.
in volumetric mucosa to advance CT colonography toward a screening
[11] Overview: Bladder Cancer (8 Jun., 2010) [Online] Available:
modality, Cancer Manage. Res., vol. 1, pp. 113, 2009.
http://www.cancer.org
[34] K. Fukunaga, Introduction to Statistical Pattern Recognition. San
[12] G. D. Steiner, D. L. Trump, and K. B. Cummings, Metastatic bladder
Diego: Academic Press, 1990.
cancer: Natural history, clinical course, and consideration for treatment,
Urologic Clin. North Amer., vol. 19, pp. 735746, 1992.
[13] Y. Z. Almallah, C. D. Rennie, J. Stong, and M. J. R. Lancashire, Uri-
nary tract infection and patient satisfaction after flexible cystoscopy and Authors photographs and biographies not available at the time of publication.
urodynamic evaluation, Urology, vol. 56, no. 1, pp. 3739, 2000.