Beruflich Dokumente
Kultur Dokumente
13673
Baidoshvili A, Stathonikos N, Freling G, Bart J, ‘t Hart N, van der Laak J, Doff J, van der Vegt B, Kluin P M &
van Diest P J
(2018) Histopathology 73, 777–783. https://doi.org/10.1111/his.13673
Validation of a whole-slide image-based teleconsultation network
Aims: Most validation studies on digital pathology Loading speed of the images, zooming latency and
diagnostics have been performed in single institutes. focus quality were scored. Leaving out eight minor
Because rapid consultation on cases with extramu- discrepancies without any clinical significance, the
ral experts is one of the most important uses for concordance rate between remote digital and original
digital pathology laboratory networks, the aim of microscopic diagnoses was 97.8%. The two cases
this study was to validate a whole-slide image-based with a major discordance (for which the light micro-
teleconsultation network between three independent scopic diagnoses were deemed to be the better ones)
laboratories. resulted from a different interpretation of diagnostic
Methods and results: Each laboratory contributed 30 criteria in one case and an image quality issue in the
biopsies and/or excisions, totalling 90 specimens other case. Average scores for loading speed of the
(776 slides) of varying difficulty and covering a wide images, zooming latency and focus quality were 2.37
variety of organs and subspecialties. All slides were (on a scale up to 3), 2.39 (scale up to 3) and 3.06
scanned centrally at 940 scanning magnification (scale up to 4), respectively.
and uploaded, and subsequently assessed digitally by Conclusions: This validation study demonstrates the
16 pathologists using the same image management suitability of a teleconsultation network for remote
system and viewer. Each laboratory was excluded digital consultation using whole-slide images. Such
from digital assessment of their own cases. Concor- networks may contribute to faster revision and con-
dance rates between the two diagnostic modalities sultation in pathology while maintaining diagnostic
(light microscopic versus digital) were compared. standards.
Keywords: digital network, digital pathology, remote teleconsultation, teleconsultation network
Materials and methods The three laboratories were free in the assignment of
individual cases to pathologists; however, the pathol-
THE NETWORK
ogists had to have had some basic experience with
A teleconsultation network was set up between the digital pathology. In total, 16 pathologists were
Laboratory for Pathology East Netherlands (LabPON; involved in the study (three UMCG, 10 Isala and
laboratory H) in Hengelo and the pathology laborato- three LabPON). The study cases were assessed digi-
ries of the Isala Clinic in Zwolle (laboratory Z) and tally using the IMS viewer (Philips). As only cases
the University Medical Center Groningen (laboratory from the other two mutual laboratories were scored,
G), the Netherlands. The network used an IntelliSite there were 180 digital assessments of the 90 cases.
image management system (IMS) which was installed All pathologists were asked to score the cases blinded
on a remote server in a datacentre in Amsterdam, to the original microscopic diagnosis, but they were
the Netherlands (Philips Digital Pathology Solutions, privy to the original clinical and macroscopic infor-
Best, the Netherlands). All three locations were tested mation, as well the original pathology diagnosis.
previously for Information and Communication Tech- They had to formulate a diagnosis, but no micro-
nology (ICT) infrastructure. Thus, the IMS was acces- scopic evaluation was requested. In addition, partici-
sible through the internet, allowing upload and pants were asked to score the delay in digital case
access of data from the three laboratories with a simi- retrieval (latency) after login at the IMS server as 1
lar bandwidth and latency. By hosting the server fully (noticeable latency), 2 (some latency) or 3 (no notice-
separately from the three participating locations, able latency). Image build-up (tiling) latency was
potential firewall restrictions by the private hospital scored in a similar manner (score 1–3), and lastly,
networks were circumvented. quality of focus of the images was scored from 1
© 2018 John Wiley & Sons Ltd, Histopathology, 73, 777–783.
Validation of a WSI-based teleconsultation network 779
Table 1. Tissue types from all laboratories signed-out diagnosis and the WSI-based diagnosis),
slightly discrepant (mild differences between the two
Specimen type diagnostic modalities without clinical or prognostic
Organ Biopsy Resection Total implications) or discrepant (differences with clinical
Oesophagus 1 0 1
and/or prognostic implications for the patient). If pos-
sible, discordances were also classified for their cause
Stomach duodenum 7 0 7 (interpretative or more technical reasons).
Appendix 0 1 1
Colon 6 1 7
Results
Liver 3 0 3
In total, 90 cases were evaluated (Table 1) resulting
Vulva 2 1 3 in 180 digital evaluations (each laboratory evaluated
Cervix uteri 3 1 4 only the cases provided by the other two laborato-
ries). The 90 cases encompassed 780 glass slides, 1–
Endometrium 5 1 6 44 slides per cases, with a median of six glass slides
Tuba 0 1 1 per case. From these 780 glass slides, 776 were
scanned and available for digital analysis. The four
Ovary 0 3 3
digital slides that were missing comprised one iron
Placenta 0 1 1 staining, one cytological smear and two immunohis-
tochemistry slides. This omission did not result in any
Breast 2 3 5
diagnostic problem, so all 90 cases remained in the
Lymph node 7 3 10 series. In one slide, a peripheral piece of tissue that
Bone marrow 5 0 5
was only partially covered by the tape was not
scanned.
Skin 9 7 16 The pathologists scored the speed of case retrieval
Tongue 0 1 1 and of image building and focus quality. The mean
values for these scores were 2.37 (scale up to 3;
Lung 0 2 2 1 = considerable latency to 3 = no latency), 2.39
Kidney 6 0 6 (idem) and 3.06 (scale up to 4, from score 1 = whole
slide out of focus to score 4 = everything in focus),
Urinary bladder 1 0 1
respectively (Figure 1). Focusing problems of any
Prostate 3 0 3 score were noted in 41 of digital 776 slides (5.3%).
Five slides were (almost) completely out of focus
Brain 1 0 1
(0.6%), and nine slides were partially out of focus
Soft tissue 1 2 3 (1.2%). In a few cases, the focusing problems were
due to ink-marks on top of the original glass slides
Bone/cartilage 0 1 1
that (on purpose) had not been removed before scan-
Total 61 29 90 ning. In one prostate biopsy with a very small focus
of adenocarcinoma readily detectable in the original
double staining for basal keratins and p63, one
pathologist was not able to make a certain digital
(whole slide out of focus), 2 (several parts out of diagnosis of adenocarcinoma because of this annota-
focus), 3 (minor parts out of focus) to 4 (everything tion on the glass slide and the resulting blurring
optimally focused). (Figure 2).
In 80 of 90 cases (89%, 180 evaluations), full con-
cordance was obtained between all three diagnoses
DATA ANALYSIS
(one original and two digital diagnoses per case).
In line with previous studies,7–11 the original micro- There were two major (2.2% of cases) and eight
scopic and WSI-based diagnoses were compared by at minor discordances (8.8% of cases; Table 2). Further
least two independent pathologists to judge if the cor- analysis showed that most discordances were due
relation between two diagnoses were concordant probably to differences in the pathologists’ interpreta-
(complete agreement between the first original tion/experience/awareness (eight cases). In one skin
© 2018 John Wiley & Sons Ltd, Histopathology, 73, 777–783.
780 A Baidoshvili et al.
200
180
160
140 72 75 72 Optimal
120
100 Optimal Tiny parts poor
80
69
60 102 88 Suboptimal Minor parts poor
40
20
20
17 19 Slow Major parts poor
0 6
Case Image Focus
retrieval buliding
Figure 1. Speed of case retrieval and image building and quality of image focus. Using the same image management system and viewer in
their own laboratory, each pathologist scored the speed of digital case retrieval and image building in a three-tiered system. The quality of
focusing was scored in a four-tiered system. As each case was scored by two pathologists at different locations, 180 assessments were avail-
able. The number of assessments with a specific score are indicated within the coloured bars. The numbers of individual slides with focusing
problems are given in the text.
biopsy with serial sections on three glass slides, a issues. The number of cases was relatively small com-
small basocellular carcinoma (BCC) was overlooked pared to other studies, but the case mix was relatively
by one pathologist. One skin biopsy contained a small complex, including renal, bone marrow and lymph
BCC that was surrounded by a monotonous lympho- node biopsies with malignant lymphomas, as well as
cytic infiltrate. This infiltrate had not been not a few sarcoma specimens, allowing evaluation of the
immunophenotyped by the contributing laboratory, network for consultation purposes. Importantly, all
as the patient was already known to also have B cell 16 pathologists were familiar with digital pathology
chronic lymphocytic leukaemia (B-CLL). One patholo- but, with the exception of a few, were not practising
gist did not interpret this infiltrate as abnormal in the this daily, precluding any positive prejudice to digital
digitalised slides, and thus diagnosed only the BCC. pathology.
Technical issues played a role in the discordance in The digital network indeed appeared to be suitable
only two cases. These included the already mentioned for consultation purposes, with only a few technical
prostate biopsy with the small focus of adenocarci- issues limiting its use. In particular, the speed of case
noma and a bone marrow trephine biopsy with signs retrieval and building images were not optimal, but
of hyperparathyroidism and pure red cell aplasia, in nevertheless were not perceived as a major nuisance
which the large inclusions typical for Parvo-B19 viral by the 16 pathologists involved (Figure 1). Some
infection in few (pro)erythroblasts were not identified slides showed parts that were also out of focus; how-
in the digitalised haematoxylin and eosin (H&E)- ever, focus quality was generally felt to be sufficient.
stained slides, but were appreciated only in the Only one case, with a very small focus of prostatic
immunohistochemical staining. This was due proba- adenocarcinoma out-of-focus problems, hindered the
bly to the low contrast in the digitalised H&E-stained diagnostic process.
slides. Some restraints of digital pathology for consulta-
tion and review are clear, such as the impossibility
of performing additional studies such as molecular
Discussion analysis, but also the use of birefringence for the
detection of amyloid in Congo red-stained slides.
The aim of this study was to test the feasibility of a Other limitations are the detection of small
digital teleconsultation network for remote consulta- microorganisms such as Helicobacter pylori in H&E
tion in pathology using WSI. Three laboratories par- slides. However, in general such limitations can be
ticipated with, in total, 90 scanned cases. Each avoided easily; for instance, by the addition of
laboratory was asked to review the cases from the other stains such as immunohistochemistry for
two other laboratories and to score relevant technical H. pylori.
© 2018 John Wiley & Sons Ltd, Histopathology, 73, 777–783.
Validation of a WSI-based teleconsultation network 781
Importantly, other specimens with very focal to more respect to loading, zooming and focusing speed, we
extensive focusing problems (4.2% of all slides) were asked the participants to score latencies which were
encountered, but this did not preclude a correct diag- critical factors in handling WSI. The scores of 2.37
nosis (Tables 2 and 3). This relatively high percent- and 2.39 were not optimal, clearly leaving room for
age illustrates, nevertheless, that pathologists should improvement. However, none of the 16 pathologists
be critical concerning the focus quality of the images. experienced this as a major drawback. Slow loading
As focus problems can be recognised easily, a proper speed can be amended by optimising the network and
check of the focus quality of all images to be image server performance, streaming properties of the
uploaded, and rescanning of slides if necessary, viewer, processor speed and graphics performance of
should be incorporated for the time being. This can the computer. The same holds for zooming latency.
be performed by a technician, but technical improve- The rate-limiting factors here are slow external and
ments as well as software algorithms checking focus internal networks, a slow server and/or computer.
quality automatically will also probably find a place In conclusion, this pilot study demonstrates the
in daily practice. To date, some scanners already suitability of a teleconsultation network for fast
have these options. Rescanning slides will, in prac- remote digital consultation. These encouraging
tice, lead to some delay, but will still be much faster results have stimulated further regional or nationwide
than sending slides by mail. networks of digital pathology. In the Netherlands an
Incorporation of digital consultation into routine initiative began 3 years ago to establish PIE (Pathol-
practice requires fast handling of images to prevent ogy Image Exchange) as a national platform for
efficiency losses and match routine microscopic exchange of WSI between Dutch pathology laborato-
assessments. To evaluate the proposed system in ries for consultation, revision and pathology panels.
1 Skin resection Residual melanoma Residual in-situ No residual melanoma Microscope Major P
melanoma
4 Skin biopsy BCC & B-CLL B-CLL BCC & B-CLL Microscope Minor P
5 Skin biopsy BCC & actinic Actinic keratosis BCC & actinic keratosis Microscope Minor P
keratosis
6 Lymph node Breast gland inclusion Reactive with small Reactive lymph node Microscope Minor P
breast gland
inclusion
7 Bone marrow Osteitis fibrosa cystica & Osteitis fibrosa Cyst & pure red cell Microscope Minor P & T?
pure red cell aplasia cystica & pure aplasia (parvovirus in IHC)
based on parvovirus red cell aplasia
infection (parvovirus in IHC)
8 Liver biopsy Bile duct adenoma Bile duct hamartoma Bile duct cyst Microscope Minor P
& haemangiona
10 Gastric biopsy Fundic gland polyp Fundic gland polyp Fundic gland polyp Digital Minor P
with low grade
dysplasia
*P, Pathologist (awareness, interpretation); T, Technical, image quality (focus, contrast); IHC, Immunohistochemistry; BCC, Basocellular car-
cinoma; B-CLL, B cell chronic lymphocytic leukaemia.
Table 3. Breakdown of specimens with very focal to more Pathologists Pathology and Laboratory Quality Center. Arch.
extensive focusing problems Pathol. Lab. Med. 2013; 137; 1710–1722.
4. Williams S, Henricks WH, Becich MJ, Toscano M, Carter AB.
n (%) Telepathology for patient care: what am I getting myself into?
Adv. Anat. Pathol. 2010; 17; 130–149.
Slides fully scanned in focus 735 (94.7) 5. Chen J, Jiao Y, Lu C, Zhou J, Zhang Z, Zhou C. A nationwide
telepathology consultation and quality control program in
Slides with minor focusing problems 27 (3.4) China: implementation and result analysis. Diagn. Pathol.
2014; 9(Suppl); S2.
Slides with more extensive focusing problems 14 (1.8)
6. Zhao C, Wu T, Ding X et al. International telepathology consul-
Total 776 (100) tation: three years of experience between the University of
Pittsburgh Medical Center and KingMed Diagnostics in China.
J. Pathol. Inform. 2014; 5; S33–S34.
7. Al Janabi S, Huisman A, Vink A et al. Whole slide images for
This project is in the operational phase and allows primary diagnostics in dermatopathology: a feasibility study. J.
the processing of cases for digital revision and consul- Clin. Pathol. 2012; 65; 152–158.
tation with all the relevant patient data available in a 8. Al Janabi S, Huisman A, Vink A et al. Whole slide images for
secure environment. primary diagnostics of gastrointestinal tract pathology: a feasi-
bility study. Hum. Pathol. 2012; 43; 702–707.
9. Al Janabi S, Huisman A, Nap M, Clarijs R, van Diest PJ. Whole
slide images as a platform for initial diagnostics in histopathol-
Acknowledgements ogy in a medium sized routine laboratory. J. Clin. Pathol. 2012;
65; 1107–1111.
Philips provided the collaboration server for this 10. Al Janabi S, Huisman A, Willems SM, Van Diest PJ. Digital
research without restrictions. Since 2016 (after fin- slide images for primary diagnostics in breast pathology: a fea-
ishing this research) LabPON has had a partnership sibility study. Hum. Pathol. 2012; 43; 2318–2325.
with Philips Digital Pathology. None of the authors 11. Goacher E, Randell R, Williams B, Treanor D. The diagnostic
concordance of whole slide imaging and light microscopy: a
received any financial support or compensation for systematic review. Arch. Pathol. Lab. Med. 2017; 141; 151–
their efforts in this study. 161.
12. Williams BJ, DaCosta P, Goacher E, Treanor D. A systematic
analysis of discordant diagnoses in digital pathology compared
Conflict of interest with light microscopy. Arch. Pathol. Lab. Med. 2017; 141;
712–718.
None. 13. Furness P. A randomized controlled trial of the diagnostic
accuracy of internet-based telepathology compared with con-
ventional microscopy. Histopathology 2007; 50; 266–273.
References 14. Wilbur DC, Madi K, Colvin RB et al. Whole-slide imaging digi-
tal pathology as a platform for teleconsultation: a pilot study
1. Al Janabi S, Huisman A, Van Diest PJ. Digital pathology: current using paired subspecialist correlations. Arch. Pathol. Lab. Med.
status and future perspectives. Histopathology 2012; 61; 1–9. 2009; 133; 1949–1953.
2. Cheng CL, Tan PH. Digital pathology in the diagnostic setting: 15. Jones NC, Nazarian RM, Duncan LM et al. Interinstitutional
beyond technology into best practice and service management. whole slide imaging teleconsultation service development:
J. Clin. Pathol. 2017; 70; 454–457. assessment using internal training and clinical consultation
3. Pantanowitz L, Sinard JH, Henricks WH et al.; for the College cases. Arch. Pathol. Lab. Med. 2015; 139; 627–635.
of American Pathologists Pathology and Laboratory Quality 16. Bauer TW, Slaw RJ. Validating whole-slide imaging for consul-
Center. Validating whole slide imaging for diagnostic purposes tation diagnoses in surgical pathology. Arch. Pathol. Lab. Med.
in pathology: guideline from the College of American 2014; 138; 1459–1465.