Adherence to pre-set benchmark quality criteria to qualify as expert assessor of dysplasia in Barrett's esophagus biopsies - towards digital review of Barrett's esophagus
van der Wel, M J; Klaver, E; Duits, L C; Pouw, R E; Seldenrijk, C A; Offerhaus, Gja; Visser, M; Ten Kate, Fjw; Biermann, K; Brosens, Laa; Doukas, M; Huysentruyt, C; Karrenbeld, A; Kats-Ugurlu, G; van der Laan, J S; van Lijnschoten, G; Moll, Fcp; Ooms, Ahag; Tijssen, J G; Bergman, Jjghm; Meijer, S L
(2019) United European Gastroenterology Journal, volume 7, issue 7, pp. 889 - 896
(Article)
Abstract
Background: Dysplasia assessment of Barrett's esophagus biopsies is associated with low observer agreement; guidelines advise expert review. We have developed a web-based review panel for dysplastic Barrett's esophagus biopsies. Objective: The purpose of this study was to test if 10 gastrointestinal pathologists working at Dutch Barrett's esophagus expert centres met
... read more
pre-set benchmark scores for quality criteria. Methods: Ten gastrointestinal pathologists twice assessed 60 digitalized Barrett's esophagus cases, enriched for dysplasia; then randomised (7520 assessments). We tested predefined benchmark quality criteria: (a) percentage of 'indefinite for dysplasia' diagnoses, benchmark score ≤14% for all cases, ≤16% for dysplastic subset, (b) intra-observer agreement; benchmark score ≥0.66/≥0.39, (c) percentage agreement with 'gold standard diagnosis'; benchmark score ≥82%/≥73%, (d) proportion of cases with high-grade dysplasia underdiagnosed as non-dysplastic Barrett's esophagus; benchmark score ≤1/78 (≤1.28%) assessments for dysplastic subset. Results: Gastrointestinal pathologists had seven years' Barrett's esophagus-experience, handling seven Barrett's esophagus-cases weekly. Three met stringent benchmark scores; all cases and dysplastic subset, three met extended benchmark scores. Four pathologists lacked one quality criterion to meet benchmark scores. Conclusion: Predefined benchmark scores for expert assessment of Barrett's esophagus dysplasia biopsies are stringent and met by some gastrointestinal pathologists. The majority of assessors however, only showed limited deviation from benchmark scores. We expect further training with group discussions will lead to adherence of all participating gastrointestinal pathologists to quality criteria, and therefore eligible to join the review panel.
show less
Download/Full Text
Keywords: Barrett's esophagus, benchmark quality criteria, consensus gold standard diagnosis, digital microscopy, observer agreement, review panel, whole slide imaging, Barrett’s esophagus, Gastroenterology, Oncology
ISSN: 2050-6406
Publisher: SAGE Publications Inc.
Note: Funding Information: The following author contributions were made: study concept and design: MJW, EK, SLM, JJGHMB. Acquisition of data: MJW, CAS, GJAO, MV, FJWK, KB, LAAB, MD, CH, AK, GKU, JSL, GL, FCPM, AHAGO, SLM. Analysis and interpretation of data: MJW, EK, JGT, JJGHMB, SLM. Drafting of the manuscript: MJW, EK, LCD, REP, JGT, JJGHMB, SLM. Critical revision for important intellectual content and final approval of the manuscript: all authors. Study supervision: SLM, JJGHMB. Publisher Copyright: © Author(s) 2019.
(Peer reviewed)