Skip to main content
The NCI Community Hub will be retiring in May 2024. For more information please visit the NCIHub Retirement Page:https://ncihub.cancer.gov/groups/ncihubshutdown/overview
close

Presentation 2021: JSM Pathologist Agreement from Quantitative Measurements: a Pilot Study

Version 4
by (unknown)
Version 5
by (unknown)

Deletions or items before changed

Additions or items after changed

1 == ASA Joint Statistical Meeting Presentation 8 August 2021==
2
3 * Presenter: Brandon D Gallas, Ph.D.
4 * Title: Pathologist Agreement from Quantitative Measurements: a Pilot Study
5 * When August 8, 2021
6 * Format: 3 minute lightening talk, 15 minute video
7 * [https://ww2.amstat.org/meetings/jsm/2021/]
8 * [https://ww2.amstat.org/meetings/jsm/2021/onlineprogram/AbstractDetails.cfm?abstractid=318980 Link to Program Selection]
9
10 =4 Minute Lightening Talk=
11 +
* Slides [[File(04min-Pathologist_Agreement_from_Quantitative_Measurements-A_Pilot_Study_-_Gallas.pdf)]]
12 [[Video(https://www.youtube.com/watch?v=2SmcQIASxI8)]]
13
14 =15 Minute Presentation=
15 +
* Slides [[File(15min-Pathologist_Agreement_from_Quantitative_Measurements-A_Pilot_Study_-_Gallas.pdf)]]
16 [[Video(https://www.youtube.com/watch?v=xaPxOCWm-VI)]]
17
18 ----
19 '''Abstract #18980:''' *Background* We studied interobserver variability in pathologists who evaluate breast cancer biopsy specimens. Our goal is to create a validation dataset that is fit for a regulatory purpose. *Methods* Pathologist annotators completed data collection tasks via two modalities: an optical light microscope and two digital platforms (slides were scanned at 40X). Pathologists were trained on the clinical task of sTIL density estimation before annotating pre-specified regions of interest (ROIs) across all platforms.*Results* The pilot study accumulated 6,257 sTIL density estimates from 34 pathologists evaluating 64 cases, with 10 ROIs per case. The variability of sTIL density estimates in an ROI increases with the mean; the square roots of the reader-averaged mean-squared differences were 8.3, 17.7, and 40.4 as the sTIL density reference score increased from 0-10%, 10-40%, and 40-100%, respectively. *Conclusions* This pilot study will inform the development of statistical methods, simulation models, and sizing analyses for pivotal studies. We will explore this validation dataset and analysis tools and make them publicly available.