Skip to main content
The NCI Community Hub will be retiring in May 2024. For more information please visit the NCIHub Retirement Page:https://ncihub.cancer.gov/groups/ncihubshutdown/overview
close

Presentation 2021: Wen Quantitative Agreement Analysis for HTT Pilot Study Data

Version 3
by (unknown)
Version 4
by (unknown)

Deletions or items before changed

Additions or items after changed

1 ===Quantitative Agreement Analysis for HTT Pilot Study Data===
2 * Presenter: '''Si Wen, Ph.D.'''
3 * When: '''Friday, July 16th, at 11:00 am EDT
4 -
* Related manuscript: Wen, S.& Gallas, B. D. (2021). Three-way Mixed Effect ANOVA to Estimate MRMC Limits of Agreement. arXiv preprint https://arXiv:2107.08891. Submitted to Statistics in Biopharmaceutical Research.
+
* Related manuscript, submitted to Statistics in Biopharmaceutical Research, can be read [https://arxiv.org/abs/2107.08891 HERE]
5 +
* The GitHub repo with an R package for the methods and simulations: [https://github.com/DIDSR/ANOVA.MRMC.LOA]
6 * Downloadable Files: [[File(0716-Quantitative_Agreement_Analysis_for_HTT_data.pdf)]]
7
8 [[Video(https://www.youtube.com/watch?v=WLZKgrGMtcw)]]
9
10 ----
11 =Title: Quantitative Agreement Analysis for HTT Pilot Study Data=
12 ----
13 =Detailed Abstract=
14 Computational algorithms have been applied to support many medical and clinical tasks. For some of the clinical tasks, such as evaluating stromal tumor-infiltrating lymphocytes (sTILs) in a whole slide image, there are no ground truth reference values. In this work, we collect quantitative reference values from pathologists. To validate the effectiveness of the algorithms, we are exploring the use of agreement analysis, such as limits of agreement (LOA), to assess the closeness between the algorithm results and reference values quantitatively. The inter-reader variability is introduced into the agreement analysis when multiple pathologists/readers are involved in generating the reference values for each case. To decompose the total variation in the data, we use the random effects ANOVA model. The decomposed reader and case variance components are used to estimate LOA and the variance, so that this agreement analysis takes both the reader and case variability into consideration. The between-reader agreement among the pathologists can also be analyzed by the ANOVA, which can in turn be linked to the intraclass correlation coefficient (ICC). We will use the HTT pilot study data to present the analytical result.