Skip to main content
The NCI Community Hub will be retiring in May 2024. For more information please visit the NCIHub Retirement Page:https://ncihub.cancer.gov/groups/ncihubshutdown/overview
close

HTT update Current

Version 9
by (unknown)
Version 10
by (unknown)

Deletions or items before changed

Additions or items after changed

1 [MainPage Wiki Main Page]
2
3 [HTTupdates Previous Updates]
4 +
5 +
----
6 +
[https://didsr.github.io/HTT.home/ Due to the coming shutdown of the NCIhub, we have a new site for updates.]
7 +
----
8
9 We are pleased to announce some recent accomplishments of the High-throughput truthing project (HTT).
10
11 A list of all previous updates can be found [HTTupdates on this page]. Our publications and presentations are organized [https://www.zotero.org/groups/4384613/eedap_studies_presentations_publications_and_studies/library in this Zotero library]. Our data is being shared [https://github.com/DIDSR/HTT in this GitHub repository.]
12
13 The HTT project’s '''objective''' is to create a validation dataset fit for a regulatory purpose. Pursuing this objective is expected to inform regulatory frameworks and be instructive to others to develop their own validation datasets. For more detailed information about the project and/or to register as a pathologist-data-collector, please visit [https://ncihub.org/groups/eedapstudies/].
14
15 The HTT project has been accepted as a project of the Truthing and Validation Workgroup of '''PIcc'''.
16 * PIcc is The Pathology Innovation Collaborative Community.
17 * PIcc is pronounced "Pie" CC.
18 * [https://www.digitalpathologyalliance.org/truthing-validation Link to the Truthing and Validation workgroup.]
19 * [https://www.fda.gov/about-fda/cdrh-strategic-priorities-and-updates/collaborative-communities-addressing-health-care-challenges-together Link to the FDA Collaborative Communities Program.]
20
21 The HTT project was also accepted as a project of the W.H.O. International Collaboration for Cancer Classification and Research (IC3R).
22 * The IC3R project is named PADEA (Pathologist Annotation Datasets for Evaluating Algorithms) to allow the effort to grow to other applications beyond TILs evaluation.
23 * [https://ic3r.iarc.who.int/projects/ Link to IC3R "Projects" page.]
24
25 To contact us with any questions or join our efforts: [HTTContacts Contact Us HERE]
26
27 ----
28 =Updates=
29
30 ==== October 2022 ====
31 * Brandon Gallas presented to the FDA Oncology Center of Excellence
32 * "Developing a dataset to validate computational models that analyze digital pathology images to assess tumor-infiltrating lymphocytes (TILs) in breast cancer"
33 * [https://ncihub.org/groups/eedapstudies/wiki/Presentation2022:FDAOCEWebinarValidatingModelsinDigitalPathology:OverviewofHTTProjectGallas Link to Recording and Slides]
34
35 ==== September 2022 ====
36 * Personal Celebrations! Project managers Victor Garcia, and Kate Elfer celebrated their weddings to their significant others!
37
38 ==== August 2022 ====
39 * Slides for our pivotal study have been received from Emory University and Stony Brook University and scanned with an Aperio AT2 DX (FDA-qualified WSI scanner)
40 * Brandon Gallas presented to the Pathology Innovation Collaborative Community a Webinar on "ROC and MRMC Tutorials"
41 * [https://ncihub.org/groups/eedapstudies/wiki/Presentation2022:PathologyInnovationCollaborativeCommunityWebinarROCandMRMCTutorialsGallas Link to Recordings, Slides, and Abstract]
42
43 * Brandon Gallas and Si Wen presented their work at the Joint Statistical Meeting:
44 * Brandon Gallas, "Exploring Pathologist-Pathologist Agreement as a Baseline for Algorithm-Pathologist Agreement"
45 * Si Wen, "Limits of Agreement for an MRMC Study"
46
47 ==== July 2022 ====
48
49 * '''Info Sharing''': One day, the public health emergency will be declared over. Here is guidance on what happens to devices that fall within pandemic enforcement policies, like WSI scanners: [https://www.fda.gov/regulatory-information/search-fda-guidance-documents/transition-plan-medical-devices-fall-within-enforcement-policies-issued-during-coronavirus-disease LINK]
50
51 * Open-Position: ORISE Fellow
52 * Victor Garcia, MD, is transitioning into an FDA/CDRH/DIDSR full-time staff fellow
53 * We therefore have an open ORISE Fellow position for the next year (starting 01 October 2022): Statistics and Informatics Support the Assessment of Artificial Intelligence and Machine Learning
54 * Actively recruiting now - please distribute! [[File(jobDescriptionDigitalPathologyAIML-20220617-2_1.pdf)]]
55
56 * '''Needed:''' We are looking for an FDA-cleared Scanner. We are targeting the the Aperio AT2 DX because it has a format that is open enough to be supported by several software tools and platforms.
57 * One batch of pivotal study slides are in our hands!
58
59 * Upcoming Presentations: American Statistical Association's Joint Statistical Meeting
60 * Session: Assessing Agreement and Reader Reliability in Medical Imaging Analysis (organized by Si Wen)
61 * August 7th, 2022 in Washington DC
62 * [https://ww2.amstat.org/meetings/jsm/2022/onlineprogram/ActivityDetails.cfm?SessionID=221988 Link to Session Info]
63 * Brandon will present "Exploring ​Pathologist-Pathologist Agreement​ as a Baseline for ​ Algorithm-Pathologist Agreement​"
64 * Si will present "Limits of Agreement for an MRMC Study"
65 *
66 * We hope to schedule a redux of the session to be hosted by PIcc.
67 * Published: Hongfei Du, Si Wen, Yufei Guo, Fang Jin, and Brandon D. Gallas, “Single reader between-cases AUC estimator with nested data,” Stat Methods Med Res, p. 9622802221111540, Jul. 2022, doi: [https://journals.sagepub.com/doi/10.1177/09622802221111539 10.1177/09622802221111539].
68
69 ==== June 2022 ====
70 * Re-Introduction: Phoebe Qian, ORISE Intern
71 *[https://ncihub.org/groups/httleadership/wiki/AdminCollaboratorPhoebeQian Please see Phoebe's Admin page]
72 * Phoebe is rising high school senior returning for her second summer with us!
73 * Phoebe is hunting for colleges for Fall 2023 with a focus on computer science