AI-Enhanced Subtyping of Thymic Tumors: Attention-based MIL with Pathology-Specific Feature Extraction - Kussaibi, Haitham (medRxiv, 2024)
Purpose The precise classification of thymic tumors using whole slide images (WSIs) is essential for accurate diagnosis and treatment. While traditional Convolutional Neural Networks (CNNs) are commonly used for this purpose, emerging models tailored to pathology, such as Phikon and HistoEncoder, present promising alternatives as feature extractors. Additionally, the limited availability of annotated WSIs has driven the development of weakly-supervised classifiers like multiple-instance learning (MIL) models. In this study, we evaluate nine different combinations of extractor-classifier pairs for thymic tumor subtyping, including a novel, self-developed attention-based MIL classifier, AttenMIL.Methods The process began with curating a dataset of thymic tumor Whole Slide Images (WSIs) from the TCGA platform. Using the Yottixel method, patches were derived from these WSIs, and features were extracted from the patches using three different pathology-specific models: Phikon, HistoEncoder, and a pathology-fine-tuned ResNet50. The extracted features were then organized into small bags of instances through a chunking technique. Subsequently, three MIL classifiers AttenMIL, TransMIL, and Chowder were trained. Finally, the efficacy and generalizability of nine different combinations of extractor-classifier pairs were evaluated on unseen test images. Confusion matrices for each pair were utilized to provide insights into misclassification patterns and potential error sources.Results The Phikon feature extractor consistently delivered the highest classification accuracies, particularly when paired with the AttenMIL and Chowder classifiers, achieving up to 99% accuracy. This combination significantly outperformed other feature extractor-classifier pairs. Confusion matrices revealed that the AB and B3 subtypes were the most commonly confused classes across the different models.Conclusions The study demonstrates the potential of domain-specific feature extractors like Phikon, when coupled with robust MIL classifiers such as the novel AttenMIL and Chowder, in enhancing the accuracy and reliability of thymic tumor classification. The chunking-based augmentation method proved effective for thymic tumors, which are relatively homogeneous, but its applicability to heterogeneous tumors remains to be explored. Future research should address class imbalances and improve generalizability to different datasets.Competing Interests The author has declared no competing interest.No funding was received for conducting this study.Declaration of generative AI and AI-assisted technologies in the writing process While preparing this work, the author used ChatGPT to improve language and readability. After using this tool/service, the author reviewed and edited the content as needed and took full responsibility for the publication’s content.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study did not receive any fundingAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced in the present study are available upon reasonable request to the author https://github.com/hkussaibi