Automated Classification of Fat-infiltrated Axillary Lymph Nodes on Screening Mammograms ======================================================================================== * Qingyuan Song * Roberta M. diFlorio-Alexander * Ryan T. Sieberg * Dennis Dwan * William Boyce * Kyle Stumetz * Sohum D. Patel * Margaret R. Karagas * Todd A. Mackenzie * Saeed Hassanpour ## Abstract **Objectives** Fat-infiltrated axillary lymph nodes (LNs) are unique sites for ectopic fat deposition. Early studies showed a strong correlation between fatty LNs and obesity-related diseases. Large-scale studies are needed to confirm these preliminary results but this is hampered by the scarcity of labeled data. With the long-term goal of developing a rapid and generalizable tool to aid data labeling, we developed an automated deep learning (DL)-based pipeline to classify the status of fatty LNs on screening mammograms. **Methods** Our internal dataset included 886 mammograms from a tertiary academic medical institution, with a binary status of the fat-infiltrated LNs based on the size and morphology of the largest visible axillary LN. A two-stage DL model training and fine-tuning pipeline was developed to classify the fat-infiltrated LN status using the internal training and development dataset. The model was evaluated on a held-out internal test set and a subset of the Digital Database for Screening Mammography. **Results** Our model achieved an accuracy of 0.97 (95% CI: 0.94-0.99) on 264 internal testing mammograms and an accuracy of 0.82 (95% CI: 0.77-0.86) on 70 external testing mammograms. The model successfully extracted meaningful LN-related features from the mammograms. **Conclusion** This study confirmed the feasibility of using a DL model for fat-infiltrated LN classification. The model provides a practical tool to identify fatty LNs on mammograms and to allow for future large-scale studies to evaluate the role of fatty LNs as an imaging biomarker of obesity-associated pathologies. **Advances in knowledge** Our study is the first to classify fatty LNs using an automated DL approach. ## Introduction Obesity is highly prevalent worldwide and is a substantial risk factor for increased morbidity and mortality from cardiovascular disease, cancer and other chronic diseases1–3. An increasing body of evidence shows that body mass index (BMI) > 30 kg/m2 is insufficient for determining the risk of obesity-related diseases4–6. In contrast, ectopic fat deposition within and around organs such as the visceral cavity, liver, and muscle is a better predictor of obesity-associated illness and can be quantified from medical imaging such as MRI and CT 4,7,8. Ongoing work suggests that axillary lymph nodes (LNs) are novel ectopic fatty depots associated with obesity-related disease9,10. However, annotated data in this domain are limited, and further large-scale studies are limited by the lack of an automated tool to annotate and characterize fat-infiltrated LNs. Benign, nonmetastatic LNs demonstrate variable size and morphology due to variable hilar fat deposition. On mammography, fat-infiltrated LNs have an expanded, lucent, fat-infiltrated hilum that enlarges the overall size of the LN, while normal axillary LNs are smaller and radiologically denser (**Figure 1**). Recent research has shown that fat-infiltrated axillary LNs identified on screening mammograms are highly linked to obesity11. A recent case□control study of 431 obese breast cancer patients further showed that patients with enlarged fat-infiltrated contralateral axillary LNs on breast MRI and mammography had a higher risk of ipsilateral breast cancer nodal metastases, independent of patients’ age, BMI, and tumor characteristics9. Another recent study reported a positive association between fat-infiltrated axillary LNs and the prevalence of type 2 diabetes (T2DM) in women with obesity, independent of age and BMI, and confirmed that fat-infiltrated LNs are more commonly seen in women with obesity10. A smaller study recently reported a decrease in serum lipids in obese women who had a reduction in the size of fatty nodes after bariatric surgery, raising the possibility that fatty LNs are a modifiable risk factor for cardiometabolic disease among people with obesity12. These studies highlight the potential clinical importance of mammographically detected fat-infiltrated axillary LNs as a novel imaging biomarker of an advanced breast cancer status and cardiometabolic disease among women with obesity. ![Figure 1.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/09/21/2022.09.20.22280111/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/F1) Figure 1. Screening mammogram of a female (70’s) with benign variable LN morphology. **a)** Full-field mediolateral oblique (MLO) view of the right breast and **b)** magnified view of the right axilla demonstrates two adjacent LNs with differences in central lucency and size and morphology (A: 28 mm versus B: 3 mm) secondary to variable degrees of fat expansion of the LN hilum. We recorded the status as a benign fat-infiltrated LN based on the largest longitudinal axis of the largest visible axillary LN. Axillary LNs are visualized on approximately 50%-80% of digital screening mammograms11,13. Standard clinical mammographic imaging interpretation includes the evaluation of the axilla for abnormal LNs that may indicate a malignant process. However, fat-infiltrated LNs are considered benign normal variants that do not require further evaluation, measurement, or analysis. In the studies mentioned above, the measurement and classification of axillary LNs were obtained manually and confirmed by multiple radiology experts9,11,14. The manual assessment procedure is not only time-consuming and laborious but can also result in interobserver inconsistencies. Previous studies have reported variable interrater agreement for the classification of axillary LNs, with Pearson correlation coefficients ranging from 0.64 to 0.95, suggesting that the reader agreement can be improved9,11,12. An automated pipeline is required to standardize the labeling process and speed up the assessment of the fat-infiltrated LN status on breast images in bulk for future large-scale studies to further explore the potential of fat-infiltrated LNs as imaging biomarkers of obesity associated diseases. In recent years, deep learning (DL) models such as convolutional neural networks (CNNs) have been utilized for medical image analysis and demonstrated their usefulness in various clinical tasks15–17. CNN approaches can bypass the laborious manual feature extraction steps and directly operate on the input images by learning the indicative patterns for the classification and characterization of the images. Additionally, CNN models that have been pretrained on vast image datasets and have learned feature extraction on generic images can be subsequently fine-tuned to attain expertise-level performance on medical image datasets that are usually much smaller18,19. In this paper, we aim to investigate the feasibility of employing DL models for fat-infiltrated LN assessments on screening mammograms, with the long-term goal of establishing an automated, end-to-end fat-infiltrated LN classifier for future studies. The purpose of this study is to lay the groundwork for future research investigating fat-infiltrated LNs as potential imaging biomarkers of obesity-related pathologies. To the best of our knowledge, this is the first attempt to use a DL technique to automatically evaluate the status of fat-infiltrated LNs on screening mammography. ## Methods ### Data Source for Model Development This study, and the usage of human participant data in this project, were approved by the Institutional Review Board (IRB) with a waiver of informed consent. The internal dataset used for this study included 886 full-field digital screening mammogram (FFDM) mediolateral oblique (MLO) views with detectable axillary LNs collected through a retrospective review of screening mammograms over an 8-month period at a tertiary care academic medical facility. The detailed data collection process is described in a previous study10. In brief, the largest visible axillary LN on the left or right MLO view was measured and labeled, with a final assessment achieved via a consensus review between two radiology reviewers9. The images were labeled as positive samples if they contained a fat-infiltrated LN larger than 18 mm and with a fat-infiltrated LN morphology, or as negative samples if smaller than or equal to 18mm. The dataset yielded 416 positive samples and 470 negative samples. ### Image Preprocessing and Internal Dataset Construction The mammograms were received in the standard Digital Imaging and Communications in Medicine (DICOM) format and came in various orientations and sizes. Images were converted to JPEG format before applying the preprocessing workflow implemented in Python (version 3.8). We first identified and applied a binary mask using the largest contour of the breast and removed all text markers and noise outside of the contour of the breast. Through visual inspection of the mammograms, we found that a region of 1500×1500 pixels in the axillary region of the mammogram was sufficient to cover all the axillary LNs. Therefore, a 1500×1500-pixel patch in the axillary region of each image was extracted and used to construct the initial dataset for model development. ### Oversampling of Nonaxillary Patches The axillary region of mammograms contains radiographic densities that are unrelated to the imaging characteristics of the axillary LNs. These densities, including but not limited to breast tissue, vessels, muscle, skin folds, fibro-glandular tissue and radiographic densities that are also present in the non-axillary portion of the mammogram. To help the model better distinguish the LNs from non-nodal radiographic densities, we sampled patches from nonaxillary regions of the breast and used them as additional negative samples. We implemented a sliding-window approach to sample additional 1500×1500 pixel images outside the axillary region, with a step size of 750 pixels, as illustrated in Figure 2. These additional nonaxillary patches were combined into the negative samples of the initial dataset. ![Figure 2.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/09/21/2022.09.20.22280111/F2.medium.gif) [Figure 2.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/F2) Figure 2. Automated image processing and dataset construction. A patch was extracted from the upper outer corner of the MLO view and used as the axillary patch during the model training and hyperparameter tuning stage. Additional patches were extracted by a sliding window approach from the nonaxillary region and added to the negative samples in the model-finetuning stage. Finally, we randomly split the dataset into a 70% training set, a 10% development set for hyperparameter tuning, and a 20% testing set. **Table 1** shows the class distribution of the initial dataset’s training, development and testing sets, and the oversampled larger dataset that included the nonaxillary patches. View this table: [Table 1.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/T1) Table 1. The distribution of mammograms in the training, development and test sets. ### Model Training The model training was conducted in two stages, a model training and selection stage, followed by a model-finetuning stage. In the first stage, various CNN models were trained on the smaller dataset with only axillary patches to select the best-performing model architecture and hyperparameter settings. We experimented with several well-established CNN architectures, including VGG1620, ResNet1821 and DenseNet12122, with initial weights pretrained on the ImageNet dataset23. Kaiming weight initialization24was used for the binary output fully connected layer. Hyperparameters, including batch size (8 or 16) and initial learning rate (1 × 10−4, 5 × 10−5, or 2.5 × 10−5), were selected by a grid search to optimize the cross-entropy loss. The model with the lowest loss on the development set was selected for the fine-tuning stage. In the second stage, the pretrained model chosen from the previous stage was further fine-tuned on a larger training dataset that included the oversampled negative patches using the best hyperparameters selected from the first stage. In both stages, the model parameters were optimized using the ADAM optimizer25 with a step learning rate decay of 0.5 every 15 epochs throughout the training. The training ended when the development set loss did not show improvement for 30 consecutive epochs. Before training, grayscale image patches were resized to 224×224 pixels and converted to 3-channel images by repeating it three times to fit into the pretrained model that operates on RGB images. Images were standardized to have a mean of zero and a standard deviation of one. To expand the training data’s size and improve the model’s generalizability, we used data augmentation on the training data, including random 90-degree rotation, random horizontal and vertical flipping, sharpening, noise addition, and contrast variation. The details of data preprocessing and augmentation implementation are described in **Supplementary Material S1**. The model training process was conducted on NVIDIA Titan Xp graphical processing units (GPUs) with 12 GB of memory and was implemented using the PyTorch framework26. ### Internal Model Evaluation and Visualization We evaluated the performance of the final model on the test set by calculating the accuracy, sensitivity, specificity, precision, sensitivity and F1 score. Confidence intervals were calculated with 10,000 bootstrap resampling. We also plotted the receiver operating characteristic (ROC) curve and calculated the area under the curve (AUC). To address the interpretability of our DL model, we generated the visualization of our model outcome on the images using Gradient-weighted Class Activation Mapping (GradCAM)27. The resulting heatmaps highlighted the most indicative region of the images based on the region’s influence on the model’s prediction outcome. ### External Validation To assess the generalizability of our model, we evaluated it on images from the Curated Breast Imaging Subset of the Digital Database for Screening Mammography (CBIS-DDSM). This dataset contains scanned film mammography studies in DICOM format. From the dataset, 110 normal mammograms without any abnormalities (Breast Imaging Reporting and Data System (BI-RADS) category 1) and with visible axillary LNs were sampled as the external test set for this study. A breast radiologist, and a graduate student with four years of experience in FIN radiology, independently reviewed the cases and labeled them as fat-infiltrated or normal. Due to the loss of pixel spacing information in this dataset, the size of the LN could not be measured directly from the mammograms. Therefore, an LN was labeled fat-infiltrated if it displayed a fat-infiltrated LN morphology with an expanded fatty hilum relative to the surrounding nodal cortex as previously described. Cases with disagreement were further discussed, and a final classification was determined by consensus between the two readers. Cases with low visibility due to multiple overlapping nodes were removed from this external test set. The review yielded 35 cases with fat-infiltrated LNs, and 35 cases with normal axillary nodes, to construct a balanced dataset. We evaluated our model on the labeled external data and visualized the model decision with GradCAM. ## Results ### Model Performance on the Internal Dataset During stage 1 of training, the ResNet18 model outperformed the other two architectures with a testing accuracy of 0.94 with 15 false predictions out of 264 testing samples (**Table 2a**). Therefore, the ResNet18 model was chosen for further fine-tuning. The model performance was improved by fine-tuning the model on the oversampled negative patches from the nonaxillary region with a testing accuracy of 0.97 on the axillary patches. The final hyperparameters for each model, based on our parameter tuning on the development set, are shown in **Supplementary Table 1**, and the comparison of the Stage 1 model performance is included in **Supplementary Figure 1**. The visualization of the model’s outcome highlighted by the GradCAM heatmap (**Figure 3**) indicated that the model considered the contributing features of both fat-infiltrated and normal LNs in its decision-making. In addition, the model correctly classified the cases as fat-infiltrated, when both the fat-infiltrated and normal LNs were present on the mammograms, by focusing on only the regions of the fat-infiltrated node **(Figure 3b)**. ![Figure 3.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/09/21/2022.09.20.22280111/F3.medium.gif) [Figure 3.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/F3) Figure 3. Examples of Grad-CAM visualization. Red highlights the areas that highly influenced the model’s outcome, while blue indicates regions considered unimportant to the predictions by the model. The original grayscale images are shown on the side for reference. View this table: [Table 2.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/T2) Table 2. Summary of the Evaluation Metrics of Best-performed Models on the Internal Test Set with 95% Confidence Intervals. Of note, although the best-performing model from Stage 1 of training achieved a satisfactory classification performance on the axillary patches, the model was prone to make false predictions by misclassifying features unrelated to fat-infiltrated LNs. Through visual inspection and analysis of the model errors, we found that false-positives were caused by misinterpretation of an adjacent dense vessel as an LN cortex or mischaracterization of small normal LNs grouped around central subcutaneous fat as a single larger node with expanded hilar fat. The false negative classifications were due to the model failing to localize the LN due to dense muscle or breast tissue, or when the model focused only on the normal LNs when a mixture of normal and fat-infiltrated LNs was present. An example visualization of the errors is shown in **Supplementary Figure 2**. The errors from the Stage 1 Resnet18 model were more prominent when applying the model to the oversampled test set (**Table 2b**). The model yielded more false-positive classifications by mistakenly classifying breast tissue and vessels as fat-infiltrated LNs. After fine-tuning the model with oversampled negative patches, the errors were significantly reduced (**Table 2b**), and the AU-ROC was improved to 1.00 (**Figure 4**). ![Figure 4.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/09/21/2022.09.20.22280111/F4.medium.gif) [Figure 4.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/F4) Figure 4. Stage 2 model AU-ROC and examples of improved model predictions. a) The AU-ROC of the Stage 2 model improved to 1.00. b) Two cases illustrate the improved final model performance. In Case 1, the final model correctly localized the axillary region, which the Stage 1 model failed to. In Case 2, the final model more accurately highlighted the entire fat-infiltrated LN, while the Stage 1 model only highlighted part of the node. ### Model Performance on External Validation On the external dataset, the Pearson correlation between the independent labels of the two reviewers was 0.61 (p value 0.001). Using the consensus labels of the external data, our model achieved an accuracy of 0.82 (95% CI: 0.77-0.86) and an AUROC of 0.87 (95% CI: 0.82-0.91) (**Table 3**), and the visualization of model performance on the external data is shown in **Figure 5**. Overall, the model identified most of the cases with fat-infiltrated nodes (sensitivity: 0.92, 95% CI: 0.87-0.96). False negatives resulted from failing to identify the fat-infiltrated LN from the background muscle due to low contrast (**Figure 5c**). The model resulted in more false-positives on the external dataset than on the internal dataset. The false-positives were mostly due to misclassifying a cluster of multiple normal nodes or surrounding vessels as fat-infiltrated nodes (**Figure 5d-f**). ![Figure 5.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/09/21/2022.09.20.22280111/F5.medium.gif) [Figure 5.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/F5) Figure 5. Visualization of model performance and error analysis on the external DDSM dataset. a) Confusion matrix of model classification. b) ROC curve of model prediction. c) A false negative classification resulted from misidentifying the fat-infiltrated LN (arrow-pointed) due to a low contrast from the background and focusing only on the normal node. d) A false-positive case possibly related to the overlying pectoralis muscle and a small node with a lucent center (arrow-pointed). The highlighted node has a lucent center with a normal size relative to the surrounding normal node. e) A false-positive case due to misclassification of multiple normal nodes with space in between as fat infiltrated (arrow-pointed). f) Misclassification of vessels (arrow-pointed) as fat-infiltrated nodes. View this table: [Table 3.](http://medrxiv.org/content/early/2022/09/21/2022.09.20.22280111/T3) Table 3. Model Performance on the External Dataset ## Discussion Emerging evidence shows that fat-infiltrated axillary LNs identified in breast imaging studies are associated with obesity and obesity-related pathology. These findings suggest that expanded lymph node hilar fat may represent ectopic fat deposition within the immune-lymphatic system. Large-scale studies are needed to confirm axillary fatty nodes as a potential imaging biomarker of obesity-associated illness among patients. Due to the time-intensive nature of manual lymph node evaluation, a machine learning technique that can automatically identify and classify fatty nodes in large datasets is needed to enable further investigation of the role of ectopic fat deposition within the immune-lymphatic system. In this study, we developed an automated end-to-end DL-based pipeline, from image preprocessing to the classification of the fat-infiltrated axillary LN status, from digital screening mammography without manual annotation of the LNs. Our model achieved an accuracy of 0.97 and a 1.00 AU-ROC in classifying the LN status of an independent internal test dataset. The model’s accuracy and AU-ROC on the external dataset are 0.82 and 0.87, respectively. The model was capable of discriminating LN features from other imaging features with similar radiographic density, including breast tissue, pectoralis muscle, skin folds, and vessels. The model benefited from fine-tuning on oversampled training patches from regions containing these lookalike features. Therefore, this automated approach can categorize the status of fat-infiltrated LNs in digital mammograms in bulk with minimal manual intervention and provide a critically needed tool for further research of fat-infiltrated LNs and their association with obesity-related diseases. Screening mammography is widely used as a primary tool for early breast cancer detection and has a high utilization among age-eligible females in the United States28. Digital imaging studies contain information that is unrelated to the study indication but may be used for patient risk stratification and prediction of future adverse health events. Consideration of these incidental imaging features is referred to as opportunistic imaging. Recent studies have revealed that the added value of opportunistic imaging can improve disease screening and benefit patient care29. For example, studies have reported that breast arterial calcification (BAC) detected by mammography screening could be a risk marker for coronary artery disease30–32. As a result, many computational approaches have been developed to automatically detect BACs from screening mammography33,34. Our automated approach for classifying fat-infiltrated LNs is needed to perform additional studies and determine whether fatty nodes may similarly add extra value to mammography screening as a risk marker for obesity-related disorders. To date, only a few modest studies have looked at fat-infiltrated LNs visualized on screening mammography. There remains a need for a rapid and generalizable tool to assess the status of fat-infiltrated axillary LNs for future studies. To our knowledge, our study is the first to analyze fat-infiltrated axillary LNs using an automated DL approach. In previous studies, human-extracted features, including expanded hilar fat morphology, hilar and cortical dimensions, and overall LN size, were manually assessed by multiple radiologists9,11,14. The measurement and assessment of fat-infiltrated LNs are not readily available in any existing dataset and are resource intensive and time-consuming to collect in bulk. Our end-to-end DL approach has the advantage of automatically learning and extracting radiomic feature representations related to fat-infiltrated LNs directly from mammography images and providing consistent and accurate outcomes on new images. Our model bypasses the manual feature engineering step and requires minimal preprocessing steps, thereby significantly reducing individual bias and the time needed to measure and evaluate the LN status on images. Machine-extracted LN radiomic features can capture objective and detailed morphological and textual characteristics that may not be detectable by visual analysis. These radiomic features can aid image interpretation and provide insight into fat-infiltrated LNs and their disease association in future studies35,36. Our model successfully captured the features relevant to the axillary LNs in almost all cases that were verified by GradCAM visualizations, and generated the proper classification on our test sets. The high sensitivity of 0.92 of our model on the subset of the external CBIS-DDSM dataset confirmed the model’s utility in classifying fat-infiltrated LNs on mammograms from an unseen data distribution. There are several possible explanations for the reduced overall model performance on the external data compared to the internal dataset. DDSM is a collection of digitized analog film-screen mammograms first released in 1997. Due to the inherently low contrast resolution of film screen mammography compared to digital mammography, axillary LNs were more challenging to characterize on the external dataset37. Second, the CBIS-DDSM data contain no pixel spacing information and therefore did not allow for an LN measurement as a feature of fat-infiltrated LNs. The labeling of the external dataset relied on the LN morphology without consideration of the LN size and was therefore less informative and more error-prone than the internal dataset. However, our model performed well in characterizing axillary LNs as fatty on the consensus labels of the external dataset using only morphologic criteria. Nonetheless, CBIS-DDSM is currently the only public dataset with a sufficient number of digitized full-field mammograms for external validation. Our model should be re-evaluated when additional digital mammography datasets become publicly available. The results of this study must be considered with a few limitations. First, all mammography exams used for model development were obtained from a single medical center. Our pipeline with a fixed-sized crop of the axilla worked well in capturing the axillary LNs within a uniform image dataset; however, due to variations in scanning procedures and equipment, the same setting may not work for mammograms acquired from other institutions. Further training and validation of our model on larger datasets across multiple institutions would improve the generalizability of our approach. Therefore, we plan to further validate our model on additional data from external collaborators. Second, our model coarsely localized LNs based on image-level labels and still generated false-positive classifications in cases where multiple normal LNs overlapped and formed a cluster around subcutaneous fat. The model may benefit from segmentation approaches, such as U-Net38, to identify individual LNs if detailed pixel-level annotations become available. Last, our model was designed to classify the binary status of LNs as normal versus fat-infiltrated, and the size cutoff between the two classes was selected based on the evidence and previous findings in this domain9. In future work, we plan to expand the model to provide a more fine-grained classification of fat-infiltrated LNs, including the degree of hilar fat expansion and the number of fat-expanded LNs. We also plan to extend our study to examine the potential associations between fat-infiltrated LN-related features and breast cancer outcomes, and evaluate the model’s viability as a potential risk stratification tool for obesity and other obesity-related diseases. In summary, our study demonstrated a promising performance of a DL model developed to classify mammographically visualized axillary lymph nodes. The model achieved a high performance on both internal and external test sets. This approach can enable further investigation of the role of fat-infiltrated axillary nodes in obesity-associated deaths. ## Supporting information Supplementary [[supplements/280111_file08.docx]](pending:yes) ## Data Availability A de-identified version of the data and the source code for this analysis can be shared with interested researchers upon reasonable request. ## Funding This research was supported in part by grants from the US National Institute of Health (R01CA249758, R01LM012837, P20GM104416). ## Competing Interests The authors declare no competing interests. * Received September 20, 2022. * Revision received September 20, 2022. * Accepted September 21, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Pi-Sunyer X. The Medical Risks of Obesity. Postgrad Med. 2009;121(6):21–33. doi:10.3810/pgm.2009.11.2074 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3810/pgm.2009.11.2074&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19940414&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 2. 2.Avgerinos KI, Spyrou N, Mantzoros CS, Dalamaga M. Obesity and cancer risk: Emerging biological mechanisms and perspectives. Metabolism. 2019;92:121–135. doi:10.1016/j.metabol.2018.11.001 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/J.METABOL.2018.11.001&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 3. 3.Powell-Wiley TM, Poirier P, Burke LE, et al. Obesity and Cardiovascular Disease: A Scientific Statement From the American Heart Association. Circulation. 2021;143(21):e984–e1010. doi:10.1161/CIR.0000000000000973 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1161/CIR.0000000000000973&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 4. 4.Ferrara D, Montecucco F, Dallegri F, Carbone F. Impact of different ectopic fat depots on cardiovascular and metabolic diseases. Journal of Cellular Physiology. 2019;234(12):21630–21641. doi:10.1002/jcp.28821 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/jcp.28821&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 5. 5.Chooi YC, Ding C, Magkos F. The epidemiology of obesity. Metabolism. 2019;92:6–10. doi:10.1016/j.metabol.2018.09.005 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.metabol.2018.09.005&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 6. 6.Milić S, Lulić D, Štimac D. Non-alcoholic fatty liver disease and obesity: Biochemical, metabolic and clinical presentations. World J Gastroenterol. 2014;20(28):9330–9337. doi:10.3748/wjg.v20.i28.9330 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3748/wjg.v20.i28.9330&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25071327&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 7. 7.Britton KA, Fox CS. Ectopic Fat Depots and Cardiovascular Disease. Circulation. 2011;124(24):e837–e841. doi:10.1161/CIRCULATIONAHA.111.077602 [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6ImNpcmN1bGF0aW9uYWhhIjtzOjU6InJlc2lkIjtzOjExOiIxMjQvMjQvZTgzNyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIyLzA5LzIxLzIwMjIuMDkuMjAuMjIyODAxMTEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 8. 8.Neeland IJ, Ross R, Després JP, et al. Visceral and ectopic fat, atherosclerosis, and cardiometabolic disease: a position statement. The Lancet Diabetes & Endocrinology. 2019;7(9):715–725. doi:10.1016/S2213-8587(19)30084-1 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S2213-8587(19)30084-1&link_type=DOI) 9. 9.diFlorio-Alexander RM, Song Q, Dwan D, et al. Fat-enlarged axillary lymph nodes are associated with node-positive breast cancer in obese patients. Breast Cancer Res Treat. Published online June 3, 2021. doi:10.1007/s10549-021-06262-z [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10549-021-06262-z&link_type=DOI) 10. 10.Song Q, diFlorio-Alexander RM, Patel SD, et al. Association between fat-infiltrated axillary lymph nodes on screening mammography and cardiometabolic disease. Obesity Science & Practice. n/a(n/a). doi:10.1002/osp4.608 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/osp4.608&link_type=DOI) 11. 11.diFlorio Alexander RM, Haider SJ, MacKenzie T, Goodrich ME, Weiss J, Onega T. Correlation between obesity and fat-infiltrated axillary lymph nodes visualized on mammography. Br J Radiol. 2018;91(1089):20170110. doi:10.1259/bjr.20170110 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1259/bjr.20170110&link_type=DOI) 12. 12.Dwan D, Ramin SK, Chen Y, Muller KE, diFlorio-Alexander RM. Decrease in the Size of Fat-Enlarged Axillary Lymph Nodes and Serum Lipids after Bariatric Surgery. Cells. 2022;11(3):482. doi:10.3390/cells11030482 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/cells11030482&link_type=DOI) 13. 13.Chang JM, Leung JWT, Moy L, Ha SM, Moon WK. Axillary nodal evaluation in breast cancer: state of the art. Radiology. 2020;295(3):500–515. doi:10.1148/radiol.2020192534 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1148/radiol.2020192534&link_type=DOI) 14. 14.Keshavarz E, Ahangaran A, Pouya EK, Maheronnaghsh R, Chavoshi M, Rouzrokh P. Effects of Obesity on Axillary Lymph Node Structure: Association of Hilar Fat Deposition and Alterations in Cortex Width. Maedica (Bucur). 2020;15(1):99–104. doi:10.26574/maedica.2020.15.1.99 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.26574/maedica.2020.15.1.99&link_type=DOI) 15. 15.Yala A, Lehman C, Schuster T, Portnoi T, Barzilay R. A Deep Learning Mammography-based Model for Improved Breast Cancer Risk Prediction. Radiology. 2019;292(1):60–66. doi:10.1148/radiol.2019182716 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1148/radiol.2019182716&link_type=DOI) 16. 16.Tomita N, Cheung YY, Hassanpour S. Deep neural networks for automatic detection of osteoporotic vertebral fractures on CT scans. Computers in Biology and Medicine. 2018;98:8–15. doi:10.1016/j.compbiomed.2018.05.011 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.compbiomed.2018.05.011&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29758455&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 17. 17.Jiang S, Tomita N, Hassanpour S. Automatic Brain Lesion Segmentation on MRI Images using a 3D Convolutional Neural Network. In: ; 2019. 18. 18.Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C. A Survey on Deep Transfer Learning. arxiv:180801974 [cs, stat]. Published online August 6, 2018. Accessed March 3, 2021. [http://arxiv.org/abs/1808.01974](http://arxiv.org/abs/1808.01974) 19. 19.Pan SJ, Yang Q. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering. 2010;22(10):1345–1359. doi:10.1109/TKDE.2009.191 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/TKDE.2009.191&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000281000500001&link_type=ISI) 20. 20.Simonyan K, Zisserman A. Very Deep Convolutional Networks for Large-Scale Image Recognition. arxiv:14091556 [cs]. Published online April 10, 2015. Accessed March 3, 2021. [http://arxiv.org/abs/1409.1556](http://arxiv.org/abs/1409.1556) 21. 21.He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition. arxiv:151203385 [cs]. Published online December 10, 2015. Accessed March 3, 2021. [http://arxiv.org/abs/1512.03385](http://arxiv.org/abs/1512.03385) 22. 22.Huang G, Liu Z, Maaten LVD, Weinberger KQ. Densely Connected Convolutional Networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). ; 2017:2261–2269. doi:10.1109/CVPR.2017.243 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/CVPR.2017.243&link_type=DOI) 23. 23.Deng J, Dong W, Socher R, Li L, Kai Li, Li Fei-Fei. ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition. ; 2009:248–255. doi:10.1109/CVPR.2009.5206848 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/CVPR.2009.5206848&link_type=DOI) 24. 24.He K, Zhang X, Ren S, Sun J. Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. arxiv:150201852 [cs]. Published online February 6, 2015. Accessed March 3, 2021. [http://arxiv.org/abs/1502.01852](http://arxiv.org/abs/1502.01852) 25. 25.Kingma DP, Ba J. Adam: A Method for Stochastic Optimization. arxiv:14126980 [cs]. Published online January 29, 2017. Accessed March 3, 2021. [http://arxiv.org/abs/1412.6980](http://arxiv.org/abs/1412.6980) 26. 26.Paszke A, Gross S, Massa F, et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. arxiv:191201703 [cs, stat]. Published online December 3, 2019. Accessed March 3, 2021. [http://arxiv.org/abs/1912.01703](http://arxiv.org/abs/1912.01703) 27. 27.Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization. Int J Comput Vis. Published online October 11, 2019. doi:10.1007/s11263-019-01228-7 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11263-019-01228-7&link_type=DOI) 28. 28.Street W. Breast Cancer Facts & Figures 2019-2020. :44. 29. 29.Boutin RD, Lenchik L. Value-Added Opportunistic CT: Insights Into Osteoporosis and Sarcopenia. AJR Am J Roentgenol. 2020;215(3):582–594. doi:10.2214/AJR.20.22874 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2214/AJR.20.22874&link_type=DOI) 30. 30.Rotter MA, Schnatz PF, Currier AA, O’Sullivan DM. Breast arterial calcifications (BACs) found on screening mammography and their association with cardiovascular disease. Menopause. 2008;15(2):276–281. doi:10.1097/gme.0b013e3181405d0a [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/gme.0b013e3181405d0a&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17917612&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 31. 31.Suh JW, Yun BL. Breast Arterial Calcification: A Potential Surrogate Marker for Cardiovascular Disease. J Cardiovasc Imaging. 2018;26(3):125–134. doi:10.4250/jcvi.2018.26.e20 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4250/jcvi.2018.26.e20&link_type=DOI) 32. 32.McLenachan S, Camilleri F, Smith M, Newby DE, Williams MC. Breast arterial calcification on mammography and risk of coronary artery disease: a SCOT-HEART sub-study. Clin Radiol. 2019;74(6):421–428. doi:10.1016/j.crad.2019.01.014 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.crad.2019.01.014&link_type=DOI) 33. 33.Wang J, Ding H, Bidgoli FA, et al. Detecting Cardiovascular Disease from Mammograms With Deep Learning. IEEE Trans Med Imaging. 2017;36(5):1172–1181. doi:10.1109/TMI.2017.2655486 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/TMI.2017.2655486&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28113340&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 34. 34.AlGhamdi M, Abdel-Mottaleb M, Collado-Mesa F. DU-Net: Convolutional Network for the Detection of Arterial Calcifications in Mammograms. IEEE Trans Med Imaging. 2020;39(10):3240–3249. doi:10.1109/TMI.2020.2989737 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/TMI.2020.2989737&link_type=DOI) 35. 35.Liu Y, Xu X, Li F. Image Feature Matching Based on Deep Learning. In: 2018 IEEE 4th International Conference on Computer and Communications (ICCC). ; 2018:1752–1756. doi:10.1109/CompComm.2018.8780936 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/CompComm.2018.8780936&link_type=DOI) 36. 36.Zhang Z, Lee WS. Deep Graphical Feature Learning for the Feature Matching Problem. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE; 2019:5086–5095. doi:10.1109/ICCV.2019.00519 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/ICCV.2019.00519&link_type=DOI) 37. 37.Faridah Y. Digital versus screen film mammography: a clinical comparison. Biomed Imaging Interv J. 2008;4(4):e31. doi:10.2349/biij.4.4.e31 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2349/biij.4.4.e31&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21611016&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F21%2F2022.09.20.22280111.atom) 38. 38.Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. arxiv:150504597 [cs]. Published online May 18, 2015. Accessed June 22, 2021. [http://arxiv.org/abs/1505.04597](http://arxiv.org/abs/1505.04597)