Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Multi-omics biomarker selection and outlier detection across WHO glioma classifications via robust sparse multinomial regression

View ORCID ProfileJoão F. Carrilho, View ORCID ProfileRoberta Coletti, View ORCID ProfileBruno M. Costa, View ORCID ProfileMarta B. Lopes
doi: https://doi.org/10.1101/2024.08.26.24312601
João F. Carrilho
1Center for Mathematics and Applications (NOVA Math), NOVA School of Science and Technology, Caparica, Portugal
2Department of Mathematics, NOVA School of Science and Technology, Caparica, Portugal
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for João F. Carrilho
  • For correspondence: jf.carrilho{at}campus.fct.unl.pt marta.lopes{at}fct.unl.pt
Roberta Coletti
1Center for Mathematics and Applications (NOVA Math), NOVA School of Science and Technology, Caparica, Portugal
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Roberta Coletti
Bruno M. Costa
3ICVS/3B’s—PT Government Associate Laboratory, Braga/Guimarães, Portugal
4Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Campus Gualtar, Braga, 4710-057, State, Portugal
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Bruno M. Costa
Marta B. Lopes
1Center for Mathematics and Applications (NOVA Math), NOVA School of Science and Technology, Caparica, Portugal
2Department of Mathematics, NOVA School of Science and Technology, Caparica, Portugal
5UNIDEMI, Department of Mechanical and Industrial Engineering, NOVA School of Science and Technology, Caparica, Portugal
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Marta B. Lopes
  • For correspondence: jf.carrilho{at}campus.fct.unl.pt marta.lopes{at}fct.unl.pt
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Gliomas are aggressive brain tumors difficult to treat mostly due to their large molecular heterogeneity. This requires continuous improvement in the molecular characterization of the glioma types to identify potential therapeutic targets. Advances in glioma research are rapidly evolving, contributing to the updates of the WHO classification of tumors. Data analysis of multiple omics layers through classification and feature selection methods holds promise in identifying crucial molecular features for distinguishing between glioma types. We developed a robust and sparse classification workflow based on multinomial logistic regression to investigate the molecular landscape of gliomas. We considered transcriptomics and methylomics glioma profiles of patients labeled following the latest WHO glioma classification updates (2016 and 2021). Overall, our results show a notable improvement in glioma types separability for the 2021 WHO updated patient labels at both omics levels. Patients flagged as outliers for the 2016 WHO classification exhibited a molecular profile deviating from the one of the respective classes, which was more aligned with the current associated glioma type according to the 2021 WHO update. The methylomics profiles were particularly promising in the identification of outliers. These contributions will support further revisions of glioma molecular characterization and the development of novel targeted therapies.

1 Introduction

Gliomas are tumors that arise from the glial or progenitor cells of the Central Nervous System (CNS), being the main class of tumors of the brain and spinal cord. Over the past few decades, there has been extensive research in the field of biology focused on gliomas, which led to a rapidly evolving understanding of this class of tumors and histological subclasses at molecular levels. This evolving process has caused the World Health Organization (WHO) classification of gliomas to alter over time [1–3], as the advances in scientific research bring new intuitions into tumor inhabitation, ontogeny, and progression.

The status of isocitrate dehydrogenase (IDH) gene family, along with the combined loss of the short arm of chromosome 1 and the long arm of chromosome 19 (1p/19q co-deletion), has been included into the guidelines for the WHO Classification of Tumors of the CNS in 2016 [2]. Consequently, astrocytoma and glioblastoma samples were further defined by their molecular characteristics, categorized as “IDH mutant” or “IDH wild-type”, coherently with the IDH status. Accordingly, the oligodendroglioma subtype was also molecularly defined, associating it with the joint presence of IDH mutation and 1p/19q co-deletion. Oligoastrocytoma samples according to the 2007 guidelines [1], i.e., gliomas characterized by mixed glial cells, were mostly reassigned to oligodendroglioma or astrocytoma, based on the status of the IDH mutation and presence or absence of 1p/19q co-deletion, respectively.

The latest WHO Classification of Tumors of the CNS, published in 2021 (2021-WHO) [3], emphasizes the relevance of molecular alterations in glioma classification. In adult-type gliomas, IDH testing is used as the separation factor between GBM and lower-grade glioma (LGG), namely astrocytoma and oligodendroglioma. Specifically, GBM is assigned in the presence of IDH wild-type coupled with certain molecular or histological features. On the other hand, if a sample exhibits IDH mutations, it is considered oligodendroglioma if chromosomes 1p and 19q are co-deleted, and astrocytoma otherwise.

The update of the classification guidelines is due to the advances in sequencing technologies that generate omics information. The implementation of machine learning algorithms to analyze omics data has revealed great potential, producing accurate results while effectively handling the molecular heterogeneity of tumors and the high dimensionality of omics data [4]. Feature selection techniques are essential for reducing the dataset dimension to a subset of representative features. This not only prevents overfitting but also aids in identifying relevant features related to tumor evolution. A state-of-the-art approach is feature selection via model regularization. This implies adding a penalty term in the model objective function which encourages sparsity in the model feature space. The elastic net regularizer [5] combines both ℓ1 (lasso) and ℓ2 (Ridge) regularization, being particularly suitable for omics studies where high-dimensional datasets are generated and many irrelevant features might be present.

Classification tasks have the goal of estimating the sample category based on their characteristics and similarities with others assigned to the same label. Many examples demonstrate the great potentiality of such methods in the context of glioma, or cancer in general. Multinomial logistic regression (MLR) was applied to glioma clinical and single nucleotide polymorphism data from the Mayo Clinic to classify patients regarding molecular subtypes (IDH wild-type, IDH mutant 1p/19q non-codeleted and IDH mutant 1p/19q codeleted), returning relevant results to enhance understanding of gliomas [6]. Sparse MLR with the elastic net penalty (SMLR) was applied to breast cancer miRNA data to find biomarkers with great prognostic potential regarding breast cancer subtypes, achieving good accuracy results [7]. In the same publication, six machine learning methods (MLR, MLR with the lasso or the ridge penalties, Support Vector Machines, and Random Forest) were applied to the reduced dataset composed of the biomarkers selected by SMLR for classification tasks, obtaining good classification accuracy values [7].

Biological datasets often contain outliers, observations that may stem from errors in sample labeling or atypical characteristics relative to their assigned group. Classical models may fail to identify outlying samples, leading to suboptimal solutions and reduced model accuracy. To mitigate variance caused by outliers, some authors suggest robust adaptations of statistical learning methods that allow the algorithm to handle and flag outlying samples. A common approach to robustness in linear and logistic regression models to high-dimensional datasets is the Least Trimmed Squares (LTS) estimator [8–10], which evaluates the error function at several subsets of samples and flags the ones out of the optimal subset as outliers. Segaert et al. [11] and Carrilho and Lopes [12] combined this estimator with the elastic net regularizer for outlier detection in triple-negative breast cancer and lower-grade glioma (LGG) RNA sequencing (RNA-seq) data from The Cancer Genome Atlas (TCGA), respectively, in binary classification scenarios via robust sparse binary logistic regression (rSLR). Robust SMLR with the LTS estimator (rSMLR) was recently proposed by Kurnaz and Filzmoser (2022) [13] for multi-class scenarios.

Despite the acknowledged importance of identifying outlier observations (e.g., patients, cells), uncovering their deviating origin in the feature space is crucial for gaining deeper insights into disease heterogeneity. A proper elementwise approach for outlier detection is expected to prevent discarding relevant information in the non-outlying data matrix elements [14]. The Detect Deviating Cells (DDC)1 algorithm [15] stands out as a pioneering elementwise outlier detection method for its ability to consider correlations between variables and deal with high-dimensional data. Grosso modo, this method flags the cells that stand out in each column in a standardized dataset and then for each cell, predicts its value according to the unflagged cells in its row whose columns are correlated with its column. A cell is then considered anomalous when its observed and predicted values differ significantly from each other. Segaert et al. [11] applied the DDC algorithm to breast cancer RNA-seq TCGA data, after robust feature selection by rSLR [10], for additional insights regarding the deviations of flagged patients in the selected features compared to the remaining observations in their respective classes.

This study aims to identify molecular biomarkers of glioma heterogeneity to advance our understanding of these tumors and ultimately enhance diagnostic therapeutic decision-making. Alongside disease stratification and biomarker selection, it is also essential to identify patients who exhibit deviations from the typical molecular pattern observed in patients of the same glioma type. Such advances perfectly align with current efforts to refine glioma classification. To this end, we applied multi-class classification with embedded feature selection to multi-omics glioma TCGA data with patient group labeling updated regarding the 2016 and 2021 WHO CNS classification guidelines. We developed SMLR and rSMLR models for both 2016-WHO [2] and 2021-WHO [3] datasets to assess whether the 2021-WHO classification update enhanced the differentiation of glioma types and improved the allocation of outlier patients identified for the 2016-WHO classification. The classification task was complemented by visual inspection of the observations in a reduced dimensional feature space obtained via the Uniform Manifold Approximation and Projection (UMAP) algorithm [16], to understand the separability of the classes before and after feature selection. In the final phase of the analysis pipeline, we applied the DDC algorithm [15] to the 2016-WHO dataset, allowing the 2016 outliers’ molecular profile to be compared to the overall class pattern obtained by following the 2021 classification, on a featurewise basis.

2 Materials and Methods

2.1 Datasets

This study uses glioma RNA-seq and DNA methylation (DNA-meth) datasets from the TCGA portal. Data were extracted through the R functions getFirehoseData, available from the Bioconductor R package RTCGA [17], and GDCquery, GDCdownload and GDCprepare, from the Bioconductor R package TCGAbiolinks [18–20]. The glioma RNA-seq dataset contains the expression of 20501 genes from 659 patients. The glioma DNA-meth dataset includes the methylation level of 480457 sites from 653 patients. A pre-filtering procedure was applied to exclude non-valid entries, non-CpG sites, probes related to sexual chromosomes, cross-reactive and polymorphic CpGs [21–24], leading to 340427 CpG sites. The two datasets include sets of patients with significant overlap (80% shared samples).

In both omics datasets, three patient diagnostic labels are available, using the different editions of the WHO classification of tumors of the central nervous system: the original TCGA annotations, dated 2007 [1] (2007-WHO), and the updated diagnosis following the 2016 [2] (2016-WHO), and the 2021 [3] (2021-WHO) guidelines [25]. A cross-comparison between the diagnostic labels defined according to 2016-WHO (rows) and 2021-WHO (columns) in both (a) RNA-seq and (b) DNA-meth datasets can be found in Table 1. One can see that label changes occur mainly across the pairs GBM and astrocytoma (LGG-a), LGG-a and oligodendroglioma (LGG-od), and 75% previously unclassified samples in 2016-WHO became GBM in 2021-WHO.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1: Diagnostic labels defined according to 2016-WHO (rows) and 2021-WHO (columns) in (a) RNA-seq, and (b) DNA-meth datasets. The numbers in each cell represent the number of patients that moved from the class (glioma type) in the rows to the class in the columns with the classification update (LGG-a, astrocytoma; LGG-od, oligodendroglioma).

2.2 Multinomial logistic regression with the elastic net penalty (SMLR)

Let us assume we have N observations x1, xN of p variables. Each observation is also associated with a categorical factor variable Gi with K possible levels. The multinomial logistic regression estimates the probability of a given sample to be attributed to a level ℓ = 1, …, K, under the assumption Embedded Image for each observation i.

This can be modeled as [26, 27]: Embedded Image where βℓ = (β1ℓ, …, βpℓ) are coefficients estimated by minimizing the following negative log-likelihood function: Embedded Image where β denotes the matrix of dimension (p + 1) × K, with the parameters β0ℓ and βℓ in its columns.

In equation (2), gi represents the observed level of the variable Gi and the last term represents the penalty function, i.e., the term ensuring sparsity in the model, controlled by the regularization parameter λ. In this study, we used the Elastic net (EN) penalty [5], therefore: Embedded Image where the value of α ∈ [0, 1] regulates the balance between lasso and ridge penalties [5].

2.3 Robust multinomial logistic regression with the elastic net penalty and the least trimmed squares estimator (rSMLR)

SMLR is a powerful tool when performing feature selection on multinomial high-dimensional data, however, outlying observations might increase the variance of the estimator. To address this issue, Kurnaz and Filzmoser proposed the robust SMLR (rSMLR) method [13], which identifies the observations that deviate from the rest of the data by integrating the LTS estimator [8] into the SMLR algorithm.

The subset H ⊆ {1, 2, …, N } and coefficients β0ℓ and βℓ, ℓ = 1, …, K are then optimized by minimizing the penalized negative trimmed log-likelihood function in Equation (4), under the constraint |H| = h: Embedded Image Parameters α and λ are optimized by 5-fold pairwise cross-validation from an input grid, resulting in the values αopt and λopt. Due to the computational cost, the rSMLR algorithm returns an approximate solution, from the convergence of an iterative method to minimize the function in Equation (4) and a further re-weighting step (Equation (5)) to increase the efficiency of the LTS estimator: Embedded Image where Nw is the number of non-zero weights wi and λupd is optimized by 5-fold cross-validation for the previously obtained αopt value. For further details, refer to Kurnaz and Filzmoser [13].

2.4 Detect Deviating Cells (DDC)

The DDC algorithm, proposed by Rousseeuw and Van Den Bossche (2018) [15] is a powerful tool for measuring each feature’s effect in observations flagged as out-liers. Conversely to rSMLR, which detects outliers based on a rowwise approach, this method is able to estimate the influence of a single variable on all the patients, considering the dataset as a matrix composed by N × p entries we call cells.

By fixing an observation (row), DDC provides an estimate of the value of each data cell, based on those of the variables correlated with it, in the same row. Then, the robustly standardized residual from the estimated and the actual cell value is computed, and the cell is flagged as an outlier if the corresponding residual’s absolute value exceeds Embedded Image (i.e., the squared root of the 0.99-quantile of the χ2 distribution with 1 degree of freedom) [15].

Cells in DDC plots are interpreted according to a scale of colors which goes from blue (cell whose observed value is significantly lower than its predicted value) to red (cell whose observed value is significantly higher than its estimated value). For the remaining cells, their estimated and observed values verify an average, not significant difference.

2.5 Analysis pipeline

Figure 1 shows a schematic representation of the proposed multi-omics analysis. As part of data preprocessing, patients from both RNA-seq and DNA-meth datasets were associated with the diagnostic labels according to 2016-WHO and 2021-WHO [25]. Unclassified samples were not considered in our study. Before applying the classification algorithms, we split the datasets into training (75%) and test (25%) sets maintaining the original proportion of samples in each class. SMLR classification has been repeated for 100 runs, while rSMLR classification was applied over 30 runs due to the high computational cost of this method.

Fig. 1:
  • Download figure
  • Open in new tab
Fig. 1: Overview of the analysis pipeline developed for glioma biomarker discovery and outlier detection.

The proposed methodology first applies classification to normalized (z-score) RNA-seq dataset, for both train and test sets. Features with a null standard deviation were discarded, leading to a total of 20200 variables. To overcome the problem of the high dimensionality of the DNA-meth dataset, it has been included only in the second stage of the analysis. Specifically, the number of DNA-meth variables was reduced to the subset of methylation sites associated with the genes previously selected by classification algorithms applied to RNA-seq data, with α = 0.1. The map linking genes and methylation sites was obtained by the R package methylGSA [28].

For both classification methods (SMLR and rSMLR), a sequence of α parameters was tested, from 0 (Ridge) to 1 (lasso), with a step of 0.1. The rSMLR model also requires an initial sequence of values for λ, set as {0.01, 0.02, …, 0.09, 0.1, 0.2, …, 0.9, 1}. λ and α were jointly estimated by pairwise cross-validation. Then, after that estimation, an updated value of λ was obtained in the re-weighting step. Classification by SMLR and rSMLR was performed using the R packages glmnet [27], and enetLTS [29], considering both the assigned patients’ labels (2016-WHO and 2021-WHO).

A feature was considered to be selected by a classification method when it was identified in at least 75 out of 100 train/test splits. Analogously, patients were considered misclassified if they were systematically assigned to the wrong class in at least 75% of the runs. A similar approach was considered for outlier identification, by taking into account that outliers can be detected only if they appear in the training set. Therefore, patients were defined as outliers if flagged by at least 75% of the training sets that include the sample.

After rSMLR classification, the DDC method was used by considering only the outliers detected from the 2016-WHO classification, to study their molecular profiles in light of the latest guideline release (2021-WHO). Every stage of our study was supported by UMAP visualization performed by umap R package [30] to facilitate the interpretation of the results. All procedures were implemented using version 4.1.3 of the R statistical software [31].

3 Results and Discussion

A prior graphical visualization of the data and the corresponding class membership in a subspace of reduced dimension was performed through the UMAP before the classification task. Figure 2 shows UMAP representations of the complete RNA-seq dataset, labeled according to 2016 and 2021 WHO classifications (left and right panels, respectively). It reveals a great improvement in patient groups’ homogeneity with the 2021 classification. For instance, in the left panel, we can observe a group of samples (bottom-left) including GBM and LGG, which in 2021 were mostly classified as GBM (right panel). The 2021-WHO also improves the distinction between the two LGG types (LGG-a and LGG-od), leading to more homogeneous groups. It can also be noted that unclassified samples are located near the GBM group on both left and right panels, which can be an indicator of the class they could potentially belong to. Unclassified samples were not considered in the subsequent analyses, as they were not included in the supervised analysis due to the lack of an updated diagnostic label.

Fig. 2:
  • Download figure
  • Open in new tab
Fig. 2:

UMAP representations of the RNA-seq dataset. The two panels highlight with different colours the sample labels, assigned according to (a) 2016-WHO and (b) 2021-WHO. GBM: glioblastoma Embedded Image LGG-a: astrocytoma Embedded Image LGG-od: oligodendroglioma Embedded Image unclassified: unclassified patients Embedded Image

Despite the pointed changes between classifications, both UMAP representations highlight the separability of glioma classes, which favors the application of sparse multinomial methods to identify the features that stand out as key diagnostic biomarkers in glioma-type classification. In the following, we show the results obtained by the application of SMLR and rSMLR models to the glioma omics data. We discuss the two model outcomes separately from a multi-omics perspective, according to the pipeline defined in Section 2.5.

3.1 SMLR models

SMLR was applied to RNA-seq data with patients classified according to both 2016-WHO and 2021-WHO. The overall SMLR performances by varying the parameter α are summarized in Table 2.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2: Results obtained with SMLR models regarding the RNA-seq dataset. βij ≠ 0: number of coefficients which obtained a non-null value in at least 75% of the models; no. features: number of features corresponding to βij ≠ 0 coefficients; AUC: area under the ROC curve value; Sd: sample standard deviation for the associated value.

Following 2016-WHO, the SMLR models provided good performances, with mean multinomial area under the ROC curve (AUC) values [32, 33] of approximately 0.95 and low-expressed standard deviation values for all α values regarding both training and test sets. When considering 2021-WHO, the performances further improved, with an average AUC value around 0.99 for all models and small variances.

When applying SMLR to the reduced DNA-meth dataset, good AUC values were obtained for both training and test sets (Table 3). A slight decrease in the model performance with respect to the RNA-seq outcomes was verified for 2016-WHO. Conversely, 2021-WHO led to similar AUC values to the ones presented in Table 2.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3: Results obtained with SMLR models from the DNA-meth dataset. βij ≠ 0: number of coefficients which obtained a non-null value in at least 75% of the models; no. features: number of features corresponding to βij ≠ 0 coefficients; AUC: area under the ROC curve value; Sd: sample standard deviation for the associated value.

These results further support the improvement of the newest classification guidelines, which appear to be more in accordance with patients’ molecular profiles. Notably, for both omics layers and guidelines (2016-WHO and 2021-WHO), no decrease in model predictive performance was observed with feature selection for increased α values, highlighting the ability of sparse models generated to select relevant variables able to discriminate between glioma types.

To further discuss the samples that were assigned to the wrong class (i.e., mis-classified) by the SMLR model, we considered specific values of the regularization parameter α. These values were chosen to select an interpretable amount of features, which might be comparable between both classification guidelines for each omic.

For the RNA-seq data, the results obtained for α = 0.3, in the case of 2016-WHO, and α = 0.5, for 2021-WHO, were inspected. Instead, for the DNA-meth data results, α = 0.4 and α = 0.7, were respectively chosen for 2016-WHO and 2021-WHO classification. We chose these α values since the respective models achieved a very satisfactory performance while selecting a relatively small yet biologically informative subset of genes. Table 4 resumes the patients that were misclassified according to 2016-WHO (rows) by the SMLR model based on both RNA-Seq and DNA-meth data. Most misclassified patients by SMLR viewed their label changed with the update to 2021-WHO [3, 25], suggesting great accordance between the 2021-WHO classification and both transcriptomics and methylomics profile.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 4: Label changes in the misclassified patients by SMLR applied to the RNA-seq (α = 0.3) and DNA-meth (α = 0.4) datasets, from 2016 to 2021 WHO classifications (the numbers in each cell represent the number of patients which moved from the class in the rows to the class in the columns with the classification update).

Figure 3 compares the Venn diagrams of intersections of misclassified patients across RNA-seq and DNA-meth datasets regarding both classifications. Based on the 2016-WHO guidelines (Figure 3a), despite most mislabeled samples being identified in common by the two omics layers, the SMLR model also detected some cases that do not match the associated class only according to one omics. This result points out that possibly mislabeled patients can have discordant transcriptomics and methylomics profiles, thus, fostering a multi-omics integrated analysis. When considering the 2021-WHO labels (Figure 3b) the number of patients assigned to a different class is highly reduced, corroborating the better performances of the model in this case.

Fig. 3:
  • Download figure
  • Open in new tab
Fig. 3:

Venn diagrams with the intersection of the misclassified patients by SMLR-based classifiers applied to RNA-seq and DNA-meth datasets regarding (a) 2016-WHO and (b) 2021-WHO, where only patients comprised in both datasets were considered.

3.2 rSMLR models

Table 5 summarizes the results of rSMLR models. Notably, those performed a more relaxed feature selection for 2021-WHO than for 2016-WHO. Since the identified features correspond to the variables having non-null coefficients in at least 75% of the runs, this result suggests a high agreement in variable selection performed by the rSMLR models based on 2021-WHO. Also, this outcome is influenced by the regularization parameter choice, which the robust version of the model automatically estimates by pairwise cross-validation. When considering 2021-WHO classification, the parameter estimation were consistent among all the 30 runs, while for 2016-WHO different values were obtained. More details about the estimated regularization parameters are available in the Supplemental Material section (Table S1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 5: Results obtained with rSMLR models (βij ≠ 0: number of coefficients which obtained a non-null value in at least 75% of the models; no. features: number of features corresponding to βij ≠ 0 coefficients; AUC: area under the ROC curve value; Sd: sample standard deviation for the associated value).

The rSMLR based on 2016-WHO obtains slightly lower averaged AUC values when compared to SMLR. Nevertheless, also in the robust estimation, the model performances are remarkable, with an average AUC value around 0.93 (for RNA-seq) and 0.89 (for DNA-meth) in both training and test sets. Looking at the results based to 2021-WHO guidelines, the rSMLR model performs an accurate separation of the three defined glioma types, with high AUC values around 0.99 in train and test sets, for both omics layers.

Besides the variable selection based on the patients’ classes, the rSMLR method allows for the detection of outliers, i.e., patients who have a transcriptomics and/or methylomics profile differing from the one characterizing their class. To provide a visualization of the 2D-graphical distribution of the samples divided per class, and based on the subset of selected features in each case (2016-WHO and 2021-WHO) and omics, UMAP algorithm was applied to reduced datasets (Figure 4).

Fig. 4:
  • Download figure
  • Open in new tab
Fig. 4:

UMAP representations of patients based on the variables selected by the rSMLR models considering: (a-c) 2016-WHO guidelines, with colors assigned according to 2016-WHO; (d-f) 2016-WHO guidelines, with colors assigned according to 2021-WHO; (g-i) 2021-WHO guidelines, with colors assigned according to 2021-WHO. First column: selected features from RNA-seq dataset. Second column: starting DNA-meth dataset. Third column: selected features from DNA-meth dataset. GBM: patients with glioblastoma Embedded Image GBM.out: outlier patients within the glioblastoma class Embedded Image LGG-a: patients with astrocytoma Embedded Image LGG-a.out: outlier patients within the astrocytoma class Embedded Image LGG-od: patients with oligodendroglioma Embedded Image LGG-od.out: outlier patients within the oligodendroglioma class Embedded Image unclassified: unclassified patients Embedded Image

The aim was to observe how the projection of the patients in a lower dimentional space changes, by considering only variables selected by the applied method, across the two omics. In particular, each line of the Figure 4 includes, in sequence, the UMAP graphs based on: the selected genes (rSMLR outcome based on RNA-seq data), the associated CpG sites (starting DNA-meth data), and the selected CpG sites (rSMLR outcome based on DNA-meth data). The first (Figures 4a to 4c) and last (Figures 4g to 4i) lines consider the subset of variables depending on the 2016-WHO and 2021-WHO labels, respectively. The samples (points) are colored according to their diagnostic labels. Instead, the line in the middle (Figures 4d to 4f), reports the same projection based on the 2016-WHO, while the colors are assigned based on the 2021-WHO classes, allowing an easier observation of the diagnostic label evolution. In each graph, the outlier samples are colored differently, based on the class to which they belong.

Overall, all UMAPs show a good separation of the three glioma types. However, when considering 2016-WHO labels, an overlap of the two LGG types is visible from RNA-seq data (Figure 4a). This class heterogeneity is further emphasized when moving to the DNA-meth layers (Figures 4b and 4c), where the groups appear highly mixed, with many LGG-a and LGG-od samples projected in the GBM area, most of which identified as outliers. Interestingly, if these samples are colored according to the 2021-WHO diagnostic labels, most of them change to GBM (Figure 4f), supporting the great improvement of the latest guidelines. This result is confirmed by the UMAPs obtained from the subset of features selected by the model considering the 2021-WHO labels, in which a nearly-perfect separation of the three types is obtained after the application of both steps of our pipeline (Figure 4i).

A quantification of outliers and misclassified samples resulting from rSMLR model based on 2016-WHO guidelines, with respect to their updated 2021-WHO diagnostic labels, is summarized in Table 6. As previously observed, most of the LGG outliers changed their labels to GBM, which fosters a more detailed cellwise study of these samples to understand the aspects that led to their identification. On the other hand, from the misclassification results, many LGG-od samples wrongly assigned can be noted, most of which would be classified as LGG-a following 2021-WHO guidelines. By focusing on DNA-meth data, the number of outliers and misclassified samples increases, and also some GBM cases appear. The majority of these additional samples, which were not pointed out by the analysis on RNA-seq data, would change their diagnostic label with the 2021-WHO guidelines update, suggesting a bigger discrepancy between samples profiles and glioma types in DNA-methylation than in gene expression. Figure 5 shows the Venn diagrams of outlier patients identified across RNA-seq and DNA-meth datasets regarding both classifications. Conversely to what observed for samples misclassified by SMLR model, most outliers were identified from methylomics, further supporting the relevance of this layer.

Fig. 5:
  • Download figure
  • Open in new tab
Fig. 5:

Venn diagrams with intersections of patients flagged by the rSMLR model as outliers from RNA-seq and DNA-meth datasets based on (a) 2016-WHO and (b) 2021-WHO. Only patients comprised in both omics datasets were considered.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 6: Patients detected as outliers or misclassified by the rSMLR model based on 2016-WHO, applied to the RNA-seq and DNA-meth datasets. The rows report the 2016-WHO labels, while the columns refer to their 2021-WHO update. Each cell represents the number of patients who changed their diagnosis with the 2021-WHO update, from the class in the rows to the class in the columns.

The comparison between outliers and misclassified samples, depending on the guidelines and the omics layer considered, is visible in the Venn diagrams in Figure 6. Overall, an agreement between the two groups can be observed (i.e., outliers were mainly misclassified). Additionally, the models based on 2016-WHO labels led to a higher number of misclassified samples, confirming the difficulty in identifying the glioma types defined by 2016-WHO based on the patients’ molecular profiles.

Fig. 6:
  • Download figure
  • Open in new tab
Fig. 6:

Venn diagrams with intersections of patients that were misclassified (Misc.) and flagged as outliers (Out.) by rSMLR models based on 2016-WHO (a-b) and 2021-WHO (c-d).

To analyze the molecular profile of the samples identified as outliers based on the 2016-WHO labels, the DDC algorithm was applied. Figure 7 illustrates the DDC results corresponding to RNA-seq data. Rows report all the outliers, together with a random subset of samples per type. To facilitate the comparison among patients’ profiles, outliers are sorted to be close to the samples belonging to the glioma type to which these would be associated according to the 2021-WHO. Columns list the variables that were selected by rSMLR model, grouped according to the glioma type to which they are related. Colored cells (from blue to red) highlight the genes of a given sample having a different expression/methylation level (lower or higher) compared to their predicted expected value. By looking at Figure 7, based on RNA-seq data, it is possible to detect some common patterns between patients with different diagnoses. For instance, the first outliers’ group, coherently with GBM samples, presents a high deviation of the gene RAB42 that is not common neither in LGG-a, nor in LGG-od patient profiles. Accordingly, the only LGG-od outlier sample changing the diagnosis to LGG-a based on 2021-WHO shows high expression of C15orf21, a gene the model detects to characterize LGG-a.

Fig. 7:
  • Download figure
  • Open in new tab
Fig. 7: DDC plot for the features selected by the model from the RNA-seq dataset.

The DDC plots regarding the DNA-meth data are showed in the Supplemental Material (Figures S1 to S3). Due to the huge number of features selected in this case, each figure refer to the CpG sites selected for a given glioma type. From this representation, the pattern characterizing LGG-a and LGG-od samples is even more evident, and it highly differs from the GBM one. Moreover, the outliers’ methylomics profile matches with the one of their corresponding class based on 2021-WHO labels, suggesting a strong alignment between methylomics data and glioma types (see, as an example, the GBM outliers that would change to LGG-a with the 2021-WHO update). The DDC algorithm was also applied to further investigate outliers detected by considering the updated 2021-WHO guidelines for glioma classification. The corresponding Figures are provided in the Supplemental Material section (S4 to S9).

The top 20 features associated with each glioma type for RNA-seq dataset were further investigated across the literature. The relevant findings of this research are summarized in Table S2 (Supplemental Material), highlighting the genes’ influence on glioma or cancer processes. Table S3 (Supplemental Material) lists the top 20 features selected for DNA-meth dataset. This table reports methylation sites and their associated genes, together with their rankings in both methylomics and transcriptomics for each glioma type based on the rSMLR outcome.

4 Conclusion

The objective of this study was to identify molecular biomarkers of glioma heterogeneity, as well as the identification of outlying patients through their molecular profiles. This contributes to enhancing the molecular understanding of these tumors and support clinical and therapeutic decisions.

SMLR and rSMLR models were applied to glioma RNA-seq and DNA-meth data. Patient labeling according to the 2021-WHO notably improved model performances, based on both transcriptomics and methylomics data, with the outliers identified by rSMLR applied to 2016-WHO data corroborating the 2021-WHO patient labeling update. SMLR and rSMLR models also selected groups of transcriptomics and methylomics variables as potential diagnostic biomarkers, which might uncover relevant insights on glioma heterogeneity from a biological perspective. Most top-selected genes were already reported in the literature as being connected with glioma or cancer in general, therefore supporting the methodology used and fostering the biological validation of the non-reported genes.

Despite the outstanding performance of SMLR and rSMLR models when applied to 2021-WHO, the robust model still identified outliers (i.e. deviating molecular profiles) among the classes, which means that the supervised approach followed does not cover all glioma heterogeneity.

The results obtained by the models and the analysis of the outlying patients highlighted an important role of methylomics in outlier detection, suggesting that future updates of glioma classifications must focus on patient methylomics profiles as already pointed out in prior studies [34–36].

It will also be advantageous in future studies to use unsupervised methods, namely robust clustering, to investigate the within-group variability and identify new glioma subgroups towards the development of more personalized therapies.

Data Availability

The updated diagnostic labels of the samples of the TCGA glioma dataset used in this study are available at: https://github.com/RobertaColetti/Update-TCGA-glioma-WHOclassification.

https://github.com/RobertaColetti/Update-TCGA-glioma-WHOclassification

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgements

This work was supported by national funds through Fundação para a Ciência e a Tecnologia (FCT I.P.) with references CEECIN-ST/00042/2021, UIDB/00297/2020 and UIDP/00297/2020 (NOVA MATH), UIDB/00667/2020 and UIDP/00667/2020 (UNIDEMI), and developed within the project “MONET: Multi-omic networks in gliomas” (PTDC/CCI-BIO/4180/2020). The results here obtained are based upon data generated by the TCGA Research Network: https://www.cancer.gov/tcga. We thank Professor Susan P. Holmes for her valuable revision and comments on the manuscript.

Footnotes

  • Supplemental Figures S8 and S9 updated

  • ↵1 xij elements of a data matrix X. Not to be interpreted in the biological sense.

References

  1. [1].↵
    Louis, D.N., Ohgaki, H., Wiestler, O.D., Cavenee, W.K., Burger, P.C., Jouvet, A., Scheithauer, B.W., Kleihues, P.: The 2007 WHO classification of tumours of the central nervous system. Acta Neuropathologica 114, 547 (2007)
    OpenUrl
  2. [2].↵
    Louis, D.N., Perry, A., Reifenberger, G., Deimling, A., Figarella-Branger, D., Cavenee, W.K., Ohgaki, H., Wiestler, O.D., Kleihues, P., Ellison, D.W.: The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary. Acta Neuropathologica 131, 803–820 (2016)
    OpenUrlCrossRefPubMed
  3. [3].↵
    Louis, D.N., Perry, A., Wesseling, P., Brat, D.J., Cree, I.A., Figarella-Branger, D., Hawkins, C., Ng, H.K., Pfister, S.M., Reifenberger, G., Soffietti, R., Deimling, A., Ellison, D.W.: The 2021 WHO classification of tumors of the Central Nervous System: a summary. Neuro-Oncology 23(8), 1231–1251 (2021)
    OpenUrlCrossRefPubMed
  4. [4].↵
    Cai, Z., Poulos, R.C., Liu, J., Zhong, Q.: Machine learning for multi-omics data integration in cancer. iScience 25, 103798 (2022)
    OpenUrl
  5. [5].↵
    Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society 67(2), 301–320 (2005)
    OpenUrl
  6. [6].↵
    Eckel-Passow, J.E., Decker, P.A., Kosel, M.L., Kollmeyer, T.M., Molinaro, A.M., Rice, T., Caron, A.A., Drucker, K.L., Praska, C.E., Pekmezci, M., Hansen, H.M., McCoy, L.S., Bracci, P.M., Erickson, B.J., Lucchinetti, C.F., Wiemels, J.L., Wiencke, J.K., Bondy, M.L., Melin, B., Burns, T.C., Giannini, C., Lachance, D.H., Wrensch, M.R., Jenkins, R.B.: Using germline variants to estimate glioma and subtype risks. Neuro-oncology 21(4), 451–461 (2019)
    OpenUrlCrossRef
  7. [7].↵
    Li, J., Zhang, H., Gao, F.: Identification of miRNA biomarkers for breast cancer by combining ensemble regularized multinomial logistic regression and Cox regression. BMC Bioinformatics 23, 434 (2022)
    OpenUrl
  8. [8].↵
    Rousseeuw, P.J., Leroy, A.M.: Robust Regression and Outlier Detection. John Wiley and Sons, New York (1987)
  9. [9].
    Alfons, A., Croux, C., Gelper, S.: Sparse Least Trimmed Squares Regression for Analyzing High-Dimensional Large Data Sets. The Annals of Applied Statistics 7(1), 226–249 (2013)
    OpenUrl
  10. [10].↵
    Kurnaz, F.S., Hoffmann, I., Filzmoser, P.: Robust and sparse estimation methods for high-dimensional linear and logistic regression. Chemometrics and Intelligent Laboratory Systems 172, 211–222 (2018)
    OpenUrl
  11. [11].↵
    Segaert, P., Lopes, M.B., Casimiro, S., Vinga, S., Rousseeuw, P.J.: Robust identification of target genes and outliers in triple-negative breast cancer data. Statistical Methods in Medical Research 28(10-11), 3042–3056 (2019)
    OpenUrlCrossRef
  12. [12].↵
    Carrilho, J.F., Lopes, M.B.: Classification and biomarker selection in lower-grade glioma using robust sparse logistic regression applied to RNA-seq data. Brazilian Journal of Biometrics 40, 371–381 (2022)
    OpenUrl
  13. [13].↵
    Kurnaz, F.S., Filzmoser, P.: Robust and sparse multinomial regression in high dimensions. Data Mining and Knowledge Discovery 37, 1609–1629 (2023)
    OpenUrl
  14. [14].↵
    Alqallaf, F., Van Aelst, S., Yohai, V.J., Zamar, R.H.: Propagation of Outliers in Multivariate Data. The Annals of Statistics 37(1), 311–331 (2009)
    OpenUrl
  15. [15].↵
    Rousseeuw, P.J., Bossche, W.: Detecting Deviating Data Cells. Technometrics 60(2), 135–145 (2018)
    OpenUrl
  16. [16].↵
    McInnes, L., Healy, J.: Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018)
  17. [17].↵
    Kosinski, M., Biecek, P.: RTCGA: The Cancer Genome Atlas Data Integration. (2021). R package version 1.24.0. https://rtcga.github.io/RTCGA
  18. [18].↵
    Colaprico, A., Silva, T.C., Olsen, C., Garofano, L., Cava, C., Garolini, D., Sabedot, T., Malta, T.M., Pagnotta, S.M., Castiglioni, I., Ceccarelli, M., Bon-tempi, G., Noushmehr, H.: Tcgabiolinks: An r/bioconductor package for integrative analysis of tcga data. Nucleic Acids Research (2015) doi:10.1093/nar/gkv1507
    OpenUrlCrossRefPubMed
  19. [19].
    Mounir, M., Lucchetta, M., Silva, T.C., Olsen, C., Bontempi, G., Chen, X., Noushmehr, H., Colaprico, A., Papaleo, E.: New functionalities in the tcgabi-olinks package for the study and integration of cancer data from gdc and gtex. PLoS computational biology 15(3), 1006701 (2019)
  20. [20].↵
    Silva, T.C., Colaprico, A., Olsen, C., D’Angelo, F., Bontempi, G., Ceccarelli, M., Noushmehr, H.: Tcga workflow: Analyze cancer genomics and epigenomics data using bioconductor packages. F1000Research 5 (2016)
  21. [21].↵
    Jin, B., Li, Y., Robertson, K.D.: Dna methylation. Genes & Cancer 2(6), 607–617 (2011)
    OpenUrlCrossRefPubMed
  22. [22].
    Chen, Y.-a., Lemire, M., Choufani, S., Butcher, D.T., Grafodatskaya, D., Zanke, B.W., Gallinger, S., Hudson, T.J., Weksberg, R.: Discovery of cross-reactive probes and polymorphic CpGs in the Illumina Infinium HumanMethylation450 microarray. Epigenetics 8(2), 203–209 (2013)
    OpenUrlCrossRefPubMedWeb of Science
  23. [23].
    Johansen, M.L., Stetson, L.C., Vadmal, V., Waite, K., Berens, M.E., Connor, J.R., Lathia, J., Rubin, J.B., Barnholtz-Sloan, J.S.: Gliomas display distinct sex-based differential methylation patterns based on molecular subtype. Neuro-Oncology Advances 2(1), 1–12 (2020)
    OpenUrl
  24. [24].↵
    Grant, O.A., Wang, Y., Kumari, M., Zabet, N.R., Schalkwyk, L.: Characterising sex differences of autosomal DNA methylation in whole blood using the Illumina EPIC array. Clinical Epigenetics 14(62) (2022)
  25. [25].↵
    Mendonça, M.L., Coletti, R., Gonçalves, C.S., Martins, E.P., Costa, B.M., Vinga, S., Lopes, M.B.: Updating TCGA glioma classification through integration of molecular profiling data following the 2016 and 2021 WHO guidelines. bioRxiv preprint (2023) doi:10.1101/2023.02.19.529134
    OpenUrlAbstract/FREE Full Text
  26. [26].↵
    Zhu, J., Hastie, T.: Classification of gene microarrays by penalized logistic regression. Biostatistics 5(3), 427–443 (2004)
    OpenUrlCrossRefPubMedWeb of Science
  27. [27].↵
    Friedman, J., Hastie, T., Tibshirani, R.: Regularization Paths for Generalized Linear Models via Coordinate Descent. Journal of Statistical Software 33(1), 1–22 (2010)
    OpenUrlCrossRef
  28. [28].↵
    Ren, X., Kuan, P.F.: methylGSA: a Bioconductor package and Shiny app for DNA methylation data length bias adjustment in gene set testing. Bioinformatics 35(11), 1958–1959 (2019)
    OpenUrlCrossRef
  29. [29].↵
    Kurnaz, F.S., Hoffmann, I., Filzmoser, P.: enetLTS: Robust and Sparse Methods for High Dimensional Linear and Binary and Multinomial Regression. (2022). R package version 1.1.0. https://CRAN.R-project.org/package=enetLTS
  30. [30].↵
    Konopka, T.: umap: Uniform Manifold Approximation and Projection. (2022). R package version 0.2.8.0. https://CRAN.R-project.org/package=umap
  31. [31].↵
    R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2022). R Foundation for Statistical Computing. https://www.R-project.org/
  32. [32].↵
    Hand, D.J., Till, R.J.: A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems. Machine Learning 45, 171–186 (2001)
    OpenUrlCrossRef
  33. [33].↵
    Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., Müller, M.: pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 12, 77 (2011)
    OpenUrlCrossRefPubMed
  34. [34].↵
    Capper, D., Jones, D.T.W., Sill, M., Hovestadt, V., Schrimpf, D., Sturm, D., Koelsche, C., Sahm, F., Chavez, L., Reuss, D.E., Kratz, A., Wefers, A.K., Huang, K., Pajtler, K.W., Schweizer, L., Stichel, D., Olar, A., Engel, N.W., Linden-berg, K., Harter, P.N., Braczynski, A., Plate, K.H., Dohmen, H., Garvalov, B.K., Coras, R., Hölsken, A., Hewer, E., Bewerunge-Hudler, M., Schick, M., Fischer, R., Beschorner, R., Schittenhelm, J., Staszewski, O., Wani, K., Varlet, P., Pages, M., Temming, P., Lohmann, D., Selt, F., Witt, H., Milde, T., Witt, O., Aronica, E., Giangaspero, F., Rushing, E., Scheurlen, W., Geisenberger, C., Rodriguez, F.J., Becker, A., Preusser, M., Haberler, C., Bjerkvig, R., Cryan, J., Farrell, M., Deckert, M., Hench, J., Frank, S., Serrano, J., Kannan, K., Tsirigos, A., Brück, W., Hofer, S., Brehmer, S., Seiz-Rosenhagen, M., Hänggi, D., Hans, V., Rozsnoki, S., Hansford, J.R., Kohlhof, P., Kristensen, B.W., Lechner, M., Lopes, B., Mawrin, C., Ketter, R., Kulozik, A., Khatib, Z., Heppner, F., Koch, A., Jouvet, A., Keohane, C., Mühleisen, H., Mueller, W., Pohl, U., Prinz, M., Benner, A., Zapatka, M., Gottardo, N.G., Driever, P.H., Kramm, C.M., Müller, H.L., Rutkowski, S., Hoff, K., Frühwald, M.C., Gnekow, A., Fleischhack, G., Tippelt, S., Calaminus, G., Monoranu, C.-M., Perry, A., Jones, C., Jacques, T.S., Radlwimmer, B., Gessi, M., Pietsch, T., Schramm, J., Schackert, G., Westphal, M., Reifenberger, G., Wesseling, P., Weller, M., Collins, V.P., Blümcke, I., Bendszus, M., Debus, J., Huang, A., Jabado, N., Northcott, P.A., Paulus, W., Gajjar, A., Robinson, G., Taylor, M.D., Jaunmuktane, Z., Ryzhova, M., Platten, M., Unterberg, A., Wick, W., Karajannis, M.A., Mittelbronn, M., Acker, T., Hartmann, C., Aldape, K., Schüller, U., Buslei, R., Lichter, P., Kool, M., Herold-Mende, C., Ellison, D.W., Hasselblatt, M., Snuderl, M., Brandner, S., Korshunov, A., Deimling, A., Pfister, S.M.: DNA methylation-based classification of central nervous system tumours. Nature 555(7697), 469–474 (2018)
    OpenUrlCrossRefPubMed
  35. [35].
    Kessler, T., Schrimpf, D., Doerner, L., Hai, L., Kaulen, L.D., Ito, J., Bent, M., Taphoorn, M., Brandes, A.A., Idbaih, A., Dômont, J., Clement, P.M., Campone, M., Bendszus, M., Deimling, A., Sahm, F., Platten, M., Wick, W., Wick, A.: Prognostic Markers of DNA Methylation and Next-Generation Sequencing in Progressive Glioblastoma from the EORTC-26101 Trial. Clinical Cancer Research 29(19), 3892–3900 (2023)
    OpenUrl
  36. [36].↵
    Drexler, R., Khatri, R., Schüller, U., Eckhardt, A., Ryba, A., Sauvigny, T., Dührsen, L., Mohme, M., Ricklefs, T., Bode, H., Hausmann, F., Huber, T.B., Bonn, S., Voß, H., Neumann, J.E., Silverbush, D., Hovestadt, V., Suvà, M.L., Lamszus, K., Gempt, J., Westphal, M., Heiland, D.H., Hänzelmann, S., Ricklefs, F.L.: Temporal change of DNA methylation subclasses between matched newly diagnosed and recurrent glioblastoma. Acta Neuropathologica 147(21) (2024)
Back to top
PreviousNext
Posted August 28, 2024.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Multi-omics biomarker selection and outlier detection across WHO glioma classifications via robust sparse multinomial regression
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Multi-omics biomarker selection and outlier detection across WHO glioma classifications via robust sparse multinomial regression
João F. Carrilho, Roberta Coletti, Bruno M. Costa, Marta B. Lopes
medRxiv 2024.08.26.24312601; doi: https://doi.org/10.1101/2024.08.26.24312601
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Multi-omics biomarker selection and outlier detection across WHO glioma classifications via robust sparse multinomial regression
João F. Carrilho, Roberta Coletti, Bruno M. Costa, Marta B. Lopes
medRxiv 2024.08.26.24312601; doi: https://doi.org/10.1101/2024.08.26.24312601

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)