Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Genetic co-occurrence networks identify polymorphisms within ontologies highly associated with preeclampsia

Andreea Obersterescu, View ORCID ProfileBrian J. Cox
doi: https://doi.org/10.1101/2024.07.09.24310164
Andreea Obersterescu
aDepartment of Physiology University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian J. Cox
aDepartment of Physiology University of Toronto, Toronto, Canada
bDepartment of Obstetrics and Gynecology, University of Toronto, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brian J. Cox
  • For correspondence: b.cox{at}utoronto.ca
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Polygenic diseases require the co-occurrence of multiple risk variants to initiate a pathology. An example is preeclampsia, a hypertensive disease of pregnancy with no known cure or therapy other than the often-preterm delivery of the neonate and placenta. Preeclampsia is challenging to predict due to symptomatic and outcome heterogeneity. Transcriptomic and genetic analysis suggests that this is a multi-syndromic and multigenic disease. Previous research applications of traditional GWAS methods to preeclampsia identified only a few alleles with marginal differences between cases and controls. We seek to identify genetic networks related to the pathophysiology of preeclampsia as potential avenues of therapeutic investigation and early genetic testing. We created a novel systems biology-based method that identifies networks of co-occurring SNPs associated with a trait or disease. The co-occurring pairs are assembled into higher-order associations using network graphs. We validated our method using simulation modelling and tested it against maternal genetic data of a previously assessed preeclampsia cohort. The genetic co-occurrence network identified SNPs in or near genes with ontological enrichment for VEGF, immunological and hormonal pathways, among others with known physiological disruption in preeclampsia. Our findings suggests that preeclampsia is caused by relatively common alleles (<5%) that accumulate in unfavorable combinations.

Introduction

Preeclampsia is a hypertensive disorder of pregnancy that globally causes over 70,000 maternal deaths and 500,000 neonatal deaths annually1. Preeclampsia is largely untreatable aside from medically induced delivery to limit fetal and maternal mortality2. In high-resource settings, it accounts for $10s of billion in health care costs annually and a large proportion of maternal and neonatal admissions to hospital and intensive care. Preeclampsia is challenging to detect before the onset of overt symptoms of hypertension and kidney dysfunction (proteinuria), and the disease can progress rapidly3,4. Most early detection methods, such as sFLT/PGF ratios, have high negative predictive value to help rule out people5. Symptomatic onset is variable, occurring between week 24 and term6. The preeclampsia pathology is multifactorial, with most cases presenting with maternal systemic inflammation of the vascular system (hypertension) and inflammation of the liver, kidney and heart7,8. On the fetal side, there can be fetal and placental growth restriction. Most frequently discussed are various pathologies involving defective angiogenesis and vascular remodelling6,9. Others more strongly favour immunological and metabolic origins of the disease10,11. There are likely many subtypes of the disease, and our previous work identified major histological and transcriptional subtypes involving placental development, maternal cardiovascular and immune systems12–14.

The maternal and fetal genomes appear to potentially contribute to disease risk, with an estimated contribution of over 50% 15. Genetic testing is sought to identify early disease markers and targets for therapeutic intervention and prevention. Genome-wide association studies are generally used to find polymorphisms (SNPs) associated with a disease. GWAS studies on preeclampsia find few associated SNPs and do not replicate well between populations15. Maternal studies identified SNPs in the INHBB gene in both Australian and Han Chinese cohorts but not in a Norwegian/Finnish cohort16,17. Inhibins are thought to play a role in spiral artery remodelling critical to proper placental development, oxygenation and nutrient transfer 16. In an Icelandic/UK cohort, SNPs near the FLT1 gene were found to be associated with PE in a GWAS of the placental (fetal) genome18. The FLT1 gene encodes the vascular endothelial growth factor receptor that binds vascular endothelial growth factor alpha (VEGFA). In fetal trophoblasts, the soluble sFLT1 isoform is expressed and released into maternal circulation at levels higher on average than preeclampsia19. It is thought that circulating sFLT-1 binds VEGF A (VEGFA), preventing activation of the transmembrane receptor and inhibiting angiogenesis. While these may relate to the common vascular pathologies observed, the association of the SNP with the disease is weak, representing a minority of cases, as many healthy pregnancies carry the alleles.

Moving away from univariate testing and single gene associations to disease, we propose that PE is a polygenic disease resulting from an accumulation of co-occurring SNPs within genes belonging to pathways critical to the observed pathophysiology. The polygenic risk score (PRS) is a current method to address polygenic disease20. These scores are created by conducting a GWAS analysis and using the statistical test results to rank and select SNPs based on an arbitrary cut-off, leading to models with dozens to 1000s of SNPs. The prediction is made by weighting SNPs by their effect sizes and summing them20. PRS methods highlight that having more SNPs associated with a trait will increase the risk of developing that trait. However, it should be noted that not all SNPs included in the score are biologically relevant, and consequently, scores with fewer SNPs can perform better than those with many20. Accepting single polymorphisms above the statistical threshold inflates false discovery and diminishes the ability to discover gene set enrichments. Polymorphisms that contribute to disease are likely to appear in multiple biochemical pathways21,22. However, PRSs still utilize a univariate signal and do not consider how many pathways or how severely pathways are hit.

We propose that an improvement is to utilize a framework similar to a synthetic lethal screen, where two or more genes are disrupted simultaneously23,24. If the two co-occurring mutations create a phenotype, these are scored as a gene-gene interaction23,24. These interacting genes are typically enriched in protein-protein interactions and may be in the same pathway24. Alternatively, genetic interactions may occur in parallel pathways such that there is a loss of redundancy24.

To address the limitation of GWAS and the PRS methods, we created a novel method that first tests for SNP co-occurrence and then tests for the enrichment of the co-occurrence to a pathology or trait. Importantly, individual SNPs are not strictly required to be enriched to the trait. Co-occurring SNPs enriched to a trait are assembled into higher order structures using network graphs revealing a complexity of genetic interaction associated with preeclampsia. These larger networks are then tested using ontology enrichment to identify key pathways with enriched polymorphic variants in preeclampsia.

Results

Simulated random genomes show low background co-occurrence of SNPs

We used data modeling to establish a ground truth data set to evaluate if co-occurrence could used identify polymorphic variants associated with disease. The R package minutest was used to simulate 6,000 individuals with 4000 alleles through random breeding. Linkage disequilibrium was simulated at values like those observed in the 1000 genomes project25. First, we aimed to establish the background false discovery rate of SNP cooccurrence using simulated small genomes where alleles could be spiked to associate with the disease. To establish the background rate, we randomly drew 1000 individuals from the population for cases and controls each (without replacement). We did so ten times (with replacement) to form paired datasets for ten trials. These should have no true differential co-occurrence.

Since the cohorts comprised 4000 alleles, each trial tested 7,998,000 SNP pairs for co-occurrences. An average of just 3 SNP pairs passed the co-occurrence filter (FDR-adjusted p-value ≤ 0.05 from a hypergeometric test for co-occurrence and FDR-adjusted p-value from a chi-squared test for co-occurrence in case vs control) used to create networks. Additionally, after spiking independent SNPs (either with disease or in LD models), paired datasets had no individual SNPs that were associated with disease (p-value ≤ 5 x 10-8 from Cochrane-Armitage trend test). These findings established that our methods produced a low background rate of co-occurring SNPs in the simulations.

Co-occurring SNPs in cases, controls are separable by graph properties

Next, we aimed to identify the true discovery rate, sensitivity and specificity in simulated small genomes. Additionally, we aimed to determine if network graph properties could be used to identify true discoveries. We used the case-control cohort we generated above to simulate a disease state with co-occurrence (Fig. 1A). In the cases, a range of spiked SNPs (5-80) were selected and forced to correlate at different phi values (0.2, 0.3 and 0.4). Critically, when spiking co-occurring SNPs we did not alter the frequency of the SNPs between the cases and controls ensuring that no individual SNPs was enriched. Each combination of spiked alleles and phi values was evaluated in 10 trials of 1000 cases and 1000 controls and we evaluated their means and distributions.

Figure 1.
  • Download figure
  • Open in new tab
Figure 1. Method Overview.

(A) Simulation workflow. (i) A general population of genomes is generated: 6000 individuals, each with 4000 SNPs. SNPs are coded as binary genotypes with 0s and 1s representing the absence or presence of a minor allele, respectively. At this stage, the LD parameter was varied to allow the proposed co-occurrence network to be tested on different LD models. (ii) Random sampling is used to create control and disease populations. Ten pairs of datasets are generated for a given model. (iii) In the disease population, a subset of SNPs are randomly selected and forced to correlate with one another while their frequencies are maintained. These are referred to as the spiked SNPs. Different disease models are represented by varying the number of spiked SNPs and the correlation level between them. (iv) The proposed co-occurrence method was tested. All possible pairs of SNPs were analyzed. Pairs that significantly co-occurred at significantly different rates in the two populations were placed into a co-occurrence network. (B) Workflow for real-world data. (i) Control and PE data were downloaded from EBI. (ii) Standard GWAS protocols were applied to the data for quality control. To match the input data size in simulations, 4000 SNPs with the smallest p-values from GWAS were selected for further analysis. (iii) The proposed co-occurrence method was applied as in the simulations. (iv) Pathway analysis was conducted on several SNP sets.

We observed that the models with more spiked SNPs had a higher correlation between spiked SNPs and returned a greater number of SNP pairs as statistically significant into the co-occurrence network (Wilcox test, FDR adjusted p-value ≤ 0.05). The model with five spiked SNPs at a correlation of 0.2 had, on average, 41 SNP pairs placed into the co-occurrence network. The model with 80 spiked SNPs at a correlation of 0.4 had, on average, 4003 SNP pairs placed into the network. As the number of SNP pairs passing into the network increased, the total number of SNPs increased, averaging 56 SNPs in the former model and 1033 SNPs in the latter.

Next, we graphically evaluated the models using networks (Fig. 2A-C). Each node represents a SNP, and an edge was drawn between all pairs of SNPs that passed the co-occurrence filter. For all models, the network had a structure where spiked nodes appeared to be the network’s hubs, belonging to a larger, more connected sub-network (Fig. 2A-C). Surrounding the connected sub-network are smaller disconnect sub-networks that did not contain spiked nodes/alleles.

Figure 2.
  • Download figure
  • Open in new tab
Figure 2. In simulations, the co-occurrence method identified SNP networks with low background.

(A - C) Networks generated by disease models with 5 SNPs at a correlation of 0.2, 20 SNPs at a correlation of 0.3, and 80 SNPs at a correlation of 0.4, respectively. Nodes represent SNPs and edges link pairs that passed the co-occurrence filter. Spiked SNPs are green. Background SNPs in the connected subnetwork are orange. The connected subnetwork is the set of nodes that connect to spiked nodes, either directly as neighbours or indirectly via other nodes. Background SNPs in the disconnected subnetwork are purple. (D) relationship between the degrees of spiked nodes (green boxplots) vs. background nodes (blue boxplots) by the number of spiked SNPs from 5 to 80, representing ten trials. Each plot is a different correlation level (phi 0.2 to 0.4). At a phi=0.2 only 80 SNPs was significant(Wilcox test, FDR corrected P value so symbol< 0.05), at all other phi values all ranges of SNPs significantly different(Wilcox test, FDR corrected P value so symbol< 0.05). (E, F) Networks generated by LD models with 1 and 9 SNPs per LD block, respectively. Colours are described in A – C. (G) Degree of nodes across LD models. Each pair of boxplots represents all nodes from 10 trials of a given model. Green boxplots represent spiked nodes, and blue boxplots represent background nodes. Models are laid out left to right from one to nine SNPs per LD block.

We evaluated the graph properties of the spike nodes relative to the non-spiked (background) nodes in the network graphs. Across all models, the mode of the spiked SNPs’ degrees was significantly higher than the mode of the background SNPs’ degrees (Fig. 2D). Furthermore, the minimum degree of the spiked SNPs and the maximum degree of the background SNPs was significantly different for disease models with a correlation of 0.3 or 0.4 (Wilcox test, FDR corrected P value < 0.05). At the 0.2 correlation level, only the model with 80 SNPs had significantly different extremes for the degree of spiked and background SNPs(Wilcox test, FDR corrected P value < 0.05) (Fig. 2 D). Based on the recall properties of the spiked SNPs, we estimated a study could be powered with a minimum of 250 each case and controls for a weak correlation (phi=0.2) and 100 cases and controls for a strong correlations (phi=0.4) to exceed an 80% recall rate (Fig. S1).

Supplemental Figure 1.
  • Download figure
  • Open in new tab
Supplemental Figure 1. Power analysis simulation.

Power was empirically estimated by the ability to recall 80 spiked nodes in a simulation study. Ten simulations were performed for populations of 100-1000 at phi 0.2 (weak effect) and 0.4 (strong effect).

LD block size does not affect SNP co-occurrence identification

LD block size varies with genetic subpopulations, which can be problematic when making comparisons between populations. To address block size, we re-evaluated the simulated case-control models while varying the LD block size when generating the simulated genomic populations (prior to any creation of paired control and disease datasets). Network structure appeared to be relatively unaffected by variation in LD. Graphs of different LD models were highly similar, where spiked nodes were again network hubs with a higher degree than background nodes and part of a larger, more connected sub-network. (Fig. 2E-G).

Co-occurring SNPs in preeclampsia

To evaluate the performance of our co-occurrence method on real-world data, we accessed a previously published GWAS data set on a case-control study of preeclampsia (Fig. 1B). Genotyping data was obtained from the EGA dataset repository as PLINK files (control dataset EGAD00000000022 and PE dataset EGAD00010000854). Control data was a general control population used by WTC to study other diseases and therefore contained males and additional SNPs26. Males were filtered out, and only SNPs genotyped in the PE population (maternal genomes) were retained. Of note is that controls were not collected to exclude PE cases, though PE has a low prevalence of about 5% worldwide15. Standard GWAS quality control procedures were applied with no imputation. The final dataset contained 3172 individuals (1320 control, 1852 PE) and 509,532 SNPs.

To correct and control for probes with a high degree of collinearity due to batch effects of cases and controls, we modelled the association of SNPs to patient classes was tested assuming an additive model using logistic regression with five multidimensional scaling components as covariates to account for ancestry. After correction, 93 SNPs still passed a Bonferroni significance threshold (9.8 x 10-8), and 350 SNPs failed due to multi-collinearity. We removed all 350 failing SNPs. This is a minimal loss relative to the over 500,000 SNPs passing QC.

Preeclampsia genetics produce a co-occurrence network

As the co-occurrence network method was applied to data with unusually high GWAS-significant SNPs, we evaluated data sets with and without the 93 passing SNPs. We assumed that most of these Bonferroni passing SNPs represent spurious differences due to a residual batch effect of merging the two cohorts. While this was not a systematic assessment of all SNPs and does not guarantee all spurious signals were removed, it removes SNPs with the strongest univariate signals, which are the SNPs most likely to affect the co-occurrence network by adding random noise.

SNP ranking is a common approach used in polygenic risk models of GWAS data20. We identified the top 4000 SNPs ranked by their p-value for differential enrichment between cases and controls. Of the 4000 input SNPs, our cooccur method placed 2895 in a network of 9755 pairs that passed the co-occurrence filter. Graphing the network (Fig. S2A) showed that although the size of the network was more extensive than observed in simulations (Fig. 2A-C), the structure of the network remained consistent (Fig. S2A). The preeclampsia data network produced a larger connected sub-network and a separate set of many smaller discrete sub-networks, herein referred to as the disconnected sub-network. We observed that the disconnected sub-network was primarily composed of small (<9 nodes) self-contained modules (Fig. 3A). These were removed for clarity in the graph (Fig. 3B). As expected from our simulations, the distribution of degree in the network was bimodal (Fig. 3C and inset i), as co-occurring disease-associated SNPs should have higher degrees than other nodes in the network as indicated by our modeling (Fig. 2). Excluding the 93 GWAS-significant SNPs from the network resulted largely in removal of nodes from the disconnected subnetwork (Fig. S2B). As the disconnected network is predicted to be background we focused our investigation on the connected co-occurrence network.

Supplemental Figure 2.
  • Download figure
  • Open in new tab
Supplemental Figure 2. Other visualizations of the PE co-occurrence network.

(A) Unfiltered network. Nodes represent SNPs and edges link pairs that passed the co-occurrence filter. Purple represents the disconnected sub-network, and orange represents the connected sub-network. All nodes are shown, including small subnetworks less than none nodes; shown are 2859 nodes connected by 9755 edges. Nodes overlap due to the large number of nodes, making the network structure challenging to see. (B) Connected sub-network after removal of GWAS-significant SNPs. Nodes that lost their connection to the main connected sub-network have been re-coloured purple.

Figure 3.
  • Download figure
  • Open in new tab
Figure 3. Preeclampsia genetic co-occurrence network.

(A) Filtered view. Clusters of less than nine nodes in size are removed to visualize the network structure better. Nodes represent SNPs and edges link pairs that passed the co-occurrence filter. Purple represents the disconnected sub-network, and orange represents the connected sub-network. (B) Distribution of size of clusters in the full network. The dotted grey line marks clusters of size 9. The clusters greater than 9 nodes are displayed in A. (C) Distribution of degree of nodes in the full network showing a bimodal distribution (inset figure i). D) Column and row names represent the SNP sets for which pathway analysis was conducted. Numbers represent the Jaccard coefficient of overlap in significant pathways for two given SNP sets (0 means no overlap, and 1 represents complete overlap. The Top 400, Full Network and Disconnected Network all show a high level of overlap. The Connected Network is highly unique. The GWAS network is also unique but limited in total number of discovered pathways.

Co-occurring SNP network is enriched in pathways related to PE pathophysiology

We proposed that the accumulation of minor allele SNPs within pathways leads to poor function and risk of preeclampsia. To test this, we used over-representation analysis of significantly co-occurring SNPs for the enrichment of Gene Ontology27. We accepted only Gene Ontology’s with a fold enrichment ≥ 2 and FDR-adjusted p-value ≤ 0.05 as significant. Critically, we evaluated multiple SNP groupings for enrichments to evaluate if the co-occurrence network contained more abundant and interpretable pathways in the context of PE pathophysiology. Specifically, we tested the full network, connected and disconnected sub-networks separately. The top 4000 and GWAS-significant SNPs were also tested for pathway enrichment. To globally assess the enrichment similarities between the different SNP sets, we evaluated the overlap of discovered pathways using a Jaccard score (Fig. 3D). The top 4000 SNPs, the entire co-occurrence network and the disconnected network were highly overlapped with a Jaccard score greater than 0.5 for all comparisons. However, the connected network was highly different, with all Jaccard scores of 0.1 or less relative to other comparisons. This was interesting as the connected network is a subset of all the top 4000 SNPs and the entire cooccurrence network.

As enriched ontologies can be highly redundant due to genes sharing multiple annotations and the hierarchical nature of the ontologies, we used the Cytoscape28 plugin EnrichmentMap29 to consolidate highly similar ontologies and create annotations based on high-frequency words in the ontology titles/descriptions30. The connected sub-network produced many ontological clusters that related to known aspects of PE pathophysiology (Fig. 4). Most prominent was a cluster of ontologies related to vascular endothelial growth factor (VEGF) signalling (Fig 4 and S3A). Defects in maternal vascular (spiral artery) remodelling are a hallmark of many PE cases. Although this is known, the SNPs discovered by co-occurrence may describe the genetic changes that lead to a poor maternal angiogenic response to pregnancy. Other pathways of interest involve immune functions, specifically leukocyte-mediated responses, chemokine interactions, interferon gamma signalling, antigen presentation and lymphocyte migration. We and others previously observed altered immune cell infiltration patterns in PE, including a subtype of PE that appears to be of a maternal immune system origin12,31. We verified these results after the removal of the 93 Bonferroni GWAS significant SNPs from the co-occurrence network. This produced a highly similar network graph enriched for the same ontologies (Fig. S3B), likely as the majority of the 93 SNPs are in the disconnected network.

Supplemental Figure 3.
  • Download figure
  • Open in new tab
Supplemental Figure 3. VEGF signaling-centered network.

A) detailed view of the pathways with significant gene overlap and annotated to VEGF signalling and related pathways. B) Enriched Gene ontologies after removal of the GWAS passing SNP/genes. A minimal change in enrichment is observed.

Figure 4.
  • Download figure
  • Open in new tab
Figure 4. The connected sub-network is enriched in Gene Ontologies related to the PE pathophysiology.

Nodes represent gene ontologies, and edges represent genetic overlap of ontologies (shared gene names). Clusters are named after the most common word patterns in the ontologies they contain. The largest cluster related to VEGF signalling is highlighted in red. All ontologies had a fold enrichment ≥ 2 and FDR-adjusted p-value ≤ 0.05.

Our modelling predicted that the disconnected network would be background co-occurrence unrelated to PE, unexpectedly we observed a high number of enriched ontologies, many with known association to preeclampsia pathophysiology (Fig. S4A). Of interest and relating to previous observations in PE patients were pathway clusters related to plasma sodium/potassium transport, phagosome pH, atrial action, urea and creatine homeostasis, and steroid biosynthesis, including glucosylceramides and thyroid stimulation.

Supplemental Figure 4.
  • Download figure
  • Open in new tab
Supplemental Figure 4. The disconnected network is enriched in ontologies related to the pathophysiology of preeclampsia.

A) The enrichment map of the ontologies is significantly associated with the SNPs of the disconnected network. Many are known to be related to the pathophysiology of preeclampsia. B) The enrichment map of the top 4000 SNPs used to build the co-occurrence networks.

However, a standard GWAS did not produce many enriched ontologies (data not shown). The top 4000 SNPs and the full network did not produce as many ontologies as the disconnect or the connect networks, despite a larger number of genes (Fig. S4B).

Discussion

Little progress has been made on the treatment and predictive diagnosis of preeclampsia2. Likely this results from the high heterogeneity between patients due to subtypes of the disease observed by us and others12,32–35. We modelled PE genetics as sets of interacting SNPs/alleles that frequently co-occur in PE to improve predictive testing and spur new avenues for PE therapy development.

Our modelling of the co-occurrence method indicated that bona fide co-occurring SNPs would form networks with high degrees and interconnectivity. Spurious co-occurrence tended not to be connected to the high-degree network and is composed of low-degree nodes. This finding fits our proposal that these multigenic causes of PE are due to the accumulation of minor alleles within pathways. Encouragingly we observed an overall similar graph topology using real-world PE data, with a highly connected central SNP network and smaller discrete networks disconnected from the central network. The agreement between the model data and the real-world data suggests that the method is working to identify SNPs associated with PE.

Significantly the connected network was highly enriched in biological processes with many related to the pathophysiology of PE. These included VEGF signalling. Poor VEGF signalling and angiogenesis are frequently observed as a feature of pathology, circulating biomolecules and genetic associations13,15,19,36,37. Other enriched ontologies of interest were related to immune cells and the presentation and trafficking of antigens. Paternal antigens are thought to play a role in PE risk for first pregnancies38. Our previous analysis of PE cohorts identified a maternal immune subtype with molecular and histopathology signs of graft versus host disease12,13,31. Generally, subsequent pregnancies with the same partner are at a lower risk due to maternal immune priming or adaptive tolerance to the paternal epitopes/antigens22.

Unexpectantly, the outer disconnected network was enriched in gene ontology terms related to possible roles in PE. If disconnected network were random noise, we would expect few enriched ontologies. Ontology enrichments of the disconnected network that may be related to PE pathophysiology were sodium-potassium plasma regulators, atrial action39, urea creatine homeostasis40, steroid biosynthesis and thyroid stimulation41. A possibility is that the disconnected network may contain genetic co-occurrence networks for associated comorbidities. Pre-existing conditions such as chronic hypertension and obesity are considered risk factors for PE but can occur independently of PE42. Potentially some forms of preeclampsia are the accumulation of a series of comorbidities that reduce the ability of the mother’s physiology to adapt to pregnancy. The genetic presence of a comorbidity may synergize with PE causal SNPs. A more rigorous case-control design that balanced obesity and other patient demographics could test this hypothesis.

An additional explanation for the enrichment of ontologies to the disconnected network is that the network is incomplete. As we used only 4000 ranked SNPs, using more SNPs might produce a larger co-occurrence network that links members of the disconnected network to the connected network. The poorer performance of ontology enrichment analysis using either the top 4000 SNPs or the full network is likely due to false positives let in by the permissive p-value in the absence of a second test (such as co-occurrence).

We encountered a few hundred probes with spurious correlation to patient classes likely due to residual batch effects, which further resulted in 93 SNPs passing a Bonferroni correction using standard GWAS method. However, the potentially spuriously passing SNPs that reached the cooccurrence network generally fell within the disconnected network. Our simulation models indicate that the disconnected network is background noise. The identification of the spuriously passing SNPs in the disconnected network indicates that our method may be robust to noisy data, potentially due to the application of two significance tests and the demand of cooccurrence embedded in a higher order structure of the connected network.

Importantly, the results of our study remaining to be reproduced in other cohorts of PE cases. Similar to typical GWAS findings, we cannot conclude that the observed co-occurrence SNPs are causal to the pathology of PE but may be linked to the causal SNPs. A possible approach is the imputation of genotypes to resolve the potential causal alleles. Our method may be applicable to sequencing-based variant discovery, such as exome resequencing or genome sequencing, but we have not validated this approach. Currently, we are working to improve this method to enable a more significant number of alleles to be tested for co-occurrence and to identify genetic subtypes of disease.

The results of our analysis may form the basis of genetic tests before or early in pregnancy. In the future, a combinatorial genetic test could classify a patient into PE subtypes and identify specific molecular and biochemical susceptibilities. Knowledge of the disrupted pathways is a start to personalized medicine approach to treating PE. Broadly this method could be applied to any disease or trait to identify co-occurrence genetic networks as the method uses standard SNP chip data sets. Other conditions known to be polygenic, including cardiovascular disease or neuropsychiatric disorders, may benefit from applying our co-occurrence method to existing data sets. To facilitate the application of the co-occurrence method to other data sets, we made the code available through a GitHub repository with supporting documents.

Methods

Co-occurrence filter and network

For case-control genomic data, pairs of SNPs passing two co-occurrence filters created networks. The first filter selected SNP pairs that co-occurred more or less frequently than expected in the control or case population. Co-occurring refers to at least one minor allele at both SNP loci. Co-occurrence was calculated by a customized version of the co-occur function from the R package co-occur, which uses a hypergeometric test43. SNP pairs with FDR-adjusted p-values ≤ 0.05 passed the filter. We parallelized the function to run more efficiently but limited all analyses to a maximum of 4000 input SNPs. The second filter selected for SNP pairs that co-occurred at significantly different rates in control vs case populations. A chi-squared test was used, and SNP pairs with FDR-adjusted p-values ≤ 0.05 passed the filter. Networks, with nodes representing SNPs and edges representing co-occurrences, were created with the graph package in R44.

Simulations for method validation

For validation, the co-occurrence method was applied to artificial case-control populations. A population of artificial genomes was generated with the R function to generate SNPs from the package minutest (version 1.7)45. Genotypes were re-coded to 0s or 1s to represent minor alleles’ absence or presence. A population of 6000 subjects was generated. To generate a single trial of a case-control dataset, two sets of 1000 genomes were sampled from the population to form the case and control cohorts without replacement. Before altering the case-cohort, the co-occurrence method was applied to assess its results when no difference was expected.

In the case-cohort, the correlation was forced between a set of randomly sampled SNPs (herein called spiked SNPs). Individual frequencies of the SNPs were maintained to ensure no difference in individual SNP frequency between case and control. This was accomplished with the function rmvbin from the R package bindata46. When provided with a matrix containing the desired correlation level between sampled SNPs and the minor allele frequencies of the sampled SNPs, the function generates genotypes (0s and 1s) that satisfy both the desired correlation and minor allele frequencies. These genotypes replaced the original genotypes of the sampled SNPs in the disease population. In total, ten cohorts were generated.

Fifteen disease models were generated by combinations of the number of spiked SNPs (5, 10, 20, 40, or 80), and the correlation level (0.2, 0.3, or 0.4) was varied. For the disease models, the background genomic structure of the population was kept constant (2 SNPs per LD block, 8 LD blocks per gene, and 250 genes). For the disease models, ten pairs of case-control were drawn from the population (before spiking SNPs). Each of the 15 disease models that varied SNP number and correlation value was built from the same ten cohorts.

Additionally, nine LD models were generated, where the number of SNPs per LD block varied from 1 to 9. The number of genes was set to keep the size of the simulated genome close to but under 4000 SNPs. The disease model used for LD models was kept constant (20 SNPs at a correlation of 0.3). As the population parameters were altered during the simulation, a new set of 10 case controls for each LD model were used for each LD block size.

Individual SNPs were tested for disease association using the Cochrane-Armitage trend test (p ≤ 5 x 10-8) to demonstrate that the generated case-control datasets did not yield significant univariate results. The co-occurrence method described above was then applied to the datasets. The resultant networks were then assessed. Spiked nodes were coloured differently in the network to determine if they were visually distinguishable from background nodes. Their degree (number of neighbouring nodes in the network) was assessed. A Wilcox test was used to determine if the mode of the ten cohorts spiked SNPs’ degrees significantly differed from the mode of background SNPs’ degrees (FDR adjusted p-value ≤ 0.05) within a given disease or LD model. Likewise, a Wilcox test was used to determine if the minimum of spiked SNPs’ degrees significantly differed from the maximum of background SNPs’ degrees (FDR adjusted p-value ≤ 0.05).

Preeclampsia data: QC, GWAS, and co-occurrence

Genotyping data was obtained from the European Genome-Phenome Archive’s dataset repository. The Wellcome Trust Case Control Consortium (WTC) originally collected the data. The PE dataset (EGAD00010000854) containing maternal genomic data and the control dataset (EGAD00000000022) were collected separately though both cohorts were from the United Kingdom. The controls served as common controls for the WTC to study several diseases. They thus included males and were not described as excluding PE. However, PE has a low prevalence of around 5%8,15.

A standard GWAS protocol, using PLINK47, KING48, and R, was applied to the data for quality control and to prioritize a set of 4000 SNPs to input into the co-occurrence method. Control and disease data were merged, and only SNPs in both datasets were kept. Only females were kept. No imputation was done as the co-occurrence method was applied to only 4000 SNPs. The following quality control measures were performed: individuals with discordant sex, genotype missing rates ≥ 0.025, heterozygosity ≥ 2 standard deviations away from the mean, and non-northern European ancestry (inferred using KING) were removed. One individual from every related pair (IBS > 0.185) was removed. SNPs with genotype missing rates ≥ 0.05, with genotype missing rates that differed between control and PE (FDR adjusted p-value from chi-squared test ≤ 0.05), that deviated from Hardy-Weinberg equilibrium (p ≤ 1.0 x 10-6), and whose minor allele frequency was ≤ 0.05 were removed. Association was tested assuming an additive model using logistic regression with five multidimensional scaling components. Bonferroni significance level was used (0.05 divided by the number of SNPs).

Only 4000 SNPs were input into the co-occurrence method to remain consistent and allow comparison to simulations. The 4000 SNPs with the smallest p-values from the GWAS were used. Genotypes of these SNPs were coded as 0s and 1s, and the co-occurrence method described earlier was then applied.

Pathway enrichment of genotypes in co-occurrence network

Pathway enrichment was conducted using GREAT49. This web-based tool assigns SNPs (including intergenic ones) to genes and then tests for their over-representation in pathways. The set of all SNPs passing quality control was used as the genomic background for these tests. The association rules used to assign SNPs to genes were left as their default: “basal plus extension” with proximal set to 5.0 kb upstream and 1 kb downstream, distal set to 1000 kb, and curated regulatory domains included. Gene Ontology pathways with fold enrichment ≥ 2 and FDR-adjusted p-value ≤ 0.05 were considered significant.

Cytoscape 28(version 3.7.2) was used to interpret the many pathways returned28 to create a less redundant network where pathways (nodes) with high genetic overlap are linked. Within Cytoscape, the Enrichment Map29 and Auto-Annotate30 apps were used to create the network and summarize its clusters.

Funding

BJC was supported by Tier 2 Canada Research Chair in maternal fetal communication and AO was supported by a graduate scholarship from NSERC.

Data Availability

Genotyping data was obtained from the European Genome-Phenome Archive's dataset repository. The Wellcome Trust Case Control Consortium (WTC) originally collected the data. The PE dataset (EGAD00010000854) containing maternal genomic data and the control dataset (EGAD00000000022) were collected separately, though both cohorts were from the United Kingdom.

Acknowledgments

High performance computing infrastructure and technical support was provided by Compute Canada and SciNet.

The authors that they have no competing financial interests and that funders had no input into research or review of publication of results.

References

  1. 1.↵
    Organization. WH. Trends in Maternal Mortality: 2000 to 2017: Estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations Population Division; World Health Organization: Geneva, Switzerland, 2019. 2020.
  2. 2.↵
    Roberts JM, Bell MJ. If we know so much about preeclampsia, why haven’t we cured the disease? Journal of Reproductive Immunology. 2013;99(1–2):1–9.
    OpenUrlCrossRefPubMed
  3. 3.↵
    Pennington K a, Schlitt JM, Jackson DL, Schulz LC, Schust DJ. Preeclampsia: multiple approaches for a multifactorial disease. Disease models & mechanisms. 2012;5(1):9–18.
    OpenUrl
  4. 4.↵
    McLaughlin K, Zhang J, Lye SJ, Parker JD, Kingdom JC. Phenotypes of pregnant women who subsequently develop hypertension in pregnancy. Journal of the American Heart Association. 2018;7(14):1–12.
    OpenUrlCrossRefPubMed
  5. 5.↵
    Kleinrouweler CE, Wiegerinck MMJ, Ris-Stalpers C, Bossuyt PMM, van der Post J a M, von Dadelszen P, Mol BWJ, Pajkrt E. Accuracy of circulating placental growth factor, vascular endothelial growth factor, soluble fms-like tyrosine kinase 1 and soluble endoglin in the prediction of pre-eclampsia: a systematic review and meta-analysis. BJOG: an international journal of obstetrics and gynaecology. 2012;119(7):778–87.
    OpenUrl
  6. 6.↵
    Redman CW, Sargent IL, Staff a C. IFPA Senior Award Lecture: making sense of pre-eclampsia - two placental causes of preeclampsia? Placenta. 2014;35 Suppl:S20–5.
    OpenUrlCrossRefPubMedWeb of Science
  7. 7.↵
    Chaiworapongsa T, Chaemsaithong P, Yeo L, Romero R. Pre-eclampsia part 1: Current understanding of its pathophysiology. Nature Reviews Nephrology. 2014;10(8):466–480.
    OpenUrl
  8. 8.↵
    Burton GJ, Redman CW, Roberts JM, Moffett A. Pre-eclampsia: pathophysiology and clinical implications. The BMJ. 2019;366:1–15.
    OpenUrl
  9. 9.↵
    Ahmad S, Ahmed A. Elevated placental soluble vascular endothelial growth factor receptor-1 inhibits angiogenesis in preeclampsia. Circulation research. 2004;95(9):884.
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    Gleicher N. Why much of the pathophysiology of preeclampsia-eclampsia must be of an autoimmune nature. American journal of obstetrics and gynecology. 2007;196(1):5.e1-7.
    OpenUrlCrossRefPubMed
  11. 11.↵
    Rademacher TW, Gumaa K, Scioscia M. Preeclampsia, insulin signalling and immunological dysfunction: a fetal, maternal or placental disorder? Journal of reproductive immunology. 2007;76(1–2):78–84.
    OpenUrlCrossRefPubMed
  12. 12.↵
    Leavey K, Benton SJ, Grynspan D, Kingdom JC, Bainbridge SA, Cox BJ. Unsupervised placental gene expression profiling identifies clinically relevant subclasses of human preeclampsia. Hypertension. 2016;68(1):137–147.
    OpenUrlCrossRef
  13. 13.↵
    Benton SJ, Leavey K, Grynspan D, Cox BJ, Bainbridge SA. The clinical heterogeneity of preeclampsia is related to both placental gene expression and placental histopathology. American journal of obstetrics and gynecology. 2018;219(6):604--e1.
    OpenUrlCrossRef
  14. 14.↵
    Gibbs I, Leavey K, Benton SJSJ, Grynspan D, Bainbridge SA, Cox BJBJBJ. Placental transcriptional and histologic subtypes of normotensive fetal growth restriction are comparable to preeclampsia. American Journal of Obstetrics and Gynecology. 2019;220(1):110--e1.
    OpenUrlCrossRef
  15. 15.↵
    Gray KJ, Saxena R, Karumanchi SA. Genetic predisposition to preeclampsia is conferred by fetal DNA variants near FLT1, a gene involved in the regulation of angiogenesis. American Journal of Obstetrics and Gynecology. 2017;218(2):211–218.
    OpenUrl
  16. 16.↵
    Johnson MP, Brennecke SP, East CE, Göring HHH, Kent JW, Dyer TD, Said JM, Roten LT, Iversen AC, Abraham LJ, Heinonen S, Kajantie E, Kere J, Kivinen K, Pouta A, et al. Genome-wide association scan identifies a risk locus for preeclampsia on 2q14, near the inhibin, beta B gene. PLoS ONE. 2012;7(3).
  17. 17.↵
    Wang Q, Wang G, Guo C, Cao X, An L, Du M, Qiu Y, Yang Y, Wang Y, Wang S, Wang X, Ma X. Single nucleotide polymorphisms near the inhibin beta B gene on 2q14 are associated with pre-eclampsia in Han Chinese women. European Journal of Obstetrics and Gynecology and Reproductive Biology. 2015;193:127–131.
    OpenUrl
  18. 18.↵
    McGinnis R, Steinthorsdottir V, Williams NO, Thorleifsson G, Shooter S, Hjartardottir S, Bumpstead S, Stefansdottir L, Hildyard L, Sigurdsson JK, Kemp JP, Silva GB, Thomsen LC V., Jääskeläinen T, Kajantie E, et al. Variants in the fetal genome near FLT1 are associated with risk of preeclampsia. Nature Genetics. 2017;49(8):1255–1260.
    OpenUrlCrossRefPubMed
  19. 19.↵
    Levine RJ, Maynard SE, Qian C, Lim K-H, England LJ, Yu KF, Schisterman EF, Thadhani R, Sachs BP, Epstein FH, Sibai BM, Sukhatme VP, Karumanchi SA. Circulating angiogenic factors and the risk of preeclampsia. The New England journal of medicine. 2004;350(7):672–83.
    OpenUrlCrossRefPubMedWeb of Science
  20. 20.↵
    Dudbridge F. Power and Predictive Accuracy of Polygenic Risk Scores. PLoS Genetics. 2013;9(3).
  21. 21.↵
    Johnson MP, Roten LT, Dyer TD, East CE, Forsmo S, Blangero J, Brennecke SP, Austgulen R, Moses EK. The ERAP2 gene is associated with preeclampsia in Australian and Norwegian populations. Human Genetics. 2009;126(5):655–666.
    OpenUrlCrossRefPubMedWeb of Science
  22. 22.↵
    North R a., McCowan LME, Dekker G a., Poston L, Chan EHY, Stewart a. W, Black M a., Taylor RS, Walker JJ, Baker PN, Kenny LC. Clinical risk prediction for pre-eclampsia in nulliparous women: development of model in international prospective cohort. Bmj. 2011;342(apr07 4):d1875–d1875.
    OpenUrlAbstract/FREE Full Text
  23. 23.↵
    Ooi SL, Pan X, Peyser BD, Ye P, Meluh PB, Yuan DS, Irizarry RA, Bader JS, Spencer FA, Boeke JD. Global synthetic-lethality analysis and yeast functional profiling. Trends in Genetics. 2006;22(1):56–63.
    OpenUrlCrossRefPubMedWeb of Science
  24. 24.↵
    Hajeri VA, Amatruda JF. Studying synthetic lethal interactions in the zebrafish system: Insight into disease genes and mechanisms. DMM Disease Models and Mechanisms. 2012;5(1):33–37.
    OpenUrl
  25. 25.↵
    Gabriel SB, Schaffner SF, Nguyen H, Moore JM, Roy J, Blumenstiel B, Higgins J, DeFelice M, Lochner A, Faggart M, Liu-Cordero SN, Rotimi C, Adeyemo A, Cooper R, Ward R, et al. The structure of haplotype blocks in the human genome. Science. 2002;296(5576):2225–2229.
    OpenUrlAbstract/FREE Full Text
  26. 26.↵
    Burton PR, Clayton DG, Cardon LR, Craddock N, Deloukas P, Duncanson A, Kwiatkowski DP, McCarthy MI, Ouwehand WH, Samani NJ, Todd JA, Donnelly P, Barrett JC, Davison D, Easton D, et al. Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature. 2007;447(7145):661–678.
    OpenUrlCrossRefPubMedWeb of Science
  27. 27.↵
    27. The Gene Ontology Consortium, Carbon S, Douglass E, Dunn N, Good B, Harris NL, Lewis SE, Mungall CJ, Basu S, Chisholm RL, Dodson RJ, Hartline E, Fey P, Thomas PD, Albou LP, et al. The Gene Ontology Resource: 20 years and still GOing strong. Nucleic Acids Research. 2019;47(D1):D330–D338.
    OpenUrlCrossRefPubMed
  28. 28.↵
    Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome research. 2003;13(11):2498–504.
    OpenUrlAbstract/FREE Full Text
  29. 29.↵
    Merico D, Isserlin R, Stueker O, Emili A, Bader GD. Enrichment map: a network-based method for gene-set enrichment visualization and interpretation. PloS one. 2010;5(11):e13984.
    OpenUrlCrossRefPubMed
  30. 30.↵
    Kucera M, Isserlin R, Arkhangorodsky A, Bader GD. AutoAnnotate: A Cytoscape app for summarizing networks with semantic annotations. F1000Research. 2016;5:1717.
    OpenUrl
  31. 31.↵
    Leavey K, Grynspan D, Cox BJBJBJ. Both “canonical” and “immunological” preeclampsia subtypes demonstrate changes in placental immune cell composition. Placenta. 2019;83(May):53–56.
    OpenUrl
  32. 32.↵
    Leavey K, Bainbridge SA, Cox BJ. Large scale aggregate microarray analysis reveals three distinct molecular subclasses of human preeclampsia. PloS one. 2015;10(2):e0116508.
    OpenUrlCrossRefPubMed
  33. 33.
    Redman CWG, Staff AC, Roberts JM. Syncytiotrophoblast stress in preeclampsia: the convergence point for multiple pathways. American Journal of Obstetrics and Gynecology. 2021:1–21.
  34. 34.
    von Dadelszen P, Magee LA, Roberts JM. Subclassification of preeclampsia. Hypertension in pregnancy: official journal of the International Society for the Study of Hypertension in Pregnancy. 2003;22(2):143–8.
    OpenUrl
  35. 35.↵
    Taylor BD, Ness RB, Klebanoff MA, Zoh R, Bass D, Hougaard DM, Skogstrand K, Haggerty CL. First and second trimester immune biomarkers in preeclamptic and normotensive women. Pregnancy Hypertension. 2016;6(4):388–393.
    OpenUrl
  36. 36.↵
    Weiner E, Mizrachi Y, Grinstein E, Feldstein O, Rymer-Haskel N, Juravel E, Schreiber L, Bar J, Kovo M. The role of placental histopathological lesions in predicting recurrence of preeclampsia. Prenatal Diagnosis. 2016;36(10):953–960.
    OpenUrl
  37. 37.↵
    McGinnis R, Steinthorsdottir V, Williams NO, Thorleifsson G, Shooter S, Hjartardottir S, Bumpstead S, Stefansdottir L, Hildyard L, Sigurdsson JK, Kemp JP, Silva GB, Thomsen LC V., Jääskeläinen T, Kajantie E, et al. Variants in the fetal genome near FLT1 are associated with risk of preeclampsia. Nature Genetics. 2017;49(8):1255–1260.
    OpenUrlCrossRefPubMed
  38. 38.↵
    Zenclussen AC, Gerlof K, Zenclussen ML, Sollwedel A, Bertoja AZ, Ritter T, Kotsch K, Leber J, Volk HD. Abnormal T-cell reactivity against paternal antigens in spontaneous abortion: Adoptive transfer of pregnancy-induced CD4+CD25+ T regulatory cells prevents fetal rejection in a murine abortion model. American Journal of Pathology. 2005;166(3):811–822.
    OpenUrlCrossRefPubMedWeb of Science
  39. 39.↵
    Inci S, Nar G, Aksan G, Sipahio lu H, Soylu K, Dogan A. P-wave dispersion and atrial electromechanical delay in patients with preeclampsia. Medical Principles and Practice. 2015;24(6):515–521.
    OpenUrl
  40. 40.↵
    Bainbridge SA, Roberts JM. Uric Acid as a Pathogenic Factor in Preeclampsia. Placenta. 2008;29(SUPPL.):67–72.
    OpenUrl
  41. 41.↵
    Toloza FJK, Derakhshan A, Männistö T, Bliddal S, Popova P V., Carty DM, Chen L, Taylor P, Mosso L, Oken E, Suvanto E, Itoh S, Kishi R, Bassols J, Auvinen J, et al. Association between maternal thyroid function and risk of gestational hypertension and pre-eclampsia: a systematic review and individual-participant data meta-analysis. The Lancet Diabetes and Endocrinology. 2022;10(4):243–252.
    OpenUrl
  42. 42.↵
    Block-Abraham DM, Turan OM, Doyle LE, Kopelman JN, Atlas RO, Jenkins CB, Blitzer MG, Baschat AA. First-trimester risk factors for preeclampsia development in women initiating aspirin by 16 weeks of gestation. Obstetrics and Gynecology. 2014;123(3):611– 617.
    OpenUrl
  43. 43.↵
    Griffith DM, Veech JA, Marsh CJ. Cooccur: Probabilistic species co-occurrence analysis in R. Journal of Statistical Software. 2016;69(1):1–17.
    OpenUrl
  44. 44.↵
    Csardi G, Nepusz T. The igraph software package for complex network research. Inter Journal Complex Systems. 2006:1695.
  45. 45.↵
    Hieke S, Binder H, Nieters A, Schumacher M. minPtest: a resampling based gene region-level testing procedure for genetic case-control studies. 2014:51–63.
  46. 46.↵
    Leisch F, Weingessel A, Hornik K. On the Generation of Correlated Artificial Binary Data. Working Paper. 1998;(13):1–15.
    OpenUrl
  47. 47.↵
    Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MAR, Bender D, Maller J, Sklar P, De Bakker PIW, Daly MJ, Sham PC. PLINK: A tool set for whole-genome association and population-based linkage analyses. American Journal of Human Genetics. 2007;81(3):559–575.
    OpenUrlCrossRefPubMed
  48. 48.↵
    Manichaikul A, Mychaleckyj JC, Rich SS, Daly K, Sale M, Chen W-M, Barrett J. Robust relationship inference in genome-wide association studies. 2010;26(22):2867–2873.
  49. 49.↵
    McLean CY, Bristor D, Hiller M, Clarke SL, Schaar BT, Lowe CB, Wenger AM, Bejerano G. GREAT improves functional interpretation of cis-regulatory regions. Nature biotechnology. 2010;28(5):495–501.
    OpenUrlCrossRefPubMedWeb of Science
Back to top
PreviousNext
Posted July 10, 2024.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Genetic co-occurrence networks identify polymorphisms within ontologies highly associated with preeclampsia
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Genetic co-occurrence networks identify polymorphisms within ontologies highly associated with preeclampsia
Andreea Obersterescu, Brian J. Cox
medRxiv 2024.07.09.24310164; doi: https://doi.org/10.1101/2024.07.09.24310164
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Genetic co-occurrence networks identify polymorphisms within ontologies highly associated with preeclampsia
Andreea Obersterescu, Brian J. Cox
medRxiv 2024.07.09.24310164; doi: https://doi.org/10.1101/2024.07.09.24310164

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Sexual and Reproductive Health
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)