Gut community structure as a risk factor for infection in Klebsiella-colonized patients
=======================================================================================

* Jay Vornhagen
* Krishna Rao
* Michael A. Bachman

## Abstract

The primary risk factor for infection with members of *the Klebsiella pneumoniae* species complex is prior gut colonization, and infection is often caused by the colonizing strain. Despite the importance of the gut as a reservoir for infectious *Klebsiella*, little is known about the association between the gut microbiome and infection. To explore this relationship, we undertook a case-control study comparing the gut community structure of *Klebsiella*-colonized intensive care and hematology/oncology patients. Cases were *Klebsiella*-colonized patients infected by their colonizing strain (N = 83). Controls were *Klebsiella*-colonized patients that remained asymptomatic (N = 149). First, we characterized the gut community structure of *Klebsiella*-colonized patients agnostic to case status. Next, we determined that gut community data is useful for classifying cases and controls using machine learning models and that the gut community structure differed between cases and controls. *Klebsiella* relative abundance, a known risk factor for infection, had the greatest feature importance but other gut microbes were also informative. Finally, we show that integration of gut community structure with bacterial genotype or clinical variable data enhanced the ability of machine learning models to discriminate cases and controls. This study demonstrates that including gut community data with patient- and *Klebsiella*-derived biomarkers improves our ability to predict infection in *Klebsiella*-colonized patients.

**Importance** Colonization is generally the first step in pathogenesis for bacteria with pathogenic potential. This step provides a unique window for intervention since a given potential pathogen has yet to cause damage to its host. Moreover, intervention during the colonization stage may help alleviate the burden of therapy failure as antimicrobial resistance rises. Yet, to understand the therapeutic potential of interventions that target colonization, we must first understand the biology of colonization and if biomarkers at the colonization stage can be used to stratify infection risk. The bacterial genus *Klebsiella* includes many species with varying degrees of pathogenic potential. Members of the *K. pneumoniae* species complex have the highest pathogenic potential. Patients colonized in their gut by these bacteria are at higher risk of subsequent infection with their colonizing strain. However, we do not understand if other members of the gut microbiota can be used as a biomarker to predict infection risk. In this study, we show that the gut microbiota differs between colonized patients that develop an infection versus those that do not. Additionally, we show that integrating gut microbiota data with patient and bacterial factors improves the ability to predict infections. As we continue to explore colonization as an intervention point to prevent infections in individuals colonized by potential pathogens, we must develop effective means for predicting and stratifying infection risk.

## Introduction

The gut is a vast ecosystem populated by trillions of bacteria, viruses, and microbial eukaryotes. The majority of these microbes have beneficial or neutral impacts on host health; however, some are potential pathogens. Under specific circumstances, some gut microbes can escape to distant body sites, leading to infection. One such group of pathogens is the *Klebsiella pneumoniae* species complex (referred to as “*Klebsiella*”). This complex contains several potentially pathogenic species of *Klebsiella*, including *K. pneumoniae*, *K. variicola*, *K. quasipneumoniae*, *K. quasivariicola* sp. nov., and *K. africana* (reviewed in (1)). These bacteria are common causes of bacteremia, pneumonia, and urinary tract infection (UTI). The genome content of a given strain of *Klebsiella* determines its infectious potential, where the presence of virulence and fitness factors permits and enhances infectivity, and antimicrobial resistance genes complicate infection treatment (2). As of 2019, *Klebsiella* is the third leading global cause of death attributable to, or associated with, antimicrobial resistance (3). More research is necessary to understand the *Klebsiella* pathogenesis. Such research may lead to improved diagnosis and treatment, and therein reduce the burden of *Klebsiella* disease.

*Klebsiella-*colonized patients are at increased risk for subsequent infection (4–6). Though few patient-centered studies determine the specific origin of infectious *Klebsiella*, those that have demonstrate that *Klebsiella-*colonized patients are infected with their colonizing strains in about ∼80% of cases (4, 6, 7). Additionally, gut dominance by *Klebsiella* is a risk factor for infection in *Klebsiella-* colonized patients (8–10). The identification and interrogation of factors that permit, enhance, or restrict *Klebsiella* gut colonization are receiving increased attention due to the clear importance of the gut as a reservoir for infectious *Klebsiella*. Recent laboratory-based studies have identified novel gut fitness factors (11–14), microbes that enhance colonization resistance (15, 16), and gut community structures that are permissive or restrictive to colonization (11, 17). Despite increased interest, studies aiming to understand gut ecology in *Klebsiella-*colonized patients are comparatively sparse, limiting the translatability of laboratory-based findings to real-world settings.

Previously, we performed a cohort study of over 1,900 *Klebsiella*-colonized patients in the intensive care and hematology/oncology units (7). The goal of this study was to identify patient variables associated with infection and two corresponding nested case-control studies were performed to assess the role of gut dominance in *Klebsiella* infection (8) and to rigorously identify infection-associated *Klebsiella* factors (18). Here, we aimed to leverage this case-control cohort of patients to understand the gut ecology of *Klebsiella-*colonized patients and determine if microbiome-derived biomarkers can improve infection prediction in *Klebsiella*-colonized patients.

## Results

### Description of study population

238 patients were originally selected from a cohort of 1,978 *Klebsiella* colonized intensive care and hematology/oncology patients (7) for a nested case-control study to assess the role of gut colonization density as a risk factor for *Klebsiella* infection (8). Cases were defined as colonized patients who met clinical criteria for infection (see prior publications for detailed criteria and physician case review process) with a *Klebsiella* strain that was detectable in the gut prior to infection. Controls had rectal colonization but no subsequent, symptomatic clinical infection. Cases were matched 1:2 with asymptomatically colonized controls based on rectal swab collection date, age, and sex. For the present study, we selected 232 patients (Table 1) from the previous study based on inclusion in our previous comparative genomics study and available DNA extracted from the rectal swab most proximal to the infection (18). The most common infection type was bacteremia, followed by UTI and respiratory infection (Table 1). 16S rRNA sequencing was performed using the method described by Kozich *et al.* 2013 (19).

View this table:
[Table 1.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/T1)

Table 1. 
Select patient demographics

### Description of the gut community of *Klebsiella-*colonized patients

First, we aimed to explore the gut community structure of *Klebsiella-*colonized patients agnostic of case status. *Klebsiella*, *Enterococcus*, *Escherichia/Shigella*, *Finegoldia*, and *Peptoniphilus* were the dominant gut microbiota in this study population (Figure 1A). Probabilistic modelling using Dirichlet multinomial mixtures (20) was used to determine if metacommunities exist in our study population. The optimal number of community clusters was two (Laplace approximation = 194340.97, Table S1), though one and three-community clusters yielded similar fits (one-community Laplace approximation = 194864.80, three-community Laplace approximation = 200401.69, Table S1). Case status was not associated with metacommunity structure in either the two (partition 1 v partition 2 odds ratio [95% CI] = 1.35 [0.789-2.32]) or three-community models (partition 1 v partition 2 odds ratio [95% CI] = 1.11 [0.505-2.46], partition 1 v partition 3 odds ratio [95% CI] = 0.921 [0.414-2.05], partition 2 v partition 3 odds ratio [95% CI] = 0.826 [0.46-1.48]). Principle coordinates analysis revealed that *Klebsiella* and *Enterococcus* were strong components determining metacommunity structure in both two (Partition 1, Figure 1B) and three-partition communities (Partition 3, Figure 1C), whereas other dominant gut microbiota influence different metacommunities (Figures 1B, C). Alpha-diversity analysis of these metacommunities revealed that *Klebsiella* influenced partitions (Partition 1 and Partition 3 in two and three partition communities, respectively) were significantly less rich (Chao), even (Shannon) and diverse (Inverse Simpson) than other metacommunities (Figures 1D-I). Interestingly, Partition 1 of the three-partition community clustering, which is heavily influenced by *Escherichia/Shigella* (Figure 1C), was significantly less rich, even, and diverse than Partition 2 (Figure 1G-I), which is influenced by *Finegoldia* and *Peptoniphilus* (Figure 1C). Given that *Finegoldia* and *Peptoniphilus* are strict anaerobes and *Klebsiella*, *Enterococcus*, and *Escherichia/Shigella* are facultative anaerobes, it may be the case that alpha diversity is driven by the presence or absence of anaerobic bacteria in the gut in this patient population. Collectively, these data indicate that *Klebsiella* is the dominant gut microbe in this population of *Klebsiella-*colonized patients, and is associated with reduced richness, evenness, and diversity.

![Figure 1.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F1)

Figure 1. *Klebsiella* is the dominant gut microbe in *Klebsiella-*colonized patients
(A) Top five operational taxonomic units (OTUs) in *Klebsiella-*colonized patients (N = 232). Principal coordinates analysis with overlayed biplots of OTUs of two (B) and three-partition (C) community clustering using Dirichlet multinomial mixtures. Analysis of the Chao, Shannon, and Inverse Simpson alpha-diversity indices in two (D-F) and three-partition community clustering (G-I, boxplot indicates median with interquartile range, *p* indicates student’s *t* test *p-*value after Benjamini & Hochberg correction for multiple comparisons). For all panels, each datapoint indicates one patient.

### Determination of optimal taxonomic level to classify cases and controls

Out next goal was to determine the ability of microbiota composition to discriminate cases from controls. To this end, we used supervised machine learning models to classify case status, using different taxonomic levels as input data. Due to their high interpretability compared to other methods, we chose to use regularized logistic regression. To ensure optimal model performance, training was iterated across several combinations of hyperparameters (as in (21)), wherein the hyperparameter combination that yielded peak training performance was used for the final model (Figure S1). This process was repeated for phylum, class, order, family, genus, OTU, and amplicon sequence variant (ASV) level-data. ASVs provided the most robust discrimination of cases and controls (median area under the receiver-operator characteristic curve [AUC] = 0.68), followed by OTU (median AUC = 0.64) and phylum (median AUC = 0.63, Figure 2A). Additionally, models using ASVs as their input variables were most likely to yield an AUC > 0.5, indicating that classification of cases and controls was better than random chance. We found similar outcomes using the random forest method (Figure S2A), indicating that our results are robust across models that differ in method and interpretability. As we observed optimal model performance with ASVs, we decided to use the taxonomic level for the further study analyses.

![Figure 2.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F2)

Figure 2. Amplicon sequence variants best discriminate cases and controls
(A) Regularized logistic regression model performance, as measured by area under the receiver-operator characteristic curve (AUC), on 100 test data sets consisting of a random subset of samples (80%) to predict case status in *Klebsiella* colonized patients (N = 232) using different taxonomical data inputs. Black circles indicate median AUC values, and black lines indicate standard deviation (*p* indicates Tukey multiple pairwise-comparison ANOVA *p-*value following one way). (B) Top model features for regularized logistic regression models using amplicon sequence variants (ASVs) as input data, corresponding to panel A, “ASVs.” Circles indicate mean feature importance and lines indicate interquartile range. Feature importance values in red and black indicate a regression weight that are weighted toward cases and controls, respectively. (C) Regularized logistic regression model performance on test data sets for 100 seeds predicting case status in *Klebsiella* colonized patients using all ASVs (All ASVs) or excluding ASVs ASV000001, ASV000021, and ASV000195 (-Top ASVs, *p* indicates student’s *t* test *p-*value). Black circles indicate median AUC values, and black lines indicate standard deviation. For panels A and C, each datapoint indicates one test data set.

Consistent with previous observations that gut dominance by *Klebsiella* is a risk factor for infection in colonized patients (8–10), ASV000001 *Klebsiella* was the most important feature in our regularized logistic regression models and was weighted toward cases (Figure 2B). Interestingly, two other ASVs, ASV000021 *Akkermansia*, and ASV000195 *Anaerostipes*, were also highly important features weighted toward cases (Figure 2B). This suggests that other members of the gut microbiota have discriminatory power for case status, rather than discriminatory power being limited to *Klebsiella*. Similar results were yielded in our random forest models (Figure S2A). Given the relatively high feature importance of these ASVs compared to other important features (Figure 2B), we hypothesized that removal of the ASVs may result in a model with no ability to classify cases and controls (AUC ≤ 0.5). Removal of these ASVs significantly reduced model performance (Figure 2C); however, most models were still able to classify cases and controls better than chance (AUC > 0.5). This indicates that peak model performance relies on inclusion of many or all ASVs, rather than a small subset of ASVs.

### Case and control gut community profiles differ

Given that cases and controls can be distinguished based on ASVs using machine learning, we next wanted to determine if the gut community profile of cases and controls differ. To this end, Yue and Clayton θ dissimilarity index was calculated for each patient and used to assess the difference in beta-diversity between cases and controls. Visualization of distances using principal coordinates analysis revealed subtly different clustering of these groups (Figure 3A). Though variance between the two groups was highly dimensional, as indicated by the low axis loadings (Figure 3A), the gut microbiota of cases and controls was significantly different (adjusted *p*-value = 1 x 10-4, AMOVA). Only community evenness (Shannon) was significantly different between cases and controls, though community richness and diversity displayed similar trends (Figure 3B-D). Interestingly, the ASVs that were highly important for classifying cases and controls using machine learning models (Figures 2B, S2B) partially differed from those enriched in either cases or controls. Linear discriminant analysis revealed that, as expected, ASV000001 *Klebsiella* was significantly enriched in cases, though unlike what was observed in the machine learning models, ASV000002 *Enterococcus* was also enriched in cases and ASV000012 *Streptococcus* was enriched in controls (Figure 3E-F). Similar results were yielded using OTUs instead of ASVs to differentiate cases and controls (Figure S3). Network analysis revealed that the gut community of controls was more connected than the gut community of cases (Figure S4), suggesting a more stable gut community. Collectively, these data indicate that significant differences, not limited to *Klebsiella* relative abundance, exist between cases and controls that underpin the ability to discriminate these two groups based on gut community profile.

![Figure 3.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F3.medium.gif)

[Figure 3.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F3)

Figure 3. Cases and controls have distinct gut community profiles based on ASVs
(A) Principal coordinates analysis with overlayed biplots of specific ASVs. Analysis of molecular variance (AMOVA) based on the Yue and Clayton θ dissimilarity index was used to assess the difference in beta-diversity between cases (N = 83) and controls (N = 149). Analysis of the (B) Chao, (C) Shannon, and (D) Inverse Simpson alpha-diversity indices between cases (N = 83) and controls (N = 149, boxplot indicates median with interquartile range, *p* indicates student’s *t* test *p-*value).

(E) Linear discriminant analysis (LDA) effect size was used to identify differentially abundant (*p-*value < 0.05) ASVs between cases (N = 83) and controls (N = 149). (F) Summary of relative abundances of ASVs that were differentially abundant (Figure 3E) between cases (N = 83) and controls (N = 149) or highly important features for classification of cases and controls using regularized logistic regression shown in Figure 2B (boxplot indicates median with interquartile range). For all panels, each datapoint indicates one patient.

Previously, we were able to detect the presence of multiple *Klebsiella* strains in colonized patients (18). A deeper exploration of ASVs revealed 30 ASVs that were classified as *Klebsiella*, and another 10,470 ASVs that were only classified to the level of Enterobacteriaceae. The majority (83.1%, 193/232) of patients had only one detectable *Klebsiella* ASV; however, 9.9% (23/323) of patients had multiple *Klebsiella* ASVs and 6.9% (16/232) had no *Klebsiella* ASVs (Figure S5A) despite microbiological confirmation of *Klebsiella* colonization. Interestingly, we detected ASV000019 *Klebsiella* in several controls, though no cases (Figure S5B). Though ASVs based on the V4 region of the 16S rRNA gene do not provide high-confidence species-level resolution, it was notable that the ASV000019 sequence primarily aligned to members of the *K. oxytoca* complex (22), whereas the ASV000001 sequence primarily aligned to members of the *K. pneumoniae* complex (Table S2). Interestingly, ASV000001 is absent from patients colonized by ASV000019 (Figure S5C). Collectively, these results suggest that strain-level measurement of cocolonization may be possible through targeted genomic sequencing to understand colonization dynamics. More sophisticated sequencing techniques will need to be developed to assay colonization dynamics using discarded rectal swabs.

### Inclusion of gut microbiota data enhances discrimination of cases and controls

Finally, we hypothesized that inclusion of 16S rRNA gene sequencing data with clinical factors and *Klebsiella* genotype would enhance the ability of machine learning models to discriminate cases and controls. To test this hypothesis, we permutated ASVs with patient factors and *Klebsiella* genotype in our regularized logistic regression models. 84 clinical factors, including several laboratory values, antibiotic exposure, and comorbidities were included (Table S3) and the 27 infection-associated genes identified in our previous comparative genomics study were included as *Klebsiella* genotype (18). Clinical data were missing for two patients, so these patients were excluded from all analyses. Use of clinical factors as the sole input variables led to poor model performance (Figure 4): 14/100 of regularized logistic regression models had an AUC ≤ 0.5, with a median AUC = 0.6. Addition of ASVs to clinical factors enhanced median model performance (Figure 4, median AUC = 0.64). The lack of predictive ability of the clinical factors, especially antimicrobial exposure is somewhat surprising, as gut dominance is a known risk factor for infection (8–10), and disruption of the gut microbiota, such as what occurs with antibiotic exposure, leads to dominance in experimental gut colonization models (11, 13). Therefore, one may expect that antibiotic exposure would be an important feature for discriminating cases and controls in this study. Rather, exposure to most antibiotics was not amongst the most important features in regularized logistic regression models using clinical factors as the input variables (Figure S6A) and the effects of antibiotic exposure on model performance was negligible (Figure S6B). This included a variable for “high-risk” antibiotic exposure, which is a composite variable that includes β-lactam/β-lactamase inhibitor combinations, carbapenems, third- and fourth-generation cephalosporins, fluoroquinolones, clindamycin, and oral vancomycin based on their impact on indigenous gut microbiota (23). The only antibiotic present amongst the most important features was aminoglycoside exposure, and its effects on model performance was subtle (Figure S6A). The importance of antibiotics was further reduced when ASVs were included (Figure S6C-D).

![Figure 4.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F4.medium.gif)

[Figure 4.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F4)

Figure 4. Inclusion of ASVs enhances the ability to discriminate cases from controls
Regularized logistic regression model performance, as measured by area under the receiver-operator characteristic curve (AUC), on test data sets for 100 seeds predicting case status in *Klebsiella* colonized patients (N = 230) using combinations of clinical variables, *Klebsiella* genotype, and ASVs. Black circles indicate median AUC values, black lines indicate standard deviation, and *p* indicates Tukey multiple pairwise-comparison ANOVA *p-*value following one way.

Use of *Klebsiella* genotype as the sole input variables led to a median model performance that was greater than that of clinical factors alone (Figure 4, median AUC = 0.67). This finding is expected, as the 27 genes used as input variables are known to be associated with cases in our previous study (18), whereas most clinical factors were not associated with case status in our original cohort study (7). Interestingly, addition of ASVs to *Klebsiella* genotype enhanced model performance, leading to a median model performance exceeding 0.7 (Figure 4, median AUC = 0.73). Finally, integration of all three datasets led to the highest median model performance, though performance was similar to models using only ASVs and *Klebsiella* genotype (Figure 4, median AUC = 0.74). Similar results were yielded using random forest; however, inclusion of clinical factors with ASVs and *Klebsiella* genotype reduced median model performance (Figure S7, median AUC = 0.74) compared to only ASVs and *Klebsiella* genotype (Figure S7, median AUC = 0.77). In total, these data indicate that inclusion of ASVs with *Klebsiella* genotype leads to peak model performance. This suggests that the gut community profile patients colonized by *Klebsiella* can be combined with other infection-associated variables to discriminate, and potentially predict, infection in these patients with reasonable confidence.

## Discussion

In this study, we have described the gut community of *Klebsiella*-colonized patients and demonstrated that the gut community differs between patients that remain asymptomatic (controls) and those that acquire a subsequent symptomatic infection with their colonizing strain (cases). In machine learning models based on this data, *Klebsiella* relative abundance had the greatest feature importance other gut microbes were also informative. Interestingly, clinical factors such as antibiotic exposure poorly discriminated cases and controls, whereas a combination of gut community data and *Klebsiella* genotype classified cases and controls with a reasonable degree of accuracy (AUC > 0.7). Collectively, this study demonstrates that the gut community of *Klebsiella*-colonized patients can be integrated with other biomarkers to assess infection risk.

An important facet of this study population compared to other study populations is the diversity of colonizing *Klebsiella* strains. Often, studies aimed at describing the gut microbiota of *Klebsiella*-colonized patients capture patients colonized with highly clonal multi-drug resistant (MDR) *Klebsiella* strains (24, 25). In contrast, >100 unique sequence types of *Klebsiella* were identified in this study population, predominantly from non-MDR lineages (7). The attention given to MDR lineages is of course warranted; however, the majority of *Klebsiella* infections are caused by non-MDR lineages (26) and studies have demonstrated that the bulk of colonizing *Klebsiella* strains are diverse (27). It is likely that the gut microbiota, clinical, and genetic factors that increase infection risk in patients colonized by MDR *Klebsiella* differ from those colonized by non-MDR *Klebsiella*. Additionally, the *Klebsiella* in the study population was predominantly non-hypervirulent strains (e.g., “classical” *Klebsiella*). It is also likely that the gut microbiota, clinical, and genetic factors differ in individuals colonized by hypervirulent *Klebsiella* differ from those colonized by non-hypervirulent *Klebsiella*. For example, we identified a *Klebsiella* factor canonically associated with hypervirulence, the *ter* operon, as a microbiome-dependent gut fitness factor (11). This locus was associated with infection in a hospital-wide patient cohort (28) but not in this cohort of intensive care and hematology/oncology patients (7). This highlights the importance of studying all lineages with pathogenic potential to enable accurate risk assessment in colonized patients to reduce the burden of *Klebsiella* disease.

Many microbiome studies classify individuals at risk for or experiencing disease as being in a state of dysbiosis; however, this imprecise term often lacks the context of the definition of a healthy microbiome. This is critical for establishing a causal link between the gut microbiome and disease, especially as the microbiome gradually shifts with age, environment, diet, healthcare exposure, and yet undiscovered variables (reviewed in (29)). The goal of the present study is not to indicate that the gut microbiome of *Klebsiella*-colonized patients is in a state of health or dysbiosis. Rather, the goal is to identify biomarkers that predict infection in colonized patients. Ideally, the observations here will be tested experimentally to explore a causal role in disease. For example, *Akkermansia* (ASV000021) is currently being considered as a probiotic therapy due to its positive impacts on health (30–32). Yet, in this study, *Akkermansia* is important for model performance (Figure 2B) but is relatively low abundance and not enriched in cases (Figure 3C-D). This finding highlights differences between machine leaning and classic linear discriminant analysis approaches for identifying sequences associated with specific communities. It may be the case that the ASVs identified through linear discriminant analysis have occult interactions with one another and/or other ASVs that explain the differential outcomes of these approaches. Similarly, laboratory experiments have demonstrated that members of the *K. oxytoca* complex can reduce *K. pneumoniae* gut colonization (15). Here we observed that the ASV that most likely represents the majority of the *K. pneumoniae* complex (ASV000001) is absent in patients colonized by the ASV that most likely represents the majority of the *K. oxytoca* complex (ASV000019, Figure S5C). Despite a potential probiotic effect against *K. pneumoniae*, *K. oxytoca* is a pathogen that is often highly antimicrobial resistant (reviewed in (22)). Therefore, while microbial competition with *K. pneumoniae* may explain this finding, characterizing *K. oxytoca* as a member of a healthy or dysbiotic gut microbiome remains in question. Further exploration of the biomarkers identified in this study is necessary to determine their importance in influencing infection risk in *Klebsiella*-colonized patients and therein define dysbiosis and its role in infection risk in this patient population.

The variables that are most important in classifying cases and controls likely differ between pathogens and patient populations. For example, clinical biomarkers do not appear to be critical for discriminating case status in this study (Figure 4). This is in contrast to studies performed at the same clinical site leveraging electronic health records to stratify the risk of complicated *Clostridium* (*Clostridioides*) *difficile* infection (33), suggesting a disease-specific effect where the utility of these clinical data in making predictions varies across prediction tasks. Similarly, the finding that ASVs yield the optimal taxonomical resolution for classifying case status (Figure 2) is interesting. A recent machine learning study determined that OTUs were the optimal taxonomical level for predicting colorectal cancer (34). The preference for use of ASVs or OTUs in microbiome studies remains contested (35, 36); however, our study supports the premise that optimal taxonomical resolution is highly dependent on the patient population and outcomes of interest and does not necessarily favor OTUs or ASVs. Ideally, clinical studies interrogating the role of the microbiome in disease would report both OTU and ASV data when using 16S rRNA gene sequencing, such that we gain a greater understanding of how taxonomical resolution influences the stratification of patient risk in conjunction with other potential risk factors.

Though this study adds to our understanding of the gut microbiome of *Klebsiella*-colonized patients, it is not without its limitations. First, we used a case-control design for this study to carefully control for the influence of known and unknown patient factors. However, this study design leads to an overrepresentation of infection in the study population and the predictive modeling metrics should be interpreted only in the context of this study, since in the general population we would expect a much lower infection risk, such as the 4.3% attack rate in our large cohort study from which this nested case-control study was derived (7). Ideally, future studies assessing the role of the microbiome as a risk factor for *Klebsiella* infection will accurately represent the true attack rate while capturing a large enough number of patients, both colonized by *Klebsiella* and not, to maintain suitable study power. Therefore, hypotheses generated in small- and medium-sized studies can be rigorously tested in a study population that reflects the general population. Second, this study is limited in its ability to make functional conclusions about the microbiome due to the use of 16S rRNA gene sequencing instead of metagenomics or other -omics approaches. Unfortunately, many -omics approaches remain cost restrictive and lack easily testable hypotheses. This and similar studies will aid in the generation of hypotheses that can be tested using these approaches in the future. Finally, the use of machine learning models in this study is a useful means of determining the discriminatory ability of a large set of variables but is limited in its interpretability. Clinically actionable risk stratification models should be comprised of a small set of easily observable variables. In our previous studies, we developed practical tools for identifying biomarkers in *Klebsiella*-colonized patients including measurement of *Klebsiella* relative abundance and detection of infection-associated genes by PCR (7, 8). We hope that additional practical tools to assess the role of the microbiome in infection risk in *Klebsiella*-colonized patients will be developed and integrated with our previously developed tools.

The addition of this study to our collection of studies assessing patient factors, gut dominance, and *Klebsiella* genotype (7, 8, 18) represents one of the most comprehensive explorations of infection risk in a cohort of *Klebsiella*-colonized patients. Ultimately, this study provides a foundational framework for the development of integrated, actionable models for predicting and stratifying infection risk in *Klebsiella*-colonized patients.

## Methods

### Ethics statement and study subject selection

Patient enrollment and sample collection at the University of Michigan were approved by and performed per the Institutional Review Boards (IRB) of the University of Michigan Medical School (Study number HUM00123033). This study was performed with a waiver of informed consent since the research involves no more than minimal risk to the subjects, could not practicably be carried out without the waiver, and uses discarded samples. Cohort identification, enrollment, clinical data extraction, chart review, case definitions, and case-control matching criteria are described in detail elsewhere (7, 8, 18). Study subjects were selected based on matching criteria, the availability of rectal swab DNA (8), and whole-genome sequencing data corresponding to the colonizing *Klebsiella* strain (18). All infectious *Klebsiella* isolates were concordant with the colonizing strain in the same patients based on Sanger sequencing of the *wzi* locus (18).

### 16S rRNA gene sequencing and data processing

DNA was previously extracted from patient rectal swabs (8) using the MagAttract PowerMicrobiome DNA/RNA Kit (Qiagen) and an epMotion 5075 liquid handling system. Standard PCRs used 1, 2, or 7 μL of undiluted DNA and touchdown PCR used 7 μL of undiluted DNA to amplify the V4 region of the 16S rRNA gene. Sequencing was performed as previously described (37). 16S rRNA gene sequences were processed with mothur (v. 1.48.0) (19, 38). The sequencing error rate was assessed using a predefined mock community and estimated to be 0.033%. Sequences were aligned to the SILVA reference alignment, release 132 (39) and binned into OTUs using the OptiClust method (40) based on 97% sequence similarity or kept as unique sequences for ASVs. Taxonomic composition was assigned by classifying sequences within mothur using a modified version of the Ribosomal Database Project training set, version 18 (41, 42). Data processing was performed using the Great Lakes High-Performance Computing Cluster at the University of Michigan, Ann Arbor or the Carbonate large-memory computer cluster at Indiana University.

## Data analysis

Data analysis was carried out in RStudio 2021.09.0+351 "Ghost Orchid" Release for macOS or in R, v. 4.2.0. R was used instead of RStudio when the analysis was being performed on The Great Lakes High-Performance Computing Cluster at the University of Michigan, Ann Arbor or the Carbonate large-memory computer cluster at Indiana University. For all analyses except network analysis, sample read counts were rarefied to the lowest-abundance sample (4,438 reads). Alpha- and beta-diversity, principal coordinates analysis, and community typing were performed using mothur. θYC was used as the distance metric for principal coordinates analysis. Differences in community structure were assessed by AMOVA from the vegan package, v. 2.6-2 (43). Differences in alpha-diversity indices were assessed by student’s *t*-test using the stats package, v. 3.6.2. Assessment of differentially enriched OTUs and ASVs was performed with linear discriminant analysis effect size analysis. Supervised machine learning was performed using mikropml, v. 1.4.0 (44). First, continuous data were split into quartiles, then input data was preprocessed in mikropml using the default settings. Supervised machine learning was performed using case status as the outcome. Input data was split 80:20 into train and test groups. An optimal model was trained using 100X 5-fold cross-validation and model performance was evaluated using the test data. For regularized logistic regression, hyperparameter selection was semi-automated. Each model was trained with alpha values ranging from 0 to 1, iterated in steps of 0.1, permutated with lambda values ranging from 10-4 to 101, iterated in steps of 3 between each log (e.g., 10-4, 2.5x10-4, 5x10-4, 7.5x10-4, 10-3, 2.5x10-3…101). Trained model performance was assessed by area under the receiver-operator characteristic curve, and hyperparameters that yielded the best performance were selected to evaluate model performance using the test data. For random forest models, the default hyperparameters were used. For each method, this process was parallelized 100 times, using 100 different seeds to determine the train:test data split, and feature importance and weight (only regularized logistic regression) was determined for all variables. Network analysis was performed using NetCoMi v. 1.1.0 (45). Networks were constructed using the compositionally aware correlation estimators, SparCC (46), and networks were compared by permutation test with 100 permutations. For all analyses, a *p*-value ≤ 0.05 after multiple comparison adjustment was considered statistically significant. Data were visualized using ggplot2, v.4.1.2 (47).

## Data and code availability

The sequencing data generated in this study have been deposited in the Sequence Read Archive (SRA) database under accession PRJNA789565. Deidentified human data are available under restricted access and can be obtained from MAB within 1 year upon request, pending approval from the University of Michigan Institutional Review Board. All other source data and code are available at [https://github.com/jayvorn](https://github.com/jayvorn).

## Data Availability

The sequencing data generated in this study have been deposited in the Sequence Read Archive (SRA) database under accession PRJNA789565. Deidentified human data are available under restricted access and can be obtained from MAB within 1 year upon request, pending approval from the University of Michigan Institutional Review Board. All other source data and code are available at https://github.com/jayvorn.

[https://github.com/jayvorn](https://github.com/jayvorn)

## Funding

This work was supported by funding from National Institution of Health ([https://www.nih.gov/](https://www.nih.gov/)) grants R01AI125307 to MAB and K99 AI153483 to JV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

## Contributions

Conceptualization: JV, KR, MAB

Methodology: JV, KR

Investigation: JV

Visualization: JV

Funding acquisition: JV, MAB

Project administration: MAB

Supervision: MAB

Writing – original draft: JV

Writing – review & editing: JV, KR, MAB

## Competing interests

KR: Dr. Rao is supported in part from an investigator-initiated grant from Merck & Co, Inc.; he has consulted for Seres Therapeutics, Inc., Rebiotix, Inc. and Summit Therapeutics, Inc. All other authors declare that they have no competing interests.

## Supplementary Information

![Figure S1.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F5.medium.gif)

[Figure S1.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F5)

Figure S1. Example of regularized logistic regression hyperparameter selection.
Regularized logistic regression trained model performance as measured by area under the receiver-operator characteristic curve (AUC) for 100 seeds. ASVs were used as input data. Each box contains the mean AUC values for each hyperparameter combination. Future model testing was performed using the hyperparameter combination that yielded the peak AUC for a given seed.

![Figure S2.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F6.medium.gif)

[Figure S2.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F6)

Figure S2. Random forest model performance
(A) Random forest model performance, as measured by area under the receiver-operator characteristic curve (AUC), on test data sets for 100 seeds predicting case status in *Klebsiella* colonized patients (N = 232). Black circles indicate median AUC values, black lines indicate standard deviation, and *p* indicates Tukey multiple pairwise-comparison ANOVA *p-*value following one way. (B) Top model features using amplicon sequence variants (ASVs) as input data, corresponding to panel A, “ASVs.” Circles indicate mean feature importance and lines indicate interquartile range.

![Figure S3.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F7.medium.gif)

[Figure S3.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F7)

Figure S3. Cases and controls have distinct gut community profiles based on OTUs
(A) Principal coordinates analysis with overlayed biplots of specific OTUs. Analysis of molecular variance (AMOVA) based on the Yue and Clayton θ dissimilarity index was used to assess the difference in beta-diversity between cases (N = 83) and controls (N = 149). (B) Analysis of the Chao, Shannon, and Inverse Simpson alpha-diversity indices between cases (N = 83) and controls (N = 149, boxplot indicates median with interquartile range, *p* indicates student’s *t* test *p-*value). (C) Linear discriminant analysis (LDA) effect size was used to identify differentially abundant OTUs between cases (N = 83) and controls (N = 149). (D) Summary of relative abundances of OTUs that were differentially abundant between cases (N = 83) and controls (N = 149, boxplot indicates median with interquartile range). For all panels, each datapoint indicates one patient.

![Figure S4.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F8.medium.gif)

[Figure S4.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F8)

Figure S4. Cases and controls have distinct gut community networks
(A) Network plots of case and control gut communities. Only ASVs with 1,000 total reads were included in network construction, and only nodes with significant correlations (student’s *t*-test Benjamini & Hochberg corrected *p-*value < 0.05) in either group are shown. Each node is a single ASV, scaled to the total read count. Only nodes Black edges are positive correlations, and red edges are negative correlations. Node colors indicate distinct clusters. (B) Permutation test (N = 100 permutations) results comparing case and control network properties.

![Figure S5.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F9.medium.gif)

[Figure S5.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F9)

Figure S5. Multiple *Klebsiella* ASVs are present in *Klebsiella*-colonized patients
(A) Count of the number of *Klebsiella* ASVs in each patient (N = 232). (B) Summary of relative abundances of *Klebsiella* ASVs with a sequence count >1 stratified by cases (N = 83) and controls (N = 149, boxplot indicates median with interquartile range). (C) Summary of relative abundance of ASV000001 when ASV000019 is absent (-ASV000019, N = 223) or present (+ASV000019, N = 9, boxplot indicates median with interquartile range). For panels B and C, each datapoint indicates one patient.

![Figure S6.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F10.medium.gif)

[Figure S6.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F10)

Figure S6. Antibiotic exposure is not important for classifying cases and controls
(A) Top model features for regularized logistic regression models using clinical variables as input data, corresponding to Figure 4 “clinical.” (B) Antibiotic exposure features for regularized logistic regression models using clinical variables as input data, corresponding to Figure 4 “clinical.” (C) Top model features for regularized logistic regression models using clinical variables and ASVs as input data, corresponding to Figure 4 “ASV+clinical.” (D) Antibiotic exposure features for regularized logistic regression models using clinical variables as input data, corresponding to Figure 4 “ASV+clinical.” For all panels, circles indicate mean feature importance and lines indicate interquartile range. Feature importance values in red and black indicate a regression weight that are weighted toward cases and controls, respectively.

![Figure S7.](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/04/20/2023.04.18.23288742/F11.medium.gif)

[Figure S7.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/F11)

Figure S7. Inclusion of ASVs enhances the ability to discriminate cases from controls using random forest
Random forest model performance, as measured by area under the receiver-operator characteristic curve (AUC), on test data sets for 100 seeds predicting case status in *Klebsiella* colonized patients (N = 230) using various input datasets. Black circles indicate median AUC values, black lines indicate standard deviation, and *p* indicates Tukey multiple pairwise-comparison ANOVA *p-*value following one way.

View this table:
[Table S1.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/T2)

Table S1. 
Sample partitions

View this table:
[Table S2.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/T3)

Table S2. 
BLAST alignment* to ASV000001 and ASV000019 rRNA sequences

View this table:
[Table S3.](http://medrxiv.org/content/early/2023/04/20/2023.04.18.23288742/T4)

Table S3. 
Clinical variables included in machine learning models*

## Acknowledgements

The authors would like to thank the University of Michigan Microbiome Core for their assistance with 16S rRNA gene sequencing and to Dr. Anna Seekatz for her valuable insight into all things gut microbiome. This research was supported in part through computational resources and services provided by Advanced Research Computing (ARC), a division of Information and Technology Services (ITS) at the University of Michigan, Ann Arbor. The authors acknowledge the Indiana University Pervasive Technology Institute for providing supercomputing and storage resources that have contributed to the research results reported within this paper.

*   Received April 18, 2023.
*   Revision received April 18, 2023.
*   Accepted April 20, 2023.


*   © 2023, Posted by Cold Spring Harbor Laboratory

The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission.

## References

1.  1.Wyres KL, Lam MMC, Holt KE. 2020. Population genomics of *Klebsiella pneumoniae*. Nat Rev Microbiol 18:344–359.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41579-019-0315-1&link_type=DOI) 

2.  2.Martin RM, Bachman MA. 2018. Colonization, Infection, and the Accessory Genome of *Klebsiella pneumoniae*. Front Cell Infect Microbiol 8:4.
    
    

3.  3. Antimicrobial Resistance C. 2022. Global burden of bacterial antimicrobial resistance in 2019: a systematic analysis. Lancet 399:629–655.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/s0140-6736(21)02724-0&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

4.  4.Martin RM, Cao J, Brisse S, Passet V, Wu W, Zhao L, Malani PN, Rao K, Bachman MA. 2016. Molecular Epidemiology of Colonizing and Infecting Isolates of *Klebsiella pneumoniae*. mSphere 1.
    
    

5.  5.Collingwood A, Blostein F, Seekatz AM, Wobus CE, Woods RJ, Foxman B, Bachman MA. 2020. Epidemiological and Microbiome Associations Between *Klebsiella pneumoniae* and Vancomycin-Resistant *Enterococcus* Colonization in Intensive Care Unit Patients. Open Forum Infect Dis 7:ofaa012.
    
    

6.  6.Gorrie CL, Mirceta M, Wick RR, Edwards DJ, Thomson NR, Strugnell RA, Pratt NF, Garlick JS, Watson KM, Pilcher DV, McGloughlin SA, Spelman DW, Jenney AWJ, Holt KE. 2017. Gastrointestinal Carriage Is a Major Reservoir of *Klebsiella pneumoniae* Infection in Intensive Care Patients. Clin Infect Dis 65:208–215.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/cid/cix270&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28369261&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

7.  7.Rao K, Patel A, Sun Y, Vornhagen J, Motyka J, Collingwood A, Teodorescu A, Baang JH, Zhao L, Kaye KS, Bachman MA. 2021. Risk Factors for *Klebsiella* Infections among Hospitalized Patients with Preexisting Colonization. mSphere 6:e0013221.
    
    

8.  8.Sun Y, Patel A, SantaLucia J, Roberts E, Zhao L, Kaye K, Rao K, Bachman MA. 2021. Measurement of *Klebsiella* Intestinal Colonization Density To Assess Infection Risk. mSphere 6:e0050021.
    
    

9.  9.Perez-Nadales E, A MN, Recio-Rufian M, Guzman-Puche J, Marin-Sanz JA, Martin-Perez C, Cano A, Caston JJ, Elias-Lopez C, Machuca I, Gutierrez-Gutierrez B, Martinez-Martinez L, Torre-Cisneros J. 2022. Prognostic Significance of the Relative Load of KPC-Producing *Klebsiella pneumoniae* within the Intestinal Microbiota in a Prospective Cohort of Colonized Patients. Microbiol Spectr 10:e0272821.
    
    

10. 10.Shimasaki T, Seekatz A, Bassis C, Rhee Y, Yelin RD, Fogg L, Dangana T, Cisneros EC, Weinstein RA, Okamoto K, Lolans K, Schoeny M, Lin MY, Moore NM, Young VB, Hayden MK, Centers for Disease C, Prevention Epicenters P. 2019. Increased Relative Abundance of Klebsiella pneumoniae Carbapenemase-producing Klebsiella pneumoniae Within the Gut Microbiota Is Associated With Risk of Bloodstream Infection in Long-term Acute Care Hospital Patients. Clin Infect Dis 68:2053–2059.
    
    

11. 11.Vornhagen J, Bassis CM, Ramakrishnan S, Hein R, Mason S, Bergman Y, Sunshine N, Fan Y, Holmes CL, Timp W, Schatz MC, Young VB, Simner PJ, Bachman MA. 2021. A plasmid locus associated with *Klebsiella* clinical infections encodes a microbiome-dependent gut fitness factor. PLoS Pathog 17:e1009537.
    
    

12. 12.Hudson AW, Barnes AJ, Bray AS, Ornelles DA, Zafar MA. 2022. *Klebsiella pneumoniae* l-Fucose Metabolism Promotes Gastrointestinal Colonization and Modulates Its Virulence Determinants. Infect Immun doi:10.1128/iai.00206-22:e0020622.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1128/iai.00206-22:e0020622&link_type=DOI) 

13. 13.Young TM, Bray AS, Nagpal RK, Caudell DL, Yadav H, Zafar MA. 2020. Animal Model To Study *Klebsiella pneumoniae* Gastrointestinal Colonization and Host-to-Host Transmission. Infect Immun 88.
    
    

14. 14.Vornhagen J, Sun Y, Breen P, Forsyth V, Zhao L, Mobley HLT, Bachman MA. 2019. The *Klebsiella pneumoniae* citrate synthase gene, gltA, influences site specific fitness during infection. PLoS Pathog 15:e1008010.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.ppat.1008010&link_type=DOI) 

15. 15.Osbelt L, Wende M, Almasi E, Derksen E, Muthukumarasamy U, Lesker TR, Galvez EJC, Pils MC, Schalk E, Chhatwal P, Farber J, Neumann-Schaal M, Fischer T, Schluter D, Strowig T. 2021. *Klebsiella oxytoca* causes colonization resistance against multidrug-resistant *K. pneumoniae* in the gut via cooperative carbohydrate competition. Cell Host Microbe 29:1663–1679 e7.
    
    

16. 16.Oliveira RA, Ng KM, Correia MB, Cabral V, Shi H, Sonnenburg JL, Huang KC, Xavier KB. 2020. *Klebsiella michiganensis* transmission enhances resistance to Enterobacteriaceae gut invasion by nutrition competition. Nat Microbiol 5:630–641.
    
    

17. 17.Sequeira RP, McDonald JAK, Marchesi JR, Clarke TB. 2020. Commensal Bacteroidetes protect against *Klebsiella pneumoniae* colonization and transmission through IL-36 signalling. Nat Microbiol 5:304–313.
    
    

18. 18.Vornhagen J, Roberts EK, Unverdorben L, Mason S, Patel A, Crawford R, Holmes CL, Sun Y, Teodorescu A, Snitkin ES, Zhao L, Simner PJ, Tamma PD, Rao K, Kaye KS, Bachman MA. 2022. Combined comparative genomics and clinical modeling reveals plasmid-encoded genes are independently associated with *Klebsiella* infection. Nat Commun 13:4459.
    
    

19. 19.Kozich JJ, Westcott SL, Baxter NT, Highlander SK, Schloss PD. 2013. Development of a dual-index sequencing strategy and curation pipeline for analyzing amplicon sequence data on the MiSeq Illumina sequencing platform. Appl Environ Microbiol 79:5112–20.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYWVtIjtzOjU6InJlc2lkIjtzOjEwOiI3OS8xNy81MTEyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDQvMjAvMjAyMy4wNC4xOC4yMzI4ODc0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

20. 20.Holmes I, Harris K, Quince C. 2012. Dirichlet multinomial mixtures: generative models for microbial metagenomics. PLoS One 7:e30126.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0030126&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22319561&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

21. 21.Topcuoglu BD, Lesniak NA, Ruffin MTt, Wiens J, Schloss PD. 2020. A Framework for Effective Application of Machine Learning to Microbiome-Based Classification Problems. mBio 11.
    
    

22. 22.Yang J, Long H, Hu Y, Feng Y, McNally A, Zong Z. 2022. Klebsiella oxytoca Complex: Update on Taxonomy, Antimicrobial Resistance, and Virulence. Clin Microbiol Rev 35:e0000621.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1128/cmr.00006-21&link_type=DOI) 

23. 23.Baggs J, Jernigan JA, Halpin AL, Epstein L, Hatfield KM, McDonald LC. 2018. Risk of Subsequent Sepsis Within 90 Days After a Hospital Stay by Type of Antibiotic Exposure. Clin Infect Dis 66:1004–1012.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/cid/cix947&link_type=DOI) 

24. 24.Kang JTL, Teo JJY, Bertrand D, Ng A, Ravikrishnan A, Yong M, Ng OT, Marimuthu K, Chen SL, Chng KR, Gan YH, Nagarajan N. 2022. Long-term ecological and evolutionary dynamics in the gut microbiomes of carbapenemase-producing Enterobacteriaceae colonized subjects. Nat Microbiol 7:1516–1524.
    
    

25. 25.Seekatz AM, Bassis CM, Fogg L, Moore NM, Rhee Y, Lolans K, Weinstein RA, Lin MY, Young VB, Hayden MK. 2018. Gut Microbiota and Clinical Features Distinguish Colonization With Carbapenemase-Producing *Klebsiella pneumoniae* at the Time of Admission to a Long-term Acute Care Hospital. Open Forum Infect Dis 5:ofy190.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

26. 26.Lam MMC, Wick RR, Watts SC, Cerdeira LT, Wyres KL, Holt KE. 2021. A genomic surveillance framework and genotyping tool for *Klebsiella pneumoniae* and its related species complex. Nat Commun 12:4188.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41467-021-24448-3&link_type=DOI) 

27. 27.Raffelsberger N, Hetland MAK, Svendsen K, Smabrekke L, Lohr IH, Andreassen LLE, Brisse S, Holt KE, Sundsfjord A, Samuelsen O, Gravningen K. 2021. Gastrointestinal carriage of *Klebsiella pneumoniae* in a general adult population: a cross-sectional study of risk factors and bacterial genomic diversity. Gut Microbes 13:1939599.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/19490976.2021.1939599&link_type=DOI) 

28. 28.Martin RM, Cao J, Wu W, Zhao L, Manthei DM, Pirani A, Snitkin E, Malani PN, Rao K, Bachman MA. 2018. Identification of Pathogenicity-Associated Loci in *Klebsiella pneumoniae* from Hospitalized Patients. mSystems 3.
    
    

29. 29.Gilbert JA, Blaser MJ, Caporaso JG, Jansson JK, Lynch SV, Knight R. 2018. Current understanding of the human microbiome. Nat Med 24:392–400.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nm.4517&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29634682&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

30. 30.Plovier H, Everard A, Druart C, Depommier C, Van Hul M, Geurts L, Chilloux J, Ottman N, Duparc T, Lichtenstein L, Myridakis A, Delzenne NM, Klievink J, Bhattacharjee A, van der Ark KC, Aalvink S, Martinez LO, Dumas ME, Maiter D, Loumaye A, Hermans MP, Thissen JP, Belzer C, de Vos WM, Cani PD. 2017. A purified membrane protein from *Akkermansia muciniphila* or the pasteurized bacterium improves metabolism in obese and diabetic mice. Nat Med 23:107–113.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nm.4236&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27892954&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

31. 31.Dao MC, Everard A, Aron-Wisnewsky J, Sokolovska N, Prifti E, Verger EO, Kayser BD, Levenez F, Chilloux J, Hoyles L, Consortium MI-O, Dumas ME, Rizkalla SW, Dore J, Cani PD, Clement K. 2016. *Akkermansia muciniphila* and improved metabolic health during a dietary intervention in obesity: relationship with gut microbiome richness and ecology. Gut 65:426–36.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiZ3V0am5sIjtzOjU6InJlc2lkIjtzOjg6IjY1LzMvNDI2IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDQvMjAvMjAyMy4wNC4xOC4yMzI4ODc0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

32. 32.Bae M, Cassilly CD, Liu X, Park SM, Tusi BK, Chen X, Kwon J, Filipcik P, Bolze AS, Liu Z, Vlamakis H, Graham DB, Buhrlage SJ, Xavier RJ, Clardy J. 2022. *Akkermansia muciniphila* phospholipid induces homeostatic immune responses. Nature 608:168–173.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

33. 33.Li BY, Oh J, Young VB, Rao K, Wiens J. 2019. Using Machine Learning and the Electronic Health Record to Predict Complicated *Clostridium difficile* Infection. Open Forum Infect Dis 6:ofz186.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ofid/ofz186&link_type=DOI) 

34. 34.Armour CR, Topcuoglu BD, Garretto A, Schloss PD. 2022. A Goldilocks Principle for the Gut Microbiome: Taxonomic Resolution Matters for Microbiome-Based Classification of Colorectal Cancer. mBio doi:10.1128/mbio.03161-21:e0316121.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1128/mbio.03161-21:e0316121&link_type=DOI) 

35. 35.Schloss PD. 2021. Amplicon Sequence Variants Artificially Split Bacterial Genomes into Separate Clusters. mSphere 6:e0019121.
    
    

36. 36.Callahan BJ, McMurdie PJ, Holmes SP. 2017. Exact sequence variants should replace operational taxonomic units in marker-gene data analysis. ISME J 11:2639–2643.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

37. 37.Seekatz AM, Theriot CM, Molloy CT, Wozniak KL, Bergin IL, Young VB. 2015. Fecal Microbiota Transplantation Eliminates *Clostridium difficile* in a Murine Model of Relapsing Disease. Infect Immun 83:3838–46.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiaWFpIjtzOjU6InJlc2lkIjtzOjEwOiI4My8xMC8zODM4IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDQvMjAvMjAyMy4wNC4xOC4yMzI4ODc0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

38. 38.Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, Lesniewski RA, Oakley BB, Parks DH, Robinson CJ, Sahl JW, Stres B, Thallinger GG, Van Horn DJ, Weber CF. 2009. Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl Environ Microbiol 75:7537–41.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYWVtIjtzOjU6InJlc2lkIjtzOjEwOiI3NS8yMy83NTM3IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDQvMjAvMjAyMy4wNC4xOC4yMzI4ODc0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

39. 39.Schloss PD. 2009. A high-throughput DNA sequence aligner for microbial ecology studies. PLoS One 4:e8230.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0008230&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20011594&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

40. 40.Westcott SL, Schloss PD. 2017. OptiClust, an Improved Method for Assigning Amplicon-Based Sequence Data to Operational Taxonomic Units. mSphere 2.
    
    

41. 41.Cole JR, Wang Q, Fish JA, Chai B, McGarrell DM, Sun Y, Brown CT, Porras-Alfaro A, Kuske CR, Tiedje JM. 2014. Ribosomal Database Project: data and tools for high throughput rRNA analysis. Nucleic Acids Res 42:D633–42.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/nar/gkt1244&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24288368&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000331139800093&link_type=ISI) 

42. 42.Wang Q, Garrity GM, Tiedje JM, Cole JR. 2007. Naive Bayesian classifier for rapid assignment of rRNA sequences into the new bacterial taxonomy. Appl Environ Microbiol 73:5261–7.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYWVtIjtzOjU6InJlc2lkIjtzOjEwOiI3My8xNi81MjYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjMvMDQvMjAvMjAyMy4wNC4xOC4yMzI4ODc0Mi5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

43. 43.Oksanen J. SG, Blanchet F., Kindt R., Legendre P., Minchin P., O’Hara R., Solymos P., Stevens M., Szoecs E., Wagner H., Barbour M., Bedward M., Bolker B., Borcard D., Carvalho G., Chirico M., De Caceres M., Durand S., Evangelista H., FitzJohn R., Friendly M., Furneaux B., Hannigan G., Hill M., Lahti L., McGlinn D., Ouellette M., Ribeiro Cunha E., Smith T., Stier A., Ter Braak C., Weedon J. 2022. vegan: Community Ecology Package, v R package version 2.6-4. [https://CRAN.R-project.org/package=vegan](https://CRAN.R-project.org/package=vegan).
    
    

44. 44.Topcuoglu BD, Lapp Z, Sovacool KL, Snitkin E, Wiens J, Schloss PD. 2021. mikropml: User-Friendly R Package for Supervised Machine Learning Pipelines. J Open Source Softw 6.
    
    

45. 45.Peschel S, Müller CL, von Mutius E, Boulesteix A-L, Depner M. 2020. NetCoMi: network construction and comparison for microbiome data in R. Briefings in Bioinformatics 22.
    
    

46. 46.Friedman J, Alm EJ. 2012. Inferring correlation networks from genomic survey data. PLoS Comput Biol 8:e1002687.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pcbi.1002687&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23028285&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F04%2F20%2F2023.04.18.23288742.atom) 

47. 47.Wickham H. 2016. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York.