Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

SARS-CoV-2 Detection in the Nasopharyngeal Swabs and Saliva of College Students using RT-qPCR and RT-LAMP

View ORCID ProfileD. A. Bikos, C. Hwang, K. A. Brileya, A. Parker, E. K. Loveday, M. Rodriguez, I. Thornton, T. LeFevre, J. N. Wilking, M. Dills, S. T. Walk, A. K. Adams, R. K. Plowright, A. B. Hoegh, J. R. Carter, J. Morrow, M. P. Taylor, D. E. Keil, M. W. Fields, View ORCID ProfileC. B. Chang
doi: https://doi.org/10.1101/2021.03.31.21254634
D. A. Bikos
aDepartment of Chemical & Biological Engineering, Montana State University, Bozeman, MT 59717, United States
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for D. A. Bikos
C. Hwang
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
K. A. Brileya
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A. Parker
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
dDepartment of Mathematical Sciences, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
E. K. Loveday
aDepartment of Chemical & Biological Engineering, Montana State University, Bozeman, MT 59717, United States
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M. Rodriguez
cDepartment of Microbiology & Immunology, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
I. Thornton
eDepartment of Mechanical & Industrial Engineering, Montana State University, Bozeman, MT 59717, United States
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
T. LeFevre
aDepartment of Chemical & Biological Engineering, Montana State University, Bozeman, MT 59717, United States
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J. N. Wilking
aDepartment of Chemical & Biological Engineering, Montana State University, Bozeman, MT 59717, United States
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M. Dills
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
S. T. Walk
cDepartment of Microbiology & Immunology, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A. K. Adams
fCenter for American Indian and Rural Health Equity (CAIRHE), Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
R. K. Plowright
cDepartment of Microbiology & Immunology, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A. B. Hoegh
dDepartment of Mathematical Sciences, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J. R. Carter
gHealth & Human Development, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
J. Morrow
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M. P. Taylor
cDepartment of Microbiology & Immunology, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
D. E. Keil
cDepartment of Microbiology & Immunology, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M. W. Fields
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
cDepartment of Microbiology & Immunology, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: connie.chang{at}montana.edu matthew.fields{at}montana.edu
C. B. Chang
aDepartment of Chemical & Biological Engineering, Montana State University, Bozeman, MT 59717, United States
bCenter for Biofilm Engineering, Montana State University, Bozeman, MT 59717, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for C. B. Chang
  • For correspondence: connie.chang{at}montana.edu matthew.fields{at}montana.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Diagnostic testing can identify outbreaks and inform preventive strategies for slowing the spread of SARS-CoV-2, the virus that causes Covid-19. The “gold standard” method for detection of SARS-CoV-2 is reverse transcription quantitative polymerase chain reaction (RT-qPCR) performed on samples collected using nasopharyngeal (NP) swabs. While NP RT-qPCR achieves high sensitivity, it requires trained personnel to administer and suffers from lengthy time-to-result. Instead, rapid saliva-based reverse transcription loop-mediated amplification (RT-LAMP) screening methods may offer advantages in sample collection and speed.

Methods Regardless of symptomatic presentation, a total of 233 individuals were tested for SARS-CoV-2 using NP RT-qPCR, alongside saliva-based RT-qPCR (SalivirDetect) and RT-LAMP (SLAMP), a simple and rapid fluorometric RT-LAMP assay performed directly on heat-inactivated saliva without any additional treatments or RNA extraction. SLAMP is conducted in triplicate and takes 45 min. Samples found negative using both saliva-based methods but positive under CDC NP RT-qPCR above the saliva method LoD were excluded from evaluation, suggesting significant differences in viral titer between sampling sites. Individuals who consumed potential inhibitors in the form of food, drink, and oral health products within 30 min of sampling were identified using a self-reported questionnaire.

Results Of the 233 NP RT-qPCR tests, 58 were positive and 175 were negative. Comparatively, SLAMP resulted in 95% sensitivity and 98% specificity and SalivirDetect 97% sensitivity and 98% specificity. Prior consumption had no measurable effect on test outcomes, except for drinking, which lowered Ct values in saliva.

Conclusions SLAMP requires less technician and instrument time than CDC-approved NP RT-qPCR and demonstrates that saliva-based RT-LAMP can enable frequent and rapid identification of pre-symptomatic and asymptomatic SARS-CoV-2 infections with high sensitivity and specificity.

Introduction

The SARS-CoV-2 virus1 emerged in late 2019, rapidly developing into a worldwide pandemic still posing a persistent threat to public health, economics, and quality of life. While real-world vaccine efficacy continues to be evaluated2, uncertainties over variant escape3, vaccine availability4, and duration of immunity5 suggest that testing will continue to play an indispensable role in managing the disease into the future. Viral spread can be controlled by deploying diagnostic tests that rapidly identify infected individuals for quarantine and contact tracing. Rapid and frequent SARS-CoV-2 testing is needed to identify new outbreaks as the world struggles to lift lockdowns6 and reopen schools for in-person instruction in Fall 20217.

The “gold standard” method for detecting SARS-CoV-2 has been reverse transcription quantitative polymerase chain reaction (RT-qPCR) performed on samples collected using nasopharyngeal (NP) swabs8. However, RT-qPCR testing requires significant reagent consumption, specialized equipment, trained operators, and several hours to perform. Collection of NP swab samples is invasive and must be performed by trained medical personnel. Performing surveillance at scale calls for innovative testing strategies that are inexpensive, minimize reagent consumption, decrease assay time-to-result, and avoid restrictions in available personnel9,10.

One such alternative to RT-qPCR is reverse transcriptase loop-mediated isothermal amplification (RT-LAMP), an isothermal technique for the amplification of RNA11. RT-LAMP simplifies SARS-CoV-2 testing by eliminating the long assay times and technical barriers such as the electronically controlled thermal cycling at high temperatures required by PCR-based methods12-17. RT-LAMP is substantially faster than RT-qPCR, and when performed on saliva samples18, eliminates the need for specialized swabs and operators while assuaging the public reluctance to testing, largely brought on by invasive NP swabs19. The RT-LAMP assay is usually completed within 45 min to confirm a negative, while some exceptionally high viral loads become detectable at ≈10 min20.

Here, we report the findings of a multi-day pilot study to evaluate saliva-based SARS-CoV-2 detection using RT-qPCR and RT-LAMP methods compared alongside to Centers for Disease Control and Prevention (CDC)-approved NP RT-qPCR testing at Montana State University (MSU) during mid-November 2020, a time when Covid-19 cases reached county-wide highs (Figure S1). We present the results of SLAMP, a rapid fluorometric RT-LAMP assay performed directly on saliva without chemical extraction steps. Additionally, we compare SLAMP to SalivirDetect21, a direct saliva-to-RT-qPCR assay and both saliva tests are compared to CDC-approved RT-qPCR performed on samples swabbed from the nasopharynx. Each participant was provided a self-reported survey identifying samples collected within 30 min of consuming food, drink, or oral hygiene products to determine the extent to which saliva test results might be affected.

Methods

Participants

Samples were collected from 233 participants who visited the on-campus CDC-approved RT-qPCR testing site provided for persons exhibiting Covid-19 symptoms or who suspected recent contact with SARS-CoV-2-positive individuals. We directly compared samples from two sources on the body of each participant, NP swabs, tested using CDC-approved RT-qPCR, and saliva, tested using SLAMP and SalivirDetect. All individuals tested signed a consent form before participating in this study (Supplementary Information – Consent Form).

Self-Reported Questionnaire

Participants were provided with a self-reported questionnaire (Supplementary Information - Questionnaire) that collected demographic information including age, gender, race, and ethnicity. Additionally, subjects were asked to confirm whether they were currently symptomatic or asymptomatic and whether they had recent contact with infected individuals. Finally, subjects were asked to disclose if they had, in the last 30 min, consumed food or liquid, used mouthwash, gum or lozenges, smoked, vaporized or chewed tobacco, or brushed their teeth.

Sample Collection

All sampling occurred at an outdoor parking lot in drive-through format while participants remained inside automobiles as an additional precaution against viral transmission. Individuals who expressed interest in participating in our pilot study were administered NP swabs by trained staff before donating an additional saliva sample as outlined by the university IRB (Supplementary Information – IRB).

Viral Inactivation - NP Swab

NP swabs were heat-inactivated by diluting collection buffer 1:2 with molecular biology grade H2O (50 μL buffer: 50 μL H2O) and assigned a location on a 96-well PCR plate. Plates were covered with sealing foil and heated to 95 °C for 5 min in a standard thermocycler before being cooled to 4 °C until ready to test.

Viral Inactivation - Saliva

In the case of saliva collection, participants were given a 3D-printed accessory caddy (Supplementary Methods, Figure S2) containing a 30-mL polypropylene medicine cup (MedPride 97205), a generic 1-mL transfer pipet, and a screw cap tube (VWR 16466-040). Saliva was expressed into the medicine cup (Figure S3i) before using the pipet to transfer ≈1.0 mL into the screw-cap tube (Figure S3ii). Tubes were indexed with heat- and water-resistant adhesive labels (Electronic Imaging Materials, Inc. 667) prepared via barcode printer (TSC MB340T). Samples were inactivated using a heat block (Labnet AccuBlock) set to 95 °C for 15 min (Figure S3iii) simultaneously during which time ribonucleases were denatured and virions lysed. While not strictly necessary, samples were removed from heat treatment and left at room temperature for 20 min to allow debris in the saliva to settle for easier pipetting. Barcodes were entered into records using a handheld scanner (Motorola Symbol LS2208-SR20007R-NA).

CDC-approved RT-qPCR from NP Swab

Next, 10 uL of diluted, heat-inactivated22 sample material was mixed with 15 μL of each 1-step PCR master mix consisting of: 1.) 1.5 μL each N1 and N2 primer probe set, 5 μL Quantabio Ultraplex 1-Step Toughmix (4×), and 7 μL H2O per reaction; 2.) 1.5 μL human RNase P reaction primer probe mix, 5 μL Quantabio Ultraplex 1-Step Toughmix (4×), and 8.5 μL H2O per reaction. Real-time PCR thermocycling was performed per CDC guidelines23. Each sample was screened in a combined N1, N2 reaction with an internal control human RNase P reaction (Supplementary Methods). Samples with no detectable fluorescence for either assay and those with SARS-CoV-2 target fluorescence between 39.5 and 45 cycle thresholds (Ct) were re-tested using a validated RNA purification kit (Promega Maxwell RSC Viral Total Nucleic Acid Multi-Pack Kit, ASB1330). RNA-purified samples were assayed under the same conditions, but with 5 μL of purified sample added to each reaction for 20 μL total reaction volume. No replicates were performed.

SalivirDetect - RT-qPCR in saliva

SLAMP was compared to the saliva-based RT-qPCR assay SalivirDetect with FDA Emergency Use Authorization (EUA) application number EUA202615, submitted August 25, 2020 and developed by Drs. Phillip Buckhaults and Carolyn Banister (University of South Carolina). SalivirDetect, like SLAMP, uses heating at 95 °C to process saliva without inactivation buffers or additives. SalivirDetect was conducted in the InHealth Life Sciences CLIA/CAP laboratory led by Dr. Deborah Keil (MSU). Briefly, ≈5 mL of saliva was collected in a 50-mL centrifuge tube. The tube was placed in a 95 °C oven (Fisherbrand Isotemp General Purpose Heating and Drying Oven) for 45 min, then allowed to sit at room temperature to cool. Two 5-μL aliquots of the saliva were transferred to two wells in a 96-well plate containing Luna Kit RT-qPCR reagents (E3600, New England Biolabs), one well containing N1 primers and the second well containing human RNase P primers from the United States CDC Real-Time Reverse Transcription PCR Panel for SARS-CoV-2 detection (Supplementary Methods). Samples were run on a CFX Opus 96 Real-Time qPCR instrument (Bio-Rad, cat no. 12011319). Only a single test per sample was performed with no replicates.

SLAMP - RT-LAMP in saliva

RT-LAMP reactions were set up as described by protocol E1700 (New England Biolabs) at 25 μL final reaction volume with the following modified formulation: 12.5 μL WarmStart 2X Master Mix (E1700L, New England Biolabs) 0.175 μL of dUTP (N0459S, New England Biolabs), 0.5 μL of UDG (M0372L, New England Biolabs), 2.5 μL of duplex NE primer mix (Supplementary Methods), 0.5 μL of 25-μM SYTO-9 (S34854, Invitrogen), 0.25 μL of 25-μL ROX reference dye (61110, Lumiprobe), 2.5 μL of 400-mM molecular biology grade guanidine HCl (GuHCl) (J65661, Alfa Aesar), 1.075 μL of nuclease-free water (B1500L, New England Biolabs), and 5 μL of heat-inactivated saliva sample. Controls were run on each 96-well plate, including SARS-CoV-2-negative heat-inactivated saliva as a no-template control (NTC), human beta-actin (ACTB) as a positive internal control, and three positive test controls of 5 × 104, 5 × 102, and 5 × 100 copies/μL synthetic SARS-CoV-2 RNA (NIST, RGTM 10169 Fragment 1) (Supplementary Methods). Positive test control dilutions were made using heat-inactivated SARS-CoV-2-negative saliva. All SLAMP reactions were prepared in 96-well qPCR plates (Applied Biosystems, 4483485) sealed using an ALPS 50V manual heat sealer (Thermo Scientific) with Clear Seal Diamond films (AB-0812, Thermo Scientific). Reactions were performed at 65 °C (1.6 °C/s ramp) on a QuantStudio 3 Real-Time PCR System (Applied Biosystems) (Figure S3iv) for 45 min. Fluorescence measurements for SYTO-9 and ROX channels were recorded every 1 min. SARS-CoV-2 may be present in highly variable amounts within the nasopharynx and the saliva24. To avoid invalid test samples where RNA was present only in the NP swab, only NP RT-qPCR-positive samples that also tested positive under at least one of the two saliva methods were included in this study. Any time-to-positive Tp > 40 min was considered negative. See Supplementary Methods for reaction curve-fitting procedure and SLAMP formulation optimization. Each saliva sample was run in triplicate.

Statistical Analysis

Statistical bootstrapping25 methods can predict how the normally triplicate SLAMP sensitivity and specificity may change when performed only in duplicates or single tests. Using our (triplicate, 45 min) SLAMP test results, 1,000 random bootstrap samples were used to predict sensitivity with respect to CDC-approved NP RT-qPCR at 95% confidence intervals when only 1 or 2 SLAMP reactions are performed per sample. In addition, we model the outcomes of SLAMP testing under hypothetical disease prevalence scenarios. Based upon the experimental sensitivity of SLAMP in triplicate and the bootstrap-predicted sensitivities of duplicate and single SLAMP tests, we determine the total number of detectable positive individuals based on a daily testing capacity of six 384-well plates, reserving 10 wells for controls when performed in triplicate, duplicate, or single tests. Specificity is assumed to remain constant.

All t-tests are reported as p values. Pearson correlation coefficients are reported as r values.

Results

Comparing testing methods: SLAMP, SalivirDetect, and NP RT-qPCR

We compare samples from two matrices, NP swab and saliva, across three different testing methods, SLAMP, SalivirDetect, and the “gold standard” CDC-approved NP RT-qPCR, the latter performed using NP swab while saliva, shown to provide sufficient viral RNA for detection26,27, was used for both SLAMP and SalivirDetect. Both SalivirDetect and CDC-approved NP RT-qPCR are PCR-based while SLAMP uses isothermal LAMP amplification. SLAMP was performed in triplicate while SalivirDetect and NP RT-qPCR tests were performed only once (Figure 1).

Figure 1.
  • Download figure
  • Open in new tab
Figure 1.

Sample collection and testing.

Demographics

Participant ages ranged from 17 to 63 with a median age of 20. Males made up 47% and females 53%. Participants were comprised of 94% white and 6% other races including Asian and mixed-race individuals of American Indian, Alaskan Native, Native Hawaiian or Pacific Islander, and African American descent. Ethnically, 9 individuals self-reported as Hispanic or Latino, 207 as not Hispanic or Latino, and 17 chose not to respond (Table 1).

View this table:
  • View inline
  • View popup
Table 1. Self-reported Demographic Information and Clinical Presentation.

Clinical presentation

Participants self-reported their illness presentation as either symptomatic or asymptomatic and indicated whether they had knowledge of recent exposure to a confirmed Covid-19-positive individual. A majority 74% of study participants self-reported as symptomatic among whom 46% indicated knowledge of recent exposure. Among the 29% asymptomatic, 6% were unaware of exposure, the remaining 94% sought testing after learning of SARS-CoV-2 exposure (Table 1).

Potential saliva contamination

Testing was conducted on a first come, first served basis without appointments. Therefore, instructions to abstain from food, drink, or oral hygiene products before donating saliva could not be provided to participants ahead of time. To determine the extent to which saliva may have been affected, the questionnaire asked participants whether they had eaten food or consumed drinks within 30 min of sampling. In addition, other consumables or oral hygiene products that may have persisted in saliva were also included, namely mouthwash, gum/lozenge, tobacco (whether smoked, vaporized, or chewed), and toothpaste from brushing teeth. Many participants had consumed multiple items. In order to make quantitative comparisons between saliva sample Ct values, we report the consumption survey results for individuals who testing positive using SalivirDetect (Table 1).

Testing outcomes - performance of the three methods

Performance metrics of saliva methods SalivirDetect and SLAMP were evaluated by comparing results to the “gold-standard” CDC-approved NP RT-qPCR method between 233 individuals tested using all three methods. We report the true positive (TP), true negative (TN), false positive (FP), and false negative (FN) counts along with the true positive rate (TPR) and true negative rate (TNR), also called sensitivity and specificity, respectively (Table 2). The sensitivity/specificity (in %) of SalivirDetect and SLAMP methods were 97/98 and 95/98, respectively. Based on NP RT-qPCR, 58 positive and 175 negative individuals were identified resulting in a disease prevalence of 25%.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2. Test Outcomes and Performance Metrics.

Comparing positive samples - two sample matrices and three testing methods

The 58 samples found positive under CDC-approved NP RT-qPCR are placed in order of increasing Ct value (decreasing effective SARS-CoV-2 genome concentration or viral titer) and compared to Ct values under SalivirDetect (Figure 2A) and Tp values using SLAMP (Figure 2B). Samples positive under saliva-based tests are compared in order of increasing SalivirDetect Ct value (Figure 2C) and increasing SLAMP Tp value (Figure 2D). False negatives are shown as missing bars and indicated by black arrows.

Figure 2.
  • Download figure
  • Open in new tab
Figure 2. Positive sample results compared between three tests.

Ct values of N=58 positive NP RT-qPCR and SalivirDetect samples in order of increasing CDC-approved NP RT-qPCR Ct value (Panel A). Ct values of N=58 positive CDC-approved NP RT-qPCR and Tp values of SLAMP samples in order of increasing CDC-approved NP RT-qPCR Ct value (Panel B). Ct values of N=59 positive SalivirDetect and Tp values of SLAMP samples presented in order of increasing SalivirDetect Ct value. Dashed line indicates 95% confidence interval SLAMP limit of detection (Panel C). Tp and Ct values of N=58 positive SLAMP and SalivirDetect tests, respectively, in order of increasing SLAMP Tp value (Panel D). Black arrows indicate undetected samples. Error bars represent one standard deviation.

Test outcomes and viral titers by age

A total of 223 participants provided age information and among these 56 were confirmed positive for SARS-CoV-2 using CDC-approved NP RT-qPCR. A histogram of these ages shows the positive results (gray) superimposed over the negative results (white), including one outlier age of 63 (Figure 3A). The most common age to be positive and negative is equal to the mode of 19 years old. Not surprisingly, the positive and negative distributions are similar (p = 0.407). Average Ct values as a function of age also indicate no trend in positivity as a function of this narrow age window (Figure 3A, inset).

Figure 3.
  • Download figure
  • Open in new tab
Figure 3. Study results and statistical predictions.

Histogram of participant age distributions, N=223. Gray and white bars represent positive and negative participants, respectively, tested using CDC-approved NP RT-qPCR (p = 0.407). Inset: average Ct values of SARS-CoV-2-positive CDC-approved NP RT-qPCR tests as a function of participant age (r = 0.00539). Error bars represent one standard deviation (Panel A). Histograms of CDC-approved NP RT-qPCR Ct values of SARS-CoV-2-positive participants self-reported as (from left-to-right) symptomatic exposed (N=76), symptomatic unexposed (N=88), asymptomatic exposed (N=64), and asymptomatic unexposed (N=4). Insets: fraction of positive tests (blue) and negative tests (white) within each category (Panel B). Box-and-whisker plots of SalivirDetect Ct values for individuals who both ate and drank (N=10), ate only (N=4), drank only (N=23), and did neither (N=21) (left panel) in addition to having used mouthwash (N=5), no mouthwash (N=52), gum/lozenge (N=6), no gum/lozenge (N=52), tobacco (N=7), no tobacco (N=51), brushing (N=31), and no brushing (N=27) (right panel) within 30 min of saliva sampling. Box-and-whisker plots define minimum, first quartile, median, third quartile, and maximum values (Panel C). Comparison between collection sites on the body. The Ct values of 56 positive CDC-approved NP RT-qPCR samples are plotted in increasing order (closed black squares). Open blue circles represent the SalivirDetect Ct values of the 56 corresponding saliva samples. Vertical lines connect NP and saliva values to guide the eye (left subplot). Cluster plot of Ct values of CDC-approved NP RT-qPCR vs. SalivirDetect. Dashed line indicates perfect correlation (r = 0.310) (right subplot) (Panel D). Bootstrap-predicted percentage of total positive individuals detected within a testing population as a function of SLAMP assay time for triplicate, duplicate or single replicate test conditions. Dashed lines indicate the mean. Solid lines indicate 95% bootstrap confidence intervals (Panel E). Total number of positive cases identified using SLAMP per 384-well plate as a function of disease prevalence for three, two, and single replicate tests. True positives (blue) and false positives (red) are generated for disease prevalence rates between 0 and 10% for single replicates, duplicates, and triplicates based on a daily capacity of six 384-well plates, reserving 10 wells for controls (Panel F).

Self-reported clinical presentations and test results

Participants were classified into four categories defined by their questionnaire responses: symptomatic exposed, symptomatic unexposed, asymptomatic exposed, and asymptomatic unexposed. Samples in each self-reported category were confirmed negative or positive based on CDC-approved NP RT-qPCR and positive individuals were assigned a Ct value. The 2nd largest category was symptomatic exposed numbering 76 individuals. Among these, only 20 participants were confirmed SARS-CoV-2-positive, around 26%. Symptomatic unexposed, the largest of all four categories, was comprised of 88 individuals from which 27 were confirmed positive, around 31%. The asymptomatic and exposed respondents numbered 64, of which only 9 tested positive, a total of only 14%. The smallest category was comprised of four participants who were asymptomatic and unexposed. Of these, half tested positive. Histograms of Ct values among the positive results with inset pie charts representing the fraction of confirmed SARS-CoV-2 positives (blue) among the negatives (white) for each category are shown in Figure 3B.

Consumption of potential inhibitors – effect on SalivirDetect Ct values

Distributions of SalivirDetect Ct values among individuals who had or had not consumed each potential inhibitor are shown in Figure 3C. Among those engaging in eating and drinking, only the Ct values of those who drank were statistically distinct compared to those who did not (p = 0.041). No other items consumed resulted in statistically significant differences in the Ct distributions of those populations. The p-values for comparisons of all other sets were >0.05.

Site comparison: Nasopharynx versus saliva

CDC-approved NP RT-qPCR and SalivirDetect provide Ct results that can be quantitatively compared between NP swabs and saliva (Figure 3D). We compare the viral titers of 56 individuals who tested positive under both methods. Viral titer has been shown to vary between these sites 28. Among samples with lower NP swab Ct values, assumed to correspond to a higher viral titer, saliva samples Ct values were higher, implying a lower viral titer than in the nasopharynx. However, when NP swab Ct values imply lower viral titers, Ct values in saliva were significantly lower, implying a difference in viral concentration between nasopharynx and oral mucosa (saliva) of possibly four orders of magnitude. Furthermore, there is a definite jump in values for the NP swab results from Ct=30-34, after which saliva Ct values are all lower than NP swab (Figure 3D, left). A correlation plot of NP vs. saliva Ct values reveals that the results have only a weak positive correlation (r = 0.310).

Statistical predictions for SLAMP tests at triplicate, duplicate, or as a single replicate

For each number of test replicates, sensitivity increases as a function of SLAMP assay duration (Figure 3E). As reported here, 45-min SLAMP with 3 replicates produced a sensitivity of 95% (95% CI: [87.9%, 100%]) as compared to the CDC-approved NP RT-qPCR standard results. Bootstrapping predicted a 90% sensitivity (95% CI: [82.8%, 96.6%]) for SLAMP with two replicates, and a 82% sensitivity (95% CI: [70.7%, 89.7%]) for SLAMP with a single replicate after the full assay time of 45 min had passed. For example, half of all positives in a test population would be detected by a single SLAMP test after 19.0 min (95% CI: [17.7 min, 21.5 min]), duplicate tests after 18.4 min (95% CI: [17.4 min, 19.3 min]), and triplicate tests after 17.7 min (95% CI: [16.9 min, 18.8 min]).

Based upon an estimated testing capacity of six 384-well plates per day (see Methods), we compare three scenarios of running samples with a single replicate, duplicate, and triplicate (Figure 3F). For these scenarios, we use the sensitivity values from Figure 3E. The specificity is assumed to be a constant 98% for all scenarios and there are 10 wells in each plate reserved for controls. Given the fixed constraint on the number of tests (≈384 × 6), screening a larger number of individuals can identify more positive cases. For example, at a disease prevalence of 10%, triplicate SLAMP would identify approximately 10.0 true positives (TP) at the cost of 2.4 false positives (FP) per 384-well plate with FPs equaling the number of TPs at a disease prevalence of 2.5%. For duplicate SLAMP, TP = 16.8, FP = 3.3, and TP = FP at a disease prevalence of 2.2%. Finally, for single test SLAMP, TP = 35.4, FP = 6.9, and TP = FP at a disease prevalence of and 2.0%.

Safety

Testing site volunteers were equipped with powered air-purifying respirators (PAPRs) during sample collection. Samples were transported in hard-sided coolers with biohazard labels. Contact surfaces were frequently disinfected using 70% ethanol solutions. All samples should be assumed to contain infectious SARS-CoV-2 virus and must be rendered safe through viral inactivation29 before testing. HEPA air purifiers (Medify Air MA-25) were used in the testing laboratory. All samples were heat inactivated before storage. See Supplementary Methods and Figure S4 for validation of viral heat-inactivation procedure.

Discussion

The demographics of this study (Table 1) reflect those of many universities throughout the US. The median age of study participants was 20 years, and 94% of participants were ages 18-24. This study was comprised of 53% females and 47% males. By comparison, the 2020 MSU student population was comprised of 48% females, 51% males, and <1% other30. This difference is in agreement with observations that suggest women seek Covid-19 testing, more than males31,32 and are more likely to take covid precautions seriously33. In terms of race, this study was comprised of 94.4% white and 5.6% non-white participants. By comparison, the 2020 MSU student population was comprised of 84% white and 16% non-white30. This difference of 10% may reflect differences in likelihood to seek Covid-19 testing34. The average US university in Fall 2020 was around 49% white35, more racially diverse than represented within our study. Nevertheless, we have no reason to doubt that SLAMP testing would be successfully employed among the student populations of other universities.

RT-LAMP (SLAMP) and RT-qPCR (SalivirDetect) Covid-19 tests performed on the saliva of 233 adults36 yielded 98% specificity for both and 95% and 97% sensitivity, respectively, sensitivities comparable to SalivaDirect37.

Surveying revealed that while 70% of pilot study participants identified as symptomatic, only 29% of these tested positive for SARS-CoV-2 (Table 2). Overall, the prevalence of Covid-19 disease was 25%, a number that coincides with incidence levels of 9-31% across the US, as estimated in the months prior to our study38. Only 5% were asymptomatic positives compared to the estimates of around 40% asymptomatic among the general population39 which is likely due to testing being reserved only for those with symptoms or recent exposures. We expect a random screening of the population would likely have produced a higher asymptomatic positive rate, given estimates ranging from 40-45% asymptomatic positive rate40.

While interference from food, drink, oral care products, and tobacco are a concern for saliva diagnostics41, we observed no significant differences in Ct distributions of SalivirDetect positive results who had or had not consumed food, oral care products, or tobacco within 30 min of saliva sampling. Interestingly, those who had consumed drink produced significantly lower Ct values (p = 0.407) than those who had not (Figure 3C). This suggests that hydrating the mouth before expressing saliva may stimulate its production, at least temporarily42, and contribute to the supply of greater viral genome from the oral mucosa43.

Viral load in saliva is consistently higher than NP swab. Strikingly, positive samples with the highest CDC NP RT-qPCR Ct values >30 are surprisingly lower than in saliva, representing a higher concentration of virus in the saliva of the oral mucosa under conditions of low titer in the nasopharynx (Figure 3D). In fact, all saliva samples had Ct ≤ 35, and the 9 individuals with the lowest NP swab virus concentrations (Ct > 35) had significantly lower Ct for the corresponding saliva sample test. SARS-CoV-2 infections have exhibited high tissue compartmentalization and data suggests viral titers may peak earlier in saliva than in NP swabs24.

While the SLAMP test has higher sensitivity when run in triplicate, running a single test can be advantageous. Given finite resources, driven by cost or supply availability, a single test on an individual can identify a substantially larger amount of infected, and infectious, individuals. We modeled the sensitivities and specificities of double and single tests from the triplicate SLAMP test data. Figure 3F shows the total number of positive individuals that can be identified by running a single 384-well plate in either triplicate, duplicate, or with a single test. Triplicate and duplicate have higher sensitivity, with 95% and 90% respectively, compared to that of a single test at 82%; however, running a single test allows more individuals to be tested.

It should be noted that specificity is assumed constant across the three SLAMP replicates (Figure 3F, red lines). Therefore, running more tests, with a lower specificity can also lead to more false positives that may require confirmatory testing. Recent work10 has demonstrated that more frequent testing with LAMP was more effective at reducing epidemic size than deploying more sensitive tests. Our analyses regarding sensitivity predict that running more samples with single replicates will lead to more false negatives, but ideally a high frequency testing strategy would catch those other cases10. Nonetheless, the data suggest that the SLAMP assay run in triplicate per individual could perform at the level of a clinical diagnostic, while when run as a single replicate could be used as a broad screening tool to identify unknown positives.

These results represent the intersection of self-reported demographics, disease presentation, and potential interferences. Our study size of N=233 with 58 diseased can be statistically interpreted with acceptable accuracy10. However, the sample number in the case of some interferences is low and limits statistical power.

SARS-CoV-2 testing that is rapid, simple, and requires no specially trained medical personnel is indispensable when large numbers of individuals must be frequently screened while remaining economical. In this study, we have compared three testing methods, NP RT-qPCR, SalivirDirect, and SLAMP. All three methods use simple heat to both inactivate and extract, which avoids costly reagents and potential supply bottlenecks. We conducted a comparison of these tests between 233 individuals from the MSU symptomatic testing site in mid-November of 2020, at the height of the largest county-wide wave of Covid-19 cases, where we detected a disease prevalence of 25%. Compared to the “gold standard” NP RT-qPCR results, SalivirDetect and SLAMP achieved 97% and 95% sensitivity and 98% and 98% specificity, respectively. We have demonstrated our SLAMP method offers a faster and simpler, while still comparatively sensitive, alternative to NP swabs and RT-qPCR methods for routine sampling, particularly of a college population.

Supported by the State of Montana through the Coronavirus Aid, Relief and Economic Security Act (CARES) Act.

Connie B. Chang and James N. Wilking are co-founders of ULTSafety, Inc. which has licensed technology from Montana State University and Harvard University relating to this publication.

We thank Nathan Tanner at New England Biolabs, Kathryn Kundrod in the Richards-Kortum group (Rice University), Paul Hergenrother (UIUC), and the Global LAMP R&D Consortium led by Christopher Mason (Weill Cornell Medicine) for helpful discussions. We thank MSU students Kyle Hain, Shawna Pratt, Emily Walter, Matthew Fisher, and Jerrica Bursik for sample collection and Donna Gollehon (MSU University Health Partners), Ryan Brickman (MSU Safety and Risk Management), and Ryan Bartlett (MSU Office of Research Compliance) for their assistance throughout the approval process and especially with sample site logistics. We thank the MSU Center for American Indian and Rural Health Equity for the use of the Health Education and Research Bus (HERB) at the sample collection site. HERB is a mobile laboratory and outreach facility supported by an Institutional Development Award (IDeA) from the National Institute of General Medical Sciences of the National Institutes of Health under grant numbers P20GM104417 and P20GM103474.

Data Availability

Data is available by request to corresponding authors.

Author Affiliations

From the Montana State University Department of Chemical & Biological Engineering (D.A.B., E.K.L., T.L., I.T., J.N.W., C.B.C.), Center for Biofilm Engineering (D.A.B., C.H., K.A.B., A.P., E.K.L., T.L., I.T., J.N.W., J.M., M.W.F., C.B.C.), Department of Microbiology & Immunology (M.R., S.T.W., R.K.B., M.P.T., D.E.K., M.W.F.), Department of Mathematical Sciences (A.P., A.B.H.), Center for American Indian and Rural Health Equity (CAIRHE) (A.K.A.), and Health & Human Development (J.R.C.).

Footnotes

  • All figures and sections updated for clarity. Supplemental files updated for clarity.

References

  1. 1.↵
    Munster VJ, Koopmans M, van Doremalen N, van Riel D, de Wit E. A Novel Coronavirus Emerging in China — Key Questions for Impact Assessment. New England Journal of Medicine 2020;382:692–4.
    OpenUrlCrossRefPubMed
  2. 2.↵
    Olliaro P, Torreele E, Vaillant M. COVID-19 vaccine efficacy and effectiveness-the elephant (not) in the room. Lancet Microbe 2021.
  3. 3.↵
    Thompson RN, Hill EM, Gog JR. SARS-CoV-2 incidence and vaccine escape. Lancet Infect Dis 2021.
  4. 4.↵
    Castillo JC, Ahuja A, Athey S, et al. Market design to accelerate COVID-19 vaccine supply. Science 2021;371:1107–9.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    Chia WN, Zhu F, Ong SWX, et al. Dynamics of SARS-CoV-2 neutralising antibody responses and duration of immunity: a longitudinal study. Lancet Microbe 2021.
  6. 6.↵
    Kirby T. When should the UK lift its lockdown? Lancet Respir Med 2021;9:e44–e5.
    OpenUrl
  7. 7.↵
    Head JR, Andrejko KL, Cheng Q, et al. School closures reduced social mixing of children during COVID-19 with implications for transmission risk and school reopening policies. J R Soc Interface 2021;18:20200970.
    OpenUrl
  8. 8.↵
    Guidance for Antigen Testing for SARS-CoV-2 for Healthcare Providers Testing Individuals in the Community. (Accessed Updated Apr. 4, 2022, at https://www.cdc.gov/coronavirus/2019-ncov/lab/resources/antigen-tests-guidelines.html.)
  9. 9.↵
    Mina MJ, Andersen KG. COVID-19 testing: One size does not fit all. 2021;371:126–7.
    OpenUrl
  10. 10.↵
    Rogers W, Ruiz-Aravena M, Hansen D, et al. High-frequency screening combined with diagnostic testing for control of SARS-CoV-2 in high-density settings: an economic evaluation of resources allocation for public health benefit. 2021:2021.03.04.21252949.
  11. 11.↵
    Mori Y, Notomi T. Loop-mediated isothermal amplification (LAMP): a rapid, accurate, and cost-effective diagnostic method for infectious diseases. J Infect Chemother 2009;15:62–9.
    OpenUrlCrossRefPubMedWeb of Science
  12. 12.↵
    Bhadra S, Maranhao AC, Paik I, Ellington AD. A One-enzyme RT-qPCR Assay for SARS-CoV-2, and Procedures for Reagent Production. Bio-protocol 2021;11:e3898.
    OpenUrl
  13. 13.
    Buck MD, Poirier EZ, Cardoso A, et al. Standard operating procedures for SARS-CoV-2 detection by a clinical diagnostic RT-LAMP assay. medRxiv 2020:2020.06.29.20142430.
  14. 14.
    Esbin MN, Whitney ON, Chong S, Maurer A, Darzacq X, Tjian R. Overcoming the bottleneck to widespread testing: a rapid review of nucleic acid testing approaches for COVID-19 detection. RNA (New York, NY) 2020;26:771–83.
    OpenUrlAbstract/FREE Full Text
  15. 15.
    Kashir J, Yaqinuddin A. Loop mediated isothermal amplification (LAMP) assays as a rapid diagnostic for COVID-19. Medical Hypotheses 2020;141:109786.
    OpenUrlCrossRefPubMed
  16. 16.
    Yan C, Cui J, Huang L, et al. Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin Microbiol Infect 2020;26:773–9.
    OpenUrlPubMed
  17. 17.↵
    Lamb LE, Bartolone SN, Ward E, Chancellor MB. Rapid detection of novel coronavirus/Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) by reverse transcription-loop-mediated isothermal amplification. PLoS One 2020;15:e0234682.
    OpenUrlCrossRefPubMed
  18. 18.↵
    Tan SH, Allicock O, Armstrong-Hough M, Wyllie AL. Saliva as a gold-standard sample for SARS-CoV-2 detection. The Lancet Respiratory Medicine.
  19. 19.↵
    For Coronavirus Testing, the Nose May Not Always Be Best. The New York Times Jan. 14, 2022.
  20. 20.↵
    Thompson D, Lei Y. Mini review: Recent progress in RT-LAMP enabled COVID-19 detection. Sensors and actuators reports 2020;2:100017-.
    OpenUrlCrossRef
  21. 21.↵
    SalivirDetect. 2021, at https://sc.edu/study/colleges_schools/pharmacy/centers/diagnostic_genomics_covid_lab/salivir-detect/index.php.)
  22. 22.↵
    A new process that can be used in place of the extraction method when materials for the current method are limited. at https://www.fda.gov/media/138931/download.)
  23. 23.↵
    Diseases CDNDoV. CDC 2019-Novel Coronavirus (2019-nCoV) Real-Time RT-PCR Diagnostic Panel. In: Prevention CfDCa, ed. CDC-006-00019, Revision: 06 ed12/01/2020.
  24. 24.↵
    Ke R, Martinez PP, Smith RL, et al. Daily longitudinal sampling of SARS-CoV-2 infection reveals substantial heterogeneity in infectiousness. Nature Microbiology 2022;7:640–52.
    OpenUrl
  25. 25.↵
    Efron B, Tibshirani R. An introduction to the bootstrap. New York: Chapman & Hall; 1993.
  26. 26.↵
    Zhu J, Guo J, Xu Y, Chen X. Viral dynamics of SARS-CoV-2 in saliva from infected patients. J Infect 2020;81:e48–e50.
    OpenUrlCrossRefPubMed
  27. 27.↵
    Corstjens PLAM, Abrams WR, Malamud D. Saliva and viral infections. Periodontol 2000 2016;70:93–110.
    OpenUrl
  28. 28.↵
    Wyllie AL, Fournier J, Casanovas-Massana A, et al. Saliva or nasopharyngeal swab specimens for detection of SARS-CoV-2. N Engl J Med 2020;383:1283–6.
    OpenUrlCrossRefPubMed
  29. 29.↵
    Adaway JE, Hawley JM, Lockhart SJ, Keevil BG. Heat Inactivation of Saliva Samples for the Analysis of Cortisol and Cortisone during the COVID-19 Pandemic. The Journal of Applied Laboratory Medicine 2020;5:1413–6.
    OpenUrl
  30. 30.↵
    Quick Facts: 2020-2021. Montana State University, 2020-2021. 2021, at https://www.montana.edu/opa/facts/quickfactsarchive/quick21.html.)
  31. 31.↵
    Lapointe-Shaw L, Rader B, Astley CM, et al. Web and phone-based COVID-19 syndromic surveillance in Canada: A cross-sectional study. PLOS ONE 2020;15:e0239886.
    OpenUrlPubMed
  32. 32.↵
    Stall NM, Wu W, Lapointe-Shaw L, et al. Sex- and Age-Specific Differences in COVID-19 Testing, Cases, and Outcomes: A Population-Wide Study in Ontario, Canada. 2020;68:2188–91.
    OpenUrl
  33. 33.↵
    Galasso V, Pons V, Profeta P, Becher M, Brouard S, Foucault M. Gender differences in COVID-19 attitudes and behavior: Panel evidence from eight countries. 2020;117:27285–91.
    OpenUrl
  34. 34.↵
    Jacobson M, Chang TY, Shah M, Pramanik R, Shah SB. Racial and Ethnic Disparities in SARS-CoV-2 Testing and COVID-19 Outcomes in a Medicaid Managed Care Cohort. American journal of preventive medicine 2021;61:644–51.
    OpenUrlCrossRef
  35. 35.↵
    Fast Facts. 2020. at https://nces.ed.gov/fastfacts/display.asp?id=372.)
  36. 36.↵
    Bujang MA, Adnan TH. Requirements for Minimum Sample Size for Sensitivity and Specificity Analysis. J Clin Diagn Res 2016;10:YE01–YE6.
    OpenUrl
  37. 37.↵
    Vogels CBF, Watkins AE, Harden CA, et al. SalivaDirect: A simplified and flexible platform to enhance SARS-CoV-2 testing capacity. Med 2021;2:263–80.e6.
    OpenUrl
  38. 38.↵
    Reese H, Iuliano AD, Patel NN, et al. Estimated Incidence of Coronavirus Disease 2019 (COVID-19) Illness and Hospitalization—United States, February–September 2020. Clinical Infectious Diseases 2020;72:e1010–e7.
    OpenUrl
  39. 39.↵
    Ma Q, Liu J, Liu Q, et al. Global Percentage of Asymptomatic SARS-CoV-2 Infections Among the Tested Population and Individuals With Confirmed COVID-19 Diagnosis: A Systematic Review and Meta-analysis. JAMA Network Open 2021;4:e2137257–e.
    OpenUrl
  40. 40.↵
    Oran DP, Topol EJ. Prevalence of Asymptomatic SARS-CoV-2 Infection A Narrative Review. Ann Intern Med 2020;173:362-+.
    OpenUrlCrossRefPubMed
  41. 41.↵
    Kapoor P, Chowdhry A, Kharbanda OP, Popli DB, Gautam K, Saini V. Exploring salivary diagnostics in COVID-19: a scoping review and research suggestions. Bdj Open 2021;7.
  42. 42.↵
    Jose A, Singh ML, Magnuson B, Farag A, Varghese R, Papas A. A randomized controlled study to evaluate an experimental moisturizing mouthwash formulation in participants experiencing dry mouth symptoms. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology 2018;126:231–9.e5.
    OpenUrl
  43. 43.↵
    Benn AM, Thomson WM. Saliva: an overview. The New Zealand dental journal 2014;110:92–6.
    OpenUrl
Back to top
PreviousNext
Posted May 31, 2024.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
SARS-CoV-2 Detection in the Nasopharyngeal Swabs and Saliva of College Students using RT-qPCR and RT-LAMP
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
SARS-CoV-2 Detection in the Nasopharyngeal Swabs and Saliva of College Students using RT-qPCR and RT-LAMP
D. A. Bikos, C. Hwang, K. A. Brileya, A. Parker, E. K. Loveday, M. Rodriguez, I. Thornton, T. LeFevre, J. N. Wilking, M. Dills, S. T. Walk, A. K. Adams, R. K. Plowright, A. B. Hoegh, J. R. Carter, J. Morrow, M. P. Taylor, D. E. Keil, M. W. Fields, C. B. Chang
medRxiv 2021.03.31.21254634; doi: https://doi.org/10.1101/2021.03.31.21254634
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
SARS-CoV-2 Detection in the Nasopharyngeal Swabs and Saliva of College Students using RT-qPCR and RT-LAMP
D. A. Bikos, C. Hwang, K. A. Brileya, A. Parker, E. K. Loveday, M. Rodriguez, I. Thornton, T. LeFevre, J. N. Wilking, M. Dills, S. T. Walk, A. K. Adams, R. K. Plowright, A. B. Hoegh, J. R. Carter, J. Morrow, M. P. Taylor, D. E. Keil, M. W. Fields, C. B. Chang
medRxiv 2021.03.31.21254634; doi: https://doi.org/10.1101/2021.03.31.21254634

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)