Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Standardization and Comparison of Emergency Use Authorized COVID-19 Assays and Testing Laboratories

Anuradha Rao, View ORCID ProfileJessica Lin, Richard Parsons, Morgan Greenleaf, Adrianna Westbrook, Eric Lai, Heather B. Bowers, Kaleb McClendon, William O’Sick, Tyler Baugh, Markayla Sifford, Julie A. Sullivan, Wilbur A. Lam, Leda Bassit
doi: https://doi.org/10.1101/2023.11.08.23297633
Anuradha Rao
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
2Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: anuradha.rao{at}emory.edu morgan.greenleaf{at}emory.edu lbassit{at}emory.edu
Jessica Lin
3Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jessica Lin
Richard Parsons
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
4Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, GA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Morgan Greenleaf
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
5Emory University School of Medicine, Atlanta, GA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: anuradha.rao{at}emory.edu morgan.greenleaf{at}emory.edu lbassit{at}emory.edu
Adrianna Westbrook
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
2Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eric Lai
6Personalized Science San Diego CA 05403 USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Heather B. Bowers
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
2Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA
7Laboratory of Biochemical Pharmacology, Emory University, Atlanta, Georgia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kaleb McClendon
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
8Emory/Children’s Laboratory for Innovative Assay Development, Atlanta, Georgia, USA
9Department of Pathology and Laboratory Medicine, Emory University School of Medicine Atlanta, GA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William O’Sick
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
8Emory/Children’s Laboratory for Innovative Assay Development, Atlanta, Georgia, USA
9Department of Pathology and Laboratory Medicine, Emory University School of Medicine Atlanta, GA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tyler Baugh
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
8Emory/Children’s Laboratory for Innovative Assay Development, Atlanta, Georgia, USA
9Department of Pathology and Laboratory Medicine, Emory University School of Medicine Atlanta, GA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Markayla Sifford
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
8Emory/Children’s Laboratory for Innovative Assay Development, Atlanta, Georgia, USA
9Department of Pathology and Laboratory Medicine, Emory University School of Medicine Atlanta, GA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Julie A. Sullivan
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
2Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wilbur A. Lam
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
3Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
10Children’s Healthcare of Atlanta, Atlanta, Georgia, USA
11Aflac Cancer and Blood Disorders Center at Children’s Healthcare of Atlanta, Atlanta, Georgia, USA
12Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leda Bassit
1The Atlanta Center for Microsystems-Engineered Point-of-Care Technologies, Atlanta, GA, United States of America
2Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA
7Laboratory of Biochemical Pharmacology, Emory University, Atlanta, Georgia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: anuradha.rao{at}emory.edu morgan.greenleaf{at}emory.edu lbassit{at}emory.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Summary

SARS-CoV-2, the causal agent of the global COVID-19 pandemic, made its appearance at the end of 2019 and is still circulating in the population. The pandemic led to an urgent need for fast, reliable, and widely available testing. After December 2020, the emergence of new variants of SARS-CoV-2 led to additional challenges since new and existing tests had to detect variants to the same extent as the original Wuhan strain. When an antigen-based test is submitted to the Food and Drug Administration (FDA) for Emergency Use Authorization (EUA) consideration it is benchmarked against PCR comparator assays, which yield cycle threshold (CT) data as an indirect indicator of viral load – the lower the CT, the higher the viral load of the sample and the higher the CT, the lower the viral load. The FDA mandates that 10-20% of clinical samples used to evaluate the antigen test have to be low positive. Low positive, as defined by the FDA, are clinical samples in which the CT of the SARS-CoV-2 target gene is within 3 CT of the mean CT value of the approved comparator test’s Limit of Detection (LOD). While all comparator tests are PCR-based, the results from different PCR assays used are not uniform. Results vary depending on assay platform, target gene, LOD and laboratory methodology. The emergence and dominance of the Omicron variant further challenged this approach as the fraction of low positive clinical samples dramatically increased as compared to earlier SARS-CoV-2 variants. This led to 20-40% of clinical samples having high CT values and therefore assays vying for an EUA were failing to achieve the 80% Percent Positive Agreement (PPA) threshold required. Here we describe the methods and statistical analyses used to establish a predefined cutoff, based on genome copies per ml (GE/ml) to classify samples as low positive (less than the cutoff GE/ml) or high positive (greater than the cutoff GE/mL). CT 30 for the E gene target using Cobas® SARS-CoV-2-FluA/B platform performed at TriCore Reference Laboratories, and this low positive cutoff value was used for two EUA authorizations. Using droplet digital PCR and methods described here, a value 49,447.72 was determined as the GE/ml equivalent for the low positive cutoff. The CT cutoff corresponding to 49447.72 GE/ml was determined across other platforms and laboratories. The methodology and statistical analysis described here can now be used for standardization of all comparators used for FDA submissions with a goal towards establishing uniform criteria for EUA authorization.

Motivation The motivation for this work was the need to establish a predefined cutoff based on genome copies per ml (GE/ml) rather than Ct, which can vary depending on the laboratory and assay used. A GE/ml-based threshold was necessary to define what constituted ‘low positives” for samples that were included in data sets submitted to the FDA for emergency use approval for SARS-CoV-2 antigen tests.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was supported by the National Institute of Biomedical Imaging and Bioengineering under the Atlanta Center for Microsystems Engineered Point-of-Care Technologies (ACME POCT). This work was supported by the NIBIB at the NIH under awards 3U54 EB027690-03S1, 3U54 EB027690-03S2, 3U54 EB027690-04S1 and the National Center for Advancing Translational Sciences of the NIH under award UL1TR002378.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This study used ONLY data that were openly available to the public, including purchased pooled nasal wash samples from Lee Biosolutions (Catalog number 991-26-P), and the publicly available Heat-Inactivated SARS-Related Coronavirus 2, Isolate USA-WA1/2020 from BEI resources (catalog number NR-52286).

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • ↵† Lead Contact: wilbur.lam{at}emory.edu.

Data Availability

Data and code are available at: https://github.com/rbparso/Calibration-Curve

https://github.com/rbparso/Calibration-Curve

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
Back to top
PreviousNext
Posted November 08, 2023.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Standardization and Comparison of Emergency Use Authorized COVID-19 Assays and Testing Laboratories
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Standardization and Comparison of Emergency Use Authorized COVID-19 Assays and Testing Laboratories
Anuradha Rao, Jessica Lin, Richard Parsons, Morgan Greenleaf, Adrianna Westbrook, Eric Lai, Heather B. Bowers, Kaleb McClendon, William O’Sick, Tyler Baugh, Markayla Sifford, Julie A. Sullivan, Wilbur A. Lam, Leda Bassit
medRxiv 2023.11.08.23297633; doi: https://doi.org/10.1101/2023.11.08.23297633
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Standardization and Comparison of Emergency Use Authorized COVID-19 Assays and Testing Laboratories
Anuradha Rao, Jessica Lin, Richard Parsons, Morgan Greenleaf, Adrianna Westbrook, Eric Lai, Heather B. Bowers, Kaleb McClendon, William O’Sick, Tyler Baugh, Markayla Sifford, Julie A. Sullivan, Wilbur A. Lam, Leda Bassit
medRxiv 2023.11.08.23297633; doi: https://doi.org/10.1101/2023.11.08.23297633

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)