Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

EHR-based Case Identification of Pediatric Long COVID: A Report from the RECOVER EHR Cohort

View ORCID ProfileMorgan Botdorf, Kimberley Dickinson, View ORCID ProfileVitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden Schwenk, View ORCID ProfileHiroki Morizono, Jonathan Cogen, Nate M Pajor, Ravi Jhaveri, Christopher B. Forrest, L. Charles Bailey the RECOVER Consortium
doi: https://doi.org/10.1101/2024.05.23.24307492
Morgan Botdorf
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Morgan Botdorf
  • For correspondence: botdorfm{at}chop.edu
Kimberley Dickinson
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
BS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vitaly Lorman
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Vitaly Lorman
Hanieh Razzaghi
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicole Marchesani
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Suchitra Rao
2Department of Pediatrics, University of Colorado School of Medicine and Children’s Hospital Colorado, Denver, CO
MBBS, MSCS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Colin Rogerson
3Division of Critical Care, Department of Pediatrics, Indiana University School of Medicine, Indianapolis, IN
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Miranda Higginbotham
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
MHA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Asuncion Mejias
4Division of Infectious Diseases, Department of Pediatrics, Nationwide Children’s Hospital and The Ohio State University, Columbus, OH
MD, PhD, MsCS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daria Salyakina
5Center for Precision Medicine, Nicklaus Children’s Hospital, Miami, FL
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Deepika Thacker
6Nemours Cardiac Center, Alfred I. duPont Hospital for Children, Wilmington, DE
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dima Dandachi
7Division of Infectious Diseases, Department of Medicine, University of Missouri-Columbia, Columbia, MO
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dimitri A Christakis
8Center for Child Health, Behavior and Development, Seattle Children’s Research Institute, Seattle, WA
MD MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emily Taylor
9New York University Grossman School of Medicine Department of Medicine New York, NY
M.A
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hayden Schwenk
10Stanford School of Medicine, Division of Pediatric Infectious Diseases, Stanford, CA
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hiroki Morizono
11Center for Genetic Medicine Research, Children’s National Hospital, Washington, D
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hiroki Morizono
Jonathan Cogen
12Division of Pulmonary and Sleep Medicine, Department of Pediatrics, Seattle Children’s Hospital, University of Washington, Seattle, WA
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nate M Pajor
13Division of Pulmonary Medicine, Cincinnati Children’s Hospital Medical Center and University of Cincinnati College of Medicine, Cincinnati OH
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ravi Jhaveri
14Division of Infectious Diseases, Ann & Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher B. Forrest
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
L. Charles Bailey
1Applied Clinical Research Center, Children’s Hospital of Philadelphia, Philadelphia, PAlJ
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Objective Long COVID, marked by persistent, recurring, or new symptoms post-COVID-19 infection, impacts children’s well-being yet lacks a unified clinical definition. This study evaluates the performance of an empirically derived Long COVID case identification algorithm, or computable phenotype, with manual chart review in a pediatric sample. This approach aims to facilitate large-scale research efforts to understand this condition better.

Methods The algorithm, composed of diagnostic codes empirically associated with Long COVID, was applied to a cohort of pediatric patients with SARS-CoV-2 infection in the RECOVER PCORnet EHR database. The algorithm classified 31,781 patients with conclusive, probable, or possible Long COVID and 307,686 patients without evidence of Long COVID. A chart review was performed on a subset of patients (n=651) to determine the overlap between the two methods. Instances of discordance were reviewed to understand the reasons for differences.

Results The sample comprised 651 pediatric patients (339 females, Mage = 10.10 years) across 16 hospital systems. Results showed moderate overlap between phenotype and chart review Long COVID identification (accuracy = 0.62, PPV = 0.49, NPV = 0.75); however, there were also numerous cases of disagreement. No notable differences were found when the analyses were stratified by age at infection or era of infection. Further examination of the discordant cases revealed that the most common cause of disagreement was the clinician reviewers’ tendency to attribute Long COVID-like symptoms to prior medical conditions. The performance of the phenotype improved when prior medical conditions were considered (accuracy = 0.71, PPV = 0.65, NPV = 0.74).

Conclusions Although there was moderate overlap between the two methods, the discrepancies between the two sources are likely attributed to the lack of consensus on a Long COVID clinical definition. It is essential to consider the strengths and limitations of each method when developing Long COVID classification algorithms.

Competing Interest Statement

Dr. Mejias reports funding from Janssen, Merck for research support, and Janssen, Merck and Sanofi-Pasteur for Advisory Board participation; Dr. Rao reports prior grant support from GSK and Biofire and is a consultant for Sequiris. Dr. Jhaveri is a consultant for AstraZeneca, Seqirus and Dynavax, and receives an editorial stipend from Elsevier. All other authors have no conflicts of interest to disclose.

Funding Statement

This research was funded by the National Institutes of Health (NIH) Agreement OT2HL161847-01 as part of the Researching COVID to Enhance Recovery (RECOVER) program of research.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Institutional Review Board (IRB) approval was obtained under Biomedical Research Alliance of New York (BRANY) protocol #21-08-508. BRANY IRB waived the need for consent and HIPAA authorization.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

All data produced in the present study are available upon reasonable request to the authors.

  • Abbreviations

    PASC
    post-acute sequelae of SARS-CoV-2 infection
    COVID-19
    coronavirus disease 2019
    SARS-CoV-2
    severe acute respiratory syndrome coronavirus 2
    PCR
    polymerase chain reaction
    EHR
    electronic health record
    MIS-C
    multisystem inflammatory syndrome in children
    ICD-10
    International Classification of Diseases, version 10
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
    Back to top
    PreviousNext
    Posted May 23, 2024.
    Download PDF

    Supplementary Material

    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    EHR-based Case Identification of Pediatric Long COVID: A Report from the RECOVER EHR Cohort
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    EHR-based Case Identification of Pediatric Long COVID: A Report from the RECOVER EHR Cohort
    Morgan Botdorf, Kimberley Dickinson, Vitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden Schwenk, Hiroki Morizono, Jonathan Cogen, Nate M Pajor, Ravi Jhaveri, Christopher B. Forrest, L. Charles Bailey
    medRxiv 2024.05.23.24307492; doi: https://doi.org/10.1101/2024.05.23.24307492
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    EHR-based Case Identification of Pediatric Long COVID: A Report from the RECOVER EHR Cohort
    Morgan Botdorf, Kimberley Dickinson, Vitaly Lorman, Hanieh Razzaghi, Nicole Marchesani, Suchitra Rao, Colin Rogerson, Miranda Higginbotham, Asuncion Mejias, Daria Salyakina, Deepika Thacker, Dima Dandachi, Dimitri A Christakis, Emily Taylor, Hayden Schwenk, Hiroki Morizono, Jonathan Cogen, Nate M Pajor, Ravi Jhaveri, Christopher B. Forrest, L. Charles Bailey
    medRxiv 2024.05.23.24307492; doi: https://doi.org/10.1101/2024.05.23.24307492

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Pediatrics
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)