Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Quantifying Clinical Trial Diversity of FDA Novel Drug Approvals

View ORCID ProfileWilliam E Fitzsimmons, View ORCID ProfileMuhammed Y Idris, View ORCID ProfilePriscilla Pemu
doi: https://doi.org/10.1101/2023.05.11.23289884
William E Fitzsimmons
1University of Illinois at Chicago Colleges of Pharmacy and Medicine, Chicago, IL, USA
3CARER Group, San Diego, CA, USA
Pharm.D., M.S.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for William E Fitzsimmons
  • For correspondence: wfitzsim{at}uic.edu
Muhammed Y Idris
2Clinical Research Center, Morehouse School of Medicine, Atlanta, GA, USA
3CARER Group, San Diego, CA, USA
Ph.D.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Muhammed Y Idris
Priscilla Pemu
2Clinical Research Center, Morehouse School of Medicine, Atlanta, GA, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Priscilla Pemu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Health care inequity includes the lack of adequate representation of various populations in clinical trials. Government, academic and industry organizations have highlighted these issues and committed to actions to improve. In order to assess the current status and future success of these initiatives a quantitative objective measure to assess the state of clinical trial diversity is needed.

Methods FDA review documents for all novel drug approvals from January 2022 through February 16, 2023 were assessed using a scorecard that considers diversity across different demographic subgroups including age (>65 yo), sex (female), race (Black and Asian) and ethnicity (Hispanic/Latino). The scorecard assigns each drug a letter grade, between A and F, for each subgroup (and overall) based on 1) the percent of each sub-population included in the trials and grades relative to the percent of the US population, 2) the number of participants from each subpopulation that received the novel new drug in the trials, 3) the incidence or prevalence of the disease/condition in each of the sub-populations.

Results The FDA approved 43 novel new drugs for 44 indications (one drug was simultaneously approved for two indications). The three drugs with A Grades reflecting the best diversity in their registration trials were tapinarof (Vtama from Dermavant), daprodustat (Jesduvroq from GlaxoSmithKline) and eflapegrastim (Rolvedon from Spectrum Pharmaceuticals.) There was good representation of elderly and females with only two drugs receiving a D grade in either of these sub-populations. In contrast, Black and Hispanic representation was often inadequate with 4 drugs receiving F grades. There were 9 drugs (20%) where there were no Black participants receiving the novel new drug and an additional 14 approvals where there were <10 Black participants receiving the novel drug. The median number of Black participants receiving the investigational drug was 9. In the Hispanic/Latino population there were 2 approvals with no Hispanic participants receiving the novel drug and 14 approvals where there were < 10 Hispanic participants receiving the drug. The median number of Hispanic participants receiving the novel drug was 12.5.

Conclusions This newly developed scorecard provides an objective quantitative approach to assess the current state of diversity in clinical trials supporting new drug approvals. Substantial improvement in racial and ethnic representation is needed. Meaningful change will require actions and cooperation amongst all stakeholders to address this multifaceted issue and will take commitment, perseverance, and appropriate incentives.

Background

Despite the rapid pace of scientific discovery driven by technological innovation, efforts to translate those discoveries into solutions that address persistent health disparities have been considerably less effective. A particularly challenging problem is the fact that clinical trials, the seminal first step in delivery of new medicines and therapies, typically do not adequately include the diverse populations who live in our most underserved and marginalized communities. Because safety and effectiveness may vary in different populations, the lack of diversity in clinical trial enrollment compromises the health care that can be delivered to those who are excluded. Whereas this problem has been recognized for decades, progress has been slow in overcoming this critical deficiency.

Awareness and the “Calls for Action” for Clinical Trial Diversity took major steps forward in 2022 on the U.S. national front. The year was marked by reports from: The National Academy of Sciences, Engineering, and Medicine report on Improving Representation in Clinical Trials and Research: Building Research Equity for Women and Underrepresented which highlighted the lack of progress in increasing trial participation of racial and ethnic minority population groups and the subsequent impact on health disparities and the national costs and consequences; The Government Accountability Office on Practices to Facilitate Diversity of Patients in Cancer Clinical Trials which focused on the Federal actions that have been taken to facilitate diversity in cancer clinical trials and the best practices from 17 cancer centers with a history of enrolling diverse populations.1,2 The FDA published a Draft Guidance entitled “Diversity Plans to Improve Enrollment of Participants from Underrepresented Racial and Ethnic Populations in Clinical Trials Guidance for Industry” to provide recommendations to biopharmaceutical sponsors developing medical products for developing a Race and Ethnicity Diversity Plan to enroll representative numbers of racial and ethnic populations in the United States in clinical trials.3 Legislatively, numerous Bills were also introduced into the 117th Congress with measures to address diversity in clinical trials including the DEPICT Act (H.R. 6584), the CURES 2.0 Act (H.R. 6000), the DIVERSE Trials Act (H.R. 5030, S.2706), and the ENACT Act of 2021 (H.R. 3085, S.1548). Although these Bills were not passed, on December 29,2022 the President signed H.R.2617 - Consolidated Appropriations Act, 2023 into Law which included amendments to laws governing the FDA referred to as Food and Drug Omnibus Reform Act of 2022, or FDORA.4 These amendments included guidance, workshops, summary reports and requirements for diversity action plans for clinical studies. While all of these reports are indicators of positive momentum and a desire to improve clinical trial diversity, there is a lack of quantitative objective data and evidence to assess the state of clinical trial diversity and in turn evaluate novel new drug approvals.

Methods

A methodology was developed to assess the clinical trial diversity in novel drug approvals by the U.S. as tabulated by calendar year in the FDA website.5 Starting in January 2022 through February 16, 2023, the FDA review for each novel drug, including new molecular entities and new therapeutic biological products, was evaluated as published in the FDA review documents.6 FDA reviews provided a breakdown of the demography for the pivotal registration trial(s) including age (>65 yo), sex (female), race (Black or African, Asian) and ethnicity (Hispanic or Latino).

Analyzing Clinical Trial Diversity

The demography for the pivotal registration trial(s) that demonstrated the safety and efficacy of the new drug were assessed.

Percent in Clinical Trial

The percentage of the total population enrolled for each group was calculated across both the treatment and control groups and compared to the U.S. Census data for each group and graded as below (less than 70% of the census representation), meets (within 70-130%) or exceeds (>130% of the census representation).7 The 30% relative margin was chosen to reflect a significant deviation from the census data which encompasses a two sided 90% confidence interval around the population average (assuming a sample size of 300) and accounts for the challenges of enrolling at or above the census average percentage.

Number Treated with New Drug

Next, the total number of each group that were treated with the new drug was tabulated for the pivotal trial(s). The main focus for this metric was to assess the ability to detect safety events in the group that were “very common” (>10%), or “common” (>1%) per EMA SmPC guidance.8 The “Rule of Three’s” was used to define whether there was sufficient exposure to detect a very common event (i.e. at least 30) or a common event (i.e. at least 300).9

Incidence of Disease or Condition

Subsequently a literature search was performed to determine if the disease or condition for which the new drug was approved is seen in decreased, similar or increased incidence/prevalence in the group compared to others (e.g. <65 yo, male, white non-Hispanic).

These three metrics, percent enrolled in pivotal trials, number treated with novel drug, and incidence/prevalence in the group, were color coded in the scorecard and used to develop a grade (A-F) for each diversity group per the algorithm shown in the Supplemental material. The grades across the 5 groups were averaged (A=4, B=3, C=2, D=1, F=0) and an overall diversity grade for the novel drug was assigned based on the scoring shown in the supplemental material.

Results

From January, 2022 through February 16, 2023, the FDA approved 43 novel new drugs for 44 indications (one drug was simultaneously approved for two indications). An analysis of the grades for these 43 drugs is summarized in Table 1 and the scorecard for each of these 44 indications is included in the Supplemental material. The three drugs with A Grades reflecting the best diversity in their registration trials were tapinarof (Vtama from Dermavant), Jesduvroq (daprodustat from GlaxoSmithKline), and eflapegrastim (Rolvedon from Spectrum Pharmaceuticals) (Figure 1). In general, there was good representation of elderly and females with only two drugs receiving a D grade in either of these groups. In contrast, Black and Hispanic representation was markedly inadequate with 4 drugs receiving F grades.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1.

Novel Drug Approvals in the US from January 2022 through February 16, 2023; 43 drugs and 44 indications

There were 9 drugs (20%; Table 2) where there were no Black participants receiving the novel new drug and an additional 14 approvals where there were <10 Black participants receiving the novel drug. Although several of the indications reflected in the 9 drugs in Table 2 have a lower incidence in Black compared to White racial groups, overall there were 11 (25%) drugs where the incidence/prevalence of the indication is increased in Blacks however the percent of Black participants in the pivotal trial(s) was less than 9.4% (i.e. <70% of the 13.4% of the U.S. census). The median number of Black participants receiving the investigational drug across all 44 indications was 9.

View this table:
  • View inline
  • View popup
Table 2.

Novel Drug Approvals with 0 Black and/or Hispanic Study Participants receiving Novel Drug

In the Hispanic/Latino population there were 2 approvals with no Hispanic participants receiving the novel drug (shown in Table 2) and 14 approvals where there were < 10 Hispanic participants receiving the drug. The median number of Hispanic participants receiving the novel drug was 12.5. There were 3 drugs where the incidence/prevalence of the indication is increased in Hispanics but the percent of Hispanic participants in the pivotal trial(s) was less than 13% (i.e. <70% of the 18.5% of the U.S. census). Additionally, there were 8 approvals where the FDA did not report Hispanic representation.

To further evaluate the potential reasons for under-representation of U.S. racial and ethnic groups, the enrollment by country was assessed. Enrollment by geography was reported in 32 of the FDA drug reviews. The average enrollment from the U.S or U.S./Canada was 43% with a median enrollment of 33%.

Conclusions

Based on this analysis of all recent novel drug approvals by the U.S. FDA, Phase 3 pivotal trials do not consistently represent the Black and Hispanic population impacted by these diseases and conditions in the U.S. This is in contrast with the FDA’s analysis of pivotal trials from 2015-2019 where they concluded that mean and yearly participation of Black participants was at or above US census data.10 In general, there is good representation of the elderly, females and Asian racial group.

This scorecard was developed to be objective, quantitative, oriented to the U.S. population, and focused on individual drugs/biologics different from previous ranking focusing on pharmaceutical companies.11 Limitations of the scorecard include: ordinal direction of the incidence/prevalence of the condition in the group (increased, similar or decreased); dependence on reporting in the FDA review documents, label and published literature; some countries (e.g. France) do not report race/ethnicity; does not include indigenous and Native American, Native Hawaian and Other Pacific Islanders; doesn’t account for gender and sexual identity.

Multidisciplinary efforts to enhance diversity are essential and we applaud the biopharmaceutical industry, federal government, and academic community for taking initial steps in the right direction.12-15 Continued and sustained efforts are essential. It is recommended that the FDA: 1) consider Post-Marketing Commitments as was done for mirvetuximab soravtansine-gynx (Elahere) for ovarian cancer in lieu of Post-marketing Requirement authority; 2) Standardize reporting of demographics in drug reviews. Ethnicity was not reported in several FDA reviews and there were differences in racial groups included in the data summaries. Biopharmaceutical Industry and organizations (PhRMA and BIO) should: 1) share best practices, including Diversity Action Plans, with transparency; 2) consider “onshoring” trials vs. offshoring as described by FDA Commissioner Califf; 3) incentivize Contract Research Organizations and study teams to enroll diverse populations 4) reassess limits on compensation to study participants. Legislators must 1) advance further legislation to incentivize industry (priority reviews or voucher, Diversity designations (similar to orphan designations); 2) advance aspects of the DEPICT, CURES 2.0, ENACT and DIVERSE Trials acts that were not included in FDORA. Investigators and clinical research centers, particularly historically black and minority service institutions, must be empowered to 1) advance the proposed clinical trial diversity scorecard to consider other racial groups (e.g. Indigenous and Native American, Native Hawaiian and Other Pacific Islanders) and underrepresented populations (e.g., sexual and gender minorities); 2) catalyze interactions between stakeholders and 3) continue sharing relevant practices to facilitate diverse enrollment and address barriers to enrollment.

Diverse representation is essential to ensure the safety and efficacy is evaluated in relevant groups before approval and commercialization.16-17 Meaningful change will require actions and cooperation amongst all stakeholders to address this multifaceted issue and will take commitment, perseverance, and appropriate incentives.

Data Availability

All data produced are available online at https://www.accessdata.fda.gov/scripts/cder/daf/index.cfm

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

References

  1. 1.↵
    National Academies of Sciences, Engineering, and Medicine 2022. Improving Representation in Clinical Trials and Research: Building Research Equity for Women and Underrepresented Groups. Washington, DC: The National Academies Press. https://doi.org/10.17226/26479.
  2. 2.↵
    GAO-23-105245 CANCER CLINICAL TRIALS; Federal Actions and Selected Non-Federal Practices to Facilitate Diversity of Patients. December, 2022.
  3. 3.↵
    DEPARTMENT OF HEALTH AND HUMAN SERVICES; Food and Drug Administration; [Docket No. FDA–2021–D–0789] Diversity Plans To Improve Enrollment of Participants From Underrepresented Racial and Ethnic Populations in Clinical Trials; Draft Guidance for Industry; Availability AGENCY: Food and Drug Administration, HHS. ACTION: Notice of availability. Federal Register / Vol. 87, No. 72 / Thursday, April 14, 2022 / Notices.
  4. 4.↵
    H.R.2617 - Consolidated Appropriations Act, 2023 https://www.congress.gov/bill/117th-congress/house-bill/2617.
  5. 5.↵
    New Drugs at FDA: CDER’s New Molecular Entities and New Therapeutic Biological Products https://www.fda.gov/drugs/development-approval-process-drugs/new-drugs-fda-cders-new-molecular-entities-and-new-therapeutic-biological-products.
  6. 6.↵
    Drugs@FDA: FDA-Approved Drugs https://www.accessdata.fda.gov/scripts/cder/daf/index.cfm
  7. 7.↵
    United States Census Bureau QuickFacts. https://www.census.gov/quickfacts/fact/table/US/PST045221
  8. 8.↵
    European Commission. A GUIDELINE ON SUMMARY OF PRODUCT CHARACTERISTICS (SmPC) September 2009. https://health.ec.europa.eu/system/files/2016-11/smpc_guideline_rev2_en_0.pdf.
  9. 9.↵
    Burns, J. (2015). If Nothing Goes Wrong, Is Everything All Right? Why We Should Be Wary of Zero Numerators*. Pediatric Critical Care Medicine, 16 (2), 198–199. doi: 10.1097/PCC.0000000000000346.
    OpenUrlCrossRef
  10. 10.↵
    Lolic M, Araojo R, Okeke M, et al. Racial and Ethnic Representation in US Clinical Trials of New Drugs and Biologics, 2015-2019. JAMA. 2021 Dec 7;326(21):2201–2203. doi: 10.1001/jama.2021.16680. PMID: 34874429; PMCID: PMC8652601.
    OpenUrlCrossRefPubMed
  11. 11.↵
    Varma T, Miller JE. Ranking pharmaceutical companies on clinical trial diversity. BMJ. 2023 Feb 10;380:334. doi: 10.1136/bmj.p334. PMID: 36764687.
    OpenUrlCrossRefPubMed
  12. 12.↵
    Reid MM, Davis SP, Henry ON, et al. Demographic diversity of US-based participants in GSK-sponsored interventional clinical trials. Clin Trials. 2023 Apr;20(2):133–144. doi: 10.1177/17407745221149118. Epub 2023 Feb 6. PMID: 36744680; PMCID: PMC10021118.
    OpenUrlCrossRefPubMed
  13. 13.
    Peters U, Turner B, Alvarez D, et al. Considerations for Embedding Inclusive Research Principles in the Design and Execution of Clinical Trials. Ther Innov Regul Sci. 2023 Mar;57(2):186–195. doi: 10.1007/s43441-022-00464-3. Epub 2022 Oct 14. PMID: 36241965; PMCID: PMC9568895.
    OpenUrlCrossRefPubMed
  14. 14.
    Varma T, Mello M, Ross JS, et al. Metrics, baseline scores, and a tool to improve sponsor performance on clinical trial diversity: retrospective cross sectional study. BMJ Med. 2023 Jan 4;2(1):e000395. doi: 10.1136/bmjmed-2022-000395. PMID: 36936269; PMCID: PMC9951369.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    Blumenthal D, James CV. A Data Infrastructure for Clinical Trial Diversity. N Engl J Med. 2022 Jun 23;386(25):2355–2356. doi: 10.1056/NEJMp2201433. Epub 2022 Apr 27. PMID: 35476634.
    OpenUrlCrossRefPubMed
  16. 16.↵
    Varma T, Jones CP, Oladele C, et al. Diversity in clinical research: public health and social justice imperatives. J Med Ethics. 2022 Apr 15:medethics-2021-108068. doi: 10.1136/medethics-2021-108068. Epub ahead of print. PMID: 35428737
    OpenUrlAbstract/FREE Full Text
  17. 17.↵
    Schwartz AL, Alsan M, Morris AA, et al. Why Diverse Clinical Trial Participation Matters. N Engl J Med. 2023 Apr 6;388(14):1252–1254. doi: 10.1056/NEJMp2215609. Epub 2023 Apr 1. PMID: 37017480.
    OpenUrlCrossRefPubMed
Back to top
PreviousNext
Posted May 16, 2023.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Quantifying Clinical Trial Diversity of FDA Novel Drug Approvals
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Quantifying Clinical Trial Diversity of FDA Novel Drug Approvals
William E Fitzsimmons, Muhammed Y Idris, Priscilla Pemu
medRxiv 2023.05.11.23289884; doi: https://doi.org/10.1101/2023.05.11.23289884
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Quantifying Clinical Trial Diversity of FDA Novel Drug Approvals
William E Fitzsimmons, Muhammed Y Idris, Priscilla Pemu
medRxiv 2023.05.11.23289884; doi: https://doi.org/10.1101/2023.05.11.23289884

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Pharmacology and Therapeutics
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)