Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Up front and open, shrouded in secrecy, or somewhere in between? A Meta Research Systematic Review of Open Science Practices in Sport Medicine Research

Garrett S. Bullock, Patrick Ward, Franco M. Impellizzeri, Stefan Kluzek, Tom Hughes, Charles Hillman, Brian R. Waterman, Kerry Danelson, Kaitlin Henry, Emily Barr, Kelsey Healey, Anu M. Räisänen, Christina Gomez, Garrett Fernandez, Jakob Wolf, Kristen F. Nicholson, Tim Sell, Ryan Zerega, Paula Dhiman, Richard D. Riley, Gary S Collins
doi: https://doi.org/10.1101/2023.03.30.23287959
Garrett S. Bullock
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
2Department of Biostatistics and Data Science, Wake Forest School of Medicine, Winston-Salem, NC, USA
3Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, University of Oxford, Oxford, United Kingdom
4Sport Injury Prevention Research Center, University of Calgary, Calgary Canada
PT, DPT, DPhil,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: gbullock{at}wakehealth.edu
Patrick Ward
5Seattle Seahawks, Seattle, WA, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Franco M. Impellizzeri
6School of Sport, Exercise, and Rehabilitation, University of Technology Sydney, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stefan Kluzek
3Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, University of Oxford, Oxford, United Kingdom
7Sports Medicine Research Department, University of Nottingham, Nottingham, UK
8English Institute of Sport, Bisham Abbey, United Kingdom
FRCP, FFSEM, DPhil
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tom Hughes
9Department of Health Professions, Manchester Metropolitan University, Manchester, United Kingdom
PT, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Charles Hillman
7Sports Medicine Research Department, University of Nottingham, Nottingham, UK
MBChB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian R. Waterman
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kerry Danelson
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kaitlin Henry
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emily Barr
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kelsey Healey
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anu M. Räisänen
10Department of Physical Therapy Education – Oregon, College of Health Sciences-Northwest, Western University of Health Sciences, Lebanon, Oregon, USA
11Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, AB, Canada
PT, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christina Gomez
10Department of Physical Therapy Education – Oregon, College of Health Sciences-Northwest, Western University of Health Sciences, Lebanon, Oregon, USA
PT, DPT, SCS, OCS, FAOOMPT
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Garrett Fernandez
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jakob Wolf
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kristen F. Nicholson
1Department of Orthopaedic Surgery & Rehabilitation, Wake Forest School of Medicine, Winston□Salem, NC, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tim Sell
12Atrium Health, Charlotte, NC, USA
PT, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ryan Zerega
12Atrium Health, Charlotte, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paula Dhiman
13Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, United Kingdom
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard D. Riley
14Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gary S Collins
13Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, United Kingdom
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Objective To investigate the extent and qualitatively synthesize open science practices within research published in the top five sports medicine journals from 01 May 2022 and 01 October 2022.

Design Meta-research systematic review

Data Sources MEDLINE

Eligibility Criteria Studies were included if they were published in one of the identified top five sports medicine journals as ranked by Clarivate. Studies were excluded if they were systematic reviews, qualitative research, grey literature, or animal or cadaver models.

Results 243 studies were included. The median number of open science practices met per study was 2, out of a maximum of 12 (Range: 0-8; IQR: 2). 234 studies (96%, 95% CI: 94-99) provided an author conflict of interest statement and 163 (67%, 95% CI: 62-73) reported funding. 21 studies (9%, 95% CI: 5-12) provided open access data. 54 studies (22%, 95% CI: 17-included a data availability statement and 3 (1%, 95% CI: 0-3) made code available. 76 studies (32%, 95% CI: 25-37) had transparent materials and 30 (12%, 95% CI: 8-16) included a reporting guideline. 28 studies (12%, 95% CI: 8-16) were pre-registered. 6 studies (3%, 95% CI: 1-4) published a protocol. 4 studies (2%, 95% CI: 0-3) reported the availability of an analysis plan. 7 studies (3%, 95% CI: 1-5) reported patient and public involvement.

Conclusion Sports medicine open science practices are extremely limited. The least followed practices were sharing code, data, and analysis plans. Without implementing open practices, barriers concerning the ability to aggregate findings and create cumulative science will continue to exist.

What is already known

  • Open science practices provide a mechanism for evaluating and improving the quality and reproducibility of research in a transparent manner, thereby enhancing the benefits to patient outcomes and society at large.

  • Understanding the current open science practices in sport medicine research can assist in identifying where and how sports medicine leadership can raise awareness, and develop strategies for improvement.

What are the new findings

  • No study published in the top five sports medicine journals met all open science practices

  • Studies often only met a small number of open science practices

  • Open science practices that were least met included providing open access code, data sharing, and the availability of an analysis plan.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Protocols

https://osf.io/4amek/

Funding Statement

This study received no funding.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

Data is available at https://osf.io/4amek/ Code is available at https://osf.io/4amek/

https://osf.io/4amek/

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted March 30, 2023.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Up front and open, shrouded in secrecy, or somewhere in between? A Meta Research Systematic Review of Open Science Practices in Sport Medicine Research
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Up front and open, shrouded in secrecy, or somewhere in between? A Meta Research Systematic Review of Open Science Practices in Sport Medicine Research
Garrett S. Bullock, Patrick Ward, Franco M. Impellizzeri, Stefan Kluzek, Tom Hughes, Charles Hillman, Brian R. Waterman, Kerry Danelson, Kaitlin Henry, Emily Barr, Kelsey Healey, Anu M. Räisänen, Christina Gomez, Garrett Fernandez, Jakob Wolf, Kristen F. Nicholson, Tim Sell, Ryan Zerega, Paula Dhiman, Richard D. Riley, Gary S Collins
medRxiv 2023.03.30.23287959; doi: https://doi.org/10.1101/2023.03.30.23287959
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Up front and open, shrouded in secrecy, or somewhere in between? A Meta Research Systematic Review of Open Science Practices in Sport Medicine Research
Garrett S. Bullock, Patrick Ward, Franco M. Impellizzeri, Stefan Kluzek, Tom Hughes, Charles Hillman, Brian R. Waterman, Kerry Danelson, Kaitlin Henry, Emily Barr, Kelsey Healey, Anu M. Räisänen, Christina Gomez, Garrett Fernandez, Jakob Wolf, Kristen F. Nicholson, Tim Sell, Ryan Zerega, Paula Dhiman, Richard D. Riley, Gary S Collins
medRxiv 2023.03.30.23287959; doi: https://doi.org/10.1101/2023.03.30.23287959

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Sports Medicine
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)