Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios
View ORCID ProfileCaitlin Silvestri, View ORCID ProfileJoshua Roshal, View ORCID ProfileMeghal Shah, View ORCID ProfileWarren D. Widmann, Courtney Townsend, View ORCID ProfileRiley Brian, View ORCID ProfileJoseph C. L’Huillier, View ORCID ProfileSergio M. Navarro, View ORCID ProfileSarah Lund, View ORCID ProfileTejas S. Sathe
doi: https://doi.org/10.1101/2024.05.31.24308044
Caitlin Silvestri
11New York Presbyterian/Columbia University Irving Medical Center, Department of Surgery, New York, NY
10Collaboration of Surgical Education Fellows (CoSEF)
MDJoshua Roshal
2Brigham and Women’s Hospital/Harvard Medical School, Boston, MA
3University of Texas Medical Branch, Galveston, TX
10Collaboration of Surgical Education Fellows (CoSEF)
MDMeghal Shah
11New York Presbyterian/Columbia University Irving Medical Center, Department of Surgery, New York, NY
MDWarren D. Widmann
4SUNY Downstate Health Science University, Brooklyn, NY
MDCourtney Townsend
3University of Texas Medical Branch, Galveston, TX
MDRiley Brian
5University of California San Francisco, San Francisco, CA
10Collaboration of Surgical Education Fellows (CoSEF)
MD, MAEdJoseph C. L’Huillier
6University at Buffalo, Jacobs School of Medicine and Biomedical Sciences, Department of Surgery, Buffalo, NY
7University at Buffalo, Department of Epidemiology and Environmental Health, Division of Health Services Policy and Practice, School of Public Health and Health Professions, Buffalo, NY
10Collaboration of Surgical Education Fellows (CoSEF)
MDSergio M. Navarro
8University of Minnesota, Department of Surgery, Minneapolis, MN
9Mayo Clinic, Department of Surgery, Rochester, MN
10Collaboration of Surgical Education Fellows (CoSEF)
MDSarah Lund
9Mayo Clinic, Department of Surgery, Rochester, MN
10Collaboration of Surgical Education Fellows (CoSEF)
MDTejas S. Sathe
11New York Presbyterian/Columbia University Irving Medical Center, Department of Surgery, New York, NY
5University of California San Francisco, San Francisco, CA
10Collaboration of Surgical Education Fellows (CoSEF)
MD
Data Availability
All data produced in the present study are available upon reasonable request to the authors. Data analysis performed for the methods is available via the link below
Posted June 01, 2024.
Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios
Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe
medRxiv 2024.05.31.24308044; doi: https://doi.org/10.1101/2024.05.31.24308044
Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios
Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe
medRxiv 2024.05.31.24308044; doi: https://doi.org/10.1101/2024.05.31.24308044
Subject Area
Subject Areas
- Addiction Medicine (349)
- Allergy and Immunology (668)
- Allergy and Immunology (668)
- Anesthesia (181)
- Cardiovascular Medicine (2648)
- Dermatology (223)
- Emergency Medicine (399)
- Epidemiology (12228)
- Forensic Medicine (10)
- Gastroenterology (759)
- Genetic and Genomic Medicine (4103)
- Geriatric Medicine (387)
- Health Economics (680)
- Health Informatics (2657)
- Health Policy (1005)
- Hematology (363)
- HIV/AIDS (851)
- Medical Education (399)
- Medical Ethics (109)
- Nephrology (436)
- Neurology (3882)
- Nursing (209)
- Nutrition (577)
- Oncology (2030)
- Ophthalmology (585)
- Orthopedics (240)
- Otolaryngology (306)
- Pain Medicine (250)
- Palliative Medicine (75)
- Pathology (473)
- Pediatrics (1115)
- Primary Care Research (452)
- Public and Global Health (6527)
- Radiology and Imaging (1403)
- Respiratory Medicine (871)
- Rheumatology (409)
- Sports Medicine (342)
- Surgery (448)
- Toxicology (53)
- Transplantation (185)
- Urology (165)