RT Journal Article
SR Electronic
T1 Using Generative AI to Simulate Patient History-Taking in a Problem-Based Learning Tutorial: A Mixed-Methods Study
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.05.02.24306753
DO 10.1101/2024.05.02.24306753
A1 Mool, Allison
A1 Schmid, Jacob
A1 Johnston, Thomas
A1 Thomas, William
A1 Fenner, Emma
A1 Lu, Kevin
A1 Gandhi, Raya
A1 Western, Adam
A1 Seabold, Brendan
A1 Smith, Kodi
A1 Patterson, Zachary
A1 Feldt, Hannah
A1 Vollmer, Daniel
A1 Nallaveettil, Roshan
A1 Fanelli, Anthony
A1 Schmillen, Logan
A1 Tischkau, Shelley
A1 Cianciolo, Anna T.
A1 Benedict, Pinckney
A1 Selinfreund, Richard
YR 2024
UL http://medrxiv.org/content/early/2024/05/03/2024.05.02.24306753.abstract
AB Background Medical educators who implement problem-based learning (PBL) strive to balance realism and feasibility when simulating patient cases, aiming to stimulate collaborative group discussion, engage students’ clinical reasoning, motivate self-directed learning, and promote the development of actionable scientific understanding. Recent advances in generative artificial intelligence (AI) offer exciting new potential for patient simulation in PBLMethod This study used a between-groups, mixed-methods approach to (1) form a comprehensive picture of Year 2 medical student interactions with a generative AI-simulated patient in a PBL tutorial, as compared to interactions with multimedia patient case materials; and (2) triangulate on the impact these interactions had on learning. Two groups of students (N = 13) gathered patient history information from a generative AI-enabled, 3D-animated avatar (AI condition). Two other student groups (N = 13) gathered patient history information from a multimedia database using keyword searching (Electronic PBL Module [ePBLM] condition). We used descriptive observation to explore student interactions with both forms of the simulated patient, and we quantitatively compared students’ perceptions of their learning experience and recall of patient history information across conditions.Results Students in the AI condition rated their present, AI-augmented PBL learning experience—particularly its clinical accuracy and teamwork aspects—significantly higher than they rated their previous PBL learning experiences using ePBLMs. Recall of patient history information did not differ between conditions. Descriptive observation indicated that the AI avatar presented case content accurately, with an appropriate amount of information provided in response to students’ questions. Students were highly engaged as a group in taking a history from the avatar. However, although students used language suggestive of anthropomorphizing of the AI (e.g., gender pronouns), they appeared to orient to it as an augmented “question bank” for gathering patient history information, using a questioning strategy akin to querying an ePBLM.Discussion Optimizing AI implementation to stimulate clinical reasoning and patient communication skills in PBL could include (1) starting early, perhaps in Year 1, before an alternative interactional framework can take hold; (2) orienting students to the AI to help them understand its capabilities; and (3) encouraging “play” with or “discovery learning” of the AI’s capabilities.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis project received funding from 3 internal sources at Southern Illinois University School of Medicine (SIU-SOM): Dean's Start-up Funds; SIU-SOM Concept Development Award; and an SIU-SOM Foundation Grant for Diabetes Research.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was deemed non-human subjects research by the Springfield Committee on Research Involving Human Subjects (6 February 2024).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors.