Abstract
Purpose To characterize the use of demographic data in multiple-choice questions from a commercial preclinical question bank and determine if there is appropriate use of different distractors.
Background Multiple-choice questions for medical students often include vignettes describing a patient’s presentation to help guide students to a diagnosis, but overall patterns of usage between different types of nonmedical patient information in question stems has yet to be determined.
Methods 380 of 453 randomly selected questions were included for analysis after determining they contained a clinical vignette and required a diagnosis. The vignettes and following explanations were then examined for the presence/absence of 11 types of demographic information, including age, sex/gender, and socioeconomic status. We compared both the usage frequency and relevance between the 11 information types.
Results Most information types were present in less than 10% of clinical vignettes, but age and sex/gender were present in over 95% of question stems. Over 50% of questions included irrelevant information about age and sex/gender, but 75% of questions did not include any irrelevant information of other types. Patient weight and environmental exposures were significantly more likely to be relevant than age or sex/gender.
Discussion Students using the questions in this study will frequently gain practice incorporating age and sex/gender into their clinical reasoning while receiving little exposure to other demographic information. Based on our findings, we posit that questions could include more irrelevant information, outside age and sex/gender, to better approximate real clinical scenarios and ensure students do not overvalue certain demographic data.
Competing Interest Statement
The Scholar-Rx corporation had no role in the study design, data collection, or interpretation.
Funding Statement
This study did not receive any funding
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵* Co-second author
Data Availability
All data produced in the present study are available upon reasonable request to the authors
