ABSTRACT
Problem In the competency-based medical education literature, investigators have typically discussed notions of trust in the context of entrustment decision-making rather than as attitudes within competency frameworks. Complementarity between concepts of entrustable professional activities and of competencies created an opportunity to infuse the latter with notions of trust.
Bedside cardiac assessment (BCA) exemplified one such competency. Traditional approaches to teaching and learning BCA addressed relevant knowledge and skills but not attitudes. We conceptualized entrustability as part of an attitudinal approach to teaching and learning BCA more holistically and effectively. The purpose of this thematic analysis was to explore students’ experience, in a medicine clerkship at one U.S. medical school, of participating in a newly developed BCA curriculum that aimed to foster attitudinal growth and a holistic approach to clinical learning.
Approach Building upon Teaching for Understanding and conceptual change frameworks, the authors developed a flipped class curriculum utilizing pre-class short online videos and practice exercises followed by in-class activities and reflective discussions. Using a combination of content analysis and thematic analysis methodology of open-ended questionnaires administered from November 2017 to June 2018, the authors analyzed the experiences of medical students at one of the schools at which the curriculum was implemented.
Outcomes Thematic analysis suggested learning strategies were effective and that peer encounters, skills practice, and encounters with educators were meaningful. The analysis also revealed opportunities to improve the original instructional design.
Next Steps The authors will incorporate feedback into future iterations of the curriculum and make it widely available to better study its impact on learners’ abilities; entrustability as a construct; and transfer of learning from the classroom to the workplace. Further work is needed to clarify the value of incorporating notions of trust into competency frameworks. The authors intend this exploratory work to stimulate conversations around expanded roles of trustworthiness and entrustability in medical education.
PROBLEM
Notions of trust are foundational to the concept of competency-based medical education (CBME).1 One such notion, entrustability, is typically discussed in the context of entrustment decision-making, an approach to assessment based on work or output, rather than as an attitude complementing knowledge and skills within a competency framework2 (see Figure). Yet “without a competency framework to describe the spectrum of necessary physician abilities, the result might be…a definition [of the physician] based solely on [their] work or output…and thus potentially ignore…abilities required of the twenty-first century physician…”3 Bedside cardiac assessment (BCA), which requires the integration of patients’ physiology, symptoms, signs, and social and psychological aspects of illness, exemplifies one such ability. When performed well, BCA also facilitates faster and more expedient diagnosis and improves the performance of diagnostic technology like focused cardiac ultrasound.4,5 However, teaching and learning BCA is declining, and traditional, reductionist approaches address knowledge and skills4 but not attitudes of the “K/S/A” domains. In this paper, we conceptualize entrustability as part of an attitudinal approach to teaching and learning BCA more holistically and effectively.
Abbreviation
EPAs: entrustable professional activities
A competency is an observable, activity-related ability that integrates knowledge, skills, values, and attitudes. By contrast, an entrustable professional activity (EPA) is an essential task “..that a learner can be trusted to perform without direct supervision…once sufficient competence has been demonstrated,” which requires the integration of multiple competencies.3 Overlap between these two concepts (Figure) creates an opportunity to infuse competency development with notions of trust and, by so doing, “…[counter] the notion of a check-box approach of CBME that has been said to reduce the medical profession to a series of superficial skills.”2
Several of the Association of American Medical College’s Core Entrustable Professional Activities for Entering Residency (CEPAERs) are directly relevant to BCA: integrating the scientific foundations of medicine with clinical reasoning skills to guide history taking and physical examination (EPA 1), updating and prioritizing differential diagnoses (EPA 2), and communicating with patients or families to ensure pre- and post-procedure explanation (EPA 12).1 In the authors’ view, competent BCA requires integration of not just knowledge of cardiac pathophysiology and skills such as cardiac auscultation, jugular venous pressure measurement, and clinical reasoning, but also self-aware attitudes associated with trustworthiness and entrustability such as understanding the importance of the patient’s perspective, symptoms, and predicament.1,6
The purpose of this study was to explore students’ experience of participating in a newly developed BCA curriculum that sought to foster attitudinal growth and a holistic approach to clinical learning.
APPROACH
Instructional design of the curriculum
To improve the teaching and learning of BCA as a fully developed competency, we developed a curriculum using constructivist learning theories that support learner development, acquisition of professional attitudes, and effective self-assessment in addition to traditional knowledge and skills. We explicitly incorporated notions of trust, asking learners to reflect upon the processes of learning and of communicating with patients. Its title, Listen Before You Auscultate,7 asks the learner to hear the patient’s perspective, both empathically, as a human predicament; and diagnostically, as an element of the clinical history in diagnostic reasoning.
We built upon the Teaching for Understanding (TfU) framework, which helps learners go beyond facts to gain deep understanding that can then be applied in new contexts.8 In particular, TfU helps educators engage students in challenging learning experiences that help build and demonstrate their understanding. Three other principles of TfU help educators identify topics, concepts, and skills that are worth understanding; define overarching, long term understanding-goals or “throughlines” and frame sub-goals focused on the most important aspects of those topics; and develop assessment practices that deepen student understanding. The curriculum’s constructivist undergirding is further supported by adult, experiential, and transformational learning theories.6
Within the CBME framework, the abilities of a professional progress along a spectrum from novice to expert.3 We used conceptual change theory to foster the development of expertise, generating dissatisfaction with learners’ current conceptions and skills, ensuring that new material was both understandable and plausible, and creating the expectation that the time invested would be fruitful.9 We emphasized causal relationships, another hallmark of expertise development,10 to further help learners process patterns more efficiently. Finally, we applied principles of effective multimedia design11 and strategies to manage cognitive load.12
To develop the flipped class curriculum, we developed pre-class assignments with short videos, and developed in-class activities and a facilitator guide (see Table 1). In the first video, a patient unexpectedly asked the viewer, “Why should I trust your clinical skills?” followed by statements by the onscreen instructor about the importance of patient communication skills. Two, one-hour class sessions followed, including a large-group discussion about the patient’s startling question and simulated patient encounters in which understanding the patient’s perspective was central to effective, pre-procedural communication. In the class sessions, students also engaged in JVP measurement exercises and a team game in which students identified heart sounds in various clinical contexts.
Listen Before You Auscultate bedside cardiac assessment curriculum
Evaluation strategy
We implemented the integrated curriculum at Boston University Medical Center (BUMC, Massachusetts USA), Kansas University Medical Center (Kansas USA), Central Clinical School Monash University (Australia), and Tan Tock Seng Hospital (Singapore). To better understand learners’ experiences, we surveyed the third-year students on internal medicine rotation at BUMC.
From November 2017 to June 2018, we asked participants to complete a post-class survey with open-ended questions. After the first classroom session, we surveyed students about their experiences with the pre-class assignments and the session. After the second session, we surveyed students about their experiences in that session and the curriculum as a whole. Because the survey questions varied slightly from site to site, content analysis13(p7) allowed us to group the survey questions into two categories, those related to successful learning and those related to opportunities for improvement (see Table 2).
Question Categories That Resulted from the Grouped Survey Questions
This analysis and categorization was required due to unanticipated variation in the survey questions presented to the students following the activity. See text for details.
We then analyzed the responses using a sequence of content analysis and then thematic analysis.13 Applied Thematic Analysis13(p15-17) approach was implemented in which two researchers (DN, IO) engaged the separated data sets independently using an initial open coding strategy. Codes were developed using a constant comparison methodology, and we developed the final codebook based on consensus discussions to resolve differences. A third researcher (JM) served as arbiter to facilitate differences in perspectives. A re-examination of the codes in context resulted in the emergence of themes, reported below.
OUTCOMES
There were 489 short answer questions presented within the surveys, of which 61.6% (n=301) were analyzed. The remaining 38.4% (n=188) were blank or unintelligible. There was a 75.4% (n=159/211) completion rate for questions related to “Successful Learning” and a 51.1% (n=142/278) completion rate for questions related to “Opportunities for Improvement.” First-round coding agreement rate was 54.8% (n=165/301). All coding disagreements were resolved by discussion resulting in consensus, except for 3.7% (n=11/301), which required arbitration. Thus, common definitions of codes emerged easily, resulting in effective codebooks (see Table 3).
Codebooks
Codes were developed using a constant comparison methodology, with the final codebook based on consensus discussions. Third year students on internal medicine rotation, Nov. 2017 - June 2018. Boston University Medical Center, Massachusetts USA. See text for details.
The emergent codes clustered around various themes in each category. Successful Learning themes centered around effective learning strategies and meaningful peer encounters, skills practice, and educator encounters (see Table 4). Sample comments representing the Successful Learning codes included:
Themes Related to Successful Learning
Third year students on internal medicine rotation, Nov. 2017 - June 2018 Boston University Medical Center, Massachusetts USA
“The pre-class videos were helpful because they got me thinking what we learned today ahead of time. (code VHL, Participant 1129-08),”
“I like the standarized [sic] approach to the cardiac exam (SAE, 120-16),” “…I prefer to make mistakes in the simulated environment and a little more effective [sic] with active patients (SAE, 1214-10),” and
“Showing examples of approaches to different patients” (ATP, 1206-06).
The last two responses also exemplified concepts of a transition to recognizing that holistic care was dependent on effective communication with the patient.
Interactions with instructors and peers were valued as contributing to learning as seen here:
“The interactive aspect of the in-class activities helped [learning],” (IWV, 1129-11)
“In person demonstration…,” (DOE, 1129-02)
“Interactive exercises,” (IWV, 1129-10), and
“Good teachers.” (GTE, 1129-10)
Each of these quotes contributes to an overarching concept, the importance of learning beyond the knowledge and skills domains, affirming the importance of attitudinal aspects of the development of clinical abilities and the meaningfulness of human interaction while learning.
The Opportunities for Improvement themes focused on instructional design improvements, individual learning preferences, instruction related improvements, and general comments regarding how no improvement was needed (see Table 5). Sample comments representing the Improvement codes included:
Themes Related to Opportunities for Improvement
Third year students on internal medicine rotation, Nov. 2017 - June 2018 Boston University Medical Center, Massachusetts USA
“Hard to watch videos while in a busy Med service, this would have been more useful in 2nd year when we were learning about physical exam (WPC, 1129-05)” and
“… Why should I trust clinical skills likely more relevant of a discussion start of 3rd year (WPC, 0411-11).”
Perspectives varied widely on not just the sequence but also the presentation of the concepts within the overall medical school curriculum. This was exemplified by one student’s comment on individual learning preferences and expectations, “The variety of teaching methods used in each session (MMT, 0411-01),” under the Successful Learning category.
These emergent themes became the basis for our understanding of the learning experiences, as we discuss next.
DISCUSSION
In this paper, we introduce the concept of integrating entrustability into competency development, emphasizing the sometimes-forgotten attitudinal or affective domain of teaching and learning. We used cognitive science-based instructional design to weave together threads of knowledge and skill development, notions of trust, and communication with patients, to create a curriculum that learners experienced as meaningful. A holistic, effective learning experience like the Listen Before You Auscultate curriculum may make it more likely that learners will transfer new competencies to the workplace, further strengthening the fabric of CBME.
Two throughlines in the TfU framework, attitudinal aspects of the development of clinical abilities and the development of learners’ diagnostic reasoning, particularly supported this approach. As an attitudinal, meaning-making concept, entrustability presumes that understanding, or at least trying to understand, a patient’s feelings, intentions, and assumptions (and perhaps culture, race, class, or gender) is necessary for transformative learning to occur.6 The development of diagnostic reasoning is central to the progression of expertise, so we designed the assignments and activities to enable participants to learn and practice tools such as hypothesis testing and pattern recognition.
Thematic analysis suggested that the learning strategies were effective and that peer encounters, skills practice, and encounters with educators were meaningful. Learners affirmed the implicit value of integrating human interaction, and thus learning in the “attitudes” domain, as contributing to successful learning. The analysis captured experiences that have the potential to help transition learning from a solely transactional approach to one “…where the consequent personal transformation on the part of students can actually lead to wider, positive social transformation.”6 The analysis also revealed opportunities to improve the original instructional design, which will be incorporated into future iterations.
Additionally, classroom facilitators observed improved transfer of knowledge from classroom to workplace, an expected benefit of the TfU approach. For example, prior to the class sessions, students expressed little confidence in their JVP measurement skills. At the second session, most reported having measured their patients’ JVPs over the preceding week.
Limitations
Given the use of the content analysis approach and inability to explore further the emergent themes from the limited data set, the instructional design’s generalizability to learners in other health professions education programs is limited and may require further study. Further, this dataset was based on responses to similar but not identical survey questions, which may have introduced an unintended bias which would require further study.
We conceptualized entrustability as part of an attitudinal aspect of a competency but acknowledge that it could also be viewed as a construct that is challenging to measure.2 Similarly, while our explicit incorporation of notions of trust in the curriculum1 aligns with students’ desire to be introduced early to the CEPAERs framework,14 future concept or outcome analyses are needed to clarify the value of incorporating elements of entrustment beyond their well-established roles in assessment. Finally, as CBME’s shared language evolves,3 we acknowledge the inherent ambiguity of such terms as trust, trustworthiness and entrustability.
Next Steps
We will make the curriculum widely available and continue to study its impact on learners’ BCA-related knowledge, skills, and attitudes, entrustability as a construct, and transfer. We hope that thoughtful design of curricula that foster learners’ entrustability and attitudinal growth will promote development beyond traditional knowledge and skills, and that this exploratory work will stimulate conversations around expanded roles of trustworthiness and entrustability in medical education.
Data Availability
All data produced in the present study are available upon reasonable request to the authors.
FUNDING/SUPPORT
An Education Pilot grant from the BUMC Faculty Development Committee funded part of this study. Our work was also partially supported with resources from VA Bedford, VA Boston, and the New England Geriatric Research Education and Clinical Center.
OTHER DISCLOSURES
None.
ETHICAL APPROVAL
The Boston University Medical Center Institutional Review Board (IRB) reviewed the research and made the determination that it was not human subjects research and therefore had no requirement to obtain consent, IRB Number: H-42353, Jan. 10, 2022. This work was reviewed by the VA Bedford Healthcare System IRB and determined not to require its oversight.
DISCLAIMERS
Views and content are those of the authors and do not reflect the official policy or position of VA or any agency of the United States Government.
PREVIOUS PRESENTATIONS
Early versions of the curriculum and proposed evaluation strategy were presented in poster format:
Meisel JL, Chen D, March G, Bernard SA, Carmona H, Petrosa E, Papps N. Building competence – an active-learning approach. Alliance for Academic Internal Medicine. Academic Medicine Week (2018). San Antonio TX, USA.
Meisel JL, Chen D, March G, Bernard SA, Carmona H, Papps N. Building competence and confidence in clinical skills: a systematic, flipped classroom approach to learning bedside cardiac assessment. Northeast Group on Educational Affairs Annual Conference (2017). University of Rochester School of Medicine and Dentistry. Rochester NY, USA.
ACKNOWLEDGEMENTS
The study team wishes to thank the many people who were integral to the success of this project, especially the students who learned with us, Sonia Ananthakrishnan, Warren Hershman, Kelly Ho, and David Flynn at the Boston University Medical Center (BUMC). Thanks to Tina Grotzer, Flossie Chua, and Bryan Mascio at the Harvard Graduate School of Education, Vlad Valtchinov at Harvard Medical School, and Maria Romero at VA Bedford Healthcare System. We gratefully acknowledge the work of the late Dr. Michael S. Gordon at the University of Miami Miller School of Medicine for teaching auditory heart sounds mnemonics and Dr. W. Proctor Harvey’s “5-Finger Approach” to cardiac assessment, from which was adapted the 6-Step Systematic Approach to Bedside Cardiac Assessment.
Footnotes
at the time this article was written
