Virtual Reality for Pediatric Trauma Education - A Face and Content Validation Study

I. Introduction

Trauma continues to be a critical health problem worldwide, particularly in pediatric populations, claiming the lives of a million children annually.[1] According to the World Health Organization, trauma has been a leading cause of child mortality in 204 countries for the past three decades.[2] Despite significant advancements in trauma care during this period, mortality rates have remained high.[1]

Errors in care persist and are often linked to poor communication and decision-making among trauma team members.[3,4] Providing training in non-technical skills, such as situational awareness, leadership, and teamwork, can change this reality.[5,6] Non-technical skills foster efficient collaboration during challenging and stressful environments, enhancing the quality of care.[7,8] However, the methods for teaching and assessing these skills are not standardized, revealing notable discrepancies in pediatric trauma training approaches across different settings.[8,9]

In low- and middle-income countries (LMICs), pediatric trauma care is also hindered by resource limitations, a shortage of expert providers, and the scarcity of training programs.[10,11] The use of advanced technologies for trauma education, like high-fidelity mannequins, has unfortunately exacerbated inequities. The current courses are prohibitively expensive and, consequently, not viable for widespread implementation,[12,13] remaining accessible only to a limited part of the population.[10,14,15]

Virtual reality (VR) has emerged as an innovation in healthcare that can help address these gaps. [16] By creating engaging and realistic clinical environments, VR can help healthcare professionals refine their skills in a setting that imitates real-world demands.[17,18] In LMICs, VR also presents a potential opportunity to democratize access to pediatric trauma education without incurring heavy expenses on physical equipment.[19] Moreover, with built-in, instant feedback systems, platforms with automatic feedback can also facilitate debriefing, enhancing the learning experience.[17]

To our knowledge, only one VR platform specific to the pediatric emergency room has been documented in the literature. [20] Abulfaraj et al. randomly assigned pediatric and emergency medicine interns to their single-user VR platform or to a high-fidelity mannequin for a seizure simulation. The time-to-critical actions, such as oral suction and oxygen administration, demonstrated no statistically significant differences between the VR and mannequin groups. Notably, limited prior experience with VR gaming was reported, and most participants displayed a significant increase in subjective confidence after the simulation sessions.

The literature has also documented single-user VR platforms tailored for adult trauma scenarios, which have the potential to reduce the cost of training. [17,21,22] Cohen et al. designed a 3-scenario adult trauma VR simulation for which they found a high level of acceptance and perceived realism among participants, with 96% considering the virtual environment valuable. [23]

In another study evaluating a single-user VR for ATLS, participants were satisfied with the platform and learning experience.[24] Furthermore, the results illustrated adequate construct validity, with attending physicians achieving the highest decision accuracy and the lowest mortality rate compared to trainees.

Cybersickness is the negative side of VR. It is characterized by symptoms akin to motion sickness, such as dizziness and nausea, experienced in virtual environments without actual physical movement.[25,26] The reported incidence of cybersickness varies widely in the literature, with some studies indicating minimal effects (less than 10%) while others suggest rates as high as 80%.[20,25,27] The incidence of cybersickness is influenced by numerous factors, including the users’ roles and actions in the virtual simulation and the duration of exposure.[25,27] An initial evaluation of cybersickness is instrumental in guiding the development of further scenarios, as the presence of symptoms does not necessarily require abandoning the task, being the reason we decided to include it as a measure. Such symptoms rather inform decisions to potentially restrict usage time or decrease the need to move (virtually) during the assessment.

This study aims to assess the face and content validity of a multi-user virtual simulation platform for pediatric trauma training called PeTIT VR - Pediatric Trauma Innovative Training in Virtual Reality. (Figure 1) The platform accommodates up to five users concurrently – constituting four trainees and an instructor – enabling them to enter into a 3D environment to practice the initial trauma assessment, comprising primary and secondary surveys. All virtual trauma bay assets and interactions were crafted with input from pediatric trauma experts to maximize realism and educational value. Scenarios are set to evolve dynamically in response to trainee actions, and quantitative and qualitative performance feedback is automatically provided at the end to facilitate debriefing. A screen appears, informing students about the tasks they completed or missed (for example, checking the airway and starting fluids) and also displays the time it took for the user to accomplish each task.

• Download figure
• Open in new tab

Figure 1.

PeTIT VR

This study seeks to examine face and construct validity and represents the initial phase of an extensive research agenda. The platform has been used for research purposes and is not currently commercially available.

II. Methods

Participants

Eleven physicians participated in the study (Table 1). Of these, five were male (45%), and six were female (55%), with a median age of 35 years (range 29 - 54 years). Participants had graduated from eight countries, including Canada, Brazil, Argentina, Afghanistan, Iran, the United States of America, Sudan, and Nigeria (Figure 2). Among them, five were staff pediatric surgeons (45%), three identified as residents (27%), one as a pediatric emergency staff (9%), one as an emergency physician (9%), and one as a general practitioner (9%). Approximately one-third (36%) of them had prior experience with VR.

View this table:

• View inline
• View popup
• Download powerpoint

Table 1. Demographic distribution of the participants

• Download figure
• Open in new tab

Figure 2.

Geographic distribution of medical institutions where participants completed their medical training

III. Results

IV. Discussion

Effective trauma training is pivotal for accurate and timely interventions, especially given the disparities observed globally.[28] However, the high costs of current courses limit trauma education dissemination.[12,13] Beyond the challenges of securing mannequins and instructors, current training recommendations for pediatric trauma are simply unfeasible.[29] For example, the American College of Surgeons’ Resources for Optimal Care of the Injured Patient of 2014 has recommended at least 16 hours of pediatric trauma training yearly for all healthcare providers caring for injured children. [29] However, even the Advanced Trauma Life Support (ATLS) course, the world’s most successful trauma course offered in 86 countries, has only been completed by 6% of the world’s physicians over the past 14 years.[30–32] Based on this scenario, we estimate that training four-member teams in every trauma center to treat the 60 million children who visit hospitals yearly[1,29,33–35] could require an impossible investment of 1.2 billion US dollars in pediatric trauma education annually.

Furthermore, the potentially immersive nature of VR, some with realistic scenarios, stands to enrich patient interactions and encourage collaboration among team members. VR may help to authentically replicate the stress factors of a hospital environment, including the presence of relatives, ambient noise, and interdepartmental dynamics. [36,37] Finally, VR platforms can provide automated feedback, such as a checklist of completed tasks and the time taken to perform them. Users’ recall following stressful events can be unreliable.[38] Having a generated list that details tasks performed—or not performed—by users, along with the timing of each, can assist instructors in guiding the debriefing process toward areas of weakness. Additionally, the availability of this automated record decreases the need for instructors to take notes during the session.[38]

Participants highlighted the benefit of this VR platform in enhancing non-technical skills over technical skills. While limited haptic feedback in VR has been noted as a barrier to practicing technical skills before, some authors disagree with this argument.[39–42] They underpin that successful technical tasks often hinge on decision-making processes, including selecting the correct equipment and identifying anatomical landmarks.[39–42] Given that decision-making is a critical component of non-technical skills and can be simulated in VR, the platform may offer substantial benefits even for technical skills.

In our opinion, to benefit most from the platform, it is crucial to define the learning objectives clearly, and identify target users before creating any virtual scenario. Our primary goal was to augment the capabilities of established trauma teams. For these experienced providers, technical skill acquisition (for example, inserting a chest tube) is less of an issue, allowing them to concentrate on other learning facets where this virtual platform has more benefits, such as encouraging communication and collaboration between users in a stressful environment.

In our study, 27% of the users reported significant sickness, which raised initial concerns among the research team. However, follow-up discussions with participants indicated that two (18%) were not wearing their usual prescription glasses, which can cause eye strain issues. Other participants believed they could discern all details, such as small text on a virtual flier. They reported blurry vision or difficulty focusing on the cybersickness survey. Yet, these issues are known limitations of the current headset’s display resolution and optics rather than project-virtual simulation issues. Furthermore, the interpupillary distance (IPD) setting within the headset itself was not calibrated for each user, which may cause users with an IPD further from the norm to encounter a blurry stereoscopic view, contributing to dizziness and eye fatigue.[43]

The feedback obtained will be instrumental in refining our tutorial to clarify the platform’s limitations and to instruct users to take the necessary time to adjust the headset for optimal comfort. Users will be advised to take breaks where required, and IPD will be calibrated for each user individually before their virtual simulation is conducted. Future test headsets will utilize newer display technology with improved resolution and optics to further alleviate issues. Further evaluations will be conducted to ensure the cybersickness level after these modifications.

V. Conclusion

Our preliminary assessment of a VR platform for pediatric trauma education has yielded promising results. Users expressed satisfaction with the realism of the virtual trauma bay, the virtual patient, and the equipment. The platform was deemed particularly effective for enhancing non-technical skills over technical skills, with potential benefits extending across a broad spectrum of users, from medical students to experienced staff. Finally, most participants concurred that the tested VR platform offers a more immersive simulation training experience than high-fidelity mannequins.

Nonetheless, moderate cybersickness was reported by almost one-third of the participants. Even though this may be attributed to hardware limitations, such as the inability to render fine details, this concern warrants careful investigation. Given that VR can help address crucial gaps in pediatric trauma education—namely, accessibility and non-technical skills training, these initial findings encourage subsequent trials to compare VR simulation and high-fidelity mannequins.