Perceived Clinical Readiness of Senior Medical Students as Outcomes of Online Clerkship in the Philippines: New Normal in Medical Education

Background of the study

As COVID-19 posed a deadly threat, medical institutions are now faced with new challenges in delivering and continuing the medical education process safely while maintaining its standards.¹ This has resulted in a transition from the usual face-to-face classes and direct clerkship training within a hospital to a new platform of remote learning with online lectures and conferences, and virtual clinical experience. Medical schools have temporarily suspended their clerkship rotation and training in a hospital setting to limit the spread of COVID-19 infection by minimizing personal interaction and in turn decreasing the risk of exposure of medical students.

The use of online interactive discussions and virtual clinical settings may allow the students to perfect the educational theory and exhibit the competencies necessary for progression and continue their training.² Virtual web-based platforms such as Zoom and Google Meet have been used for the delivery of webinars, case discussions, reading assignments, and small group discussions (SGDs, peer mentoring). Online learning has also been shown to be as effective as conventional teaching because it promotes self-directed learning,³ develops interactive virtual clinical teaching, and encourages student engagement and student feedback, with added benefits of easy accessibility of learning materials.⁴

However limited patient care and interaction can restrict bedside teaching opportunities and can impact how medical students acquire and hone their clinical skills, and develop collaborative experiences. Also, such measures being adapted cannot wholly replace the physician-to-patient interaction which is integral to medical training.¹ Moreover, there has been a concern that medical students may miss out on the experiences of clinical rotations, such as exposure to an authentic patient environment. This may be a challenge since the students are encouraged to be innovative and adaptive in developing and demonstrating their skills and knowledge. However, this situation may also provide a way for the students and medical educators to analyze the outcome of the recent changes in the medical set-up and provide new principles and practices that may contribute to the advancement of medical education.⁵ In this study, the researchers aimed to provide an overview of medical students’ clinical readiness during this time of the pandemic where digital medical education is being instituted, and alternative clinical clerkship training programs and new modes of student-patient interaction are practiced.

Significance of the study

Meeting the competencies and completing the requirements are needed to progress in the clinical clerkship training and to become a well-rounded physician in the future. With the sudden transition to remote learning brought by the pandemic, various aspects of the medical education process have been affected, with much of the impact seen on the medical students who had to ensure they acquire the necessary clinical skills and experience while they continue to adapt to the new platform. The findings of this study will be of considerable importance to the following population:

Research Question

How does online clinical clerkship training programs affect the preparedness of the fourth year medical students in the Philippines to practice medicine?

General Objectives

The study aims to determine the level of clinical readiness of the fourth year medical students in the Philippines with regards to the performance of clinical skills under the new online learning platform in the practice of medicine.

Specific Objectives

Specifically, this study seeks to answer the following questions:

• 1. Academic training profile of the students

  • 1.1 Performance last academic year

  • 1.2 Suspension of face-to-face clinical rotations

  • 1.3 Length of time with face-to-face experience

  • 1.4 Types of online activities

  • 1.5 Methods of evaluation for skills

  • 1.6 Learning management system

• 2. What is the extent of readiness as an impact of online clinical training on the developmental areas of:

  • 2.1 Clinical Skills

    • 2.1-1 General Clinical Skills

    • 2.1-2 Department of Obstetrics and Gynecology

    • 2.1-3 Department of Surgery

    • 2.1-4 Department of Internal Medicine

    • 2.1-5 Department of Pediatrics

    • 2.1-6 Department of Family and Community Medicine

  • 2.2 Patient Management

  • 2.3 Communication and Team Working

  • 2.5 Understanding Clinical Guidelines and protocols

  • 2.6 Personal development and wellbeing

• 3. Is there a significant difference in the readiness level of the respondents with respect to the different mandated preparatory skills?

• 4. Based on the results, what strategies can be forwarded to improve the online delivery of clinical training?

Study Design

This study employed a descriptive research design using the cross-sectional survey method. The researchers measured the clinical preparedness of fourth year medical students in the Philippines, hereinafter referred to as respondents, based on their online clinical learning for this academic year 2020-2021. An online questionnaire was used for the survey.

Study Setting

This study targeted respondents from the 44 medical schools in the Philippines. The medical schools are found all over the country in different regions namely: Region 1, Region 2, Region 3, Region 4A, MIMAROPA, Region 5, Region 6, Region 7, Region 8, Region 9, Region 10, Region 11, and NCR.

Study Population

The population of interest was composed of the fourth year medical students, approximately 5,500, in the Philippines with an estimated cohort of 44. Respondents were enrolled in their respective medical schools as fourth year medical students for the academic year 2020-2021.

Sampling design

This study employed a multi-stage sampling. The first stage was stratified random sampling where the researchers took the medical schools as strata. The second stage was to do convenient sampling due to the nature of availability, commitment, and consent of the students from each school with a targeted minimum of 30 students from each school based on the central limit theorem.

Inclusion Criteria

The participants included those who were enrolled as regular fourth year medical students or those who were conditionally enrolled (with pending requirements for submission) as long as they received the same training in this case little to no face-to-face classes as the other regular medical students.

Exclusion Criteria

Participants who were currently on a leave of absence (LOA), those who were irregular students, or those who changed medical schools during their training were excluded from the analysis.

Data Collection Process

The researchers tapped a student network organization based in the Philippines. From there, the online questionnaire was sent through the “Google Forms” link along with a copy of “Informed Consent,” which was distributed to all medical schools in the Philippines via an organization’s representative, in coordination with the researchers. The said organization is a non-stock, non-profit, and voluntary, that is incorporated under the Philippine laws. With their mission to promote quality and medical education in the country, the researchers chose them because the data that can be collected may serve as a primary source of information about the clinical preparedness of senior clerkship. The researchers then set a time frame for the collection of data and strictly adhered to the schedule. Constant follow-up was done. Responses to the forms were automatically saved in a drive where only the researchers can gain access. Once all the data were collected and collated, the analysis followed in two weeks.

Data Collection Tool

The researchers crafted a simple survey/questionnaire (See Appendix A) focusing on the clinical preparedness of the respondents, based on the competency set nationally by the Commission on Higher Education (CHED). The questionnaire aimed to explore the readiness of interns as they transitioned themselves into graduates in the Doctor of Medicine (M.D.) program, how well they were prepared, and how confident they were in dealing with actual patients in the clinical setting, in the effect of this global pandemic brought about by COVID-19. The n-item questionnaire was designed to combine multiple choice, Likert scale questions, and open-ended questions.

Validity and Reliability

The crafted questionnaire was evaluated and scrutinized by different panels, composed of medical students, undergraduate and postgraduate medical educators, including the Research Adviser and Research Director of the researchers’ academic institution. For the face validity, the research questionnaire satisfactorily met the researchers’ objective in exploring senior clerk’s readiness and preparedness for the clinical rotation, as approved by the panel’s consensus. To ensure content validity, questions were based accordingly on the minimum competencies or program outcomes in the four major areas of clinical clerkship mentioned in the Joint Memorandum Order No. 2016-18. Researchers also did cross-reference with areas explored by other authors in the published literature. Construct validity was not a problem as self-perceptions of the respondents were gathered instead of abstract concepts. The Cronbach Alpha’s Test was used to measure the internal consistency and reliability of the questionnaire, the instrument obtained an excellent internal consistency with a Cronbach alpha value of 0.98 (See Appendix B).

Statistical Treatment

For the categorical data especially on the profiling, frequency and simple percentage were used. In terms of analyzing the perceived readiness, a weighted mean was computed. Likewise, the Analysis of Variance (One Factorial Design) was employed to determine the significance of the differences of readiness levels across the developmental areas. A Tukey’s post hoc test was applied when significance was detected at 0.05 level of significance.

Ethical Consideration

The research was subjected to examination and approval by the Institutional Review Board (IRB) of Cebu Institute of Medicine (CIM). A detailed description of the study including the rationale, objectives, and procedures was provided to the student network organization. Any form of risk or harm while answering the survey questionnaire was reported to the student network organization, researchers, and the IRB. The researchers obtained informed consent from the participants before the survey began.

Informed Consent

This study obtained informed consent (See Appendix C) from our respondents that followed the WHO-ERB standards. All the following elements were detailed in the informed consent: the purpose of the study, type of research intervention, participant selection, voluntary participation, procedures, duration, risks, benefits, and confidentiality. As previously mentioned, participation was completely voluntary and the respondent had total freedom to decide whether to finish the questionnaire or not. Strictly, all identifying and personal information remained confidential.

Confidentiality and Security of Information

The questionnaire was submitted to the IRB of CIM. Before answering the questionnaire, the respondents were made to read and respond to the informed consent that was presented on the first page of the online questionnaire. Participation of the respondents was voluntary. Respondents were assured that the information gathered from the survey was used for research purposes only and that their identities remained anonymous. Information obtained in this study included the personal information of the respondents and was kept confidential. The following measures were instituted:

1. Completed questionnaire did not contain identifying information. They were marked with a serial code and a separate identifier sheet was kept with the corresponding serial code matching the one on the completed questionnaire. The identifier sheet was kept and made known only to the primary investigator. Identifiable data were encrypted.

2. The files were only stored and accessible with the account of the principal investigator

3. All study data were disposed of promptly after the study duration.

Non-Maleficence

Each participant was informed of the objectives and design of the study in the informed consent forms.

Beneficence

The results of the study will be used to contribute to novel and existing knowledge in the use of online learning for the senior clerkship or fourth year curriculum.

Benefits

Since this study did not require compulsory participation of the respondents, they had the right to withdraw from participating in this research study if they wished to do so. They also had the right to ask about the analysis of data gathered from the data collection.

Protection

Any information that could incriminate the respondents nor any personal data provided was not released without the patient’s consent. The data collectors were third year medical students who were rigorously prepared to handle and administer the questionnaire and address any concerns that would possibly harm the respondents.

Section 1: Personal and online learning profile of the respondents

Table 1 shows the personal and learning profile of the respondents where it can be verified that most senior medical students who participated in the survey were females (62.43%), with a mean age of 25.85 years old. Almost all respondents (98.80%) also revealed that there was a suspension of face-to-face clinical rotations due to the COVID-19 pandemic. A majority did not also plan for a leave of absence (58.56%) where 62.34% claimed to have had face-to-face duty during the worldwide health crisis. For those who had experiences of face-to-face duties, 61% of them claimed that they were on duty for only less than a month.

Table 2 illustrates the medical academic institutions of the respondents. The strength of this survey was being able to include the experiences and perception of the students enrolled in the medical schools found all over the country in different regions namely: Region 1, Region 2, Region 3, Region 4A, MIMAROPA, Region 5, Region 6, Region 7, Region 8, Region 9, Region 10, Region 11, and NCR.

Table 3 enlists the most common online activities the senior medical students engaged during the pandemic. The combination of online/pre-recorded lectures, video-making, online fora / webinars / conferences recorded the highest frequency (74.31%). This is followed by online/pre-recorded lectures, online fora / webinars / conferences, case report with 12.25%.

In the area of assessment, Table 4 reveals that the students claimed that Objective Structured Clinical Examination (OSCE), Online Journal Reports, and Case Studies (41.62%) were most commonly used during this pandemic. This is followed by the assessment techniques using Online Journal Reports and Case Presentations, Situational Analysis, and Reflection at the rate of 21.73%.

Table 5 depicts the frequently used learning management system platforms in the delivery of learning during this time of pandemic. It can be validated that Google classroom and Blackboard got the highest frequency (26.15%), followed by the use of Google classroom, Canvas, Blackboard at 7.83%. Likewise, it can be noticed that the Zoom platform was also commonly used in the delivery of lessons.

Table 6 outlines the perception of the students when asked about the outcomes of the online modality in learning. In terms of their development of skills in preparation for actual or face-to-face patient interaction, respondents generally indicated an unsure response with more than half (55.62%) of these medical learners. This is followed by their claims that they are not convinced that the online delivery of the different lessons helped them develop the necessary skills. Likewise, the majority of the respondents (79.56%) also perceived to have no confidence in assisting in hospital functions. This also showed in their negative response (44.48%) when asked about their mastery in performing physical examination (PE) and being able to identify the normal and abnormal findings with less supervision.

Section 2: Extent of readiness as an impact of online clinical training on the developmental areas

Table 7 shows the extent of perceived readiness of the students in terms of general clinical skills. Overall, it can be deduced that they rated this domain of readiness as “moderate” (2.92). While the respondents claimed to be “ready” for “Obtaining a complete and concise clinical history” (3.76); however, they rated “less ready” for the items on “responding effectively during emergencies, securing the airway, breathing, and circulation of the patient” (2.26) and “dealing with patients with psychiatric or psychological problems (e.g., substance abuse, psychosis) and those with cognitive impairments (e.g., dementia)” (2.33).

In the area of OB-Gyne, the respondents generally rated their skills acquired from online learning as “moderate” (2.68). This can be attributed to the fact that “performing Pap smears”, “performing internal examinations”, “managing patients from labor until delivery via normal spontaneous vaginal deliveries (NSVD)” and “Assisting in OB or Gyne minor or major surgeries” were the skills they perceived to be “less ready” about.

In terms of surgery, the respondents also rated this domain of readiness as “moderate” (2.68). In fact, it can be verified from Table 9 that “Performing incision” (2.19) was a skill they perceived to be “less ready.”

Table 10 shows the perceptions of the students who claimed that they were only moderately prepared for the different tasks associated with internal medicine. It can be validated that “performing an NGT insertion” (2.50) and “Performing urethral catheterization” (2.58) were rated the least in this domain.

In terms of pediatrics-related skills, the students rated “ready” on the item of “performing a complete history and physical examination in pediatric patients” (3.45); however, items on “performing NGT/OGT insertion”, “performing urethral catheterization”, and “performing and interpreting a PPD test” were rated as “less ready” only.

Table 12 shows that generally, the students perceived a “moderate” level (3.26) of readiness in terms of Family and Community Medicine-specific skill sets. It can be validated that they perceived the item on “identifying problems commonly encountered in rural medical practice” as “ready” already (3.40). But, the items on “doing online consultations through Telemedicine’’ and “formulating and managing team approach in implementing health programs’’ were the least rated competencies in this domain.

As to the patient management skill sets, the respondents generally rated this domain as “ready” (3.62). This is attributable to the fact that they rated the highest perceived readiness on the aspect of “taking opportunities to promote health and prevent disease” (3.83) and “behaving with respect for patients’’ (4.15); however, the item “discussing medication, including unwanted effects, with patients’’ was rated the least (3.38) in this part of the survey.

In terms of communication and teamwork as necessary competencies at work, the students perceived that they were already “ready” (3.78) at the onset of the survey. This can be attested from their high ratings on the items for “working harmoniously with colleagues” (3.97), “maintaining good interpersonal relations with the paramedical hospital staff (nurses, medical technologist, PT/OT) and the non-medical hospital staff” (3.91) and “seeking help and advice from senior colleagues” (3.96).

Students deemed themselves “ready” in terms of the skills to understand clinical guidelines and protocols with an overall rating of 3.91.

The senior medical students also claimed that they were already “ready” (3.78) in terms of the personal development and wellbeing needed to function in their future jobs in the hospitals.

Summary of perception on students’ level of readiness

It can be revealed from the bar graph that compliance to “Clinical Guidelines and Protocols” was the highest rated domain in terms of readiness. This is followed by “Communication and Teamwork;” and “Personal Development and Wellbeing.” Meanwhile, the skills for OB-Gyne, surgery, pediatrics, internal medical, and general clinical skills were poorly rated in terms of the level of readiness.

Section 3: Significant difference in the readiness level of the respondents with respect to the different mandated preparatory skills

Using a One-Way ANOVA, the significance of the mean differences in the perception of readiness with respect to the different mandated preparatory skills was performed. Through the p-value approach, the ANOVA p-value recorded at 0.000 which is less than the level of significance at 0.05. This means that the null hypothesis of no significance can be highly rejected. This implies further that the differences in the extent of perception of readiness across mandated preparatory skills were statistically significant.

It can be deduced from the table that the ratings for readiness on “Clinical Guidelines and Protocol “, “Communication and Teamwork” and “Personal Development and Wellbeing” were perceived to be the highest. Since these three domains of readiness shared the same Tukey’s grouping category, then the three did not significantly differ in terms of the ratings. The readiness is then followed by patient management skills, then family and community medicine. Lastly, the Tukey’s test verified that the students rated significantly lower in terms of readiness on the items of Surgery and OB-Gyne-related skills.

Medical School

1. Schedule students for access to on-campus facilities for skills development and simulation (e.g., skills laboratory).

2. Create opportunities for clerk-to-patient interactions (e.g., telemedicine, hospital rotations).

3. Make clinical clerks and instructors aware of the clerk’s current confidence levels to identify which areas they need to focus on improving. Let students evaluate their performance in every department (e.g., standardized questionnaire).

4. Let clinical instructors give real-time, individual feedback with regards to the clerk’s performance in terms of soft and hard skills.

5. Set a strong system in ensuring the fairness of the online summative assessment.

6. Further improve online clinical training with the use of sophisticated technologies aimed to mimic bedside assessment and clinical scenarios.

7. Allocate funds to secure and give out essential materials needed for skills practice.

8. Prioritize continuity of learning through blended learning to ensure that the medical students meet the required learning objectives and the standards set by CHED. Create and implement guidelines regarding the resumption of face-to-face classes and develop a bridging program to ease the transition from online learning to face-to-face classes.

9. Encourage students to actively participate during clinical skill training by checking on student comprehension and posing questions to maintain student enthusiasm and interest.

10. Further give all-encompassing help to the students, for example, managing the emotional well-being impacts of the pandemic and recognizing approaches to limit these adverse consequences.

Medical Students

1. Continue developing skills through practice.

2. Utilize available facilities as well as opportunities for clinical exposure/hands-on experience.

3. Maximize the use of reliable online resources for supplementary use.

4. Assimilate further knowledge by joining webinars and medical conferences.

5. Effectively take part in the conversation by posing inquiries and reacting to them during class meetings and clinical skill training.

6. Actively participate in educating the community regarding common medical misconceptions and other health-related issues.

7. Provide input on their peers and teachers to allow every member an opportunity to ponder their insight and convey their feedback in a steady and organized manner.

The community

1. Set clear guidelines to guarantee persistent instructive improvement of the medical students during crisis or pandemics.

2. Provide a stronger vaccination campaign in prioritizing medical students and frontline workers with clinical responsibilities.

3. Maximize resources in the surveillance and monitoring of the COVID-19 pandemic.

Future researchers

1. Construct an extensive questionnaire with regards to assessing skills in each specific department.

2. Assess the number of hours the clinical clerks get to practice a hard skill in a specific department.

3. Determine methods used by clerks to further improve their skills outside hospital rotations and skills laboratory e.g., methods used to practice at home.

4. Maximize response rate by sending the study questionnaire directly to the medical school deans, class representatives and providing updates for completion.

5. Utilize a more systematic sampling method to capture a better representation of the population.

6. Further study on the long-term impact brought about by the absence of clinical training for several months and identify competencies that have not been fully accomplished by the medical students.