Innovating Pathology Learning via Kahoot! Game-based Tool: A Quantitative Study of Students’ Perceptions and Academic Performance

Introduction

Pathology learning requires continuous training of cognition and skills ^[1]. Continuous formative assessment helps students in learning as it permits learners to demonstrate their development of skills, and receive support and feedback for more improvement.^[2] Finding methods that engage and motivate students to be continuously evaluated,^[3] and seeking improvement is needed.

Kahoot! is a formative assessment freely available online tool that is based on the concept of game-based learning. Kahoot! creates a competitive environment through providing time limits and scoring, and is supported by mobile devices. It was launched in 2013, ^[4] by Mobitroll, which is a collaboration between the Norwegian University of Science and Technology with the British company We Are Human.^[5,6] Kahoot! quizzes can be accessed on any appliance that has an internet signal with no location limits. It can be utilized inside or outside the classroom for individual studentś asynchronous practice or synchronous studentś challenges.^[4,7-9]

Quizzes can be created freely on the platform by create quiz, then selecting the type of the question (MCQ, or true/false), writing it, followed by choosing the assigned time in seconds for each question. The platform asks you to mark the correct answer to be presented to the students when they answer each question as a feedback. Quizzes can be assigned either as an individual practicing tool where each student pracrices asynchronously on the quiz any time they want with no time limits, or as live challenges inside the classroom, or as a timed-challenges between students outside the classroom. In the challenges, quizzes are open only for a certain time limit which represents a window for students who want to compete with each others to answer and a winnerś list according to scores & time taken is generated. ^[8,9] To share a quiz, Kahoot! tool auto-generates a sharable code or link for the instructors. Students can access the game by using the Kahoot! application or by browsing the website via a laptop or smartphone. They enter the shared code or browse the shared link and sign up/in and the Kahoot! game starts. The students collect points based on their speed in offering correct answers. ^[4,10] Game elements present in Kahoot! quizzes include stimulating music, colorful animations, and a countdown for each question which maintain participants engagement and creates a sense of competition. Kahoot! creates a bar graph for each quiz that shows how many participants chose each of the answers provided, which gives feedback for both students and instructors.^[11] Literature reported some advantages as well as challenges that faced Kahoot! student-users in varying educational settings. ^[12]

The pilot study by Neureiter et al. (2020) is the only research done evaluating the use of Kahoot! in Pathology learning.^[13] It evaluated the general studentś perception on the use of Kahoot! and revealed good acceptance of it. It also evaluated the academic performance through pre and post kahoot tests. However, no comparative group was included in the study to evaluate if the increased performance is real compared to a non kahoot using group. Also the pre and post tests and the kahoot use were done all in the same teaching session which makes the evaluation is based on the short term memory of students retaining the acquired knowledge in the classroom.

Our research aims to investigate the effect of using Kahoot! outside classroom in Pathology learning (i.e. studentś perception, and academic performance using a comparative group).

Materials and Methods

Study design

This pilot study employed a retrospective quasi-experimental design. The academic performance of students was analyzed in the two student groups of the study (Kahoot! formative assessment tool users versus non-Kahoot! users). A survey was introduced to the Kahoot! tool users to assess their perception on the tool (Figure 1).

• Download figure
• Open in new tab

Figure 1: A diagram illustrates the study design

Before dissemination to students, the survey was sent to two experts in medical education for revision and validation, and slight modifications were done based on their opinions. The final-version survey questions were internally consistent with a calculated Cronbach’s alpha of 0.89.

Results

This study was conducted on a cohort of 110 first-year preclinical medical students with age range between 17 and 19 years. Participants’ characters are shown in table 1

Analysis of studentś preferences and perceptions of using Kahoot! as a formative assessment tool

Of the 55 students who used Kahoot! tool; 72.7% (n=40) preferred the individual practicing asynchronous quizzes over the synchronous studentś challenges (n=15, 27.3%). Overall, the majority of students perceived Kahoot! as a reason for increasing their interest in Pathology studying (n=51, 92.7%), beneficial for its learning (n=48, 77.3%), and enhancer for its understanding (n=44, 83.6%). The majority (85.4%) recommended its continuous future use in learning Pathology (n=47). This is explained by the following positive extracted results:

Over 90% of students (n=50, 90.9%) considered it helpful to focus on the subject details, retain knowledge (n=48, 87.3%), and correct misconceptions on the subject (n=45, 81.8%), as well as being an effective method for reflective learning (n=46, 83.7%). The majority (89.1%) of users perceived Kahoot! as an effective method to provide feedback (n=49). It motivated users for learning (n=45, 81.9%), and made their learning experience fun (n=49, 89.1%). (Table 2, Figure 2)

View this table:

• View inline
• View popup

Table 2: Studentś perceptions of Kahoot! Use

• Download figure
• Open in new tab

Figure 2: A chart illustr ates studentś perceptions of Kahoot! use

Kahoot! use is considered a useful tool for assessment of higher cognitive skills by majority of users; analysis (problem solving skills) (n=38, 69.1%), evaluation skills (n=34, 61.8%), application on new situations (n=51, 92.7%), and understanding (interpretation skills) (n=38, 69.1%). (Table 3, Figure 3)

View this table:

• View inline
• View popup
• Download powerpoint

Table 3: Studentś perception of the level of cognition assessed by Kahoot! use

• Download figure
• Open in new tab

Figure 3: A chart illustrates studentś perception of the level of cognition assessed by Kahoot! Use

Other mentioned advantages of Kahoot! in a descending order were practicing for exam (n=22, 40%), simple and easy to use (n=20, 36.4%), competitive (n=10, 18.2%), self confidence booster (n=6, 10.9%), forming a comprehensive image of the lecture (n=5, 9%), quick (n=5, 9%), and imagining skills booster (n=3, 5.5%). Mentioned disadvantages included no explanation for the answers of questions (n=11, 20%). A quarter of the students stated that the time limit for the questions was short (n=15, 27.3%).

Discussion

Our study results showed that using Kahoot! as the game-based tool in learning Pathology is well perceived by students as a learning booster and engager, and increased their academic performance in this medical science.

Medical students in the pre-clinical years may be upset by the amount of knowledge they need to gain, and educators are often faced with the challenging responsibility of teaching a large volume of content in a short time frame.^[16] The use of innovative methods in basic science teaching is mandatory nowadays to tackle this problem while keeping up with the new generation of learners. Studies have suggested that today’s students tend to stay more engaged in the educational activities with technology involved.^{[17, 18]}

Pathology as a basic medical science linking academic knowledge to clinical cases has always been considered challenging, as students are required to understand, interpret, apply, evaluate, problem solve and memorize a large sum of information about the human body. Innovations in teaching Pathology such as virtual microscopy, public engagement, and podcasts have been tried over the past few years.^{[19, 20]}

Games are helpful to obtain high academic performance, motivation, and improved classroom dynamics. Incorporating games in learning started to expand in higher education. Games may be used to overcome some limitations of the traditional face-to-face teaching.^[11] Besides, the game-based learning theory is based on that commitment in performing a task while playing stimulates the higher functions of the brain for active learning; this increases knowledge retention by helping the brain transform information from short to long-term memory.^[21]

Integrating a game-based tool, like Kahoot!, in learning can allow students to revise and apply what they have learned in an interactive, fun, and competitive way.^[7] Enhancing game-based learning can enhance medical studentś engagement with Pathology and the findings of our study are consistent with the literature on digital games.^[22] Learning methods and platforms that incorporate gamification as Web-based programs, mobile applications, and virtual patient simulations have proven successful in engaging students in learning activities.

To elicit students’ interest and develop their skills, continuous formative assessments in the form of online competitions using Kahoot! were carried out in this study. Besides, our first-year preclinical medical students were challenged with one new Kahoot! competition after each lecture over 2 consecutive Basic Sciences modules to boost their learning by permitting the immediate application of their acquired new knowledge.^[23]

In our study, out of a cohort of 110 students; fifty five with different high school types and educational systems used the Kahoot! game-based tool. There was a significant association between the high school type of students and their use of the Kahoot! tool in the faculty. All students of stem, American diploma, and IGCSE high school systems used it.They were followed by students of other systems; Egyptian high-school education (Thanaweyya Amma), followed by other non-Egyptian Arabic certificates. So, the type of learning received in high school impacts studentś choices of learning methods in higher education. However, participation in interactive learning and providing feedback in higher education institutions is not limited to a certain background.^[24] More encouragement to try gamification in learning and attention should be given to international students of other Arabic high school backgrounds being the least using group.

Female users in our study significantly exceeded males. Females were also found to favor flexible and interactive e-learning methods by other researchers.^[25]

The majority of Kahoot ! user students involved in the study never used this application before. Students are willing to try new educational tools offered to improve their learning experience. Thirty six percent of Kahoot! user students reported it is easy to use in their written feedback which might be helpful for students with no previous experience using it.

Using Kahoot!, most users preferred the individual asynchronous practicing quizzes over the synchronous individual challenges. Students need to set their pace for training.

The majority of Kahoot! users appreciated it as a tool for formative assessment. They recognized it as beneficial, facilitating and enhancing learning, and increasing their interest in Pathology studying. Moreover, they recommended its continuous future use in learning Pathology. They found it helpful to focus on and retain scientific details; with correction of misconception. Similar results were obtained by former studies on other basic medical sciences.^{[26, 27]}

Furthermore, using Kahoot! was associated with good academic performance in Pathology that was not related to the general academic performance of the students. Scores obtained in the comprehensive formative Pathology exam showed significantly higher performance of Kahoot! tool users. This goes in agreement with Tóth, et al.^[9] who found that lack of engagement in activities is associated with significantly lower performance. Felszeghy et al.^[4] reported higher academic performance in the Kahoot! user students in Histology, however, it was not statistically significant. Our results are encouraging and support the use of this tool in the somewhat difficult-nature subject.

Critical thinking, problem-solving, reflectivity, analysis, and contextual learning are cognitive competencies needed for an efficient graduate medical student, and they can be developed starting from preclinical years.^[28] The Kahoot! application allows the creation of various types of questions; students agreed that they could practice questions that stimulated their higher cognitive functions. Therefore, not only adding a new educational tool is enough, but choosing how to use it according to the nature of the subject/discipline and the target outcomes is an important factor.

This study confirms the positive effect on academic performance found by Neureiter et al. (2020) in Pathology learning. ^[13] On contrary to using the tool inside the classroom just after the lecture; our students used the tool outside classroom so the tool is beneficial on the intermediate and long term memory levels. Our study also used a comparative group to confirm the positive effect of Kahoot! which was not used by Neureiter et al. (2020).

Students considered Kahoot! more competitive and challenging in the open-ended questions of the survey; described it as fun, non-boring, and play-like with attractive better design. Some reported that it boosted their self confidence related to answering exams. However, nearly quarter had concerns about the time limit for each question in the quizzes. Challenges reported in the literature that faced some Kahoot! include technical problems, stress related to not having enough time to answer, and fear of losing (Wang and Tahir, 2020). ^[12] Challenges to incorporate new technological means should be considered before applying any tool, however, this should not restrain its trial. The time limit for each question during the quizz design should be taken into consideration and prolonged a little bit than that considered suitable by the instructor to allow students for thinking and training. Instructors may add a 2^nd version for each quizz to the platform with the considered “suitable” time assigned for the questions for a 2^nd phase training.

Study limitations include small number of participants, being implemented only in a general Pathology course with no systemic pathology included, and being carried out on one batch and one instituion.

Conclusion

This study assessed the criteria and effects of using Kahoot! as an online game-based tool for continuous outside-classroom formative assessment, on undergraduate preclinical students’ engagement and satisfaction while learning a medical Pathology course. The results offer an endorsement to the use of Kahoot! gamification in Pathology learning and can provide a basis for the design a Kahoot!-based formative assessment plans in Pathology curricula. The additional competition aspect of this tool added a supplementary educational value. Besides, through its flexible question design, it offered the opportunity to stimulate and train studentś higher cognitive skills needed for future practitionerś competency.

Disclosure of Interest

The authors declare that they have no conflict of interest.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Data availability

The datasets generated and analyzed during the current study are available at the corresponding author upon request.