Development and evaluation of an online training program for palliative care in India ===================================================================================== * Varun Raj Passi * Sreedevi Warrier * Rajalekshmi Balu * MM Sunilkumar * Parth Sharma ## ABSTRACT **Objective** Palliative care training at the undergraduate level is poor in India. With the need for palliative care rising in India and globally, it is possible to train physicians in resource-limited settings in palliative care via online training programs owing to ease of access and convenience. However, there is limited evidence available from India on the development and implementation of such a training program. This study aims to describe the development of an online training program offered by the Trivandrum Institute of Palliative Sciences (TIPS), Kerala, and the impact of the program on the confidence of physicians in managing various palliative care needs of their patients. **Material and Methods** The course was developed by an interdisciplinary expert team from TIPS. The course content was made keeping in mind the local sociocultural factors in India and was peer-reviewed by two external experts. The program was started in 2018 and updated and revised over the years. Currently, the program has 20 sessions, each lasting for 90 minutes. The course content was disseminated using project-ECHO’s tele mentoring model. To assess the impact of the training program, self-reported change in confidence from twenty-two batches of physicians, trained from January 2020 to August 2023. Feedback from participants was also assessed to identify areas of improvement in the training program. **Results** A total of 1159 physicians were trained during the study period. At the end of the course, 51.2% of the participants completed the evaluation survey and had a statistically significant (p<0.05) improvement in confidence in pain, gastrointestinal symptoms and breathlessness management, morphine prescription, and psychosocial communication. The duration of each session and the entire course was reported to be ideal by 88.6% and 87.9% of participants, respectively. **Conclusion** Our results show that online training can be effectively used to build confidence in physicians in managing various palliative care needs. Keywords * Palliative Care * Pain Management * Distance Education * India * Terminal Care ## 1. Introduction India had an estimated 100.4 incident cancer cases per 100,000 people in 2022, which is expected to rise.[1] The incidence of other non-communicable diseases like diabetes, hypertension, cardiovascular and respiratory diseases has also grown in India over the last few decades.[2] As these chronic diseases eventually reach an end stage, their increasing burden necessitates a scaling up of palliative care services to address disease-related suffering. In 2023, the need for palliative care in India was estimated to be 6.21 of every 1000 individuals which roughly translates to 8.4 million people.[3] However, despite the increasing burden of diseases, access to palliative care remains poor. It was estimated that 98.39% of people living with end-stage cancer in India have their palliative care needs unmet.[4] The Economist’s “Quality of Death” index ranked India at the 67th position out of the 80 countries that were studied.[5] Palliative care services in India are also unequally distributed. While most of India’s population lives in rural areas, palliative care services are provided via tertiary and secondary centres clustered in large cities.[6] This gap is more pronounced in the northern part of India.[7] A major contributing factor to these is the lack of training of healthcare workers in palliative care in India. [8,9,10] Palliative care training can be divided into specialist education, generalist education, and palliative education approach.[11] Specialist education offers in-depth training solely focused on a specialty, allowing providers to address complex palliative care needs. Specialist training in palliative medicine was recognized by the erstwhile Medical Council of India in 2010[12] and as of June 2023 is available as a three-year course in 17 teaching hospitals.[13] Generalist education provides shorter courses enabling specialists or general practitioners to offer palliative care alongside their primary practice, mainly for patients with less complex needs. The palliative education approach emphasises that all healthcare providers dealing with chronic and life-limiting conditions should possess basic palliative care skills, understand its principles, and integrate them into practice. The Competency Based Medical Education (CBME) states in its objectives that an Indian Medical Graduate should be able to understand and provide palliative care to their patients.[14] The MBBS curriculum was updated in 2019 to include modules on palliative care. However, there remains a need for trained educators to teach palliative medicine to medical students.[15] Palliative care training courses can equip Indian doctors with the skills needed to provide effective palliative care services. Usage of the online medium allows disseminating the educational content to a large audience, making it more accessible.[11] While such courses could help improve basic awareness amongst healthcare providers, they need to be designed keeping the local sociocultural context and patient needs in mind. Additionally, their efficacy needs to be studied. Our study aimed to describe the development of an online training program in palliative care for physicians-the Foundation Course in Palliative Medicine (FCPM), offered by the Trivandrum Institute of Palliative Sciences (TIPS). We also aimed to study the impact of the program on the confidence of participants in managing various palliative care needs. ## 2. Material and Methods ### 2.1 Program Background Since 2008, TIPS has offered an in-person 6-week course in palliative medicine-The Certificate Course in Pain and Palliative Medicine (CCPPM). Experience from conducting the CCPPM inspired the creation of a virtual training program to disseminate palliative care training to a wider audience. In January 2017, TIPS launched a virtual “Grand Rounds Program” (GRP) in collaboration with Project Extension of Community Health Outcomes (ECHO) to discuss the history and management of patients requiring palliative care. Project ECHO is an online technology-enabled capacity-building model, which aims to improve the knowledge and skills of community-level healthcare providers via teaching and mentorship. This is achieved by multipoint video conferencing which connects local healthcare providers with specialists at a hub site. The sessions are held regularly and follow a structured format of didactic teaching and case presentations. The GRP consisted of 15 palliative care doctors. The sessions were 2-3 hours long and were held every 2 weeks. Each session involved 4-5 case discussions along with a 15-minute didactic session on a pre-decided topic. The cases were brought in before the session from any of the interconnected centres. Feedback from the attendees of this program informed the creation of the FCPM to disseminate palliative care education to doctors with no background training in palliative care. ### 2.2 Expert Team Development An interdisciplinary expert team was established to develop the FCPM. This included five healthcare workers (two doctors from TIPS, two doctors who were recruited from the grand rounds program, and one nurse) with expertise in palliative care along with two technical support specialists and one program coordinator. During the planning phase of the course, the expert team met for multiple sessions to develop the learning program in concordance with the palliative care needs of the country. Since the launch of the first batch in June 2018, the expert team met for debriefing sessions after each batch was conducted to modify the course structure and content based on the feedback received from the participants. ### 2.3 Course Structure and Content The course was designed specifically keeping in mind the learning needs of doctors with no background training in palliative care. The FCPM could be taken by any doctor with an MBBS or BDS degree (or equivalent) with a valid registration in their country. The structure and content of the course were decided by discussion amongst members of the expert team during the planning phase of the course. The majority of topics covered were adapted from the CCPPM, and modified to meet the requirements of an online format. The course was designed to have 20 sessions with each session being 1.5 hours long. The sessions were conducted in English. Each session was structured in the following manner: First 5 minutes: General introduction of the faculty and participants Next 40 minutes: Presentation by the faculty Next 15 minutes: Discussion on the presentation Next 5 minutes: A presentation by one of the participants on a patient’s health condition Next 25 minutes: Discussion based on the patient’s story The topics covered in the FCPM included: 1. Introduction to palliative care 2. Introduction to pain and its management 3. Medical ethics 4. Communication 5. Palliative care in non-cancer illness 6. Gastrointestinal and Respiratory symptom management 7. Wound management 8. Psychosocial issues 9. Delirium 10. Palliative care emergencies 11. Organising of palliative care services 12. End-of-life care 13. Narcotic Drugs and Psychotropic Substances (NDPS) Act and opioid availability The course content and structure were peer-reviewed by two palliative care experts outside of the expert team. The course was finally launched in June 2018 ### 2.4 Learning Materials Video recordings of the live sessions were shared with the participants after each session along with other presentation materials (such as slides and key learning points). In addition to these, research articles pertaining to the topics discussed were shared as well. The participants were encouraged to use two textbooks as references: *Introducing Palliative Care* [16] and *An Indian Primer of Palliative Care.*[17] An online group with all the participants was created on a chat platform. This group was moderated by faculty. The intention for this was to keep the participants engaged and create a sense of community. Participants were encouraged to ask questions in the group chat and share additional learning resources. ### 2.5 Method of Program Evaluation At the time of registration, a demographic profile of all the participants was collected which included age, gender, qualification, healthcare sector they work in, country of residence, and state of residence. At the end of the course, participants were asked to fill out an evaluation survey. The survey collected demographic data including whether they were actively practising medicine at present, and if they were currently seeing any palliative care patients. The survey also assessed the effect of the course on the participant’s confidence in managing various palliative care needs. This was done via a retrospective pretest-posttest design, wherein the participants were asked at the end of the course to rate their confidence before and after the course on a scale of 1 to 10, with 1 indicating “not confident at all” and 10 indicating “very confident”. Feedback was also collected regarding the duration and timing of the sessions and the total duration of the course. ### 2.6 Data Analysis The data was analysed using the programming language R. Quantitative variables were expressed as mean ± standard deviation, and qualitative variables were expressed as absolute and relative frequencies (percentages). Paired-t test was used to evaluate differences in confidence in managing various palliative care needs before and after the course. A p-value of less than 0.05 was considered to be significant. ### 2.7 Ethical Approval The study was exempted from ethical review by the Internal Ethics Committee of Trivandrum Institute of Palliative Sciences on 8th July 2024. The ethics approval number of the study is TIPS/IEC-1/2024Exm. ## 3. Results The study period was from January 2020 to August 2023. During this period, 22 batches of the FCPM were conducted. ### 3.1 Demographic characteristics A total of 1159 physicians registered for the course during the study period. Out of these, 594 (51.2%) completed the evaluation survey. Demographic characteristics of participants who registered for the course are in **Table 1** and those who completed the evaluation survey are in **Table 2**. View this table: [Table 1:](http://medrxiv.org/content/early/2024/08/26/2024.08.26.24312585/T1) Table 1: Demographic characteristics of registered participants View this table: [Table 2:](http://medrxiv.org/content/early/2024/08/26/2024.08.26.24312585/T2) Table 2: Demographic characteristics of participants who completed the evaluation survey ### 3.2 Impact of online training on confidence in managing palliative care needs The evaluation survey showed a statistically significant improvement in confidence in managing all the palliative care needs that were assessed (**Table 3**). These include confidence in managing pain, confidence in prescribing oral and IV morphine, confidence in managing GI symptoms, confidence in managing breathlessness, and confidence in discussing psychosocial issues with patients. View this table: [Table 3:](http://medrxiv.org/content/early/2024/08/26/2024.08.26.24312585/T3) Table 3: Pre-test and post-test confidence scores of participants ### 3.3 Feedback from participants A majority of the participants (477 (80.3%)) who completed the evaluation survey were comfortable with the present timing of sessions between 5 to 6:30 pm. While 301 (50.6%) considered it ideal, 156 (26.3%) and 83 (14.0%) of the participants preferred the timing of the sessions to be between 3 to 4:30 pm and 6 pm to 7:30 pm, respectively. 522 (87.9%) of the participants considered the total number of sessions (20 sessions) in the course to be ideal, and 526 (88.6%) considered the duration of each session (90 minutes) to be ideal. **Figure 1** shows the ideal time of the course for the participants. ![Figure 1](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2024/08/26/2024.08.26.24312585/F1.medium.gif) [Figure 1](http://medrxiv.org/content/early/2024/08/26/2024.08.26.24312585/F1) Figure 1 ## Discussion We have described our experience in developing, implementing, and evaluating a virtual training program in palliative care for doctors. The program’s structure and content were developed and validated by palliative care experts from India and continuously modified based on feedback from each batch. A survey assessing the course’s impact on the confidence of the participants in managing various palliative care needs was administered at the end of the program. A retrospective pretest-posttest design was used to make the survey which allowed the respondents to gauge prior levels of confidence compared to current levels after the course by providing a consistent frame of reference.[18] The majority of the participants in our program were residents of India (96%) and held an MBBS degree (90.4%). 45.9% of the participants were from three states in the southern part of India-Kerala, Tamil Nadu, and Karnataka where the general availability of palliative care services is better.[7] There were no significant differences in the demographic characteristics between those who registered for the course and those who completed the evaluation survey. In resource-limited settings, Project ECHO has emerged as an innovative strategy to disseminate medical education. While there have been several studies that have described using Project ECHO to provide medical education to healthcare workers, a 2019 systematic review found very few studies from LMICs and also found most of them to be of poor quality [19]. Since then, a few studies from India, Bangladesh, and Nepal have described virtual palliative care education programs using Project ECHO. [20, 21, 22, 23] Our course incorporated previously described modifications for LMICs to the original project ECHO model.[22] These include the involvement of key local stakeholders in the leadership team, and continuous modification of the course by incorporating feedback from participants. We also encouraged asynchronous learning by creating a faculty-monitored social media group and providing the participants with video recordings of the sessions and presentation materials. Such modifications can facilitate learning, especially in resource-limited settings, and should be considered when implementing virtual training programs in LMICs. The involvement of local palliative care experts in the leadership team helped tailor the course content to the regional context. An example of this is the inclusion of “The Narcotic Drugs and Psychotropic Substances (NDPS) Act and opioid availability” in the course, which is specifically relevant to the Indian context where access to opioids is a major barrier to adequate pain control.[24] The results of our evaluation survey showed that the participants showed a significant improvement in their confidence in managing all the palliative care needs that were tested. These results were concordant with studies that have evaluated the impact of palliative care training programs incorporating Project ECHO. These include studies from high-income countries (HICs) like Canada,[25] and LMICs in Asia like Nepal, Bangladesh, and India [20,22,23] and Africa [26]. While these programs had individual differences in their structure and course, they show the utility of Project ECHO in disseminating palliative education to healthcare workers across varying backgrounds. Our study was unique in that it solely focussed on training physicians. Further, unlike other studies from South Asia which primarily focused on paediatric palliative care, our study focussed on training in general palliative care. Our results show that online training can be used to increase the confidence of doctors in managing the palliative care needs of their patients. Project ECHO’s unique tele mentoring model offers a feasible way to spread medical education to a large number of participants. This is especially useful in resource-limited settings where arranging in-person training is difficult. Given the poor quality of undergraduate training in palliative care, such courses can be used to build palliative care capacity in the country. Therefore, organisations such as the National Medical Council (NMC) should consider recognizing and implementing distance learning courses like ours at the national level to improve access to palliative care in the country. ### Study limitations and strengths Our study had a few limitations. First, only 51.2% of the eligible participants completed the end-evaluation survey, which could lead to selection bias favouring participants who found the course to be more engaging and useful. Second, participants were asked to self-report their confidence in managing palliative care needs which may not represent their actual level of learning and capabilities. Third, we were unable to assess the patient-level impact of our course. Future research should assess the effect of these courses on the quality of care received by patients. Despite these limitations, our study has many strengths. We developed and evaluated an innovative virtual palliative care training program for physicians. Our course was consistently modified based on feedback, keeping in mind the learning needs of our participants. The results of our study show the utility of online education in disseminating palliative care training to doctors. Our study also had a relatively larger sample size of 594 physicians who completed the evaluation survey, compared to other recent similar studies from South Asia. These include studies from India, Nepal, and Bangladesh where 51, 27, and 18 participants completed the evaluation survey respectively. [20,23,24] ## Conclusion Our study shows that virtual training is an innovative strategy to improve confidence in doctors in managing various palliative care needs. Therefore, online training programs have the potential to bridge gaps in access to palliative care by increasing trained palliative care providers, especially in resource-limited settings. Future research should assess the impact of these courses on patients and their families. ## Data Availability All data produced in the present study are available upon reasonable request to the authors ## Footnotes * **Funding:** N/A * **Conflicts of Interest:** Parth Sharma is the founding editor of Nivarana.org, a public health information and advocacy platform and has received honorarium for articles published in The Harvard Public Health Magazine, Think Global Health, The Hindu and The Wire. * **Statement of compliance**: The manuscript was prepared in compliance with STROBE guidelines. * Received August 26, 2024. * Revision received August 26, 2024. * Accepted August 26, 2024. * © 2024, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Sathishkumar K, Chaturvedi M, Das P, Stephen S, Mathur P. Cancer incidence estimates for 2022 & projection for 2025: Result from National Cancer Registry Programme, India. Indian J Med Res. 2022 Oct-Nov;156(4&5):598-607. doi: 10.4103/ijmr.ijmr\_1821\_22. PMID: 36510887; PMCID: PMC10231735. [CrossRef](http://medrxiv.org/lookup/external-ref?access\_num=10.4103/ijmr.ijmr_1821_22&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=36510887&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 2. 2.Arokiasamy P. India’s escalating burden of non-communicable diseases. Lancet Glob Health. 2018 Dec;6(12):e1262–e1263. doi: 10.1016/S2214-109X(18)30448-0. Epub 2018 Oct 3. PMID: 30292427. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S2214-109X(18)30448-0&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30292427&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 3. 3.Chandra A, Debnath A, Nongkynrih B. Palliative Care Need in India: A Systematic Review and Meta-analysis. Indian J Palliat Care. 2023 Oct-Dec;29(4):375-387. doi: 10.25259/IJPC\_140\_2023. Epub 2023 Nov 11. PMID: 38058486; PMCID: PMC10696344. [CrossRef](http://medrxiv.org/lookup/external-ref?access\_num=10.25259/IJPC_140_2023&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=38058486&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 4. 4.Patil S, Sharma P, Arora A, Zadey S. Unmet need for cancer palliative care in India. BMJ Support Palliat Care. 2024 Jun 8:spcare-2024-004978. doi: 10.1136/spcare-2024-004978. Epub ahead of print. PMID: 38834235. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6OToiYm1qc3BjYXJlIjtzOjU6InJlc2lkIjtzOjIwOiJzcGNhcmUtMjAyNC0wMDQ5Nzh2MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDI0LzA4LzI2LzIwMjQuMDguMjYuMjQzMTI1ODUuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 5. 5.The Economist Intelligence Unit. The 2015 Quality of Death Index Ranking [Internet]. 2015. [Cited 18th July 2024]. Available from: 2015 EIU Quality of Death Index Oct 29FINAL.pdf ([economist.com](http://economist.com)) 6. 6.Pai, R. R., Nayak, M. G., Serrao, A. J., & Salins, N. Integrating palliative care into primary health care: Indian perspectives. Prog Palliat Care. 2023; 31(5), 282–286. doi:10.1080/09699260.2023.2241799 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/09699260.2023.2241799&link_type=DOI) 7. 7.McDermott E, Selman L, Wright M, Clark D. Hospice and palliative care development in India: a multimethod review of services and experiences. J Pain Symptom Manage. 2008 Jun;35(6):583–93. doi: 10.1016/j.jpainsymman.2007.07.012. Epub 2008 Apr 18. PMID: 18395401. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jpainsymman.2007.07.012&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18395401&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000256725900005&link_type=ISI) 8. 8.Sadhu S, Salins NS, Kamath A. Palliative Care Awareness among Indian Undergraduate Health Care Students: A Needs-Assessment Study to Determine Incorporation of Palliative Care Education in Undergraduate Medical, Nursing and Allied Health Education. Indian J Palliat Care. 2010 Sep;16(3):154–9. doi: 10.4103/0973-1075.73645. PMID: 21218005; PMCID: PMC3012238. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4103/0973-1075.73645&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21218005&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 9. 9.Patel A, Deo S, Bhatnagar S. A Survey of Medical Professionals in an Apex Tertiary Care Hospital to Assess Awareness, Interest, Practices, and Knowledge in Palliative Care: A Descriptive Cross-sectional Study. Indian J Palliat Care. 2019 Apr-Jun;25(2):172-180. doi: 10.4103/IJPC.IJPC\_191\_18. PMID: 31114100; PMCID: PMC6504741. [CrossRef](http://medrxiv.org/lookup/external-ref?access\_num=10.4103/IJPC.IJPC_191_18&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31114100&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 10. 10.Bhadra K, Manir KS, Adhikary A, Kumar G, Manna A, Sarkar SK. Awareness of palliative care among doctors of various departments in all four teaching medical colleges in a metropolitan city in Eastern India: A survey. J Educ Health Promot. 2015 Mar 26;4:20. doi: 10.4103/2277-9531.154041. PMID: 25861665; PMCID: PMC4389366. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4103/2277-9531.154041&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25861665&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 11. 11.Salins N. Need for Palliative Care Education in India: Can Online Palliative Care Education Bridge These Needs? Indian J Palliat Care. 2020 Jan-Mar;26(1):1-3. doi: 10.4103/IJPC.IJPC\_7\_20. Epub 2020 Jan 28. PMID: 32132774; PMCID: PMC7017697. [CrossRef](http://medrxiv.org/lookup/external-ref?access\_num=10.4103/IJPC.IJPC_7_20&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32132774&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 12. 12.Salins N. Specialist Palliative Medicine Training in India. Indian J Palliat Care. 2015 Sep-Dec;21(3):257. doi: 10.4103/0973-1075.164904. PMID: 26600690; PMCID: PMC4617029. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4103/0973-1075.164904&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26600690&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 13. 13.Indian Association of Palliative Care. Centres offering MD/DNB in Palliative Medicine in India [Internet]. 8 Jun 2023. [Cited 18th Jul 2024]. Available from: Centres offering MD / DNB in Palliative Medicine in India - I A P C (palliativecare.in) 14. 14.Medical Council of India. Competency based undergraduate curriculum for the Indian medical graduate. 2018. [Cited 18th Jul 2023]. Available from: UG-Curriculum-Vol-III.pdf (nmc.org.in) 15. 15.Rao P. Addressing a Long-felt Need: Introducing Palliative Care for MBBS Students in the New Competency-Based Medical Education Curriculum. Indian J Palliat Care. 2019 Jul-Sep;25(3):359-360. doi: 10.4103/IJPC.IJPC\_108\_19. PMID: 31413448; PMCID: PMC6659518. [CrossRef](http://medrxiv.org/lookup/external-ref?access\_num=10.4103/IJPC.IJPC_108_19&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31413448&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 16. 16.Wilcock A, Twycross R, Toller CS. Introducing Palliative Care. 6th ed. Pharmaceutical Press; 2021 17. 17.Pallium India. An Indian Primer of Palliative Care. 1st ed. Pallium India; 2016 18. 18.Little, T. D., Chang, R., Gorrall, B. K., Waggenspack, L., Fukuda, E., Allen, P. J., & Noam, G. G. The retrospective pretest–posttest design redux: On its validity as an alternative to traditional pretest–posttest measurement. Int J Behav Dev. 2019 Oct 21;44(2). doi: 10.1177/0165025419877973. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0165025419877973&link_type=DOI) 19. 19.McBain RK, Sousa JL, Rose AJ, Baxi SM, Faherty LJ, Taplin C, Chappel A, Fischer SH. Impact of Project ECHO Models of Medical Tele-Education: a Systematic Review. J Gen Intern Med. 2019 Dec;34(12):2842–2857. doi: 10.1007/s11606-019-05291-1. Epub 2019 Sep 4. PMID: 31485970; PMCID: PMC6854140. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11606-019-05291-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 20. 20.Doherty M, Rayala S, Evans E, Rowe J, Rapelli V, Palat G. Using Virtual Learning to Build Pediatric Palliative Care Capacity in South Asia: Experiences of Implementing a Teleteaching and Mentorship Program (Project ECHO). JCO Glob Oncol. 2021 Feb;7:210–222. doi: 10.1200/GO.20.00481. PMID: 33555911; PMCID: PMC8081544. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1200/GO.20.00481&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33555911&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 21. 21.Doherty M, Modanloo S, Evans E, Rowe J, Newhook D, Palat G, Archibald D. Exploring Health Professionals’ Experiences With a Virtual Learning and Mentoring Program (Project ECHO) on Pediatric Palliative Care in South Asia. Glob Pediatr Health. 2021 Aug 31;8:2333794X211043061. doi: 10.1177/2333794X211043061. PMID: 34485624; PMCID: PMC8411613. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/2333794X211043061&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34485624&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 22. 22.Lynch-Godrei A, Sapkota S, Rowe J, Paudel BD, Aryal G, Doherty M. An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes. J Med Educ Curric Dev. 2024 Feb 22;11:23821205241234541. doi: 10.1177/23821205241234541. PMID: 38405367; PMCID: PMC10894557. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/23821205241234541&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=38405367&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 23. 23.Doherty M, Lynch-Godrei A, Azad T, Ladha F, Ferdous L, Ara R, Richardson K, Groninger H. Using Virtual Learning to Develop Palliative Care Skills Among Humanitarian Health Workers in the Rohingya Refugee Response in Bangladesh. J Med Educ Curric Dev. 2022 Aug 22;9:23821205221096099. doi: 10.1177/23821205221096099. PMID: 36032810; PMCID: PMC9403457. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/23821205221096099&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=36032810&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 24. 24.Rajagopal MR, Joranson DE. India: opioid availability. An update. J Pain Symptom Manage. 2007 May;33(5):615-22. doi: 10.1016/j.jpainsymman.2007.02.028. PMID: 17482057. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jpainsymman.2007.02.028&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17482057&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 25. 25.Lalloo C, Osei-Twum JA, Rapoport A, Vadeboncoeur C, Weingarten K, Veldhuijzen van Zanten S, Widger K, Stinson J. Pediatric Project ECHO®: A Virtual Community of Practice to Improve Palliative Care Knowledge and Self-Efficacy among Interprofessional Health Care Providers. J Palliat Med. 2021 Jul;24(7):1036–1044. doi: 10.1089/jpm.2020.0496. Epub 2020 Dec 16. PMID: 33326309; PMCID: PMC8215401. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/jpm.2020.0496&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33326309&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom) 26. 26.Yennurajalingam S, Amos CE Jr, Weru J, Addo Opare-Lokko EBVND, Arthur JA, Nguyen K, Soyannwo O, Chidebe RCW, Williams JL, Lu Z, Baker E, Arora S, Bruera E, Reddy S. Extension for Community Healthcare Outcomes-Palliative Care in Africa Program: Improving Access to Quality Palliative Care. J Glob Oncol. 2019 Jul;5:1–8. doi: 10.1200/JGO.19.00128. PMID: 31335237; PMCID: PMC6776016. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1200/JGO.19.00041&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F08%2F26%2F2024.08.26.24312585.atom)