Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

The Use of Conversational Agents in Self-Management: A Retrospective Analysis

View ORCID ProfileSelahattin Colakoglu, Mustafa Durmus, Zeynep Pelin Polat, Asli Yildiz, View ORCID ProfileEmre Sezgin
doi: https://doi.org/10.1101/2024.09.01.24312881
Selahattin Colakoglu
1Department of Clinical Development, Albert Health, Istanbul, Turkey
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Selahattin Colakoglu
  • For correspondence: selahattin.colakoglu{at}albert.health
Mustafa Durmus
1Department of Clinical Development, Albert Health, Istanbul, Turkey
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zeynep Pelin Polat
1Department of Clinical Development, Albert Health, Istanbul, Turkey
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Asli Yildiz
1Department of Clinical Development, Albert Health, Istanbul, Turkey
2School of Medicine, Biruni University, Istanbul, Turkey
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emre Sezgin
3The Abigail Wexner Research Institute, Nationwide Children’s Hospital, Columbus OH, USA
4The Ohio State University College of Medicine, Columbus OH, USA
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Emre Sezgin
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Understanding user engagement with conversational agents (CAs) in mobile health apps is crucial for improving sustained usage. We analyzed CA interactions in a mobile health app to identify usage patterns and potential barriers.

Materials and Methods Retrospective data from 100,571 active users of the Albert Health app in 2022 were analyzed. Interactions with CA were categorized by demographics (gender and age), interaction type (health information, medication-related, clinical parameters, and non-clinical), and engagement method (text, voice). Descriptive statistics were used to identify trends and patterns in app usage.

Results Out of the active users, 19,051 (18.9%) engaged with the CA. The majority were female (61%), with 43% aged 30-45 years and 23% older than 45 years. The analysis showed that 94.5% engaged in general health management, while 5.3% used disease-specific programs. Average usage per user was highest in cardiovascular and respiratory diseases. Interaction types varied, with health information and medication-related interactions. The varied messaging behavior suggests different user engagement levels, with some users seeking quick information and others engaging more deeply for health management. Engagement was high initially but decreased over time.

Discussion This study provides insights into user interactions with a healthcare CA, highlighting a preference for general health management and diverse usage patterns. The significant number of single-session users indicates potential barriers to sustained engagement, highlighting the need for strategies to enhance user experience and retention. Future research should investigate the CA’s performance, effectiveness and extend observations to broader healthcare contexts by using large language models.

Introduction

The growing demands on healthcare systems worldwide, increased prevalence of chronic diseases, and a push towards personalized patient care, necessitate innovative solutions.1 Conversational agents (CA), with their ability to automate routine interactions, offer a promising avenue to alleviate these pressures.2 They have the potential to impact healthcare by improving patients’ self-management and enhancing clinical practice by collecting and analyzing patient data, providing personalized feedback, and offering support for disease management and access to health information.3

With the increasing capabilities of eHealth and mobile health applications supported by AI, CAs have improved health communications.4 Literature presents that CAs have been tested in clinical settings for varying clinical phases including screening, monitoring, patient education and lifestyle coaching.5–8 CAs show promise in integrating into clinical practice, partnering with health professionals to monitor and assist patients, streamline clinical processes, and promote health, ultimately aiming to reduce costs, enhance operational efficiency, and elevate the quality of patient care outcomes.9 They have been used, as telemedicine tools, for completing routine check-ins and health-specific tasks, which supports chronic disease management, specifically with symptom tracking and medical adherence by being implemented into clinical care.9 Furthermore, they contribute to patient-generated health data and shared decision-making by informing HCPs about health events outside the hospital.10,11

Similarly, chatbots have been increasingly integrated into home care settings to enhance patient communication and care management. Recent studies demonstrated that they have been utilized for enhancing patient and family engagement while communicating medical test results12, for post-intervention follow-up in various healthcare interventions13, and for addressing health-seeking behaviors and improving patient outcomes.2,14,15 Additionally, they are being explored for educating chronic patients and their caregivers, demonstrating their potential to deliver personalized health information.2,16

However, to understand the potential benefits of CA in healthcare, it is essential to understand user interaction and adoption in a real-world setting. Current literature reported limited data on CA use and interactions in the medical field.17 The evidence of CA use in clinical contexts is scarce, underlining the need for understanding the characteristics of CAs.18 In addition, the current studies with CAs concentrated on text-based and smartphone app–delivered CAs with a focus on small case studies, suggesting further work on the feasibility, acceptability, and effectiveness of different CA formats.1,19,20

To fill this gap, we conducted a retrospective analysis of the usage patterns of a multimodal (voice and text) CA which is provided via a mobile application (Albert Health app) designed for health and chronic disease management.21 By analyzing the interaction data, we aim to understand and generate insights about the potential value and usage of CAs in healthcare and highlight the findings from CA use that promote user engagement and retention.

Materials and Methods

For our study, we utilized a dataset composed of de-identified user interactions with the Albert CA from the year 2022. We followed a retrospective analysis, which encompassed user engagement with Albert across both iOS and Android platforms, and in two languages, English and Turkish.

Voice-interactive mobile health assistant

Our CA (referred as “Albert” from hereon) is designed as a health assistant operating over a mobile app available in English and Turkish languages. The app is free to download and use from the Google Play Store and Apple App Store, but also available for referral by healthcare providers to invite patients to use the app. In partnership with public and private health institutions and industry, Albert is used to provide services to around 150,000 users.22

Albert is built using conversational development platforms and services, including Google Dialogflow and Rasa23,24, which provide natural language processing capabilities such as intent recognition and entity extraction. The app also uses Google Speech-to-Text (STT) and Google Text-to-Speech (TTS), to enable voice input and output and Speech Synthesis Mark-up Language (SSML) to enhance Albert’s natural and expressive responses. The main service that includes these NLP (Rasa and ML frameworks provided by Dialogflow) and STT (Google Speech) models which communicates with the mobile application and makes the necessary guidance, is called AI Engine. It sends the audio bytes in stream format to the speech-to-text models and forwards the resulting text to NLP models. See figure 1 and “An example of user interaction” section for flow of user engagement and explanation (Fig. 1).

Figure
  • Download figure
  • Open in new tab

An example of user interaction

  1. The user initiates an interaction with the mobile application by using a voice command, such as "Record my pulse as 100." This audio input is captured by the app’s interface.

  2. The audio data is then sent to the Google Cloud Speech API, a service that can process spoken language into text. The API uses advanced machine learning models to accurately transcribe spoken words into written text.

  3. The transcribed text, which reads "Record my pulse as 100," is then sent from the Google Cloud Speech API back to the application’s processing system.

  4. The application displays the transcribed text within its graphical user interface.

  5. This transcribed text is sent to the AI engine. The AI engine passes text to the NLP model to analyze the structure and semantics of the sentence to extract meaningful information.

  6. The NLP model identifies the intent, entities, and proposed actions from the user’s command. Intent refers to the user’s objective (e.g., recording health data), entities are the relevant data points or parameters involved (e.g., the pulse rate), and actions are the operations the system needs to perform (e.g., log the pulse rate in the user’s health records).

  7. The extracted intent, entities, and actions are then processed by conversational AI frameworks such as RASA or Dialogflow. These frameworks manage the conversational flow and ensure that the user’s command is executed correctly. They are capable of handling complex dialogues, maintaining context, and managing the conversation state.

  8. In the mobile application, once the intent and entities are confirmed, the app would proceed to record the user’s pulse rate as 100 in their personal health record. The graphical interface serves as a confirmation and error-checking mechanism, allowing users to verify that their voice command was understood and executed correctly.

The app is used for general health management or disease-specific self-management purposes. Disease-specific self-management programs (DMPs) are designed to address a range of health conditions across various medical specialties, including endocrinology (e.g., Diabetes Mellitus, Growth Disorders), cardiology (e.g., Hypertension, Heart Failure), nutrition (e.g., dietary management for chronic illnesses), neurology (e.g., Multiple Sclerosis), and respiratory medicine (e.g., Asthma) Each DMP was customized by considering the needs of specific patient groups and some have a disease-specific CA which lets users get information about their chronic diseases and record some disease-specific parameters. Non-DMPs are designed for general health support and promote healthy behavior without focusing on any certain disease.

Intents

Intents were divided into four groups: Access to health information, treatment adherence, clinical parameter tracking, and others. All conversations about health information seeking, such as FAQs, tips, pharmacies, appointments, medication info, and asking for advice, were included in the “Health Information” group. All conversations, such as medication reminders, were included in the “Medication adherence” group. All conversations that help clinical decision making, such as Blood Pressure, Blood Glucose Level, Body Mass Index, and Disease Journal, were included in the “Clinical decision support” group. Fallback (responses when the agent doesn’t understand a query), smalltalk (casual conversations), technical support, and guidance were included in the "Others" group (Table 1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1. Intent groups, explanations and examples

Recruitment and study setting

We included users who engage with Albert across both iOS and Android platforms, and in two languages, English and Turkish in 2022. To recruit patients for these programs, three main methods are used: patients download the app themselves from the store, healthcare professionals invite patients during hospital visits, and insurance companies recommend the app as part of their disease management initiatives. Our inclusion criteria is users from Turkey interacted with the conversational agent in 2022 at least one-time. We excluded those who entered an invalid birthdate (> 2022, < 1900).

During the installation, users were requested to provide consent for research purposes. This consent process was designed to ensure that participants were fully informed about the nature, scope, and implications of data collection and subsequent analysis activities associated with our research. Following that, users completed an onboarding survey about their demographics and disease-related conditions the first time entering the app. This study received approval from the Biruni University Ethics Committee (Approval number: 2023/83-18). During the use period, users received a one-time reminder notification on the 8th day after the installation.

Data privacy

In adherence to privacy standards, all data procured for the study were removed from personal identifiers, such as names and contact details. To further safeguard participant confidentiality, each user was assigned a distinctive identifier. The application, purpose-built for health and chronic disease self-management, autonomously recorded user interactions with the CA.

Encryption protocols were employed to ensure the privacy of the data. Throughout the analysis, user anonymity was preserved via the use of the aforementioned unique identifiers. Our analytical focus was restricted to pre-existing data, with no additional data collection undertaken.

Data analysis

We analyzed the data from 19,016 users who completed the tutorial of CA and used the chat function within the app between January 1, 2022, and December 31, 2022. Users were included as active users if they entered the app at least once in 2022, and chat users if they used Albert in 2022. The data included user demographics, disease management program (DMP) participation, and detailed user engagement data such as the number and types of interactions with Albert. We conducted descriptive analysis and analyzed the frequency and mode of user-initiated interactions (i.e., touch or voice) and the distribution of user interactions over time.

Results

Out of the 100,571 active users of Albert Health app between January 1, 2022, and December 31, 2022, 19,016 (18.9%) completed the tutorial and interacted with Albert.

Demographics

In the demographic profile of the study’s participants, 61% (7,717) of the users identified as female, while 39% (4,898) were male, and gender was not reported for 34% (6,436) of users. Age-wise, 42% (7,918) did not report their age. Among those who did, 8% (876) were between 0-15 years, 25% (2,731) were between 15-30 years, the largest age group was 30-45 years at 45% (4,979), and 23% (2,547) were 45 years or older (Table 2).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2: User Demographics

Health condition-specific findings

Within the study categorization, users engaged in health condition-specific programs—including cardiology, oncology, neurology, and endocrinology—represented 5.34% (1,015 users), with a total of 5.6% (5,369 interactions), averaging 5.3 interactions per user. General health management was utilized by 94.66% (18,001 users), accounting for 89.5% of interactions, with an average of 4.9 interactions per user (Table 3). Regarding the types of interactions, health information queries constituted the majority (27%, n=24,921), followed by clinical parameters at 20% (n=18,378), and technical support queries at 18% (n=16,521). Casual small talk comprised 14% (n=12,949), while fallback queries were at 12% (n=11,825). The least engaged category was medication-related, with 9% (n=8,889) (Table 3).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3: Engagement Rates and Program

Engagement and interaction

Users interacted with Albert most frequently (47%) for getting health information, followed by medication-related topics (36%) and clinical parameters (17%) in the clinical context (Table 4).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 4: Interaction Categories and Initiation Methods

Of the interactions related to getting health information, 56% were initiated by touch (tapping the app on the screen), and 44% by voice. Interactions related to medication tracking and clinical parameters, frequencies were also similar to getting health information, as mostly initiated via touchscreen. Among “non-clinical” types of interactions, voice-based interactions were 2 times higher than touch-based interactions (68% vs. 32%). Out of those, 11,231 users engaged for just one session (single session users) and 7,785 users with two or more sessions (multi-session users). Similarly, 10,268 users sent 1 or 2 chat messages, while 8,748 users sent two or more messages. In the first 50 days after registration, there was a peak on the first day with the most significant number of sessions made and a smaller peak on around day 10 (after reminder), and then a decreasing trend was observed. Our observation was intentionally limited to 50 days, as we did not observe any changes for the following days (Fig. 2).

Figure
  • Download figure
  • Open in new tab

Discussion

Our study underscores the increasing role of CA in the healthcare domain and prevalence of its use by patient populations, particularly in facilitating chronic disease management and general health monitoring.

The analysis of user demographics revealed a dominant engagement among female users, a trend that may reflect gender differences in health-seeking behavior and the proactive management of health via mobile technology.25 The less frequent disclosure of age could suggest privacy concerns or a lower perceived relevance of age information in app interaction.26,27 However, the reported age distribution were similar with the CA studies that most of the participants were young and middle aged adults3, indicating a similar user profile among CA users for CDM. Intriguingly, the segment reporting on behalf of young children underscores the app’s indirect reach to pediatric health management.

The preference for general health management programs over disease-specific ones could indicate a user tendency toward preventive health measures3 and the convenience of accessing a broad spectrum of health resources in a single platform.28 The considerable engagement in category interactions, which encapsulate a diverse range of topics beyond health information, medication, and clinical parameters, including small talk (casual conversations), technical support, and guidance. That indicates the versatility of the CA in addressing a wide array of user needs and questions might be preferable.29 In addition, Fallback instances demonstrated that the most common issue the message has not been truly understood by CA. This can be due to two reasons: first, the user is not synced with the assistant and terminating session before the message complete; second, the failure of speech-to-text in cases where the user mentions medical terminology or infrequently used drug names (for example, "Hodgkin’s lymphoma"). Other cases include the user not saying anything meaningful or using slang. Such instances have also been observed in the literature with earlier CA encounters in healthcare, failure of understanding statement or context.30,31 This shows there is a room for improvement in healthcare context when developing such tools and there is need for continuous evaluation of CAs. In addition, large language models can improve natural language understanding in cases where medical terminology was not captured.

The interaction patterns present a significant insight. While screen touch is the predominant mode of initiating interactions, the substantial use of voice commands, especially in the small talk and fallback (+80%) categories, signals user adaptability and the potential for more hands-free, accessible app navigation in certain contexts. One interesting note on interactions with voice-activated interfaces is that there is a notable inclination towards anthropomorphizing the technology, with users frequently initiating conversations with social inquiries and greetings, treating the system as a conversational partner32. Additionally, the voice interface serves as a primary channel for technical support requests, diverging from clinical queries. These trends could inform enhancements in the app’s design to better accommodate and encourage voice interactions, possibly reflecting user convenience or the necessity for accessibility in certain scenarios.1,33

Retention

The fact that a significant number of users (n=11,251) engaged with the app for only a single session suggests there may be barriers to sustained use, such as user expectations not being met, usability issues, or a lack of perceived value in continued interaction.34–36

Contrastingly, 7,785 users who engaged in two or more sessions represent a more committed segment, potentially indicative of a group finding ongoing utility in the app’s features. This dichotomy presents an opportunity for targeted user experience improvements and personalization to convert single-session users into regular users. Similarly, the messaging behavior—where 10,268 users sent only 1 or 2 messages, while 8,748 users had a higher engagement with two or more messages—highlights varying levels of interaction depth. It could reflect different user needs or satisfaction levels with the information and support provided.37 For instance, users sending fewer messages might be utilizing the app for quick, specific information, while those with more messages could be leveraging it for more comprehensive health management. Understanding the drivers behind these different usage patterns could inform the development of features towards both brief interactions and more detailed health discussions, optimizing the CA to serve a spectrum of user engagement preferences.1,37

Finally, the initial surge in user engagement immediately post-registration, with a second, albeit smaller peak around day 10, aligns with typical digital engagement patterns.38 This might indicate an initial curiosity or a critical period where users explore the app’s features, followed by a decline as the novelty wears off. Identifying factors that contribute to sustained engagement beyond this period could be pivotal in increasing the long-term adoption and therapeutic impact of health-related CAs. Strategies to retain users could include personalized health insights, reminders for health tracking, or gamification of health tasks to maintain a consistent user-app interaction trajectory.39,40

Limitations

The study is subject to several limitations. Firstly, the data are observational and based on user interactions within a single application, limiting the generalizability of the findings to other CAs or health apps. Secondly, the reliance on self-reported data and the substantial proportion of users not disclosing their gender or age could introduce bias and affect the accuracy of demographic insights. Additionally, the high rate of single-session users might indicate a selection bias, as the data primarily represents users who chose to engage with the app, potentially excluding those who discontinued use after initial download. The study also lacks qualitative data on user satisfaction and reasons for discontinuation, which could provide deeper insights into user behavior and preferences. Finally, the retrospective nature of the analysis limits the ability to establish causal relationships between app features and user engagement patterns, necessitating further research to explore these dynamics comprehensively.

Conclusions

The study provides insights into user engagement with a healthcare CA, indicating a predominant use for general health management and a diverse interaction pattern, which can be complementary to current telemedicine applications. These findings underscore the need for personalized and user-friendly features to address varying user needs and preferences, ultimately enhancing sustained engagement and effectiveness of health CAs. Further research is recommended to explore the causal factors influencing app usage and to generalize these findings to other healthcare applications.

Data Availability

All data produced in the present study are not available due to ethical committee approval

Contributions

S. Colakoglu: Conceptualization (lead); writing – original draft (lead); formal analysis (lead); writing – review and editing (equal). M. Durmus: Software (lead); Data curation (lead); writing – review and editing (equal). Z.P. Polat: Writing – review and editing (equal). A. Yildiz: Writing – original draft (supporting); Writing – review and editing (supporting). E. Sezgin: Supervision (lead); Conceptualization (supporting); Writing – review and editing (supporting).

Disclosure Statement

S.C., Z.P.P., M.D. and A.Y. are employees of Albert Health (developer of the mobile app). No other disclosures were reported.

Funding Information

No funding was received for this article.

References

  1. 1.↵
    Bérubé C, Schachner T, Keller R, et al. Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review. J Med Internet Res 2021;23(3):e25933; doi: 10.2196/25933.
    OpenUrlCrossRef
  2. 2.↵
    Aggarwal A, Tam CC, Wu D, et al. Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review. J Med Internet Res 2023;25:e40789; doi: 10.2196/40789.
    OpenUrlCrossRefPubMed
  3. 3.↵
    Griffin AC, Xing Z, Khairat S, et al. Conversational Agents for Chronic Disease Self-Management: A Systematic Review. AMIA Annu Symp Proc 2020;2020:504–513.
    OpenUrl
  4. 4.↵
    Parmar P, Ryu J, Pandya S, et al. Health-focused conversational agents in person-centered care: a review of apps. NPJ Digit Med 2022;5(1):21; doi: 10.1038/s41746-022-00560-6.
    OpenUrlCrossRef
  5. 5.↵
    Owens OL, Felder T, Tavakoli AS, et al. Evaluation of a Computer-Based Decision Aid for Promoting Informed Prostate Cancer Screening Decisions Among African American Men: iDecide. Am J Health Promot 2019;33(2):267–278; doi: 10.1177/0890117118786866.
    OpenUrlCrossRef
  6. 6.
    Morris RR, Kouddous K, Kshirsagar R, et al. Towards an Artificially Empathic Conversational Agent for Mental Health Applications: System Design and User Perceptions. J Med Internet Res 2018;20(6):e10148; doi: 10.2196/10148.
    OpenUrlCrossRef
  7. 7.
    Chavez-Yenter D, Kimball KE, Kohlmann W, et al. Patient Interactions With an Automated Conversational Agent Delivering Pretest Genetics Education: Descriptive Study. J Med Internet Res 2021;23(11):e29447; doi: 10.2196/29447.
    OpenUrlCrossRef
  8. 8.↵
    Fadhil A, Wang Y, Reiterer H. Assistive Conversational Agent for Health Coaching: A Validation Study. Methods Inf Med 2019;58(1):9–23; doi: 10.1055/s-0039-1688757.
    OpenUrlCrossRefPubMed
  9. 9.↵
    Xu L, Sanders L, Li K, et al. Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review. JMIR Cancer 2021;7(4):e27850; doi: 10.2196/27850.
    OpenUrlCrossRef
  10. 10.↵
    Sezgin E, Hussain S-A, Rust S, et al. Extracting Medical Information From Free-Text and Unstructured Patient-Generated Health Data Using Natural Language Processing Methods: Feasibility Study With Real-world Data. JMIR Form Res 2023;7:e43014; doi: 10.2196/43014.
    OpenUrlCrossRef
  11. 11.↵
    Park YR, Lee Y, Kim JY, et al. Managing Patient-Generated Health Data Through Mobile Personal Health Records: Analysis of Usage Data. JMIR Mhealth Uhealth 2018;6(4):e89; doi: 10.2196/mhealth.9620.
    OpenUrlCrossRef
  12. 12.↵
    Schmidlen T, Jones CL, Campbell-Salome G, et al. Use of a chatbot to increase uptake of cascade genetic testing. J Genet Couns 2022;31(5):1219–1230; doi: 10.1002/jgc4.1592.
    OpenUrlCrossRef
  13. 13.↵
    Geoghegan L, Scarborough A, Wormald JCR, et al. Automated conversational agents for post-intervention follow-up: a systematic review. BJS Open 2021;5(4); doi: 10.1093/bjsopen/zrab070.
    OpenUrlCrossRef
  14. 14.↵
    Kocaballi AB, Sezgin E, Clark L, et al. Design and Evaluation Challenges of Conversational Agents in Health Care and Well-being: Selective Review Study. J Med Internet Res 2022;24(11):e38525; doi: 10.2196/38525.
    OpenUrlCrossRef
  15. 15.↵
    Yang S, Lee J, Sezgin E, et al. Clinical Advice by Voice Assistants on Postpartum Depression: Cross-Sectional Investigation Using Apple Siri, Amazon Alexa, Google Assistant, and Microsoft Cortana. JMIR Mhealth Uhealth 2021;9(1):e24045; doi: 10.2196/24045.
    OpenUrlCrossRef
  16. 16.↵
    Kataoka Y, Takemura T, Sasajima M, et al. Development and Early Feasibility of Chatbots for Educating Patients With Lung Cancer and Their Caregivers in Japan: Mixed Methods Study. JMIR Cancer 2021;7(1):e26911; doi: 10.2196/26911.
    OpenUrlCrossRef
  17. 17.↵
    Oh YH, Chung K, Ju DY. Differences in Interactions with a Conversational Agent. Int J Environ Res Public Health 2020;17(9); doi: 10.3390/ijerph17093189.
    OpenUrlCrossRef
  18. 18.↵
    Laranjo L, Dunn AG, Tong HL, et al. Conversational agents in healthcare: a systematic review. J Am Med Inform Assoc 2018;25(9):1248–1258; doi: 10.1093/jamia/ocy072.
    OpenUrlCrossRefPubMed
  19. 19.↵
    Tudor Car L, Dhinagaran DA, Kyaw BM, et al. Conversational Agents in Health Care: Scoping Review and Conceptual Analysis. J Med Internet Res 2020;22(8):e17158; doi: 10.2196/17158.
    OpenUrlCrossRef
  20. 20.↵
    Ding H, Simmich J, Vaezipour A, et al. Evaluation framework for conversational agents with artificial intelligence in health interventions: a systematic scoping review. J Am Med Inform Assoc 2024;31(3):746–761; doi: 10.1093/jamia/ocad222.
    OpenUrlCrossRef
  21. 21.↵
    Anonymous. Albert Health. n.d. Available from: https://albert.health [Last accessed: 6/4/2024].
  22. 22.↵
    Anonymous. TurkMIA2023-Proceedings. n.d. Available from: https://turkmia.net/TurkMIA2023-Proceedings [Last accessed: 6/4/2024].
  23. 23.↵
    Anonymous. Dialogflow. n.d. Available from: https://cloud.google.com/dialogflow [Last accessed: 6/4/2024].
  24. 24.↵
    Bocklisch T, Faulkner J, Pawlowski N, et al. Rasa: Open Source Language Understanding and Dialogue Management. arXiv [csCL] 2017.
  25. 25.↵
    Link E, Baumann E. A Comparison of Women’s and Men’s Web-Based Information-Seeking Behaviors About Gender-Related Health Information: Web-Based Survey Study of a Stratified German Sample. J Med Internet Res 2023;25:e43897; doi: 10.2196/43897.
    OpenUrlCrossRef
  26. 26.↵
    Zhou L, Bao J, Watzlaf V, et al. Barriers to and Facilitators of the Use of Mobile Health Apps From a Security Perspective: Mixed-Methods Study. JMIR Mhealth Uhealth 2019;7(4):e11223; doi: 10.2196/11223.
    OpenUrlCrossRef
  27. 27.↵
    Kao C-K, Liebovitz DM. Consumer Mobile Health Apps: Current State, Barriers, and Future Directions. PM R 2017;9(5S):S106–S115; doi: 10.1016/j.pmrj.2017.02.018.
    OpenUrlCrossRef
  28. 28.↵
    Gajarawala SN, Pelkowski JN. Telehealth Benefits and Barriers. J Nurse Pract 2021;17(2):218–221; doi: 10.1016/j.nurpra.2020.09.013.
    OpenUrlCrossRefPubMed
  29. 29.↵
    Scholten MR, Kelders SM, Van Gemert-Pijnen JE. Self-Guided Web-Based Interventions: Scoping Review on User Needs and the Potential of Embodied Conversational Agents to Address Them. J Med Internet Res 2017;19(11):e383; doi: 10.2196/jmir.7351.
    OpenUrlCrossRefPubMed
  30. 30.↵
    Palanica A, Thommandram A, Lee A, et al. Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names. NPJ Digit Med 2019;2:55; doi: 10.1038/s41746-019-0133-x.
    OpenUrlCrossRef
  31. 31.↵
    Sezgin E, D’Arcy S. Editorial: Voice Technology and Conversational Agents in Health Care Delivery. Front Public Health 2022;10:887492; doi: 10.3389/fpubh.2022.887492.
    OpenUrlCrossRef
  32. 32.↵
    David-Ignatieff A, Buzeta C, De Pelsmacker P, et al. This embodied conversational agent looks very human and as old as I feel! The effect of perceived agent anthropomorphism and consumer-agent age difference on brand attitude. Journal of Marketing Communications n.d.;1–29; doi: 10.1080/13527266.2023.2199026.
    OpenUrlCrossRef
  33. 33.↵
    Zamora J. I’m Sorry, Dave, I’m Afraid I Can’t Do That: Chatbot Perception and Expectations. In: Proceedings of the 5th International Conference on Human Agent Interaction. HAI ’17 Association for Computing Machinery: New York, NY, USA; 2017; pp. 253–260; doi: 10.1145/3125739.3125766.
    OpenUrlCrossRef
  34. 34.↵
    Druce KL, Dixon WG, McBeth J. Maximizing Engagement in Mobile Health Studies: Lessons Learned and Future Directions. Rheum Dis Clin North Am 2019;45(2):159–172; doi: 10.1016/j.rdc.2019.01.004.
    OpenUrlCrossRefPubMed
  35. 35.
    Chaix B, Bibault J-E, Pienkowski A, et al. When Chatbots Meet Patients: One-Year Prospective Study of Conversations Between Patients With Breast Cancer and a Chatbot. JMIR Cancer 2019;5(1):e12856; doi: 10.2196/12856.
    OpenUrlCrossRef
  36. 36.↵
    Perski O, Crane D, Beard E, et al. Does the addition of a supportive chatbot promote user engagement with a smoking cessation app? An experimental study. Digit Health 2019;5:2055207619880676; doi: 10.1177/2055207619880676.
    OpenUrlCrossRef
  37. 37.↵
    Hauser-Ulrich S, Künzli H, Meier-Peterhans D, et al. A Smartphone-Based Health Care Chatbot to Promote Self-Management of Chronic Pain (SELMA): Pilot Randomized Controlled Trial. JMIR Mhealth Uhealth 2020;8(4):e15806; doi: 10.2196/15806.
    OpenUrlCrossRefPubMed
  38. 38.↵
    Anonymous. Global iOS App Retention Rate 2023. n.d. Available from: https://www.statista.com/statistics/1248207/ios-app-retention-rate/ [Last accessed: 6/4/2024].
  39. 39.↵
    Mustafa AS, Ali N ’ashikin, Dhillon JS, et al. User Engagement and Abandonment of mHealth: A Cross-Sectional Survey. Healthcare (Basel) 2022;10(2); doi: 10.3390/healthcare10020221.
    OpenUrlCrossRef
  40. 40.↵
    Bitrián P, Buil I, Catalán S. Enhancing user engagement: The role of gamification in mobile apps. J Bus Res 2021;132:170–185; doi: 10.1016/j.jbusres.2021.04.028.
    OpenUrlCrossRef
Back to top
PreviousNext
Posted September 02, 2024.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
The Use of Conversational Agents in Self-Management: A Retrospective Analysis
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
The Use of Conversational Agents in Self-Management: A Retrospective Analysis
Selahattin Colakoglu, Mustafa Durmus, Zeynep Pelin Polat, Asli Yildiz, Emre Sezgin
medRxiv 2024.09.01.24312881; doi: https://doi.org/10.1101/2024.09.01.24312881
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
The Use of Conversational Agents in Self-Management: A Retrospective Analysis
Selahattin Colakoglu, Mustafa Durmus, Zeynep Pelin Polat, Asli Yildiz, Emre Sezgin
medRxiv 2024.09.01.24312881; doi: https://doi.org/10.1101/2024.09.01.24312881

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Health Informatics
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)