Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

GPT-4 and Neurologists in Screening for Mild Cognitive Impairment in the Elderly: A Comparative Analysis Study

Hao Yang, Ruihan Wang, Changyu Wang, Hui Gao, Hanlin Cai, Fengying Zhang, Jialin Liu, Siru Liu
doi: https://doi.org/10.1101/2023.12.02.23299327
Hao Yang
1Information Center, West China Hospital, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ruihan Wang
2Department of Neurology, West China Hospital, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Changyu Wang
3West China College of Stomatology, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hui Gao
2Department of Neurology, West China Hospital, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hanlin Cai
2Department of Neurology, West China Hospital, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fengying Zhang
4Department of Nursing, West China School of Nursing, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jialin Liu
1Information Center, West China Hospital, Sichuan University, Chengdu, China
5Department of Medical Informatics, West China Medical School, Sichuan University, Chengdu, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: DLJL8{at}163.com siru.liu{at}vumc.org
Siru Liu
6Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: DLJL8{at}163.com siru.liu{at}vumc.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Summary

This study evaluates the efficacy of GPT-4 in screening for Mild Cognitive Impairment (MCI) in the elderly, comparing it with junior neurologists. MCI is a precursor to dementia, presenting a significant public health concern due to the rising global aging population. With over 55 million people affected by dementia worldwide, early detection is essential for timely intervention. Common screening tools, while effective, are resource-intensive, highlighting the need for more efficient methods. The study used an exploratory design with 174 participants, comparing the performance of GPT-4 against three junior neurologists. The GPT-4 model was trained using a set of language analysis indicators to evaluate the severity of MCI. Participants’ test texts and voices were grouped and independently assessed by the neurologists and the GPT-4 model. The neurologists and the GPT-4 model independently assessed the participants’ test corpus. The neurologists assessed both the text and voice of the test, while the GPT model assessed the text only. Results showed that the GPT-4 model had higher accuracy (0.81) compared to the neurologists (ranging from 0.41 to 0.49). GPT-4 demonstrated better discrimination of MCI with significant statistical difference (p < 0.001). The study also developed a clinical risk assessment nomogram based on the top ten weighted features from GPT-4’s analysis, aiding in MCI patient evaluation. In conclusion, the GPT-4 model shows promise as a diagnostic aid for MCI, potentially improving patient outcomes and reducing healthcare burdens. However, its practical applicability in real-world scenarios requires further investigation and clinical validation.

Introduction

The growing global aging population has brought Mild Cognitive Impairment (MCI) into sharp focus as a critical public health issue. MCI is increasingly recognized as the precursor stage to dementia, with a considerable risk of progression to advanced dementia [1]. Unfortunately, the absence of specific pharmaceutical treatments for MCI underscores the critical need for early detection and timely intervention [2,3]. The World Alzheimer Report 2023 emphasizes the growing challenge of dementia, with over 55 million people affected worldwide and a rising incidence rate [4,5]. The World Health Organization (WHO) estimates that by 2030, the number of people with dementia will reach 75 million, with the associated care costs expected to soar to 2 trillion USD. This escalation poses substantial societal and economic burdens [6]. Thus, early detection of cognitive impairments is vital for providing appropriate interventions and care, particularly for the aging population [7].

Early and accurate identification of cognitive changes using straightforward tools is key to guiding individuals towards more comprehensive neurocognitive evaluations and the formulation of treatment plans. Common screening instruments include the Hasegawa Dementia Scale-revised (HDS-R) [8,9], the Mini-Mental State Examination (MMSE) [8,10], Addenbrooke’s Cognitive Examination (ACE)-revised [8,11], and the Montreal Cognitive Assessment (MoCA) [12]. While these assessments have been adapted for simplicity, they still impose significant demands on healthcare providers and financial resources. Challenges such as healthcare provider shortages and time and financial constraints complicate these assessments. Consequently, there is a pressing need for an intelligent dementia screening tool that can alleviate the strain on healthcare systems and enable early and effective management of MCI [13].

Recent advancements in AI offer promise in addressing these challenges. AI’s role in healthcare is expanding, particularly in diagnostics and decision-making [14]. Current early screening approaches for cognitive impairments include using digital tools like tablet computers [11,12,15], virtual reality [16–18], and machine interactions with robots. These methods contrast with the more complex procedures typically conducted by physicians [19]. AI algorithms analyze vast patient data, enhancing the accuracy of clinical decisions and improving health outcomes. This technology also plays a crucial role in improving patient safety, optimizing health outcomes, and transforming clinical decision-making [20]. AI-based automatic screening for MCI offers the promise of enhancing diagnostic accuracy while reducing healthcare costs. Detecting pathological changes at their earliest stages could improve the outcomes of both pharmacological and non-pharmacological treatments. Therefore, developing a more sensitive, less invasive, cost-effective, and user-friendly diagnostic tool for MCI is of utmost importance.

This study aims to explore the potential of AI, particularly GPT models like ChatGPT, in the early detection of MCI. Given AI’s burgeoning role in healthcare, this research seeks to evaluate the accuracy, reliability, and practicality of using these models for MCI screening. This approach could provide an efficient and accessible method for early MCI detection, offering significant implications for healthcare systems and patient outcomes globally.

Methods

Study Design

This research was an exploratory study involving patients with MCI and normal cognition (CN) older people.

Dataset Descriptions

We included a total of 174 subjects from the DementiaBank English Protocol Delaware Corpus [16] and the DementiaBank English Pitt Corpus [17,18]. 66 MCI subjects and 108 CN subjects were included [21].

GPT4 Model

We employed the pre-existing GPT training model. The training process can be outlined as follows: Drawing on information from previously published studies, we meticulously defined essential language analysis indicators, encompassing lexical features, syntactic and grammatical attributes, and semantic characteristics, resulting in a set of seven core indicators (refer to Supplementary Materials). Upon completion of Step 1 training, participants in the study received Feedback 1, comprising more comprehensive features related to Mild Cognitive Impairment (MCI). These insights from the feedback were thoughtfully considered in new crafting prompts for Step 2. Step 2 was devised based on feedback data acquired from Feedback 2, which was utilized to generate entirely new prompts. In this phase, we extracted 21 indicators for evaluating the severity of MCI from MCI-related information (see Supplementary Materials) and established a scoring system to effectively measure the severity. Subsequently, GPT-4 gained the capability to autonomously design prompts, resulting in the creation of three distinct prompts that were later amalgamated. Moreover, the 21 indicators obtained from GPT-4 underwent statistical analysis. This ultimately culminated in the development of the GPT-4 Model [21].

Grouping of Test Materials

A cleaned 174 copies of the test text and voice material were put together, of which 66 were mildly cognitively impaired and 108 were cognitively normal participants. These participants were included in each sample group so that neurologists could assess their cognitive status. The test texts and voice in each group were randomly numbered, and there were 4 groups. Each psychiatrist independently evaluated the 4 groups of test text material, and each group was evaluated approximately 7 days apart to minimize subjective bias on the part of the evaluator.

Neurologist Selection

In this study, a purposive sampling method was used to select neurologists to ensure an accurate representation of the target population. As screening for cognitive impairment is typically carried out by junior neurologists and neurologist assistants, specific criteria were used to select participants. These criteria included the following qualifications 1. less than 5 years of professional experience in the field; 2. possession of an MD degree in neurology; 3. affiliation with A-level tertiary hospitals, which represent the highest-ranking healthcare institutions in China; 4. proficiency in English; and 5. willingness to participate in the study. Ultimately, three neurologists met these criteria and were selected. All of the selected neurologists have the necessary skills to detect mild cognitive impairment and joined the study group after qualifying.

Statistics Analysis

Descriptive statistics were conducted to analyze each variable in each group. The calculations included mean, standard deviation, median, interquartile range, minimum and maximum values. Normal distribution and homogeneity of variance tests were also performed for all variables. For the analysis of continuous variables, one-way analysis of variance (ANOVA) [22] was used as the method of statistical analysis between groups. Chi-squared tests were used for statistical analysis to compare classification results between different neurologists and the GPT-4. All statistical calculations were performed using the Python programming language, implementing the SciPy and NumPy libraries to perform one-way ANOVA and chi-squared tests. Finally, violin plots were used to visually compare the level of concentration and dispersion for each variable.

Ethical

The data utilized in this research was acquired from the publicly available DementiaBank dataset archived by TalkBank. TalkBank adheres to its own Code of Ethics, which supplements recognized professional guidelines such as the American Psychological Association Code of Ethics and the American Anthropological Association Code of Ethics [23], without replacing them. Importantly, the data does not include personal patient information and thus does not necessitate ethical approval or individual patient consent. Furthermore, all protected health information was appropriately anonymized to comply with data protection regulations.

Results

A total of three junior neurologists, one male and two females, participated in the study. Their mean age was 27 years (±2.8) and their mean clinical experience in neurology was 12 months. The characteristics of the neurologists are shown in Table 1.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1. Characteristic of neurologists’ participants in the study.

Model performance

We used the pre-trained completed GPT4 model and Table 2 shows the results of the GPT4 model. Its F1 scores for the test and training sets are 0.88 and 0.77, with accuracies of 0.92 and 0.81, respectively. The receiver operating characteristic curve is 0.86, reflecting the model’s ability to discriminate between the data on the test set. The DCA curve [24] for the GPT-4 model shows a significant net benefit, suggesting that the use of the model in medical decision making can have practical benefits. In particular, the GPT-4 model demonstrated excellent performance over a specific range of decision thresholds, providing a significant advantage over no-action or other potential models.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2. The classification results of the GPT-4 model on the training and test sets.

Top 10 feature for determining MCI

Based on the features returned by the GPT-4 results, we built a logistic model to obtain the feature weights. This represents the contribution of the different features in the model to the discrimination of MCI. These coef_ values were then sorted to determine which features contributed most to the discrimination of MCI. Finally, the top ten features with the most significant contributions are shown in Figure 3. These features have significant weights, highlighting their central role in the predictive ability of the GPT-4 model for the discrimination of MCI.

Figure 1.
  • Download figure
  • Open in new tab
Figure 1.

Participant inclusion and exclusion

Figure 2.
  • Download figure
  • Open in new tab
Figure 2.

The ROC and DCA curves of the model on the test set.

Figure 3.
  • Download figure
  • Open in new tab
Figure 3.

The top ten features contributing the most to distinguishing MCI

Feature Analysis and Distribution Disparities between MCI and NC

For the top ten ranked features, we used ANOVA to assess whether there were significant differences between patients with mild cognitive impairment (MCI) and those with cognitive normal (NC). This analysis included measures such as median, interquartile range and shape of distribution. The results show that all of these features yielded p-values below 0.05 (see Table 4), indicating the presence of significant differences between them. We also used violin plots (shown in Figure 4) to visually illustrate the distribution of these features between MCI and NC patients. These results help us to understand the differences in the distribution of features between MCI and NC.

Figure 4.
  • Download figure
  • Open in new tab
Figure 4.

Violin plots for different features.

Nomogram for Clinical Risk Assessment in MCI Patients

Based on the selection of the top ten weighted features, we constructed a logistic regression model to develop a clinical risk assessment nomogram (Figure 5)[22] for individuals with MCI. A total score of 15 or more indicates potential risk of MCI, with 22.7 being the cut-off (0.43) and a maximum score of 30. These scores help to assess the risk of MCI in patients and provide valuable clinical insight.

Figure 5.
  • Download figure
  • Open in new tab
Figure 5.

Clinical risk assessment form.

Psychiatrist evaluation results

In this study we assessed the performance of three neurologists who independently scored four sets of the same corpus. The scoring results showed significant differences between the different neurologists (Table 3). The second neurologist had the highest accuracy of 0.49, closely followed by the third with 0.45 and the first with a relatively low accuracy of 0.41. The difference in scores between neurologists was statistically significant (p<0.01). However, the difference in each neurologist’s score on the four test corpora was not significant (p> 0.05). This suggests that although there were differences in their specific scores, the overall consistency of the scores was relatively good.

View this table:
  • View inline
  • View popup
Table 3. Neurologist’s judgement of MIC
View this table:
  • View inline
  • View popup
Table 4. Comparison of results between GPT-4 and professional neurologists.

Psychiatrists and GPT-4 evaluation

In our study, the diagnostic results of three neurologists were compared with the results of the GPT-4 model, which we had specially trained for this purpose (Table 4). The GPT-4 model achieved an accuracy rate of 0.80, significantly higher than that of the neurologists, which ranged from 0.41 to 0.45. This difference is statistically significant at p < 0.001. These results highlight that the neurologists had significantly higher false positive rates of 84, 57 and 70 respectively, in stark contrast to the GPT-4 model’s false positive rate of 9. This discrepancy highlights a tendency for neurologists to misclassify healthy individuals as having a disease. These findings are further illustrated in Figure 6 by box plots, which provide a visual representation of the data and its variance.

Figure 6.
  • Download figure
  • Open in new tab
Figure 6.

Box plots comparing the results of different neurologists (GPT-4 significantly outperforms human assessments).

Discussion

Our study reveals that the GPT-4 model emerges as a promising diagnostic aid for MCI, offering an effective and consistent approach for early detection [25]. This capability holds the potential to improve patient outcomes and reduce healthcare expenditures. Since the GPT-4 does not support voice assessment when we trained the GPT-4 model, we only used textual material from MIC patients. In our analysis, the GPT-4 model demonstrated significantly higher accuracy in differentiating between MCI patients and those with NC compared to assessments made by three junior neurologists. Nevertheless, to fully confirm its effectiveness and practicality in real-world MCI diagnosis, further in-depth investigation and rigorous clinical validation of the GPT-4 model are essential.

The purposeful inclusion of junior neurologists in this study mirrors the reality that MCI screenings are often conducted by junior neurologists. This choice provided a valuable opportunity to evaluate the practical utility of the GPT model in a real-world setting and benchmark its performance against human practitioners. Our findings revealed notable variations in the diagnostic scores assigned by the neurologists (p < 0.01), with a discernible positive correlation between their clinical experience and diagnostic accuracy. Conversely, the consistency of neurologists’ assessments for the same patient across various groups did not show a statistically significant difference (p > 0.05), underscoring a high level of rater consistency and reliability.

To enhance our understanding of how the GPT-4 model evaluates MCI and Normal Cognition (CN), we analyzed the feature weights (coef_weight) returned by the model [26]. This analysis identified the top ten features that significantly contribute to differentiating MCI. These linguistic features underscore the importance of specific language elements in detecting MCI, including incorrect pronoun use, lack of coherence, memory problem, difficulty with complex concepts, orientation challenges, diminished semantic fluency, simplified sentence structure and grammar, hesitancy (trouble in finding words), and semantic paraphasia. These findings are in line with previous studies [27,28] and enhance our understanding of the GPT-4 model’s role in MCI assessment. This information will bolster healthcare providers’ confidence in utilizing the model.

Additionally, we developed a clinical risk assessment nomogram based on these ten features. This nomogram serves as a practical tool for clinicians to assess MCI and stratify patient risk levels [29]. It simplifies the process of identifying individuals at high risk for MCI and aids in directing targeted interventions and care strategies. However, this nomogram requires further validation and evaluation. Future research should explore the linguistic features identified in this study more thoroughly, which could uncover linguistic markers indicative of cognitive impairment.

Limitations

This study has several limitations that need to be considered. Firstly, our analysis was based on publicly available text and speech data. While these data sets are anonymized, it’s crucial to recognize that they might not fully capture the diversity and complexity inherent in real-world clinical scenarios. The limited voice information, which only involved the picture description and/or storytelling, but lack other routine information for clinical diagnosis of dementia, including medical history taking, physical examination, and laboratory tests etc. The incomplete information often results in the inaccurate diagnosis for physicians such as curbside consultations versus formal consultations [30,31]. Future research should aim to include more diverse and comprehensive data sets to improve the model’s applicability across varied contexts. Secondly, the cohort of neurologists involved in this study was relatively small and not native speakers with limited clinical experience. Although the included junior neurologists are proficient in English, and this setup aligns with the practical context of MCI screening, it is important to note that the results may not accurately represent the capabilities of more seasoned practitioners. Future research efforts should involve a larger and more experienced group of neurologists to validate the efficacy of the GPT-4 model in a broader clinical setting [32,33]. Thirdly, our study did not investigate potential biases within the GPT-4 model. It is essential to rigorously evaluate the model’s performance across different populations and to scrutinize it for any inherent biases. Additionally, extending the model’s applicability to other languages and demographic groups is a critical area for future exploration. Finally, due to the unavailability of GPT-4 for speech recognition during the course of our study, our analysis was confined to textual data. Future studies plan to integrate both text and speech data, expanding the scope of recognition and enhancing the model’s utility in clinical assessments.

Conclusion

Our findings indicate that the GPT-4 model, upon successful training, exhibits potential as a valuable instrument for screening individuals with Mild Cognitive Impairment (MCI). Demonstrating superior accuracy and consistency, it outperforms junior neurologists in preliminary assessments. However, further research and clinical validation are needed to assess the practical applicability of AI models such as GPT-4 in MCI diagnosis.

Data Availability

The DementiaBank dataset utilized in this study is secured by a password and access is limited to members of the DementiaBank Consortium Group. To obtain permission to access this dataset, one must become a member of the DementiaBank Consortium Group. Informed consent was obtained from all subjects in accordance with the DementiaBank guidelines.

Funding Statement

No funding.

Data Availability

The DementiaBank dataset utilized in this study is secured by a password and access is limited to members of the DementiaBank Consortium Group. To obtain permission to access this dataset, one must become a member of the DementiaBank Consortium Group. Informed consent was obtained from all subjects in accordance with the DementiaBank guidelines.

Conflict of Interest

NO

Author Contributions

JL and SL conceived the study. JL, HY, RW, CW, HG, HC, and SL and performed the data analysis, interpreted the results, and drafted the manuscript. All authors revised the manuscript. All authors read and approved the final manuscript.

The article was written entirely by human. All authors are responsible and accountable for the originality, accuracy, and integrity of the work.

Acknowledgements

All authors thank DementiaBank for corpus support. The data was provided by DementiaBank and partly supported by NIH AG03705 and AG05133.

Reference

  1. 1.↵
    McGrattan AM, Pakpahan E, Siervo M, Mohan D, Reidpath DD, Prina M, Allotey P, Zhu Y, Shulin C, Yates J, Paddick S-M, Robinson L, Stephan BCM, DePEC team. Risk of conversion from mild cognitive impairment to dementia in low- and middle-income countries: A systematic review and meta-analysis. Alzheimers Dement (N Y) 2022;8(1):e12267. PMID:35310524
    OpenUrlPubMed
  2. 2.↵
    Mild cognitive impairment - Diagnosis and treatment - Mayo Clinic. Available from: https://www.mayoclinic.org/diseases-conditions/mild-cognitive-impairment/diagnosis-treatment/drc-20354583 [accessed Nov 28, 2023]
  3. 3.↵
    Sabbagh MN, Boada M, Borson S, Chilukuri M, Dubois B, Ingram J, Iwata A, Porsteinsson AP, Possin KL, Rabinovici GD, Vellas B, Chao S, Vergallo A, Hampel H. Early Detection of Mild Cognitive Impairment (MCI) in Primary Care. J Prev Alzheimers Dis 2020;7(3):165–170. PMID:32463069
    OpenUrlPubMed
  4. 4.↵
    Dementia. Available from: https://www.who.int/news-room/fact-sheets/detail/dementia [accessed Nov 28, 2023]
  5. 5.↵
    International AD. World Alzheimer Report 2023: Reducing Dementia Risk: Never too early, never too late. 2023 Sep 21; Available from: https://www.alzint.org/resource/world-alzheimer-report-2023/ [accessed Nov 28, 2023]
  6. 6.↵
    Global action plan on the public health response to dementia 2017 - 2025. Available from: https://www.who.int/publications-detail-redirect/global-action-plan-on-the-public-health-response-to-dementia-2017---2025 [accessed Nov 29, 2023]
  7. 7.↵
    He Z, Dieciuc M, Carr D, Chakraborty S, Singh A, Fowe IE, Zhang S, Lustria MLA, Terracciano A, Charness N, Boot WR. New opportunities for the early detection and treatment of cognitive decline: adherence challenges and the promise of smart and person-centered technologies. BMC Digital Health 2023 Feb 14;1(1):7. doi: 10.1186/s44247-023-00008-1
    OpenUrlCrossRef
  8. 8.↵
    Senda M, Terada S, Takenoshita S, Hayashi S, Yabe M, Imai N, Horiuchi M, Yamada N. Diagnostic utility of the Addenbrooke’s Cognitive Examination - III (ACE-III), Mini-ACE, Mini-Mental State Examination, Montreal Cognitive Assessment, and Hasegawa Dementia Scale-Revised for detecting mild cognitive impairment and dementia. Psychogeriatrics 2020 Mar;20(2):156–162. PMID:31448862
    OpenUrlPubMed
  9. 9.↵
    Gong Q, Ishii M, Numata O, Xie W, Hirata T. Utility of a shortened Hasegawa Dementia Scale Revised questionnaire to rapidly screen and diagnose Alzheimer’s disease. Aging Med (Milton) 2021 Jun;4(2):109–114. PMID:34250428
    OpenUrlPubMed
  10. 10.↵
    Gallegos M, Morgan ML, Cervigni M, Martino P, Murray J, Calandra M, Razumovskiy A, Caycho-Rodríguez T, Gallegos WLA. 45 Years of the mini-mental state examination (MMSE): A perspective from ibero-america. Dement Neuropsychol 16(4):384–387. PMID:36530763
    OpenUrlPubMed
  11. 11.↵
    Zarrella GV, Kay CD, Gettens K, Sherman JC, Colvin MK. Addenbrooke’s Cognitive Examination-Third Edition Predicts Neuropsychological Test Performance. J Neuropsychiatry Clin Neurosci 2023;35(2):178–183. PMID:35989574
    OpenUrlPubMed
  12. 12.↵
    Gonçalves J, Gerardo B, Nogueira J, Afonso RM, Freitas S. Montreal Cognitive Assessment (MoCA): An update normative study for the Portuguese population. Appl Neuropsychol Adult 2023 Sep 14;1–7. PMID:37708840
    OpenUrlPubMed
  13. 13.↵
    Livingston G, Huntley J, Sommerlad A, Ames D, Ballard C, Banerjee S, Brayne C, Burns A, Cohen-Mansfield J, Cooper C, Costafreda SG, Dias A, Fox N, Gitlin LN, Howard R, Kales HC, Kivimäki M, Larson EB, Ogunniyi A, Orgeta V, Ritchie K, Rockwood K, Sampson EL, Samus Q, Schneider LS, Selbæk G, Teri L, Mukadam N. Dementia prevention, intervention, and care: 2020 report of the Lancet Commission. Lancet 2020 Aug 8;396(10248):413–446. PMID:32738937
    OpenUrlCrossRefPubMed
  14. 14.↵
    How AI Is Improving Diagnostics, Decision-Making and Care | AHA. 2023. Available from: https://www.aha.org/aha-center-health-innovation-market-scan/2023-05-09-how-ai-improving-diagnostics-decision-making-and-care [accessed Nov 28, 2023]
  15. 15.↵
    Fasnacht JS, Wueest AS, Berres M, Thomann AE, Krumm S, Gutbrod K, Steiner LA, Goettel N, Monsch AU. Conversion between the Montreal Cognitive Assessment and the Mini-Mental Status Examination. J Am Geriatr Soc 2023 Mar;71(3):869–879. PMID:36346002
    OpenUrlPubMed
  16. 16.↵
    Yang Q, Li X, Ding X, Xu F, Ling Z. Deep learning-based speech analysis for Alzheimer’s disease detection: a literature review. Alzheimers Res Ther 2022 Dec 14;14:186. PMID:36517837
    OpenUrlCrossRefPubMed
  17. 17.↵
    Lanzi AM, Saylor AK, Fromm D, Liu H, MacWhinney B, Cohen ML. DementiaBank: Theoretical Rationale, Protocol, and Illustrative Analyses. Am J Speech Lang Pathol 2023 Mar 9;32(2):426–438. PMID:36791255
    OpenUrlCrossRefPubMed
  18. 18.↵
    Becker JT, Boller F, Lopez OL, Saxton J, McGonigle KL. The natural history of Alzheimer’s disease. Description of study cohort and accuracy of diagnosis. Arch Neurol 1994 Jun;51(6):585–594. PMID:8198470
    OpenUrlCrossRefPubMedWeb of Science
  19. 19.↵
    Szabó P, Ara J, Halmosi B, Sik-Lanyi C, Guzsvinecz T. Technologies Designed to Assist Individuals with Cognitive Impairments. Sustainability Multidisciplinary Digital Publishing Institute; 2023 Jan;15(18):13490. doi: 10.3390/su151813490
    OpenUrlCrossRef
  20. 20.↵
    Dave M, Patel N. Artificial intelligence in healthcare and education. Br Dent J 2023;234(10):761–764. PMID:37237212
    OpenUrlPubMed
  21. 21.↵
    Wang C, Liu S, Li A, Liu J. Text dialogue analysis Based ChatGPT for Primary Screening of Mild Cognitive Impairment. JMIR Preprints. Available from: https://preprints.jmir.org/preprint/51501 [accessed Nov 29, 2023]
  22. 22.↵
    One-Way Analysis of Variance - ProQuest. Available from: https://www.proquest.com/openview/e3e316611d60e2d2ed0c5c1e8f3a8bb2/1?pq-origsite=gscholar&cbl=29232 [accessed Nov 29, 2023]
  23. 23.↵
    Code of Ethics | TalkBank. Available from: https://talkbank.org/share/ethics.html [accessed Nov 25, 2023]
  24. 24.↵
    Fitzgerald M, Saville BR, Lewis RJ. Decision Curve Analysis. JAMA 2015 Jan 27;313(4):409–410. doi: 10.1001/jama.2015.37
    OpenUrlCrossRefPubMed
  25. 25.↵
    Shea Y-F, Lee CMY, Ip WCT, Luk DWA, Wong SSW. Use of GPT-4 to Analyze Medical Records of Patients With Extensive Investigations and Delayed Diagnosis. JAMA Network Open 2023 Aug 14;6(8):e2325000. doi: 10.1001/jamanetworkopen.2023.25000
    OpenUrlCrossRef
  26. 26.↵
    Grueso S, Viejo-Sobera R. Machine learning methods for predicting progression from mild cognitive impairment to Alzheimer’s disease dementia: a systematic review. Alzheimer’s Research & Therapy 2021 Sep 28;13(1):162. doi: 10.1186/s13195-021-00900-w
    OpenUrlCrossRef
  27. 27.↵
    Vigo I, Coelho L, Reis S. Speech- and Language-Based Classification of Alzheimer’s Disease: A Systematic Review. Bioengineering (Basel) 2022 Jan 11;9(1):27. PMID:35049736
    OpenUrlPubMed
  28. 28.↵
    Balagopalan A, Eyre B, Robin J, Rudzicz F, Novikova J. Comparing Pre-trained and Feature-Based Models for Prediction of Alzheimer’s Disease Based on Speech. Front Aging Neurosci 2021;13:635945. PMID:33986655
    OpenUrlCrossRefPubMed
  29. 29.↵
    Jingyu L, Wen D, Liping Z, Xiaoling L. A nomogram for predicting mild cognitive impairment in older adults with hypertension. BMC Neurology 2023 Oct 9;23(1):363. doi: 10.1186/s12883-023-03408-y
    OpenUrlCrossRef
  30. 30.↵
    B R, M M, Jp H, K H, J K. Spoken Language Derived Measures for Detecting Mild Cognitive Impairment. IEEE transactions on audio, speech, and language processing IEEE Trans Audio Speech Lang Process; 2011 Jan 9;19(7). PMID:22199464
    OpenUrlPubMed
  31. 31.↵
    Haulcy R, Glass J. Classifying Alzheimer’s Disease Using Audio and Text-Based Representations of Speech. Front Psychol 2020;11:624137. PMID:33519651
    OpenUrlPubMed
  32. 32.↵
    Burden M, Sarcone E, Keniston A, Statland B, Taub JA, Allyn RL, Reid MB, Cervantes L, Frank MG, Scaletta N, Fung P, Chadaga SR, Mastalerz K, Maller N, Mascolo M, Zoucha J, Campbell J, Maher MP, Stella SA, Albert RK. Prospective comparison of curbside versus formal consultations. J Hosp Med 2013 Jan;8(1):31–35. PMID:23065716
    OpenUrlCrossRefPubMed
  33. 33.↵
    Kuo D, Gifford DR, Stein MD. Curbside consultation practices and attitudes among primary care physicians and medical subspecialists. JAMA 1998 Sep 9;280(10):905–909. PMID:9739975
    OpenUrlCrossRefPubMedWeb of Science
Back to top
PreviousNext
Posted December 04, 2023.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
GPT-4 and Neurologists in Screening for Mild Cognitive Impairment in the Elderly: A Comparative Analysis Study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
GPT-4 and Neurologists in Screening for Mild Cognitive Impairment in the Elderly: A Comparative Analysis Study
Hao Yang, Ruihan Wang, Changyu Wang, Hui Gao, Hanlin Cai, Fengying Zhang, Jialin Liu, Siru Liu
medRxiv 2023.12.02.23299327; doi: https://doi.org/10.1101/2023.12.02.23299327
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
GPT-4 and Neurologists in Screening for Mild Cognitive Impairment in the Elderly: A Comparative Analysis Study
Hao Yang, Ruihan Wang, Changyu Wang, Hui Gao, Hanlin Cai, Fengying Zhang, Jialin Liu, Siru Liu
medRxiv 2023.12.02.23299327; doi: https://doi.org/10.1101/2023.12.02.23299327

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)