Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Deep Stroop: Using eye tracking and speech processing to characterize people with neurodegenerative disorders while performing the Stroop Test

View ORCID ProfileTrevor Meyer, View ORCID ProfileAnna Favaro, View ORCID ProfileTianyu Cao, View ORCID ProfileAnkur Butala, View ORCID ProfileEsther Oh, View ORCID ProfileChelsie Motley, View ORCID ProfilePedro Irazoqui, View ORCID ProfileNajim Dehak, View ORCID ProfileLaureano Moro-Velázquez
doi: https://doi.org/10.1101/2023.05.30.23290742
Trevor Meyer
aDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Trevor Meyer
  • For correspondence: tmeyer16{at}jhu.edu
Anna Favaro
aDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Anna Favaro
Tianyu Cao
aDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tianyu Cao
Ankur Butala
bDepartment of Neurology, The Johns Hopkins University, Baltimore, MD, USA
cDepartment of Psychiatry and Behavioral Sciences, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ankur Butala
Esther Oh
cDepartment of Psychiatry and Behavioral Sciences, The Johns Hopkins University, Baltimore, MD, USA
eDepartment of Medicine, John Hopkins University School of Medicine, The Johns Hopkins University, Baltimore, MD, USA
fDepartment of Pathology, The Johns Hopkins University, Baltimore, MD, USA
gJohns Hopkins Bloomberg School of Public Health, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Esther Oh
Chelsie Motley
bDepartment of Neurology, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Chelsie Motley
Pedro Irazoqui
aDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Pedro Irazoqui
Najim Dehak
aDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Najim Dehak
Laureano Moro-Velázquez
aDepartment of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Laureano Moro-Velázquez
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Although many neurodegenerative diseases affect different neural circuits, they often express complex and overlapping symptom profiles making them difficult to differentiate precisely. Current methods of analyzing patients are limited to bedside examination, patient self-rating scales, semiquantitative clinician-rating scales, and other observational evidence, which are often non-specific, resulting in open multiple interpretations and ambiguity in diagnosis and treatment plans. We present a method to analyze patient symptom profiles using multimodal analysis of subjects performing the Stroop Test. We use high-sample-rate eye tracking and speech recording tools to record subject behavior while completing the Stroop Test and simultaneously analyze multiple traits of their interaction with the test. We compare the performance of healthy controls to patients with Parkinson’s Disease, Alzheimer’s Disease, and other neurodegenerative diseases with clinical parkinsonism. We automatically extract metrics based on eye motor behavior, gaze characteristic uttered responses, and the temporal relationship between gaze and uttered responses. We identify many that have clinical relevance through high correlations with existing MoCA and MDS-UPDRS, many of which have significantly different distributions between groups. We present here our analysis approach, provide freely available source code to replicate it and demonstrate the potential of multi-modal recording and analysis of patients throughout their execution of neuro-psychological tests like the Stroop Test.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study was funded by Richman Family PMCoE-AD Venture Discovery Fund and Consolidated Anti-Aging Foundation

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The IRB of Johns Hopkins Medical Institue gave ethical approval for the data collection and this work under number IRB00234370. All participants signed informed consent.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

The authors plan to share all data produced in the present study in the future.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted June 01, 2023.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Deep Stroop: Using eye tracking and speech processing to characterize people with neurodegenerative disorders while performing the Stroop Test
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Deep Stroop: Using eye tracking and speech processing to characterize people with neurodegenerative disorders while performing the Stroop Test
Trevor Meyer, Anna Favaro, Tianyu Cao, Ankur Butala, Esther Oh, Chelsie Motley, Pedro Irazoqui, Najim Dehak, Laureano Moro-Velázquez
medRxiv 2023.05.30.23290742; doi: https://doi.org/10.1101/2023.05.30.23290742
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Deep Stroop: Using eye tracking and speech processing to characterize people with neurodegenerative disorders while performing the Stroop Test
Trevor Meyer, Anna Favaro, Tianyu Cao, Ankur Butala, Esther Oh, Chelsie Motley, Pedro Irazoqui, Najim Dehak, Laureano Moro-Velázquez
medRxiv 2023.05.30.23290742; doi: https://doi.org/10.1101/2023.05.30.23290742

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)