Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Quantification of stress and well-being using pulse, speech, and electrodermal data: Study concept and design

Keisuke Izumi, Kazumichi Minato, Kiko Shiga, Tatsuki Sugio, Sayaka Hanashiro, Kelley Cortright, Shun Kudo, Takanori Fujita, Mitsuhiro Sado, Takashi Maeno, Toru Takebayashi, Masaru Mimura, View ORCID ProfileTaishiro Kishimoto
doi: https://doi.org/10.1101/2020.05.01.20082610
Keisuke Izumi
1Division of Rheumatology, Department of Internal Medicine, Keio University School of Medicine, Tokyo, Japan
2National Tokyo Medical Center, Tokyo, Japan
3Medical AI Center, Keio University, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kazumichi Minato
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kiko Shiga
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tatsuki Sugio
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sayaka Hanashiro
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kelley Cortright
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shun Kudo
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Takanori Fujita
3Medical AI Center, Keio University, Tokyo, Japan
5Health Policy and Management, Keio University School of Medicine, Tokyo, Japan
6World Economic Forum Centre for the Fourth Industrial Revolution Japan, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mitsuhiro Sado
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
7Center for Stress Research, Keio University, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Takashi Maeno
8Human System Design Laboratory, Graduate School of System Design and Management, Keio University, Kanagawa, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Toru Takebayashi
3Medical AI Center, Keio University, Tokyo, Japan
9Department of Preventive Medicine and Public Health, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Masaru Mimura
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Taishiro Kishimoto
3Medical AI Center, Keio University, Tokyo, Japan
4Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan
10Psychiatry Department, Donald and Barbara Zucker School of Medicine, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Taishiro Kishimoto
  • For correspondence: taishiro-k{at}mti.biglobe.ne.jp
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Introduction Mental disorders are a leading cause of disability worldwide and, among mental disorders, major depressive disorder was highly ranked in years lived with disability. Depression has a significant impact in the field of occupational health because it is particularly prevalent during working age. On the other hand, there are a growing number of studies on the relationship between “well-being” and employee productivity. To promote healthy and productive workplaces, this study aims to develop a technique to quantify stress and well-being in a way that does not disturb the workplace.

Methods and analysis This is a single-arm prospective observational study. The target population is adult (>20 years old) workers at companies that often engage in desk work; specifically, a person who sits in front of a computer for at least half their work hours. The following data will be collected: a) participants’ background characteristics; b) participants’ biological data during the 4-week observation period using sensing devices such as a camera built into or connected to the computer (pulse wave data extracted from the facial video images), a microphone built into or connected to their work computer (voice data), and a wristband-type wearable device (electrodermal activity data, body motion data, and body temperature); c) stress, well-being, and depression rating scale assessment data (New Occupational Stress Questionnaire, Perceived Stress Scale, Satisfaction With Life Scale, Japanese version of Positive and Negative Affect Schedule, Japanese Flourishing Scale, Subjective Well-being / Ideal Happiness, and Japanese version of Patient Health Questionnaire-9). The analysis workflow is as follows: (1) primary analysis, comprised of using software to digitalize participants’ vital information; (2) secondary analysis, comprised of examining the relationship between the quantified vital data from (1), stress, well-being, and depression; (3) tertiary analysis, comprised of generating machine learning algorithms to estimate stress, well-being, and degree of depression in relation to each set of vital data as well as multimodal vital data.

Ethics and dissemination Collected data and study results will be disseminated widely through conference presentations, journal publications, and/or mass media. The summarized results of our overall analysis will be supplied to participants.

Registration UMIN000036814

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • This study evaluates stress and well-being using biomarkers such as heart rate, acoustic characteristics, and electrodermal activity.

  • This study measures biomarkers over a long-term four-week period.

  • This study will lead to the development of a machine learning algorithm to determine people’s optimal levels of stress and well-being.

  • This is a government-funded study in which many different companies and institutions collaborated for a common purpose.

  • There is a possibility that the algorithm’s prediction accuracy level may decrease when it is applied to demographic groups other than those studied here.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Trial

UMIN000036814

Clinical Protocols

https://upload.umin.ac.jp/cgi-open-bin/ctr/ctr.cgi?function=brows&action=brows&recptno=R000041686&type=summary&language=J

Funding Statement

This work was supported by the Japan Agency for Medical Research and Development (AMED) (grant number 18le0110008h0001). The funding source did not participate in the design of this study and will not have any hand in the study's execution, analyses, or submission of results. Japan Agency for Medical Research and Development (AMED) 20F Yomiuri Shimbun Bldg. 1-7-1 Otemachi, Chiyoda-ku, Tokyo 100-0004 Japan Tel: +81-3-6870-2200, Fax: +81-3-6870-2241, Email: jimu-ask{at}amed.go.jp

Author Declarations

All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.

Yes

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Not applicable

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted May 10, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Quantification of stress and well-being using pulse, speech, and electrodermal data: Study concept and design
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Quantification of stress and well-being using pulse, speech, and electrodermal data: Study concept and design
Keisuke Izumi, Kazumichi Minato, Kiko Shiga, Tatsuki Sugio, Sayaka Hanashiro, Kelley Cortright, Shun Kudo, Takanori Fujita, Mitsuhiro Sado, Takashi Maeno, Toru Takebayashi, Masaru Mimura, Taishiro Kishimoto
medRxiv 2020.05.01.20082610; doi: https://doi.org/10.1101/2020.05.01.20082610
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Quantification of stress and well-being using pulse, speech, and electrodermal data: Study concept and design
Keisuke Izumi, Kazumichi Minato, Kiko Shiga, Tatsuki Sugio, Sayaka Hanashiro, Kelley Cortright, Shun Kudo, Takanori Fujita, Mitsuhiro Sado, Takashi Maeno, Toru Takebayashi, Masaru Mimura, Taishiro Kishimoto
medRxiv 2020.05.01.20082610; doi: https://doi.org/10.1101/2020.05.01.20082610

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Occupational and Environmental Health
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)