Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

The reliability and validity of a non-wearable indoor positioning system to assess mobility in older adults: A cross-sectional study

View ORCID ProfileIsabel B. Rodrigues, Patricia Hewston, Jonathan Adachi, Sayem Borhan, George Ioannidis, Alexa Kouroukis, Carolyn Leckie, Andrea Lee, View ORCID ProfileAlexander Rabinovich, Parthipan Siva, Rachel Swance, Suleman Tariq, Lehana Thabane, Alexandra Papaioannou
doi: https://doi.org/10.1101/2024.07.04.24309984
Isabel B. Rodrigues
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
2University of Manitoba, Rady Faculty of Health Sciences, Department of Community Health Sciences, Winnipeg, Manitoba, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Isabel B. Rodrigues
Patricia Hewston
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan Adachi
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sayem Borhan
3McMaster University, Faculty of Health Sciences, Department of Health Research Methods, Evidence, and Impact, Hamilton, Ontario, Canada
10Biostatistics Unit, St Joseph’s Healthcare Hamilton, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
George Ioannidis
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexa Kouroukis
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
4University of Toronto, Faculty of Medicine, Toronto, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carolyn Leckie
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrea Lee
5Hamilton Health Sciences, Research Development and Innovation, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexander Rabinovich
6McMaster University, Faculty of Medicine, Department of Surgery – Division of Orthopaedic Surgery, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alexander Rabinovich
Parthipan Siva
7Chirp Inc., Waterloo, ON N2J 4R2, Canada
8Faculty of Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rachel Swance
9McMaster University, Faculty of Science, Department of Kinesiology, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Suleman Tariq
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
4University of Toronto, Faculty of Medicine, Toronto, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lehana Thabane
3McMaster University, Faculty of Health Sciences, Department of Health Research Methods, Evidence, and Impact, Hamilton, Ontario, Canada
10Biostatistics Unit, St Joseph’s Healthcare Hamilton, Hamilton, Ontario, Canada
11University of Johannesburg, Faculty of Health Science, Johannesburg, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexandra Papaioannou
1McMaster University, Faculty of Health Sciences, Department of Medicine, Hamilton, Ontario, Canada
3McMaster University, Faculty of Health Sciences, Department of Health Research Methods, Evidence, and Impact, Hamilton, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: papaioannou{at}hhsc.ca
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background Chirp is a privacy-preserving radar sensor developed to continuously monitor older adults’ safety and mobility without the need for cameras or wearable devices. Our study purpose was to evaluate the inter-sensor reliability, intrasession test-retest reliability, and concurrent validity of Chirp in a clinical setting.

Methods We recruited 35 community-dwelling older adults (mean age 75.5 (standard deviation: 6.6) years, 86% female). All participants lived alone in an urban city in southwestern Ontario and had access to a smart device with wireless internet. Data were collected with a 4-meter ProtoKinetics Zeno™ Walkway (pressure sensors) with the Chirp sensor (radar positioning) at the end of the walkway. Participants walked during normal and adaptive locomotion experimental conditions (walking-while-talking, obstacle, narrow walking, fast walking). Each of the experimental conditions was conducted twice in a randomized order, with fast walking trials performed last. For intra-session reliability testing, we conducted two blocks of walks within a participant session separated by approximately 30 minutes. Intraclass Correlation Coefficient(A,1) (ICC(A,1)) was used to assess the reliability and validity. Linear regression, adjusted for gender, was used to investigate the association between Chirp and cognition and health-related quality of life scores.

Results The Chirp inter-sensor reliability ICC(A,1)=0.999[95% Confidence Interval [CI]: 0.997 to 0.999] and intrasession test-retest reliability [ICC(A,1) =0.921, 95% CI: 0.725 to 0.969] were excellent across all experimental conditions. Chirp concurrent validity compared to the ProtoKinetics Zeno™ Walkway was excellent across experimental conditions [ICC(A,1)= 0.993, 95% CI: 0.985 to 0.997]. We found a weak association between Chirp and cognition scores using the Montreal Cognitive Assessment across experimental conditions (estimated β-value= 7.79, 95% CI: 2.79 to 12.80) and no association between the Chirp and health-related quality of life using the 12-item Short Form Survey across experimental conditions (estimated β-value=6.12, 95% CI: -7.12 to 19.36).

Conclusion Our results demonstrate that Chirp is a reliable and valid measure to assess gait parameters in clinics among older adults.

INTRODUCTION

Mobility impairments can negatively influence quality of life for older adults, especially for those who would like to live independently in their home [1]. Mobility limitations increase the risk of falls [2], which are a major risk for older adults as falls often result in serious physical and psychological consequences [3,4]. Approximately one third to one half of individuals 65 years of age or older report difficulties with walking or climbing the stairs [5–7]. Mobility impairments, including changes in gait, are early indicators of health decline and subsequent disability [8,9]. Early detection and interventions to prevent further limitations could be of benefit for older adults to maintain and regain their daily activity levels and independence [5]. There are significant efforts being made to increase our understanding of and capacity to address mobility impairments and falls among older adults [10,11].

Fall risk assessments can be conducted by analyzing important parameters such as gait, balance, and activities of daily living [12,13]. For example, gait speed and step length can be used to identify older adults at high risk of falls [14,15]. In a clinical setting, healthcare providers use methods based on physical examination and functional tests such as the gait speed test, the Short Physical Performance Battery [16], and the Timed Up and Go Test [17,18] to identify quantitative aspects of gait [14]. But such physical examinations and functional measures take a considerable amount of time to perform in clinic and may not always be feasible to implement under real-world conditions [14]. Moreover, many clinics do not have access to physiotherapy and occupational therapy who evaluate other gait parameters that could predict fall risk including cadence, stride length, or swing phase time [14].

Performing continuous mobility assessments of gait may be one solution to help healthcare providers intervene sooner and reduce injuries related to falls and mobility impairments [19,20]. A means of continuously assessing mobility passively during normal activities of daily living allows for real-time mobility assessment and early identification of mobility declines and impairments [21]. Early identification of mobility declines can result in pre-emptive interventions such as physiotherapy or functional strength and balance training to aid or improve mobility [22]. Systems for at home gait analysis can be divided into three major groups: non-wearable systems, wearable systems, and a combination of non-wearable and wearable systems [23]. Each system can provide precise information on gait patterns, step speed, step length and width, and static and dynamic balance under controlled conditions [23]. Current automated mobility assessment research is focused on wearable sensors that can be used outside gait laboratories and require users’ compliance in wearing the sensors and keeping it charged [23]. In addition, such systems may be difficult for older adults to set-up and use [23]. Non-wearable, passive solutions may be more user-friendly for older adults [21,23]. Chirp (Waterloo, Ontario, Canada) is a privacy-preserving, non-wearable sensor that uses radar to passively collects gait parameters in older adults [20]. The radar-based approach in the Chirp technology can also be used to monitor gait parameters within the home [20]. Radar technology has appeared as the most suitable candidate for continuous gait monitoring at home due to its safety, simplicity, low cost, lack of contact, and unobtrusiveness while preserving privacy [24]. Before the Chirp sensor can be used in clinic to detect and predict mobility declines and fall risks, the system’s psychometric properties should be tested against standard clinical mobility assessment metrics. This study evaluated the inter-sensor reliability, intrasession test-retest reliability, and concurrent validity of the Chirp sensor among older adults in a clinical setting. Our secondary objective was to determine if there is an association between gait speed using the Chirp sensor and self-reported mobility disability and cognition.

METHODS

Study design

We conducted a cross-sectional, single-centered study. We followed the STROBE 2007 guidelines for reporting observational studies [25]. Ethics approval was obtained from the Hamilton Integrated Research Ethics Board (HIREB #15237).

Setting

We recruited participants from physicians’ offices, the local newspaper, and social media. The clinicians (JA, AR, and AP) on our team used a pre-screening referral form to identify potential participants in clinic. Our research team also screened potential individuals over the telephone to determine eligibility. We recruited participants between February to July 2023. We obtained written informed consent from each participant prior to enrolling them in the study. Participants attended one study visit in a private room at the Hamilton Health Sciences. We provided free transportation for participants with limited mobility or free parking at the clinic. We scheduled participants on a rolling basis.

Participants

We included participants if they spoke English or attended with a translator or caregiver, were ≥65 years and older, had a Morley Frail Scale score of 3 or more on the FRAIL Scale [26], and were able to follow two-step commands. We excluded individuals who did not live alone, did not have access to Wi-Fi or a smartphone, and required a wheelchair due to medical conditions.

Data sources/measurement

Chirp

The Chirp sensor uses the Texas Instrument IWR6843AOP mmWave radar sensor, a very low resolution (32×32 pixel) thermal sensor, and a microphone to continuously monitor daily activities (transfer times, walking speed, sedentary times, etc.) in the home [27]. The sensor is approved by Innovation, Science and Economic Development Canada (ISED) (IC:29827-CHIRP01T) and Federal Communications Commission (FCC) of the United States of America (FCC ID:2A9Q4-CHIRP01T) for continuous use in indoor environments. For this study, only the 60 to 64 GHz frequency-modulated continuous-wave radar sensor is used to collect a sparse 3D point cloud of moving objects in the scene. The point cloud is captured at 10 frames per second (10 Hz), in the 120-degree field of view of the sensor, up to 8 meters from the sensor. The collected point cloud is analyzed by Chirp’s artificial intelligence algorithms to detect and track people and measure their walking speed and the actions they perform (e.g., sit-down, standup, falls, etc.). The captured data can not be used to identify individuals.

Protokinetics Zeno™ Walkway

We collected data on gait parameters (i.e., gait speed) using a 4-meter ProtoKinetics Zeno™ Walkway (Havertown, PA, USA) at a sampling frequency of 100 Hz. We utilized a standard protocol from the InCIANTI protocol to collect our data [28]. The walkway is a portable, roll-up design that required set up prior to each study visit. To guarantee that the Protokinetics Zeno™ Walkway set up was standardized, we marked the mat’s location on the floor with masking tape. We used the ProtoKinetics Movement Analysis Software (PKMAS) to capture our gait parameters.

Variables

We collected demographic characteristics using an equity lens: Place of residence, Race/ethnicity, Occupation, Gender and sex, Religion, Education, Socioeconomic status, and Social capital (PROGRESS) [29]. Frailty scores were assessed using the Fit-Frailty Assessment and Management Application [30], health-related quality of life using the 12-Item Short Form (SF-12) questionnaire [31], and cognitive status using the Montreal Cognitive Assessment (MoCA) version 8.2 English [32]. Frailty scores were interpreted as follows: not frail-frail scores < 0.24, pre-frail scores 0.18 to 0.24, and frail >0.24 [30]. The SF-12 was scored by yielding two summary measures: the Physical Component Summary and the Mental Component Summary [31]. Scores above 50 indicate a better than average health-related quality of life on the SF-12, while a score below 50 suggest below-average health [31]. The MoCA was scored on a scale of 30 points, where a score of ≥ 26 points indicate normal cognition, 18 to 25, mild cognition, 10 to 17, moderate, and fewer than 10 points, severe cognitive impairment; MoCA scores were adjusted for education status [32].

Data collection

The study visit was divided into three blocks. During “Block 1”, we assessed gait parameters using the Protokinetics Zeno™ Walkway and the Chirp sensor. Following “Block 1”, we collected demographic characteristics using the PROGRESS questionnaire [29], frailty scores with the Fit-Frailty Assessment and Management Application [30], cognitive scores using the MoCA [32], and health-related quality of life with the SF-12 questionnaire [31]. During “Block 3”, we repeated the measures of the first block to collect gait parameters for a second time using the Protokinetics Zeno™ Walkway and the Chirp sensor. To determine the intrasession test-retest reliability of the Chirp sensor, the InCIANTI protocol [28] was repeated at the end of the testing session (i.e., Block 3). The Chirp sensors were positioned at the end of the walking path at 2.03 meters from the end of the ProtoKinetics Walkway at a sampling frequency of 10 Hz (Fig 1). The first Chirp sensor (herein known as Chirp 126) was set as the primary sensor, while Chirp 201 was the secondary sensor. The ProtoKinetics Zeno™ Walkway (pressure sensors) and the Chirp sensor (radar positioning) collected data simultaneously. Participants started and ended at the gait mat. Using the InCIANTI protocol [28], participants walked along a 4-meter path during normal and adaptive locomotion experimental conditions: 1) normal walking: self-selected comfortable walking pace, 2) fast walking: walk as fast as possible, 3) obstacle crossing: cross over two obstacles placed in the path while walking as fast as possible, 4) narrow-path: walk at their usual pace but stay between the lines of coloured tape placed 25 cm apart, and 5) walking-while-talking: walking normally while simultaneously performing a verbal cognitive task (i.e., asked to recite names of animals starting with the letter “p”). For the obstacle crossing, the obstacles were 11.4 cm in height and 97.8 cm in length and positioned at 135 cm and 265 cm, respectively, from the starting line of the Protokinetics Zeno™ Walkway. Each experimental condition was conducted twice (during Blocks 1 and 3) in a randomized order with the exception of fast walking trials, which were performed last in each experimental block to avoid any influence on the speed of the preceding trials. To sync the sensor to assess concurrent validity, start and end times for each walkover were defined from the first pressure-mat heel strike to the final pressure-mat toe-off time as defined by ProtoKinetics Movement Analysis Software (PKMAS) [28]. These values were precisely distance-aligned with frames captured by the Chirp sensor, and direct comparisons were made for each walkover. Blocks 1 and 3 were separated by approximately 30 minutes to collect data on intra-session reliability. During each study visit, two to three research assistants were present in the room. Participants were allowed to use assistive sensor when performing each walk since the Zeno PKMAS software can identify and remove assistive sensor tracks on the pressure sensor to capture an accurate walking speed of each individual.

Figure 1.
  • Download figure
  • Open in new tab
Figure 1.

In-clinic setup of the 4-meter ProtoKinetics Zeno™ Walkway Gait Analysis System and the Chirp sensor for testing concurrent validity of walking speed. Obstacles were only used for obstacle crossing. Narrow walk pathway is used for narrow walking scenario only.

Sample size

The approach to assess reliability is based on estimations of the Intraclass correlation (ICC) and the 95% confidence intervals (CI). Thus, we aimed to select a sample size which improves the precision of the estimate. We estimated we would need a sample size of 35 based on the primary outcome (i.e., test-retest reliability) at a 0.05 level of significance (two-tailed), 80% power, and 10% expected drop-out rate is 33 (p0 = 0.75; p1 = 0.9). A higher p0 indicates greater reliability, with p0 = 0.8 indicating the highest acceptable level of reliability [33].

Outcomes

Our primary outcome was to assess the psychometric properties of the Chirp sensor under laboratory conditions. We assessed two types of reliability: the inter-sensor reliability and intrasession test-retest reliability. Inter-sensor reliability is assessed between Chirp 126 (primary sensor) and Chirp 201 across all experiment conditions and each of the five walks. Similarly, intrasession test-retest reliability was determined by correlating average gait speeds between Block 1 and 3 for all five types of walks (i.e., all walks combined, normal walk, obstacle walk, walk and talk, narrow walk, and fast walk). To assess the concurrent validity of gait speed using the Chirp sensor, comparisons were made against the gold standard utilizing the 12-foot ProtoKinetics Zeno™ Walkway at a sampling frequency of 100 Hz. Concurrent validity was assessed using gait speed measured with the Protokinetics Zeno™ Walkway and Chirp 126 (primary sensor) across all experimental conditions and each of the five walks. Our secondary objective was to determine if there was a correlation between MoCA scores or self-reported mobility disability using the SF-12 and gait speed using Chirp 126.

Statistical analysis

Descriptive summaries were presented as mean and standard deviation (SD) for continuous variables, and frequency for categorical variables. Intraclass correlation(A,1) (ICC(A,1)) was used to assess the concurrent validity of gait speed collected from the Chirp sensor and Protokinetics Zeno™ Walkway, the inter sensor reliability between Chirp 126 and Chirp 201, and the test-retest (Chirp 126, Block 1 versus 3) across all trials for all and individual (normal walking, walking-while-talking, obstacle, narrow walking, fast walking) experimental conditions. The estimated intraclass correlation coefficients, along with 95% confidence intervals (CI), were reported. Linear regression, adjusted for gender, was used to investigate the association between Chirp 126 and MoCA and SF-12. The estimated regression coefficient (β-value) along with 95% CIs were reported. All statistical tests were two-sided with the level of significance of 0.05. All analyses were performed in R version 3.4.2 (R Foundation for Statistical Computing, Vienna, Austria).

Results

We approached 80 individuals, and after the screening process, we enrolled 35 individuals (Fig 2). Demographic characteristics of participants who chose to join the study are presented in Table 1. Of the 700 walks (35 participants × 2 blocks × 5 experimental conditions x 2 trials each), 47 walks were not collected as six participants did not feel comfortable completing some of the walks; five participants did not complete the narrow walk and/or the obstacle walk, and one participant lost their balance during the first narrow walk and could not complete the subsequent walks including the obstacle crossing. Five of the six participants used a walker. Walking data was collected using Chirp 126, Chirp 201, and the Protokinetics Zeno™ Walkway. Chirp 126 recorded 624/653 walks (95.6%), with 29 missing due to low bandwidth. Chirp 201 recorded 576/653 walks (88.2%), with 24 missing due to low bandwidth and 53 due to a broken sensor. The Protokinetics Zeno™ Walkway recorded 653/653 walks (100%) with no missing data.

View this table:
  • View inline
  • View popup
Table 1: Demographic and other health characteristics of participants at baseline (n = 35)
Figure 2:
  • Download figure
  • Open in new tab
Figure 2:

Participant recruitment and enrollment flow diagram

We conducted an inter-sensor reliability between the Chirp sensors 126 and 201. The Chirp inter-sensor reliability [ICC(A,1) = 0.999 (95% CI: 0.997, 0.999)] and intrasession test-retest reliability [ICC(A,1) = 0.921 (95% CI: 0.725,0.969)] were excellent across experimental conditions (see Table 2).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2: Results of the inter-sensor reliability and test-retest reliability of the Chirp sensors

The Chirp sensor’s concurrent validity compared to the gold-standard ProtoKinetics Zeno™ Walkway was excellent across experimental conditions [ICC(A,1) = 0.993 (95% CI: 0.985-0.997)] (see Table 3).

View this table:
  • View inline
  • View popup
Table 3: Results of the concurrent validity of the Chirp sensors to the Protokinetics Zeno™

Walkway We found a weak association between the Chirp sensor and mean MoCA scores across experimental conditions and no association between the Chirp sensor and SF-12 across experimental conditions (see Table 4).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 4: Linear regression analysis between Chirp and MoCA and physical functioning using the SF-12

Discussion

The Chirp sensor is a privacy-preserving, non-wearable sensor that uses a radar sensor to passively collect gait parameters. The main purpose of our study was to evaluate the inter-sensor reliability, intrasession test-retest reliability, and concurrent validity of Chirp in older adults in an outpatient setting. We recruited 35 community-dwelling older adults who lived alone in a moderate-sized urban city in southwestern Ontario. Data were collected with a 4-meter ProtoKinetics Zeno™ Walkway (pressure sensors) and with the Chirp sensor (radar). Participants walked during normal and adaptive locomotion experimental conditions (i.e., walking-while-talking, obstacle, narrow walking, fast walking). Each of the five experimental conditions was conducted twice in a randomized order, with fast walking trials performed last. Two blocks of walks were conducted within a participant session, separated by approximately 30 minutes, for intra-session reliability testing. We found the Chirp inter-sensor reliability and intrasession test-retest reliability were excellent across all experimental conditions [34]. The concurrent validity of the Chirp sensor compared to the gold-standard ProtoKinetics Zeno™ Walkway was also excellent across all experimental conditions. We found a weak association between Chirp and the MoCA across all experimental conditions, but no association between Chirp and the SF-12. Our results indicate that this type of radar has excellent validity and reliability to measure gait parameters in older adults in an outpatient setting and could be used to discretely detect subtle gait changes that appear among older adults.

The present work provides supporting evidence that the Chirp sensors can accurately and reliably assess gait across several different types of walks that older adults may exhibit in an outpatient setting. A brief review of the literature indicates there are few studies that use radar to assess gait parameters in older adults, especially those who may be pre-frail or frail.

Nevertheless, of the studies that do exist indicate our validity and reliability results are similar to or better than other studies that used radar to assess gait characteristics in clinical settings. In the Boroomand study, the authors collected gait speeds among 14 healthy young adults using a 24 GHz radar sensor during three different walks (i.e., slow, normal, and fast) and correlated the results of the radar sensor walk to the GAITRite mat [35]. Accuracy calculation of the radar sensor to the GAITRite mat revealed the fast gait walk had an average validity of 86%, while the average validity for the normal and low speed walks were 81% and 74%, respectively [35].

Similarly, Saho and colleagues also utilized a 24 GHz micro-Doppler radar compared to a 10-meter walkway to assess walking speed in 19 older adults [36]. Saho and colleagues achieved and accuracy of 78.8% using the radar data with a sensitivity of 64.3%, specificity of 81.8%, and precision of 89.5%. Lastly, Wang and colleagues reported an excellent reliability in step time using a 5.8 GHz pulse Doppler radar with ICC of 97% between the radar and a motion capture system under laboratory conditions in 13 healthy young adults [37]. Compared to our study, our results demonstrate similar or better validity and reliability with the Chirp sensor with a concurrent validity of 99.3% (95% CI 98.5% to 99.7%) and reliability of 99.9% (95% CI 99.7% to 99.9%) using a 4-meter range on the ProtoKinetics Zeno™ Walkway. Overall, our research suggest that the Chirp sensors appear to be a promising technology to collect gait speed in older adults in an in clinic-type environment.

Compared to other systems, radar technology has several benefits in the clinical setting over other systems. Wireless technology that uses electromagnetic waves (i.e., radar) to continuously assess gait characteristics in an outpatient setting without the involvement of a healthcare practitioner appear feasible due to the radar’s safety, simplicity, low cost, lack of contact, and unobtrusiveness while preserving privacy [24]. The advantage of our study was we collected data on several different types of walks that mimic real world conditions and with a diverse group of older adults who were not frail, pre-frail and frail. Detecting changes in gait are particularly important in the context of preventing falls and monitoring older adults’ safety and mobility.

Lower gait speeds may be associated with early diagnosis of different physical and cognitive diseases, as well as tracking an individual’s progress towards recovery following certain therapy sessions [12]. Furthermore, older persons who have slower gaits are more likely to fall, which can have a serious impact on their capacity to live independently [38]. Thus, continuous analysis of gait may detect deviations from normal speed. Our results indicate that the high validity and the reliability of the Chirp sensor to detect different types of gait parameters may be useful in the clinical setting where gait indicators may predict outcomes that are important to older adults such as falls and mobility. The results achieved in this study also pave the way to explore the use of stand-alone radar-based sensors in long hallways for day-to-day long-term monitoring of gait parameters of older adults. The next steps may be to evaluate the Chirp sensors in situations where multiple individuals are walking to increase its applicability to real world scenarios. The possibility of the coexistence of multiple walking individuals is high, especially in the outpatient setting where the hallways are shared with several individuals including patients and their caregivers, hospital staff, and healthcare providers.

Our study presents with several strengths. We recruited a diverse group of older adults who were not frail, pre-frail, or frail on the Fit-Frailty Application. We also assessed gait parameters against the gold standard ProtoKinetics Zeno™ Walkway and assessed such parameters using several types of walks that older adults would experience under real-world conditions. Despite our strengths, our study has some limitations that should be addressed. Participants in our study did use assistive sensors while completing each walk, so it is unclear if the radar system can recognize walks with sensors such as a cane or walker. We only assessed participants’ walking toward the radar (radial direction), while those walking in other directions (e.g., lateral) were not considered in this study. The validity and reliability of the Chirp sensor to assess gait parameters in other directions should be considered in future studies as arbitrary directions may mimic real-world conditions. Lastly, the majority of participants in our study identified as female and from Caucasian descent, and were well educated, so the generalizability to diverse populations may be limited as these populations often experience mistrust and distrust with tracking sensors [39].

Lastly, it is crucial to remember that the suitability of the findings for the intended use of in-home tracking and walking speed assessment from a clinical standpoint depends on a number of variables, including the particular needs of the application, the level of accuracy and precision required, and the constraints of the sensor configuration and data processing methods employed. Although our study’s results show that the Chirp sensor has the ability to track walking parameters and identify various walking activities in clinic, more testing and validation would be required to confirm the system’s validity and reliability before it could be used in other settings such as long-term care homes where there may be multiple individuals walking in the hallway.

It’s also critical to consider the sensor setup’s limits, including the radar sensor’s resolution and range as well as any possible sources.

Conclusion

Our preliminary findings indicate that the Chirp sensor has the capacity to accurately track gait in the outpatient setting, which increases opportunities for its applications in institutional environments. The Chirp inter-sensor reliability [ICC(A,1)=0.999, 95% CI: 0.997 to 0.999] and intrasession test-retest reliability [ICC(A,1) =0.921, 95% CI: 0.725 to 0.969] were excellent across experimental conditions. Chirp sensor’s concurrent validity compared to the gold-standard ProtoKinetics Zeno™ Walkway was excellent across experimental conditions [ICC(A,1)= 0.993, 95% CI: 0.985 to 0.997]. We found a weak association between Chirp and cognition scores using the Montreal Cognitive Assessment across experimental conditions (estimated β-value= 7.79, 95% CI: 2.79 to 12.80) and no association between the Chirp and health-related quality of life using the 12-item Short Form Survey across experimental conditions (estimated β-value=6.12, 95% CI: -7.12 to 19.36). These promising results suggest that this type of radar has good potential for the timely detection of discrete and subtle gait changes that appear among older adults.

Data Availability

See file S4 in the supplementary information

Supporting information

S1 Table. 2007 STROBE Checklist for Cohort Studies.

S2 File. Ethics Approval Document.

S3 File. CHIRP Study Protocol.

S4 File. De-identified Data

References

  1. 1.↵
    World Health Organization. Global age-friendly cities: A guide [Internet]. World Health Organization; 2007 [cited 2023 Jul 31]. Available from: https://apps.who.int/iris/handle/10665/43755
  2. 2.↵
    Davis JC, Best JR, Bryan S, Li LC, Hsu CL, Gomez C, et al. Mobility Is a Key Predictor of Change in Well-Being among Older Adults Who Experience Falls: Evidence from the Vancouver Falls Prevention Clinic Cohort. Arch Phys Med Rehabil. W.B. Saunders; 2015 Sep 1;96(9):1634–40.
    OpenUrl
  3. 3.↵
    Groessl EJ, Kaplan RM, Rejeski WJ, Katula JA, King AC, Frierson G, et al. Health-Related Quality of Life in Older Adults at Risk for Disability.
  4. 4.↵
    Trombetti A, Reid KF, Hars M, Herrmann FR, Pasha E, Phillips EM, et al. Age-associated declines in muscle mass, strength, power, and physical performance: impact on fear of falling and quality of life. Osteoporosis International. Springer-Verlag London Ltd; 2016 Feb 1;27(2):463–71.
    OpenUrlCrossRef
  5. 5.↵
    Webber SC, Porter MM, Menec VH. Mobility in older adults: A comprehensive framework. Gerontologist. 2010;50(4):443–50.
    OpenUrlCrossRefPubMed
  6. 6.
    Melzer D, Lan T-Y, Guralnik JM. The predictive validity for mortality of the index of mobility-related limitation-results from the EPESE study [Internet]. Vol. 32, Age and Ageing. 2003. Available from: https://academic.oup.com/ageing/article/32/6/619/13020
  7. 7.↵
    Hoffman JM, Shumway-Cook A, Yorkston KM, Ciol MA, Dudgeon BJ, Chan L. Association of Mobility Limitations With Health Care Satisfaction and Use of Preventive Care: A Survey of Medicare Beneficiaries. Arch Phys Med Rehabil. 2007 May;88(5):583–8.
    OpenUrlPubMed
  8. 8.↵
    Brown CJ, Flood KL. Mobility limitation in the older patient: A clinical review. Vol. 310, JAMA. American Medical Association; 2013. p. 1168–77.
    OpenUrlCrossRefPubMedWeb of Science
  9. 9.↵
    Groessl EJ, Kaplan RM, Rejeski WJ, Katula JA, King AC, Frierson G, et al. Health-Related Quality of Life in Older Adults at Risk for Disability.
  10. 10.↵
    Webber SC, Porter MM, Menec VH. Mobility in older adults: A comprehensive framework. Gerontologist. 2010;50(4):443–50.
    OpenUrlCrossRefPubMed
  11. 11.↵
    Bautmans I, Knoop V, Amuthavalli Thiyagarajan J, Maier AB, Beard JR, Freiberger E, et al. WHO working definition of vitality capacity for healthy longevity monitoring. Vol. 3, The Lancet Healthy Longevity. Elsevier Ltd; 2022. p. e789–96.
    OpenUrlCrossRef
  12. 12.↵
    Dubois A, Bihl T, Bresciani JP. Identifying fall risk predictors by monitoring daily activities at home using a depth sensor coupled to machine learning algorithms. Sensors. MDPI AG; 2021 Mar 2;21(6):1–10.
    OpenUrl
  13. 13.↵
    Anwary AR, Yu H, Vassallo M. Optimal Foot Location for Placing Wearable IMU Sensors and Automatic Feature Extraction for Gait Analysis. IEEE Sens J. Institute of Electrical and Electronics Engineers Inc.; 2018 Mar 15;18(6):2555–67.
    OpenUrl
  14. 14.↵
    Rispens SM, Van Schooten KS, Pijnappels M, Daffertshofer A, Beek PJ, Van Dieën JH. Identification of fall risk predictors in daily life measurements: Gait characteristics’ reliability and association with self-reported fall history. Neurorehabil Neural Repair. SAGE Publications Inc.; 2015 Jan 19;29(1):54–61.
    OpenUrlCrossRefPubMed
  15. 15.↵
    Kaye J, Mattek N, Dodge H, Buracchio T, Austin D, Hagler S, et al. One walk a year to 1000 within a year: Continuous in-home unobtrusive gait assessment of older adults. Gait Posture. 2012 Feb;35(2):197–202.
    OpenUrlCrossRefPubMed
  16. 16.↵
    de Fátima Ribeiro Silva C, Ohara DG, Matos AP, Pinto ACPN, Pegorari MS. Short physical performance battery as a measure of physical performance and mortality predictor in older adults: A comprehensive literature review. Int J Environ Res Public Health. MDPI; 2021 Oct 2;18(20).
  17. 17.↵
    Yeung T, Wessel J, Stratford P, MacDermid J. The Timed Up and Go Test for Use on an Inpatient Orthopaedic Rehabilitation Ward. Journal of Orthopaedic and Sports Physical Therapy. 2008;38(7):410–7.
    OpenUrl
  18. 18.↵
    Barry E, Galvin R, Keogh C, Horgan F, Fahey T. Is the Timed Up and Go test a useful predictor of risk of falls in community dwelling older adults: a systematic review and meta-analysis. BMC Geriatr. 2014;14(1):14.
    OpenUrlCrossRefPubMed
  19. 19.↵
    Argañarás JG, Wong YT, Begg R, Karmakar NC. State-of-the-art wearable sensors and possibilities for radar in fall prevention. Vol. 21, Sensors. MDPI; 2021.
  20. 20.↵
    Siva P, Wong A, Hewston P, Ioannidis G, Adachi J, Rabinovich A, et al. Automatic Radar-Based Step Length Measurement in the Home for Older Adults Living with Frailty. Sensors [Internet]. 2024 Feb 6;24(4):1056. Available from: https://www.mdpi.com/1424-8220/24/4/1056
    OpenUrl
  21. 21.↵
    Bamberg SJM, Benbasat AY, Scarborough DM, Krebs DE, Paradiso JA. Gait analysis using a shoe-integrated wireless sensor system. IEEE Transactions on Information Technology in Biomedicine. 2008 Jul;12(4):413–23.
    OpenUrlCrossRefPubMed
  22. 22.↵
    Guirguis-Blake JM, Perdue LA, Coppola EL, Bean SI. Interventions to Prevent Falls in Older Adults Updated Evidence Report and Systematic Review for the US Preventive Services Task Force. Jama Network. 2024;(doi:10.1001/jama.2024.4166).
    OpenUrlCrossRef
  23. 23.↵
    Argañarás JG, Wong YT, Begg R, Karmakar NC. State-of-the-art wearable sensors and possibilities for radar in fall prevention. Vol. 21, Sensors. MDPI; 2021.
  24. 24.↵
    Zeng X, Báruson HSL, Sundvall A. Walking Step Monitoring with a Millimeter-Wave Radar in Real-Life Environment for Disease and Fall Prevention for the Elderly. Sensors. MDPI; 2022 Dec 1;22(24).
  25. 25.↵
    Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. PLOS Med. 20017;16(4).
  26. 26.↵
    Morley J, Malmstrom T, Miller D. A simple frailty questionnaire (frail) predicts outcomes in middle aged african americans. J Nutr Health Aging. 2012;16(7):601–8.
    OpenUrlCrossRefPubMedWeb of Science
  27. 27.↵
    Siva P, Wong A, Hewston P, Ioannidis G, Adachi J, Rabinovich A, et al. Automatic Radar-Based Step Length Measurement in the Home for Older Adults Living with Frailty. Sensors. 2024;24(4):1056.
    OpenUrl
  28. 28.↵
    Ferrucci L, Bandinelli S, Benvenuti E, Di Iorio A, Macchi C, Harris TB, et al. Subsystems contributing to the decline in ability to walk: Bridging the gap between epidemiology and geriatric practice in the InCHIANTI study. J Am Geriatr Soc. Blackwell Publishing Inc.; 2000;48(12):1618–25.
    OpenUrlCrossRefPubMedWeb of Science
  29. 29.↵
    O’Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014;67(1):56–64.
    OpenUrlCrossRefPubMed
  30. 30.↵
    Rockwood K, Mitnitski A. Frailty in relation to the accumulation of deficits. J Gerontol A Biol Sci Med Sci. 2007;62(7):722–7.
    OpenUrlCrossRefPubMedWeb of Science
  31. 31.↵
    Ware J, Kosinski M, Keller S. A 12-Item Short-Form Health Survey Construction of Scales and Preliminary Tests of Reliability and Validity. Med Care. 1996;34(3):220–33.
    OpenUrlCrossRefPubMedWeb of Science
  32. 32.↵
    Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment [Internet]. 2005. Available from: http://www.mocatest.
  33. 33.↵
    Walter SD, Eliasziw M, Donner A. SAMPLE SIZE AND OPTIMAL DESIGNS FOR RELIABILITY STUDIES. 1998;17(December 1996):101–10.
    OpenUrl
  34. 34.↵
    McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) [Internet]. 2012;276–82. Available from: http://www.biochemia-medica.com/node/501
  35. 35.↵
    Boroomand A, Shaker G, Morita PP, Wong A, Boger J. Autonomous Gait Speed Estimation Using 24GHz FMCW Radar Technology. In: IEE EMBS International Conference on Biomedical & Health Informatics (BHI). Las Vegas: IEE EMBS; 2018. p. 66–9.
  36. 36.↵
    Saho K, Uemura K, Sugano K, Matsumoto M. Using Micro-Doppler Radar to Measure Gait Features Associated with Cognitive Functions in Elderly Adults. IEEE Access. Institute of Electrical and Electronics Engineers Inc.; 2019;7:24122–31.
    OpenUrl
  37. 37.↵
    Wang F, Skubic M, Rantz M, Cuddihy PE. Quantitative gait measurement with pulse-doppler radar for passive in-home gait assessment. IEEE Trans Biomed Eng. IEEE Computer Society; 2014;61(9):2434–43.
    OpenUrlCrossRef
  38. 38.↵
    Stone E, Skubic M, Rantz M, Abbott C, Miller S. Average in-home gait speed: Investigation of a new metric for mobility and fall risk assessment of elders. Gait Posture. Elsevier; 2015;41(1):57–62.
    OpenUrlCrossRefPubMed
  39. 39.↵
    Tariq S, Kouroukis A, Kennedy C, Adachi J, Leckie C, Papaioannou A, et al. Challenges and opportunities in recruiting diverse older adults who are frail from the MAPS-B Study. Innov Aging [Internet]. 2023 [cited 2024 Jan 22];7(S1):721. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10738575/
    OpenUrl
Back to top
PreviousNext
Posted July 07, 2024.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
The reliability and validity of a non-wearable indoor positioning system to assess mobility in older adults: A cross-sectional study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
The reliability and validity of a non-wearable indoor positioning system to assess mobility in older adults: A cross-sectional study
Isabel B. Rodrigues, Patricia Hewston, Jonathan Adachi, Sayem Borhan, George Ioannidis, Alexa Kouroukis, Carolyn Leckie, Andrea Lee, Alexander Rabinovich, Parthipan Siva, Rachel Swance, Suleman Tariq, Lehana Thabane, Alexandra Papaioannou
medRxiv 2024.07.04.24309984; doi: https://doi.org/10.1101/2024.07.04.24309984
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
The reliability and validity of a non-wearable indoor positioning system to assess mobility in older adults: A cross-sectional study
Isabel B. Rodrigues, Patricia Hewston, Jonathan Adachi, Sayem Borhan, George Ioannidis, Alexa Kouroukis, Carolyn Leckie, Andrea Lee, Alexander Rabinovich, Parthipan Siva, Rachel Swance, Suleman Tariq, Lehana Thabane, Alexandra Papaioannou
medRxiv 2024.07.04.24309984; doi: https://doi.org/10.1101/2024.07.04.24309984

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Geriatric Medicine
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)