Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Personalizing dietary interventions by predicting individual vulnerability to glucose excursions

View ORCID ProfileVictoria Brügger, View ORCID ProfileTobias Kowatsch, View ORCID ProfileMia Jovanova
doi: https://doi.org/10.1101/2024.08.07.24311591
Victoria Brügger
1School of Medicine, University of St. Gallen, St. Gallen, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Victoria Brügger
  • For correspondence: victoria.bruegger{at}unisg.ch mia.jovanova{at}unisg.ch
Tobias Kowatsch
1School of Medicine, University of St. Gallen, St. Gallen, Switzerland
2Institute for Implementation Science in Health Care, University of Zurich, Zurich, Switzerland
3Centre for Digital Health Interventions, Department of Management, Technology and Economics, ETH Zürich, Zurich, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tobias Kowatsch
Mia Jovanova
1School of Medicine, University of St. Gallen, St. Gallen, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Mia Jovanova
  • For correspondence: victoria.bruegger{at}unisg.ch mia.jovanova{at}unisg.ch
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Elevated postprandial glucose levels pose a global epidemic and are crucial in cardiometabolic disease management and prevention. A major challenge is inter-individual variability, which limits the effectiveness of population-wide dietary interventions. To develop personalized interventions, it is critical to first predict a person’s vulnerability to postprandial glucose excursions—or elevated post-meal glucose relative to a personal baseline—with minimal burden. We examined the feasibility of personalized models to predict future glucose excursions in the daily lives of 69 Chinese adults with type-2 diabetes (M age=61.5; 50% women; 2’595 glucose observations). We developed machine learning models, trained on past individual context and meal-based observations, employing low-burden (continuous glucose monitoring) or additional high-burden (manual meal tracking) approaches. Personalized models predicted glucose excursions (F1-score: M=74%; median=78%), with some individuals being more predictable than others. The low burden-models performed better for those with consistent meal patterns and healthier glycemic profiles. Notably, no two individuals shared the same meal and context-based vulnerability predictors. This study is the first to predict individual vulnerability to glucose excursions among a sample of Chinese adults with type-2 diabetes. Findings can help personalize just-in-time-adaptive dietary interventions to unique vulnerability to glucose excursions in daily live, thereby helping improve diabetes management.

Introduction

Cardiometabolic diseases are escalating worldwide—highlighting the need for better strategies to reduce their impact1,2. For example, type-2 diabetes accounts for more than 90% of the 537 millions of diabetes cases globally3, and is expected to double to at least 1.3 billion by 20501. One key factor in the management of type-2 diabetes and related cardiometabolic diseases is postprandial glucose, which refers to blood glucose levels following meal intake4,5. More specifically, postprandial glucose excursions—defined here as increases in glucose following meals that exceed an individual’s baseline levels6,7—contribute to elevated HbA1c levels and pose an independent risk factor of cardiovascular disease8. Importantly, these glucose excursions are measurable and modifiable on a daily basis. Increased evidence suggests that dietary changes that reduce the intensity and frequency of glucose excursions can help manage and potentially prevent these diseases9–12.

Relatedly, diet is a crucial intervention target for glycemic excursions and type-2 diabetes management more broadly1,2. However, people interact with and respond to foods very differently, which poses a key challenge in dietary intervention development13,14. Individuals’ blood glucose levels vary widely in response to the same foods13,14, and people live in diverse socio-cultural and economic environments, with varying eating preferences and habits15,16. Altogether, this complex inter-individual variability limits the effectiveness of population-wide dietary recommendations for glycemic health17. In response, recent work (see example Refs.13,18,19,20) suggests moving beyond ‘one-size-fits-all’ dietary recommendations, and towards personalized strategies that account for individual factors. However, there exists no formal, established method to implement such personalization effectively21.

Clinical trials have begun to explore personalized dietary approaches through deep phenotyping22, which involves integrating detailed patient data such as microbiota profiles, food logs, blood tests, and clinical history23,24 to improve metabolic parameters. One trial, for instance, tailored dietary recommendations using deep phenotyping to predict postprandial glucose predictions. The tailored diet led to short-term improvements in postprandial glucose levels for both healthy and pre-diabetic participants10. In another trial, personalized food scores were created through deep phenotyping, which included analyzing microbe data, dietary patterns, glucose monitoring, cardiovascular risk, and medical history in a representative sample of U.S. adults. The 18-week program, which also offered nutrition and lifestyle education, successfully reduced waist circumference but did not affect triglyceride levels25. Additionally, a recent study among newly diagnosed type-2 diabetes patients combined medical and dietary history, microbiome analysis, food logging, and nutritionist consultations to develop personalized dietary recommendations. These tailored recommendations resulted in better metabolic outcomes over six months compared to a standard Mediterranean diet23. While these personalization approaches show potential, they are often costly and require multiple in-person visits and clinical tests, thus making them less feasible and accessible in individuals’ daily lives26. A key open question is how to develop dietary interventions dietary interventions for cardiometabolic disease prevention and management that are more scalable, lower-burden, and more precise at the individual level?

Advances in digital health technologies offer promising solutions for developing personalized dietary interventions that can be more easily integrated into individuals’ daily lives27,28—without laboratory tests and in-clinic visits. An increasingly popular approach in this direction, drawing on the health behavior change and reinforcement literature, involves just-in-time adaptive interventions (JITAIs)29. JITAIs continuously collect individualized data from mobile devices (e.g., wearables and smartphones) with an aim to trigger support at the right time when it is needed. JITAIs aim to recognize individualized patterns and to respond to vulnerable states—periods or triggers of increased susceptibility to signals like postprandial glucose excursions29. For example, when detecting a high vulnerability state to glucose excursions, JITAIs can deploy, and dynamically adapt, personalized smartphone notifications with meal and dietary recommendations, in quasi real-time30.

While JITAIs have only begun to appear in diabetes self-management31,32,their application for dietary interventions for glycemic control, particularly for type-2 diabetes, is still in its infancy. Thus, a crucial first step in developing dietary JITAI that aim to reduce the intensity and frequency of glucose deviations, is to identify factors that best predict an individual’s vulnerability to glucose excursions4. This involves pinpointing specific theory-driven triggers, such as meal content and contextual patterns23, that indicate when a person is most at risk for glucose excursions. For instance, analyzing an individual’s past meal habits and patterns, as well as temporal context, (e.g., mealtime) can help anticipate future vulnerability periods33. For some individuals, the intake of high-glycemic foods, like refined carbohydrates, may accurately predict glucose excursions34. For others, the main triggers could be the specific timing of their sweet intake after dinner; or a combination of mealtime and the nature of their past glucose excursions35. Understanding both the timing and composition of meals may be essential for making accurate, individualized predictions. However, the degree to which individuals differ in their vulnerability predictors has not been examined systematically, with some early studies often assuming that triggers (e.g., carbohydrate intake) remain consistent across individuals36,37. Mapping out individual vulnerability patterns to glucose excursions, may allow for new opportunities to derive key tailoring variables; meaning individual-level information that is used to decide when (i.e., under what conditions) to provide a dietary JITAI29.

To identify potential triggers of postprandial glucose excursions in individuals’ daily lives, two popular methods include manual meal tracking and continuous glucose monitoring (CGM). Meal tracking is often done through ecological momentary assessment (EMA), where individuals actively log their dietary intake and other behaviors using mobile apps38,39. While manual meal tracking can provide detailed information about meal content, it requires significant participant effort to log each meal, thus resulting in high data collection burden. On the other hand, CGM uses a small sensor placed on the arm to provide passive, near real-time monitoring of interstitial glucose levels, requiring no active user input40. Initially developed for type-1 diabetes care41, CGMs are increasingly used to manage type-2 diabetes, with increased reimbursement among individuals on insulin medication40. While less burdensome, CGMs are currently more costly than meal-tracking alternatives. Further, while CGM offers a low-burden, continuous monitoring of past glucose trends, manual meal logging provides more granular details about meal content but at the cost of higher user involvement.

Together, both data streams can be used to develop individual vulnerability profiles to glucose excursions in daily life, and outside the clinic. These signals can then be integrated to predict vulnerability states and trigger dietary JITAIs, for example delivered through ubiquitous smartphones. However, an open question is to what extent CGM, and manual meal logging approaches provide complementary value for predicting postprandial glucose excursions, or if one method may be more applicable for some individuals over others. Examining this question is important to guide methodological decisions, about when to employ CGM or manual meal tracking collection for participant profiling, as these data collection methods may be tailored to an individual’s specific circumstances in dietary JITAI development.

To this end, this study employs both low-burden (passive CGM monitoring) and high-burden (manual meal logging) approaches to predict individual postprandial glucose excursions and examine individual differences in vulnerability states. Motivated by prior work10, we test the feasibility of personalized machine learning models to predict individual vulnerability to postprandial glucose excursions. We examine: (1) to what extent do low-burden and high-burden personalized models predict postprandial glucose excursions at the individual level? (2) How does the performance of low-burden and high-burden models vary across individuals? (3) How do vulnerability states, or predictors of postprandial glucose excursions, vary across individuals?

To examine these research questions, we analyzed ∼12-day of CGM, contextual, and meal patterns data collected from 69 adults with type-2 diabetes in Shanghai, China; a highly relevant context as China has one of the highest diabetes prevalence rates globally42. We developed personalized, machine learning models, trained on individual past meals and context-based features from the past ∼6 days, to predict vulnerability to future postprandial glucose excursions, within an observational, daily life setting. Following prior work6, we classified glucose excursions, as values that surpass the average of the previous postprandial glucose level relative to individual baselines, and we use F1-score as primary metric of model evaluation43, as a combined metric of precision and recall that is not sensitive to class imbalance44. This approach aims to lay the groundwork for signals into developing more precise dietary JITAIs for postprandial glucose excursions, and more broadly type-2 diabetes management.

Results

Descriptives

On average, participants (N=69) showed a baseline glycated hemoglobin (HbA1c) values at 67.6 mmol/mol (SD=24.2), and fasting glucose at 158.54 mg/dl (59.45), both consistent with previously established type-2 diabetes criteria45,46. Participants reported an average of 3.37 (SD=0.68) meals daily, over the course of approximately 12.9 (SD=2.18) days. On average, participants reported consuming a total of 958g (SD=327.83) daily. The average daily intake included: 233.9g (SD=137.6) of staples, 146.3g (SD=66.6) of animal foods, 167.7g (SD=98.4) of vegetables, 30.1g (SD=58.6) of fruits, 8.5g (SD=11.9) of legumes and nuts, 86.9g (SD=13.72) of dairy, and 1.57g (SD=4.25) of sweets. The average participant showed a postprandial glucose value of 155.19 mg/dl (SD=33.29 mg/dl) and had 37.6 postprandial blood glucose observations (SD=10.5) available for analyses. Overall, 2’595 postprandial glucose observations were included in analyses. From these values, 1’099 glucose observations were classified as glucose excursions, resulting in an overall balanced class split of 41.7% (SD=12.4%) on average per individual. Most participants (n=65; 94%) reported taking hypoglycemia medications. For more details see Table S1 for demographic characteristics of the sample; Fig. S1 for Study flowchart and participant exclusion criteria.

Personalized models predict individual postprandial glucose excursions

In line with our first research question, we examined the degree to which personalized models predict future postprandial glucose excursions at the individual level. Overall, the best personalized models— combining low and high-burden approaches—predicted future individual glucose excursions with a mean F1-score of 74% (median=78%, SD= 17%). The low-burden approach, developed by training the model on ∼6 days of past individual-level CGM observations, resulted in a mean F1-score of 72% (median=77%, SD=19%). The high-burden approach, developed by training the model on additional manual meal tracking over ∼6 days resulted in a mean F1-score of 71% (median=75%, SD=19%). See Fig. 1A for model density plots; and see Table S2, ‘Model performance metrics’ for precision, recall, and additional performance metrics.

Fig 1.
  • Download figure
  • Open in new tab
Fig 1.

Model performance. (A) Performance metrics for the best personalized models, high-burden models, and low-burden models to predict individual postprandial glucose excursions. The best personalized model compares the performance of the low-burden and high-burden models and selects the higher-performing model for each individual. (B) Inter-individual variability in predictive performance across individuals, with dots showing the median across both low-burden and high-burden models per each individual; and the line showing the within-person range across both low-burden and high-burden model performance. Visualization for Fig. 1B is adapted from Refs.47,48 F1-scores are presented as decimal points.

Further, inspecting the F1-scores at the individual-level showed wide differences in predictability between individuals, and some degree of variability across data-collection approaches. As visualized in Fig. 1B, the range of F1-scores varied considerably between individuals, suggesting that postprandial glucose excursions were more easily predictable for some individuals than for others (overall range in F1-scores 17%-100%).

Individual differences in low-burden vs. high-burden model performance

Our second research question examined individual differences in model performance across both high-burden and low-burden approaches—or the degree to which low-burden vs. high-burden models performed differently across individuals. No model performed the best across all participants. We found that the low-burden model performed better for 33% of the sample (n=23); the high burden model performed better for 28% (n=19) individuals; and no differences in model performance for the remaining 39% (n=27) participants. See Fig. 2 for individual slopes across both low- and high-burden models. Wilcoxon signed-rank tests showed that for the first subset, the low-burden model significantly improved the median F1-score by 12.2%, from 61.5% (high-burden model) to 73.7% (low-burden model) (Z =5.17, p <0.001, n=23; Fig. 2A). In contrast, for the second subset, the high-burden model significantly improved the F1-score median by 11.1%, from 66.7% (low-burden model) to 77.8% (high-burden model) (Z =3.80, p <0.001; n=19; Fig. 2B).

Fig 2.
  • Download figure
  • Open in new tab
Fig 2.

Individual differences in low-burden vs. high-burden model performance. F1-score comparison across both low-burden and high-burden models predicting individual postprandial glucose excursions. (A) Individuals for whom the low-burden (vs. high-burden) models performed better. (B) Individuals for whom the high-burden (vs. low burden) models performed. (C) Individuals for whom both low-burden and high-burden models performed similarly. Statistics are based on the paired Wilcoxon signed-rank test. Individual slopes are shown by gray lines, and the median is represented by the bold black line. Three individuals for whom the F1-scores could not be calculated were excluded from the visualization.

Vulnerability predictors vary widely across individuals

We next examined which predictors (meal and temporal context-based) mattered most to predict future postprandial glucose excursions at the individual level, and how these “top” vulnerability predictors vary across individuals. Following Ref.6, we determined the percent importance of each feature from the total feature importance for the best performing model for each participant. See Table S3 for feature categorizations across additional high-burden and low-burden models.

As shown in Fig. 3, no two participants shared the same feature importance patterns, in both direction and strength. Individuals varied widely in which predictors best predicted future postprandial glucose excursions. For individuals for whom the high-burden model performed best, the top three features included total grams intake, vegetable intake, and the hour of day. However, neither of these top features were shared across all participants (See Fig. 3). The top feature, total grams intake, had importance scores ranging from 0% to 71.4% (M= 22.7%); and was only shared across 63% (n=12) participants. Vegetable intake had an average importance of 17.5%, ranging from 0% to 90.7%, across 63% (n=12) participants; and the hour of the day had an average importance of 9.5%, ranging from 0% to 51.9%, shared across 37% participants (n=7).

Fig 3.
  • Download figure
  • Open in new tab
Fig 3.

Feature importance predicting future postprandial glucose excursions. Importance among participants for whom (A) the high-burden model or the (B) low-burden model performed best, showcasing the diversity in the importance of predictors across individuals. The feature importance of each category (e.g., meals and temporal context) is represented by the percent importance from the total feature importance per individual6. Two individuals for whom feature importance could not be calculated were excluded in the low-burden model.

For individuals for whom the low-burden model performed best, the three top features included hour of day, time in study period, and day of the week. The top feature, hour of the day, had an average importance of 55.1% (range=0%-100%), shared across 91% (n=21) individuals. The day in the study period had an average importance of 16%, (range=0%-83.5%) and was shared across 70% participants (n=16). Further, day of the week had an average importance of 8.8%, (range=0%-46.2%), and was shared among 71% (n=15) individuals. See Fig. S2 and S3 additional feature importance plots for individuals for whom the high-burden and low-burden models performed equally, and for SHAP values49, showing the direction and strength of feature importance across high-burden and low-burden models.

Personalizing dietary JITAIs based on individual vulnerability to postprandial glucose excursions

Mapping individual vulnerability patterns to postprandial glucose excursions can provide new opportunities to guide when (i.e., under what conditions) to provide a dietary JITAI29. For example, for the participant highlighted in Fig. 3A, postprandial glucose excursions were best predicted by their prior staple and sweet intake. For this individual, text-message notifications could be developed around the key mealtimes when staple and sweet intake combined is most expected. For example, on Friday evenings, when an individual is most likely to consume staples and sweets (based on past individual meal profiling), a notification could advise them to avoid these combinations and to instead opt for lower-glycemic alternatives. Here, lower-glycemic alternative recommendations could be derived based on meal contents that were most likely to reduce postprandial glucose excursions in the past. In turn, postprandial glucose excursions for the participant illustrated in Fig. 3B, are mainly predicted by temporal context-based factors (e.g., time of day). Here, time-sensitive notifications could be optimized during key risk periods, such as breakfast, identified as a highly vulnerable period for this individual. Drawing on behavior change theories, alternative breakfast choice recommendations could be paired with motivational messages such as cues to action from the Health Belief Model or self-efficacy messages from Social Cognitive Theory50 to motivate dietary changes. These two examples demonstrate how modeling inter-individual variability to glucose excursions can help design and trigger personalized JITAIs in near-real time. By integrating vulnerability triggers, dietary interventions may be more effectively customized to meet each person’s unique needs, thereby improving their postprandial glucose levels and overall diabetes management.

Discussion

Individuals vary widely in their dietary patterns, habits, and daily environments, making it difficult to apply universal dietary recommendations for diabetes management effectively. This inter-individual variability underscores the need for personalized dietary intervention strategies18,13,20, particularly for managing postprandial glucose excursions in type-2 diabetes. In this study, we aimed to set the groundwork for dietary JITAIs by developing personalized machine learning models for predicting, and potentially preventing, postprandial glucose excursions, a key outcome in type-2 diabetes management4.

As a foundational step in JITAI development51, it is essential to first identify what factors best predict an individual’s vulnerability to postprandial glucose excursions. More specifically, we developed personalized machine learning models using two approaches: a low-burden method involving week-long CGM and a high-burden approach with additional manual, meal tracking to predict individual postprandial glucose excursions. We analyzed meal and context-based patterns among a sample of Chinese adults with type-2 diabetes, who were taking hypoglycemia medication. We aimed to evaluate model performance and to examine inter-individual variability in predictability and in feature importance across individuals.

Overall, we found that personalized models were able to predict future glucose excursions (F1-score: M= 74%; median=78%), similar to scores in prior work10. However, we observed substantial inter-individual variability. For some participants, the low-burden model was more predictive; for others, the high-burden model performed better, or showed no difference. Notably, the importance of meal and context-based features predicting postprandial glucose excursions varied widely across individuals. These results indicate that is no single vulnerability to glucose excursions shared across all participants.

These results extend prior work in several ways. First, earlier studies, (e.g. Refs.10,52) have highlighted the promise of deep phenotyping using lab data (e.g., combining blood tests, microbiome profiling, health history, nutrition consultations) to predict glycemic responses and tailor dietary interventions, however the trade-offs between comprehensive data collection and associated time, burden, and cost remain unclear. An open question is whether individual phenotyping to personalize dietary interventions could be completed with lower-burden alternatives in individuals’ daily lives. To this end, our study included both low-burden CGM and high-burden manual meal tracking approaches at the individual level, thus offering a comparison of their performance. Our results, suggest that ∼6 day remote participant profiling (using CGM or manual meal-tracking) may offer a more scalable substitute for predicting postprandial glucose excursions, and personalizing dietary interventions, relative to more burden intensive lab-based phenotyping profiling approaches10. However, future research may compare different profiling methods systematically, with further cost-benefit analysis.

Both CGM and manual meal tracking approaches can be integrated into JTAIs as individuals’ go about their daily lives29. However, our results suggest that these approaches may perform differently across different individuals to predict postprandial glucose excursions, which can inform decisions on when to select one approach over another. To explore which model worked better for whom, we conducted follow-up analyses to test if baseline characteristics, such as glycemic profiles (baseline HbA1c and fasting glucose), dietary patterns (based on manual meal logging), or demographics, were associated with the individual differences in low-versus high-burden model performance. Latent profile analysis indicated that individuals with lower BMI, healthier glycemic profiles (lower baseline HbA1c and fasting glucose), more consistent mealtimes over the meal logging period, and higher intake of vegetables and staple foods were more accurately predicted by the low-burden (CGM monitoring) approach compared to the high-burden (meal tracking) approach (X2 (4, N =69) = 14.485, p < .01). These findings suggest that baseline heuristics, e.g., meal patterns and individual characteristics may perhaps help used to predict which approach is more predictive, and when, thus optimizing data collection. However, further research is necessary to validate these findings in a confirmatory setting.

While prior studies have developed several different algorithms for postprandial glucose prediction6,10, these have yet to be integrated into dietary JITAI frameworks. We extend this line of work by highlighting the feasibility of short-term (∼6 day) CGM and meal-tracking participant profiling to capture individual vulnerability to postprandial glucose excursions in a type-2 diabetes context, and to provide time-sensitive tailoring variables for JITAI development. However, to fully integrate these predictive models, future research should move from observational studies to controlled experiments; thus, validating these personalized models into a micro-randomized JITAI framework and comparing their effectiveness to generic, population-wide dietary interventions.

Our study offers high ecological validity by being conducted in a real-life setting, which enhances the relevance of our findings. Further, this study is the first to our knowledge to predict individual vulnerability to postprandial glucose excursions among a sample of Chinese adults with type-2 diabetes; with implications to integrate these individual differences into JITAI development. However, several limitations should be considered. Firstly, the dietary logs focused on meals, which may under report snacking. For example, participants reported very low consumption of sweets during the tracked period. Additionally, the sample comprised primarily Chinese adults, who reside in Shanghai with type-2 diabetes who were predominantly using hypoglycemia medications, which may limit the generalizability of the results53. For example, individuals with different ethnicities vary in baseline postprandial glucose levels54. To broaden the generalizability of these findings, further research is necessary with diverse ethnic groups, non-medicated individuals, and populations with type-1 diabetes or prediabetes. Future studies should also consider incorporating automated food tracking technologies to reduce participant burden of manual food logging55. Further, incorporating additional wearables to monitor sleep, physical activity, heart rate variability, and stress, can potentially enhance the predictability of postprandial glucose levels56. For example, research integrating wearable data has demonstrated that it is possible to improve the F1-score for postprandial glucose level predictions to 84-86% among healthy individuals6. Nevertheless, our current findings suggest that CGM and temporal data alone may already provide a promising level of predictability, for some individuals in the type-2 diabetes context.

In conclusion, our findings show that personalized machine learning models, drawing on CGM or manual meal tracking, can feasibly predict future postprandial glucose excursions among a sample of Chinese adults with type-2 diabetes, with model performance and predictors varying considerably among individuals. By employing ∼6-day CGM or manual-meal tracking profiling, interventionists can identify individual vulnerabilities to glucose excursions, thus laying the groundwork for dietary JITAIs. Future research should integrate these predictive models into JITAIs to further optimize diabetes care.

Methods

We used a publicly available, observational dataset focusing on individuals with type-2 diabetes recruited in Shanghai, China 57. The dataset is made public with an aim to advance machine learning models to optimize personalized lifestyle recommendations and glycemic control. In this dataset, patients were recruited from Diabetes Data Registry and Individualized Lifestyle Intervention in Shanghai East Hospital (September 2019 to March 2021) and Shanghai Fourth Peopleś Hospital (June 2021 to November 2021), respectively. As we only used anonymized data, ethics approval was not applicable. The original data collection study was approved by the Ethics Committee of Shanghai Fourth People’s Hospital and Shanghai East Hospital affiliated to Tongji University in accordance with the Declaration of Helsinki. Informed consent was obtained from all the patients.

Participants

Eligible participants included 106 patients diagnosed with diabetes-type 2 according to the 1999 World Health Organization (WHO) criteria 58, aged 18 or older, willing to sign the informed consent form, and having CGM recordings for at least 3 days. Patients were excluded if they reported alcohol or drug abuse, were unable to comply with the study, or were deemed unsuitable by the original investigators who completed the data collection. Our analysis included 69 participants with type-2 diabetes, with a total 2’595 postprandial glucose observations. Thirty-seven participants were excluded from our analyses: n=1 for having no postprandial glucose measures, n=36 for not having insufficient postprandial glucose measures to split the data in a train-test split (<20 observations in total), and n=3 due to insufficient variability to run the predictive models, with all observations belonging to the same class (see Supplement Flowchart Fig S1 ‘Study flowchart and exclusion criteria’).

Study procedure

As part of the data collection, participants were instructed to wear a continuous glucose monitoring device (FreeStyle Libre H, Abbott Diabetes Care, Witney, UK) to measure interstitial glucose levels continuously for up to 14 days, and to report the contents of their meals, and their diabetes medicine intake using event-based EMA surveys. Participants also provided laboratory blood measurements, collected 6 months prior to the study.

Measures

Data for model building included EMA-based meal content records, diabetes medicine intake records, CGM recordings, and temporal, context-based measures. See Supplement Tab. S3 ‘Features categorization’ for the full feature list and categorization.

Meal content features

Participants logged their meals throughout the study, and these logs were categorized into food groups commonly consumed in China59, which include: (1) staples (e.g., rice, noodles), (2) vegetables, (3) fruits, (4) animal foods (e.g., chicken, eggs), (5) dairy products, (6) legumes, nuts, and seeds, and expanded with (7) sweets, which are associated with blood glucose levels. These food groups were used once as binary variables and once as food group grams per meal. Additionally, total grams of food intake were assessed. All these variables were calculated for the current period and lagged for the previous 8-hour intake and the previous 24-hour intake based on prior work. Resulting into 45 dietary features.

Diabetes medicine-intake features

Participants recorded their daily insulin and non-insulin diabetes hypoglycemia medication intake including the exact timing. Medication logs were converted into time-varying variables to account for the different effects and doses of diabetes insulin medications on blood sugar levels over time. Basal and intermediate-acting insulins have a gradual effect over 2 to 24 hours 60,61; bolus insulin acts quickly within 15 minutes to 4 hours62; and non-insulin hypoglycemic agents start working immediately and last for about 6 hours63. Leading to 10 diabetes medicine-intake features.

Temporal features

Temporal features were created from the time stamps in the EMA logs. Variables were created for meal time, day of the month, months of the year, hour of the day and day of the study duration. To account for possible fasting periods, binary meal time indication in the last 8 hours and 24 hours, day of the week, were also included.

Postprandial glucose excursions

Based on previous research6, we calculated personalized postprandial glucose excursions, relative to an individuals’ baseline, as our main outcome. A binary variable for 2-hour postprandial glucose was determined after each self-reported meal, indicating whether it was higher or lower than the previous mean postprandial glucose measure, thus providing each participant with a personal rolling baseline. This allowed us to compute postprandial blood glucose excursions approximately 2 hours after each meal relative to each participant’s previous value. The first observation was excluded as no previous mean postprandial glucose could be determined. We also included each individual’s lagged value as a feature to reflect their postprandial glucose levels from the meal before.

Data analyses

Model development

We developed two personalized machine learning models for each participant, a low-burden and a high-burden model. The low-burden model included the following features: previous postprandial glucose excursion, medicine-intake (non-insulin hypoglycemic agents and bolus, basal, and intermediate insulin intake, dose, and effect time), and temporal features (such as mealtime, time of day). The high burden-model included the same features, in addition to dietary intake (food groups and total intake per meal, in the last 8 and 24 hours). See Supplement Table S3 ‘Features categorization’ for full features and their categorization. Any missing values were imputed using single imputation, and missingness dummy variable columns were introduced in the model.

To predict postprandial glucose excursions, we employed personalized Extreme Gradient Boosting (XGBoost) 64, a composite learning algorithm used in similar, prior work65, and used F1-score as our main model performance metric. All analyses were conducted using R version 4.3.2.

Rolling origin cross-validation

For each individual, we employed a 70/30 within-person training-test split due to the time series nature of the data. The first 70% of the observations served as the training set, while the remaining 30% was used as the test set. To determine the final model, we performed time series rolling origin cross-validation (CV) with four folds on the training set. Rolling origin cross-validation involves sequentially expanding the training data window while keeping the test data fixed. This approach is specific to time-series data and ensures that the model does not use future information to predict past events48,66.

Hyper-parameter tuning

Hyperparameters for XGBoost were determined using a 4-fold cross-validation (CV) grid search method (nrounds = seq(from = 50, to = 150, by = 50); eta = c(0, 0.0001, 0.001, 0.01, 0.015); max_depth = c(1, 2, 3); gamma = c(−0.5, 0, 0.5); colsample_bytree = c(0.5, 1, 2); min_child_weight = c(1, 2); subsample = 1), which systematically explores various combinations to find the optimal settings based on predefined criteria.

Feature importance

To determine the feature importances for both high-burden and low-burden models, we used eXtreme Gradient Boosting (XGBoost) importance and SHAP value per participant49.

Data Availability

All data produced are available online at:

https://figshare.com/collections/Diabetes_Datasets_ShanghaiT1DM_and_ShanghaiT2DM/6310860/2

Funding Statement

V.B., T.K., and M.J. are affiliated with the Centre for Digital Health Interventions, a joint initiative of the Institute for Implementation Science in Health Care, University of Zurich, the Department of Management, Technology, and Economics at ETH Zurich, and the Institute of Technology Management and School of Medicine at the University of St.Gallen, Centre for Digital Health Interventions is funded in part by Mavie Next, an Austrian health care provider, CSS, a Swiss health insurer, and MTIP, a growth equity firm. TK was also a co-founder of Pathmate Technologies, a university spin-off company that creates and delivers digital clinical pathways. However, Mavie Next, CSS, MTIP or Pathmate Technologies were involved in this protocol. The authors declare no competing interests.

References

  1. 1.↵
    GBD 2021 Diabetes Collaborators. Global, regional, and national burden of diabetes from 1990 to 2021, with projections of prevalence to 2050: a systematic analysis for the Global Burden of Disease Study 2021. Lancet 402, 203–234 (2023).
    OpenUrlCrossRefPubMed
  2. 2.↵
    Chew, N. W. S. et al. The global burden of metabolic disease: Data from 2000 to 2019. Cell Metab. 35, 414–428.e3 (2023).
    OpenUrlCrossRefPubMed
  3. 3.↵
    Ahmad, E., Lim, S., Lamptey, R., Webb, D. R. & Davies, M. J. Type 2 diabetes. Lancet 400, 1803–1820 (2022).
    OpenUrlCrossRef
  4. 4.↵
    Ceriello, A. Postprandial hyperglycemia and diabetes complications: is it time to treat? Diabetes 54, 1–7 (2005).
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    Vlachos, D., Malisova, S., Lindberg, F. A. & Karaniki, G. Glycemic Index (GI) or Glycemic Load (GL) and Dietary Interventions for Optimizing Postprandial Hyperglycemia in Patients with T2 Diabetes: A Review. Nutrients 12, (2020).
  6. 6.↵
    Bent, B. et al. Engineering digital biomarkers of interstitial glucose from noninvasive smartwatches. NPJ Digit Med 4, 89 (2021).
    OpenUrl
  7. 7.↵
    Monnier, L., Colette, C. & Owens, D. Postprandial and basal glucose in type 2 diabetes: assessment and respective impacts. Diabetes Technol. Ther. 13 Suppl 1, S25–32 (2011).
    OpenUrlPubMed
  8. 8.↵
    Hershon, K. S., Hirsch, B. R. & Odugbesan, O. Importance of Postprandial Glucose in Relation to A1C and Cardiovascular Disease. Clin. Diabetes 37, 250–259 (2019).
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    Tay, J., Thompson, C. H. & Brinkworth, G. D. Glycemic Variability: Assessing Glycemia Differently and the Implications for Dietary Management of Diabetes. Annu. Rev. Nutr. 35, 389–424 (2015).
    OpenUrl
  10. 10.↵
    Zeevi, D. et al. Personalized Nutrition by Prediction of Glycemic Responses. Cell 163, 1079–1094 (2015).
    OpenUrlCrossRefPubMed
  11. 11.
    Skyler, J. S. Effects of Glycemic Control on Diabetes Complications and on the Prevention of Diabetes. Clin. Diabetes 22, 162–166 (2004).
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    Bitew, Z. W. et al. Prevalence of Glycemic Control and Factors Associated With Poor Glycemic Control: A Systematic Review and Meta-analysis. Inquiry 60, 469580231155716 (2023).
    OpenUrl
  13. 13.↵
    Pasmans, K., Meex, R. C. R., van Loon, L. J. C. & Blaak, E. E. Nutritional strategies to attenuate postprandial glycemic response. Obes. Rev. 23, (2022).
  14. 14.↵
    Berry, S. E., et al. Publisher Correction: Human postprandial responses to food and potential for precision nutrition. Nat. Med. 26, 1802 (2020).
    OpenUrl
  15. 15.↵
    Enriquez, J. P. & Archila-Godinez, J. C. Social and cultural influences on food choices: A review. Crit. Rev. Food Sci. Nutr. 62, 3698–3704 (2022).
    OpenUrl
  16. 16.↵
    Chen, P.-J. & Antonelli, M. Conceptual Models of Food Choice: Influential Factors Related to Foods, Individual Differences, and Society. Foods 9, (2020).
  17. 17.↵
    Kris-Etherton, P. M., et al. Barriers, Opportunities, and Challenges in Addressing Disparities in Diet-Related Cardiovascular Disease in the United States. J. Am. Heart Assoc. 9, e014433 (2020).
    OpenUrlPubMed
  18. 18.↵
    Guizar-Heredia, R. et al. A New Approach to Personalized Nutrition: Postprandial Glycemic Response and its Relationship to Gut Microbiota. Arch. Med. Res. 54, 176–188 (2023).
    OpenUrl
  19. 19.↵
    Merino, J. Precision nutrition in diabetes: when population-based dietary advice gets personal. Diabetologia 65, 1839–1848 (2022).
    OpenUrl
  20. 20.↵
    Heber, D., Li, Z. & Ordovas, J. Precision Nutrition: The Science and Promise of Personalized Nutrition and Health. (Elsevier, 2023).
  21. 21.↵
    Bush, C. L. et al. Toward the Definition of Personalized Nutrition: A Proposal by The American Nutrition Association. J. Am. Coll. Nutr. 39, 5–15 (2020).
    OpenUrlPubMed
  22. 22.↵
    de Toro-Martín, J., Arsenault, B. J., Després, J.-P. & Vohl, M.-C. Precision Nutrition: A Review of Personalized Nutritional Approaches for the Prevention and Management of Metabolic Syndrome. Nutrients 9, (2017).
  23. 23.↵
    Rein, M. et al. Effects of personalized diets by prediction of glycemic responses on glycemic control and metabolic health in newly diagnosed T2DM: a randomized dietary intervention pilot trial. BMC Med. 20, 56 (2022).
    OpenUrlCrossRefPubMed
  24. 24.↵
    Hillesheim, E., Yin, X., Sundaramoorthy, G. P. & Brennan, L. Using a Metabotype Framework to Deliver Personalized Nutrition Improves Dietary Quality and Metabolic Health Parameters: A 12-Week Randomized Controlled Trial. Mol. Nutr. Food Res. 67, e2200620 (2023).
    OpenUrl
  25. 25.↵
    Bermingham, K. M. et al. Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial. Nat. Med. 30, 1888–1897 (2024).
    OpenUrlCrossRefPubMed
  26. 26.↵
    Wang, D. D. & Hu, F. B. Precision nutrition for prevention and management of type 2 diabetes. Lancet Diabetes Endocrinol 6, 416–426 (2018).
    OpenUrl
  27. 27.↵
    Huynh, P., Fleisch, E., Brändle, M., Kowatsch, T. & Jovanova, M. Digital health technologies for metabolic disorders in older adults: A scoping review protocol. bioRxiv (2024) doi:10.1101/2024.02.26.24303372.
    OpenUrlCrossRef
  28. 28.↵
    Keshet, A., Reicher, L., Bar, N. & Segal, E. Wearable and digital devices to monitor and treat metabolic diseases. Nat Metab 5, 563–571 (2023).
    OpenUrl
  29. 29.↵
    Nahum-Shani, I. et al. Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support. Ann. Behav. Med. 52, 446–462 (2018).
    OpenUrlCrossRefPubMed
  30. 30.↵
    Thomas, J. G. & Bond, D. S. Behavioral response to a just-in-time adaptive intervention (JITAI) to reduce sedentary behavior in obese adults: Implications for JITAI optimization. Health Psychol. 34S, 1261–1267 (2015).
    OpenUrl
  31. 31.↵
    Daryabeygi-Khotbehsara, R., et al. Just-In-Time Adaptive Intervention to Sit Less and Move More in People With Type 2 Diabetes: Protocol for a Microrandomized Trial. JMIR Res. Protoc. 12, e41502 (2023).
    OpenUrl
  32. 32.↵
    Zhao, L. et al. A micro-randomized pilot study to examine the impact of just-in-time nudging on after-dinner snacking in adults with type 2 diabetes: A study protocol. Diabetes Obes. Metab. 25, 2439–2446 (2023).
    OpenUrl
  33. 33.↵
    Munoz-Organero, M. Deep Physiological Model for Blood Glucose Prediction in T1DM Patients. Sensors 20, (2020).
  34. 34.↵
    Murillo, S. et al. Culinary strategies to manage glycemic response in people with type 2 diabetes: A narrative review. Front Nutr 9, 1025993 (2022).
    OpenUrl
  35. 35.↵
    Tsereteli, N. et al. Impact of insufficient sleep on dysregulated blood glucose control under standardised meal conditions. Diabetologia 65, 356–365 (2022).
    OpenUrlCrossRef
  36. 36.↵
    Pearce, K. L., Noakes, M., Keogh, J. & Clifton, P. M. Effect of carbohydrate distribution on postprandial glucose peaks with the use of continuous glucose monitoring in type 2 diabetes. Am. J. Clin. Nutr. 87, 638–644 (2008).
    OpenUrlAbstract/FREE Full Text
  37. 37.↵
    Shukla, A. P. et al. Carbohydrate-last meal pattern lowers postprandial glucose and insulin excursions in type 2 diabetes. BMJ Open Diabetes Res Care 5, e000440 (2017).
    OpenUrlAbstract/FREE Full Text
  38. 38.↵
    Shiffman, S., Stone, A. A. & Hufford, M. R. Ecological momentary assessment. Annu. Rev. Clin. Psychol. 4, 1–32 (2008).
    OpenUrlCrossRefPubMedWeb of Science
  39. 39.↵
    Jovanova, M. et al. Psychological distance intervention reminders reduce alcohol consumption frequency in daily life. Sci. Rep. 13, 12045 (2023).
    OpenUrl
  40. 40.↵
    Carlson, A. L., Mullen, D. M. & Bergenstal, R. M. Clinical Use of Continuous Glucose Monitoring in Adults with Type 2 Diabetes. Diabetes Technol. Ther. 19, S4–S11 (2017).
    OpenUrlPubMed
  41. 41.↵
    Giger, O. F., Pfitzer, E., Mekniran, W., Gebhardt, H., Fleisch, E., Jovanova, M., & Kowatsch, T. Collaboration and Innovation Patterns in Diabetes Ecosystems. bioRxiv (2024) doi:10.1101/2024.04.25.24306351.
    OpenUrlCrossRef
  42. 42.↵
    Liu, J. et al. Projected rapid growth in diabetes disease burden and economic burden in China: a spatio-temporal study from 2020 to 2030. Lancet Reg Health West Pac 33, 100700 (2023).
    OpenUrl
  43. 43.↵
    Agah, A. Medical Applications of Artificial Intelligence. (CRC Press, 2013).
  44. 44.↵
    Wu, J., Zhao, Z., Sun, C., Yan, R. & Chen, X. Learning from class-imbalanced data with a model-agnostic framework for machine intelligent diagnosis. Reliab. Eng. Syst. Saf. 216, 107934 (2021).
    OpenUrl
  45. 45.↵
    Bao, Y. et al. Glycated haemoglobin A1c for diagnosing diabetes in Chinese population: cross sectional epidemiological survey. BMJ 340, c2249 (2010).
    OpenUrlAbstract/FREE Full Text
  46. 46.↵
    Li, Y. et al. Prevalence of diabetes recorded in mainland China using 2018 diagnostic criteria from the American Diabetes Association: national cross sectional study. BMJ 369, m997 (2020).
    OpenUrlAbstract/FREE Full Text
  47. 47.↵
    Beck, E. D. & Jackson, J. J. Personalized Prediction of Behaviors and Experiences: An Idiographic Person–Situation Test. Psychol. Sci. 33, 1767–1782 (2022).
    OpenUrl
  48. 48.↵
    Jovanova, M. A person-specific approach to predict health behaviors: a proof of concept. (University of Pennsylvania, 2023).
  49. 49.↵
    Prendin, F. et al. The importance of interpreting machine learning models for blood glucose prediction in diabetes: an analysis using SHAP. Sci. Rep. 13, 16865 (2023).
    OpenUrl
  50. 50.↵
    Rigby, R. R., Mitchell, L. J., Hamilton, K. & Williams, L. T. The Use of Behavior Change Theories in Dietetics Practice in Primary Health Care: A Systematic Review of Randomized Controlled Trials. J. Acad. Nutr. Diet. 120, 1172–1197 (2020).
    OpenUrlCrossRefPubMed
  51. 51.↵
    Nahum-Shani, I., Wetter, D. W. & Murphy, S. A. Adapting just-in-time interventions to vulnerability and receptivity: Conceptual and methodological considerations. in Digital Therapeutics for Mental Health and Addiction 77–87 (Elsevier, 2023).
  52. 52.↵
    Zahedani, A. D. et al. Digital health application integrating wearable data and behavioral patterns improves metabolic health. NPJ Digit Med 6, 216 (2023).
    OpenUrl
  53. 53.↵
    Boers, H. M., Seijen Ten Hoorn, J. & Mela, D. J. A systematic review of the influence of rice characteristics and processing methods on postprandial glycaemic and insulinaemic responses. Br. J. Nutr. 114, 1035–1045 (2015).
    OpenUrlCrossRefPubMed
  54. 54.↵
    Yang, W. et al. Postprandial Glucose Excursions in Asian Versus Non-Asian Patients with Type 2 Diabetes: A Post Hoc Analysis of Baseline Data from Phase 3 Randomised Controlled Trials of IDegAsp. Diabetes Ther. 13, 311–323 (2022).
    OpenUrl
  55. 55.↵
    Westerman, K. et al. Longitudinal analysis of biomarker data from a personalized nutrition platform in healthy subjects. Sci. Rep. 8, 14685 (2018).
    OpenUrl
  56. 56.↵
    Brügger, V., Kowatsch, T. & Jovanova, M. Wearables and smartphones for modifiable risk factors in metabolic health: a scoping review protocol. bioRxiv (2024) doi:10.1101/2024.04.15.24305819.
    OpenUrlCrossRef
  57. 57.↵
    Zhao, Q. et al. Chinese diabetes datasets for data-driven machine learning. Sci Data 10, 35 (2023).
    OpenUrl
  58. 58.↵
    Gabir, M. M. et al. The 1997 American Diabetes Association and 1999 World Health Organization criteria for hyperglycemia in the diagnosis and prediction of diabetes. Diabetes Care 23, 1108–1112 (2000).
    OpenUrlAbstract/FREE Full Text
  59. 59.↵
    Zheng, Y. et al. A community-based cross-sectional study of dietary composition and associated factors among tuberculosis patients in China. Sci. Rep. 14, 2676 (2024).
    OpenUrl
  60. 60.↵
    Jacober, S. J. et al. Basal insulin peglispro: Overview of a novel long-acting insulin with reduced peripheral effect resulting in a hepato-preferential action. Diabetes Obes. Metab. 18 Suppl 2, 3–16 (2016).
    OpenUrl
  61. 61.↵
    NHS. About intermediate-acting insulin. https://www.nhs.uk/medicines/insulin/intermediate-acting-insulin/about-intermediate-acting-insulin/ (2023).
  62. 62.↵
    Howard, J. Y. & Watts, S. A. Bolus Insulin Prescribing Recommendations for Patients With Type 2 Diabetes Mellitus. Fed. Pract. 34, S26–S31 (2017).
    OpenUrlPubMed
  63. 63.↵
    Arungarinathan, G., McKay, G. A., & Fisher, M. Drugs for diabetes: part 4 acarbose. Br J Cardiol 18(2), 78–81 (2011).
    OpenUrl
  64. 64.↵
    Chen, T. & Guestrin, C. XGBoost. in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (ACM, New York, NY, USA, 2016). doi:10.1145/2939672.2939785.
    OpenUrlCrossRef
  65. 65.↵
    Zignoli, A., Skroce, K., Lipman, D. J. & Zisser, H. C. Personalized nutrition and machine-learning: Exploring the scope of continuous glucose monitoring in healthy individuals in uncontrolled settings. Biomed. Signal Process. Control 90, 105809 (2024).
    OpenUrl
  66. 66.↵
    Li, Q., Bedi, T., Lehmann, C. U., Xiao, G. & Xie, Y. Evaluating short-term forecasting of COVID-19 cases among different epidemiological models under a Bayesian framework. Gigascience 10, (2021).
Back to top
PreviousNext
Posted August 07, 2024.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Personalizing dietary interventions by predicting individual vulnerability to glucose excursions
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Personalizing dietary interventions by predicting individual vulnerability to glucose excursions
Victoria Brügger, Tobias Kowatsch, Mia Jovanova
medRxiv 2024.08.07.24311591; doi: https://doi.org/10.1101/2024.08.07.24311591
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Personalizing dietary interventions by predicting individual vulnerability to glucose excursions
Victoria Brügger, Tobias Kowatsch, Mia Jovanova
medRxiv 2024.08.07.24311591; doi: https://doi.org/10.1101/2024.08.07.24311591

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Endocrinology (including Diabetes Mellitus and Metabolic Disease)
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)