Complexity and Variability Analyses of Motor Activity Distinguish Mood States in Bipolar Disorder ================================================================================================= * Petter Jakobsen * Andrea Stautland * Michael Alexander Riegler * Ulysse Côté-Allard * Zahra Sepasdar * Tine Nordgreen * Jim Torresen * Ole Bernt Fasmer * Ketil Joachim Oedegaard ## ABSTRACT **Aims** Changes in motor activity are core symptoms of mood episodes in bipolar disorder. The manic state is characterized by increased variance, augmented complexity and irregular circadian rhythmicity when compared to healthy controls. The aim was to characterize differences in motor activity when comparing manic patients to their euthymic selves. **Methods** Motor activity was collected from 14 bipolar inpatients in mania and remission. 24-h recordings and 2-h time series in the morning and evening were analyzed for mean activity, variability and complexity. Lastly, the recordings were analyzed with the similarity graph algorithm and graph theory concepts such as edges, bridges, connected components and cliques. **Results** When compared to euthymia, over the duration of approximately one circadian cycle, the manic state presented reduced variability, displayed by decreased standard deviation (p = 0.013) and augmented complexity shown by increased sample entropy (p = 0.025). During mania there were also fewer edges (p = 0.039) and more bridges (p = 0.026). Similar changes in variability and complexity were observed in the 2-h morning and evening sequences, mainly in the estimates of the similarity graph algorithm. A comparison of morning and evening sequences within states revealed no significant change in estimates for mania. Contrarily, the euthymic state showed significant evening differences in variance and complexity, displayed by fewer edges (p = 0.010) and an increased number of connected components (p = 0.009). **Conclusion** The motor activity of mania is characterized by altered complexity, variability, and circadian rhythms when compared within-subject to euthymia. Keywords * Bipolar Disorder * Mania * Motor Activity * Actigraphy * Analysis of Variance * Systems Analysis * Biomarker ## Background Change in energy, expressed as either retarded or agitated psychomotor activity, is a core symptom of mood episodes in bipolar disorder.1-3 Psychomotor activity can be measured using wrist-worn piezoelectric accelerometers, recording acceleration in the three-dimensional space.4 The foundation for the treatment of bipolar disorder is to avoid future relapses.5 Patients typically experience changes in sleep and energy in the beginning of new episodes, often without subjectively recognizing these changes. However, if such changes can be identified as they happen, effective interventions can be established to inhibit new full-blow mood episodes. The objective information contained in motor activity data has great potential for early detection of emerging mood episodes, improving the management of the disorder and reducing the burden of disease.6-8 According to systematic reviews,1,2 the bipolar manic state is associated with increased variability and complexity in psychomotor activity patterns when compared to healthy controls. The depressed state is associated with reduced mean motor activity, increased variability and simplicity in activity patterns when compared to healthy controls, and reduced mean activity compared to the manic state. Overall, people with a bipolar disorder diagnosis have reduced mean motor activity compared to healthy controls. Few studies of bipolar manic psychomotor energy have used modern equipment to record motor activity.2-4 One group9 found increased variance and reduced mean activity when comparing hospitalized manic patients to healthy controls. A subsequent case series study,10 comparing mood episodes from a single patient, reported elevated activity levels and patterns of amplified complexity in mania compared to depression. Another group11 reported irregular circadian rhythms in a group of euthymic bipolar patients compared to healthy controls, and quite dissolved circadian cycles for an essential matching patient group in a manic or mixed state. A similar trend was observed in a study of ecological accelerometer recordings,12 reporting a correlation between manic symptom severity and diminishment of diurnal rhythmicity. Furthermore, a study of circadian rhythmicity in bipolar disorder found no difference in physical activity when comparing hospitalized manic patients to healthy controls and depressed patients.13 However, patients in a manic episode did wake up significantly earlier compared to when they were in remission, and they had significantly poorer sleep quality when manic. These previous studies were all group wise comparisons or had few participants, substantiating the need for more studies on motor activity and circadian rhythms in bipolar patients. Disrupted circadian rhythms are characteristic symptoms of mood episodes in bipolar disorder 14,15, and disturbed sleep-wake cycles are typical symptoms of mood episodes.16 The circadian system is best described as a complex system of recurring interlocked rhythms, mainly harmonized by the suprachiasmatic nucleus in the anterior hypothalamus, but also cued by hormones and adjusted by external synchronizers such as light exposure and social life patterns.17 Interlocked with the 24-h circadian rhythm is a 4-hour ultradian clock, which regulates rest-activity patterns.18 Increased dopamine function results in a disturbed cyclical clock out of sync with the circadian rhythm, and is associated with manic symptoms.19 Increased dopamine levels are also associated with arousal of the behavioral activation system,20 a system associated with increased goal directed activity triggering energy and euphoria. Evidence suggests mania is linked to a hypersensitivity in the behavioral activation system.21 Consequently, motor activity recordings register the complex dynamic interplay of circadian and ultradian biological cycles in interaction with social rhythms. There is no general standardized method for analyzing accelerometer data,4 nonetheless, non-linear dynamic analyses are considered the most rewarding method.2,10 Recently, the similarity graph algorithm, a method based on evaluating patterns of compounds in time series, has revealed a promising ability to discriminate between diagnostic groups in motor activity recordings. The method has successfully differentiated between depression, schizophrenia and healthy controls,22 as well as patients with ADHD from clinical controls (depression/anxiety) and healthy controls.23 The aim of this study was to characterize motor activity patterns of the bipolar manic state by comparing manic patients intra-individually to their euthymic selves, applying common linear and non-linear mathematical models, as well as the similarity graph algorithm. ## Patients and Methods ### Participants The participants eligible for this experiment were patients admitted to Haukeland University Hospital, Bergen, Norway, diagnosed with a bipolar disorder according to ICD-10, and in an ongoing manic episode (ICD-10 diagnosis F31.1 and F31.2; current episode manic without/with psychotic symptoms). The clinical psychiatrists residing at the hospitals’ two closed wards for affective disorders suggested potential candidates. Patients considered unable to consent by the referring psychiatrist were not invited to participate. Inclusion criteria were Norwegian speaking individuals between 18 and 70 years diagnosed with bipolar disorder, able to comply with instructions and with an IQ clinically evaluated to be above 70. Exclusion criteria were previous head trauma needing hospital treatment, having an organic brain disorder, substance dependence (excluding nicotine), or being in a withdrawal state (see table 1 for participant details). The study protocol was approved by The Norwegian Regional Medical Research Ethics Committee West (2017/937). Informed, written consent was obtained from all participants, and no compensations for participating in the study were given. View this table: [Table 1:](http://medrxiv.org/content/early/2021/06/28/2021.06.22.21259317/T1) Table 1: Patients characteristics and demographics (N = 14). ### Clinical Assessments Patient mood state was evaluated at both assessments points by the Young Mania Rating Scale (YMRS).24 YMRS rates the severity of mania based on clinical observation of the patients, as well as the patients’ subjective description of their clinical condition during the past 48 hours. The total score spans from 0 to 60, and YMRS scores below 10 is considered as being in remission, or in a euthymic state.25 The severity of depressive symptoms were rated on the Montgomery Asberg Depression Rating Scale (MADRS).26 Diagnosis was validated at the second assessment point by research personnel trained in the use of the Norwegian translation of the Mini International Neuropsychiatric Interview (MINI) version 6.0.0.27 ### Recordings of Motor Activity Motor activity was recorded for 24 hours using a wristband containing several integrated sensors,28 worn on the participants’ dominant hand.29 The participants were assessed twice, first at inclusion and later in remission, at discharge from the hospital or after hospitalization. The 3-axis accelerometer module integrated within the wristband measured acceleration in gravitational force equivalents (g), with a detection sensitivity of 0.0156 g, and a sampling frequency of 32 Hz. The raw data files were processed in RStudio version 1.2.1335, and the absolute mean of the 3-axis’ activity counts per minute was calculated for each time series of motor activity. The devices recorded motor activity for an average of 1536 ± 212 minutes (range 1190 to 2067 minutes). As all sequences need to be of similar length for the similarity graph approach, 1190 minutes was defined as the time series length to be analyzed. The average starting time for the recordings was around midday (12:51± 1:21, range 09:52 – 15:10). There were no significant differences (t-test) in starting time, and for that reason the first 1190 minutes were used from all recordings. In addition to the 1190 minutes, two shorter 120-minute periods, one in the morning (07.00 – 09.00) and one in the evening (19:00 – 21:00), were analyzed. The reason for the selection of the specific time epochs was to make it possible to include data from most participants, with minimal missing data in the time series. A threshold of ≤ 5 % missing data in the specific time series was considered acceptable, and missing values were replaced with the mean of the relevant time series. One participant exceeded the acceptable limit of missing data in the 120-minute periods and was therefore not included in the morning and evening analyses. ### Mathematical Analyses The motor activity time series were analyzed for mean activity counts per minute. Two estimates of variance, expressing the stability of the mean in a time series, were calculated for the mathematical analyses, standard deviation (SD) and root mean square successive difference (RMSSD),30 both given as ratios to the mean. Finally, the RMSSD/SD ratio was calculated. An autocorrelation function is a mathematical tool for identifying repeated patterns in time series by determining the degree of relationship between the time series and an offset copy.31 The autocorrelation at lag 1 is the correlation of a time series with itself delayed one interval. Sample entropy is a nonlinear index of complexity in dynamic time series. Higher values indicate intricacy and randomness in patterns, while smaller values point toward predictability and regularity. Sample entropy is defined as the negative natural logarithm of the likelihood of a pointwise matching sequence (m) within a certain tolerance (r) matching the next point.32 Based on previous studies on nonlinear analysis of motor activity, the following values were selected: m = 2 and r = 0.2 standard deviation.9 The Symbolic Dynamics method33 also gives an indication of the complexity of the time series.9 The principle of the method is to transform time series into strings consisting of numbers between 1 and 6, based on dividing the activity counts into six equal segments, where maximum and minimum values are limited to mean ± 3 SD to counteract the effect of outliers. Finally, the number string is divided into overlapping sequences with three consecutive numbers, giving 216 possibilities for different patterns. ### The similarity graph algorithm Before presentation of the similarity graph-based method applied in this study, some basic definitions of graph theory need to be defined. Graphs are Mathematical structures which are used to model the relations between objects. A graph G is an ordered pair (V, E), where V is the set of nodes and E is the set of edges of G. The ends of an edge are said to be incident with the edge. Two nodes which are incident with a common edge are neighbors. An induced subgraph of a graph is a graph formed from a subset of the nodes of G and all the edges connecting pairs of nodes in that subset. A connected component of G is an induced subgraph H which is not a proper subgraph of a connected subgraph of G. Let *e* be an edge of G. If G-*e* has more connected components than G, then *e* is a bridge. A complete graph is a graph in which any two nodes are connected an edge. A complete subgraph of G with *k* nodes is called a *k*-clique of G. In this paper, we apply the nonlinear similarity graph algorithm which is based on work done by Lacasa et al.,34 and has been comprehensively described.22,23 This algorithm transforms a time series S=(x1, x2, … xn) into an undirected similarity graph G. Each element of time series S corresponds to a node u in V= {1, 2, … n} and each node u is assigned a weight equal to the value of xu. The distance between two nodes u and v is |u-v| and when the distance is 1, the two nodes u and v are defined as direct neighbors. Two arbitrary nodes u and v are connected by an edge in G if and only if their distance is below a certain threshold *k* and max (xu, xv) / min (xu, xv) < 1.2. Clearly, by changing the values of *k*, different similarity graphs are obtained. Defining 20 % as the threshold for similarity is founded in previous studies of motor activity with the sample entropy method,9,10 as well as applied in our groups’ previous studies of motor activity and the similarity graph algorithm.22,23 We used a selection of similarity graph parameters to analyze our data. In summary, any node of the graph with few or no neighbors indicates an alteration in activity. Connected components of the graph indicate substantial shifts in the activity. Bridges expose more subtle activity fluctuations.23 The number of cliques represents the smoothness of activity fluctuations in a time series.35 We report on 3-cliques. An illustration of the principles of the similarity graph algorithm presents in Figure 1. ![Figure 1:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2021/06/28/2021.06.22.21259317/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/06/28/2021.06.22.21259317/F1) Figure 1: *Above:* The similarity graph algorithm exemplified and explained within a *k* = 5 time series. *Below:* In this example the similarity graph algorithm transforms a time series S=(9,10,10,8,7,8,7,6,5,10,9) into a graph G, where each element of time series S corresponds to a node in V={1,2,3,4,5,6,7,8,9,10,11}. The corresponding elements of S and nodes in V are identified as SV in the figure. Two random nodes u and v are connected by an edge in G if and only if their distance is below a certain threshold *k* (|*u-v*| < *k*), and the ratio of the element values below a threshold defined as max (xu, xv) / min (xu, xv) < 1.2. In this example *k* = 5, and edges are drawn as solid lines in the illustration. The output of the time series are 13 edges, three components (black/white/grey) two bridges (91-84, 1010-911), three missing edges between direct neighbors (103-84, 68-59 and 59-1010), one time points without edges (59), and six 3-cliques (91-102-103), (84-75-86), (84-75-77), (75-68-77), (84-86-77), (86,77,75). We have calculated the following measures for various distances of *k*: the mean number of edges, the summed number of bridges, components, missing edges between direct neighbors, time points without edges and 3-cliques. We employed *k* = 2, *k* = 5 and *k* = 40 to the 1190 minutes series, and *k* = 2 and *k* = 5 for the 120 minutes series. ### Statistics Tests of significance were performed in SPSS version 26.0. Paired-Samples T-tests were generally applied, except for the 3-cliques, which were tested using the Related-Samples Wilcoxon Signed Rank Test. A p-value < 0.05 was considered statistically significant. When comparing mania and euthymia within both state and subject, we adjusted the p-value according to a Bonferroni correction for multiple comparisons to avoid a type 1 error.36 For these analyses, a p-value less than 0.0125 was considered statistically significant. ## RESULTS Forty-five patients hospitalized for a manic episode were invited to participate in the study, of which 34 signed the consent and wore the sensor wristband once for 24 hours. Eighteen of the included patients repeated the recording when in remission. Four of the 18 had one of the assessments incompletely recorded. As a result, 14 patients were adequately recorded with the multi-sensor wristband twice. Participant characteristics and demographics are presented in Table 1. All participants were on medications. Four participants used lithium in combination with one other drug: one with a benzodiazepine, one with an antipsychotic, one with an antidepressant and the final one with Valproate. All four used the same combination of medications at both measuring points. Eight participants used a mood stabilizing medication other than lithium: six used Valproate combined with antipsychotics during hospitalization, and four when in remission. Of the other two, one participant was started on lithium in addition to valproate and antipsychotics when discharged from the hospital, and the other was switched to Lamotrigine combined with an antipsychotic when in remission. Two participants used Lamotrigine at both assessment points, one in combination with antipsychotics. Finally, one participant used solitary antipsychotics and one participant used a combination of an antipsychotic, antidepressant and benzodiazepine at both assessment points. All antipsychotics prescribed for the manic participants were antidopaminergic (Quetiapine, Olanzapine, Risperidone, Aripiprazole and Zuclopenthixol). Fig. 2 shows an example of 24-hour motor activity recordings obtained from one patient when manic (A) and euthymic (B). Analysis of the 1190-minute recordings of all participants showed no significant differences in mean activity counts per minute between mania and euthymia (Table 2). During mania, SD was significantly reduced and the RMSSD/SD ratio was significantly increased. Furthermore, the participants had significantly higher sample entropy values when manic. The similarity graph algorithm yielded statistically significant differences for several parameters. For the *k* = 2 distance the manic state exhibited reduced occurrence of edges and an increased number of bridges and missing edges compared to the euthymic state. The number of 3-cliques was also significantly reduced during mania, regarding both *k* = 2 and *k* = 5 distances. For the latter, mania was associated with an increased number of bridges and missing edges compared to euthymia. The *k* = 40 neighborhood analysis revealed significantly less components, more missing edges and less time points without edges in mania compared to euthymia (Table 2). ![Figure 2:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2021/06/28/2021.06.22.21259317/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/06/28/2021.06.22.21259317/F2) Figure 2: 24-hour accelerometer recordings from a study participant. The patient was recorded during mania when hospitalized (A), and later in remission (B). The figure shows the activity counts per minute over 24 hours, from 11 a.m. to 11 a.m. the next day. View this table: [Table 2:](http://medrxiv.org/content/early/2021/06/28/2021.06.22.21259317/T2) Table 2: Manic and euthymic states compared within subject (N =14) in 1190 minutes time series of motor activity recordings. The analysis of the 120-minute morning recordings revealed no significant differences for mean activity, variability, autocorrelation or complexity between mood states (Table 3). Nonetheless, most parameters of the similarity graph algorithm differed significantly in the *k* = 2 neighbors analysis. We found a reduction in edges and 3-cliques, as well as increased numbers of components, bridges and missing edges, in the manic compared to the euthymic morning recordings. The *k* = 5 distance analysis revealed a reduced number of edges and increased number of missing edges compared to the euthymic state. Similarly to the morning analyses, the 120-minute evening recordings showed no significant differences for mean activity, variability or autocorrelation between mood states. In contrast to the morning analyses, sample entropy values were significantly higher in the manic state. Several parameters of the similarity graph analyses presented statistically significant differences between the manic and euthymic states. We found a reduced number of edges and 3-cliques and an increased number of bridges and missing edges in mania for analyses of both *k* = 2 and *k* = 5 neighbors. View this table: [Table 3:](http://medrxiv.org/content/early/2021/06/28/2021.06.22.21259317/T3) Table 3: Manic and euthymic states compared within subject (N =13) in 120 minutes time series of motor activity. Table 4 shows the results when comparing the 120-minute morning and evening periods within mood states. The euthymic state presented five significantly different graph analysis parameters. There were fewer edges in the evening and an increased number of components, missing edges and time points without edges in the *k* = 2 neighbors analysis. Lastly, there was an increased number of missing edges in the evening in the *k* = 5 analysis. We found no diurnal differences within the manic state. View this table: [Table 4:](http://medrxiv.org/content/early/2021/06/28/2021.06.22.21259317/T4) Table 4: Morning (0700 – 0900) and Evening (1900 – 2100) differences. Mania and euthymia compared within subject (N =13) and within mood state in 120 minutes time series of motor activity. ## Discussion Our results suggest that the bipolar manic state is associated with distinct deviating motor activity when compared within subjects to their euthymic selves. Comparing the manic state to euthymia in the 20-hour (1190 minutes) time series revealed that mania is characterized by reduced variability, displayed by decreased standard deviation, and increased complexity, displayed by augmented sample entropy. We also discovered increased sample entropy values during mania in the 120-minute evening sequences. The similarity graph algorithm *k* = 2 distance appears to possess the strongest discriminating abilities, and we found significant differences between mania and euthymia for this distance in all three sequences. The manic state was associated with less edges and an increased number of missing edges between direct neighbors. This indicates increased shifts in activity, causing fewer allied time points due to non-similarity within the area limits. Nonetheless, the increased number of bridges for the manic state indicates a certain degree of smoothness in the activity shifts, as the time points are to some extent connected with at least one edge. Furthermore, the 120-minute morning sequence revealed significant changes in the connected component estimates, indicating more roughness in the manic morning motor activity, due to missing edges caused by non-similarity between time points. Finally, for all three analyzed sequences, the high number of 3-cliques for euthymia indicates more stable and robust motor activity patterns compared to the manic activity. When changing the values of *k*, different similarity graphs are obtained, and different results are to be expected.23 However, the results of the *k* = 5 neighborhood analyses were quite similar to the *k* = 2 results for both the 20-hour and the 120-minute evening sequences. The morning sequences only resulted in differences in edges and missing edges. This was somewhat unexpected, as the morning epoch presented significant differences for most of the *k* = 2 measures. For the *k* = 40 patterns in the 20-hour sequence, three measures were significantly different between states; mania exhibited increased missing edges, reduced number of components and fewer time points without connected edges compared to euthymia. In other words, mania seems to be associated with unstable activity patterns, due to increased missing edges, while euthymia seems to be associated with more dramatic shifts in activity, due to a higher number of components and unconnected time points. It is well established that variability and complexity analysis are needed to adequately reveal the information contained in motor activity data.1,2,10 However, our results suggest that the similarity graph is a more sensitive and finely calibrated tool for such a task. This is evident as the variability and complexity measures were predominantly insignificantly altered comparing mood states for the 120-minute time series, while the similarity graph revealed significant differences in all sequences, independent of the area limits defined by various sizes of *k* and length of time series. The similarity graph estimates can be regarded as a combination of variability and complexity measures. First, the patterns of connections and missing connections express fluctuations in activity similar to other estimates of variance, like SD and RMSSD.23 However, direct comparisons are difficult, as SD reveals the variability of the entire time series, while graph measures like edges, components and 3-clicks reveals variability in constricted time windows. But the estimate missing edges (between direct neighbors) is calculated over the complete time series, and provides information quite comparable to RMSSD,30 as both estimates expresses the relationship between sequential points in the whole time series. Regarding bridges, the measure exposing more subtle activity fluctuations, it is more difficult to compare to other estimates of variance, as this estimate is not really understood, but suspected to reveal underlying dynamics of the time series.23 Second, the patterns of connections and missing connections express the intricacy or simplicity of activity alterations within a shorter time series. This resembles both sample entropy and symbolic dynamics, which are also calculated based on the relationship between time points within a shorter time-series. We found an increased RMSSD/SD ratio during mania in the 20-hour recordings. This supports findings reported by Krane-Gartiser et al.,9 comparing hospitalized manic patients to healthy controls in 24-hour time series. The group reported similar results from 64-minute morning and evening epochs. We found no such RMSSD/SD-ratio differences in the 120-minutes morning and evening time series. Furthermore, Krane-Gartiser et al. discovered the most significant difference between manic patients and controls in the morning period by using the Autocorrelation lag 1 variable. Despite this variable being linked to variability, no such difference was identified in our results. We did, however, find comparable differences in both morning and evening time series, although mainly in estimates of the similarity graph algorithm, a method not applied by Krane-Gartiser et al.9 Although our results show slightly elevated mean activity levels during mania, we found no significant differences between mood states. This was to be expected, as systematic reviews conclude that mania appears better characterized by increased variability and complexity than increased mean level of activity.2 Moreover, Krane-Gartiser et al.,9 comparing hospitalized manic patients to healthy controls, found significantly lower mean activity levels for the manic patients, assumed due to the patients being pacified by hospitalization and prescribed antipsychotic medication.9 Consequently, it is reasonable to assume that the elevated activity level in mania compared to depression observed in the previously mentioned case series study,10 is primarily about the motor retardation associated with depression.1,2 Another aspect to consider regarding activity levels is the influence and manipulation of the behavioral activation system. Evidence suggests mania is linked to a hypersensitivity in the behavioral activation system, a system associated with increased goal directed activity, and generating energy arousal and euphoria.20 Both mood stabilizers, like Lithium and Valproate, as well as anti-dopaminergic antipsychotics inhibit the behavioral activation system.19 All participants in the current study were on such behavioral activation system taming medications during manic recordings, except for one participant on Lamotrigine monotherapy. Altogether, this implies that one can only speculate about the mean activity levels of an unmedicated manic person prior to hospitalization, when living in a stimulating and rewarding environment. The current results of equal activity levels between mood states should be revisited taking these findings into account. When comparing morning and evening recordings within states, we discovered reduced circadian variation in the manic state. This was indicated by ceased differences between morning and evening activity within the manic state. Contrastingly, euthymia displayed significant differences in variance and complexity between morning and evening. There were also less edges and more missing edges in the evening, as well as an increased number of components and unconnected time points in the *k* = 2 similarity graph analysis. This resembles diurnal patterns previously observed in healthy controls23, substantiating the deviating pattern displayed in the manic state. Our diurnal findings are consistent with existing evidence of disrupted circadian rhythms as a characteristic of mood episodes in bipolar disorder.14 They also support motor activity studies suggesting an association between the manic state and irregular dissolved circadian rhythmicity.11-13 One possible explanation for the apparent loss of diurnal variation in mania is the hypothesis of bifurcation of biological rhythms appearing in mania.37 This concerns the master clock in the circadian system, the suprachiasmatic nucleus, switching from its normal 24-hour cycle to a 12-hour phase. Diurnal sampling of melatonin levels in manic bipolar patients resulted in two observed peaks in melatonin secretion, as opposed to the normal single peak.38 An alternative explanation, with stronger evidential support, relates to the internal dopaminergic ultradian oscillator clock, associated with the rhythmic patterns of rest-activity18 and linked to the behavioral activation system.14,20 This clock is not controlled by the suprachiasmatic nucleus, but habitually oscillates interlocked with the circadian rhythm. When studying the motor activity of laboratory mice on methamphetamine, increased dopamine levels were found to be associated with prolonged dopaminergic cycles out of sync with the circadian rhythm.18 Furthermore, increased dopamine levels are associated with both the presence of manic symptoms19 and to stimulation of the behavioral activation system.20 Consequently, the lack of differences between morning and evening activity observed in mania could reflect a prolonged dopaminergic rhythm out of sync with the circadian phase. It could also reflect a triggered behavioral activation system disturbing the social rhythm. In other words, we may have identified patterns of disordered rest-activity cycles and diminished circadian rhythmicity in bipolar mania. ### Limitations There are some structural weaknesses and limitations to this study that may have restricted the findings. To start, the sample size is rather small, which may affect statistical power. However, the within-subject design reduces this weakness. Neither gender, age nor body mass index were controlled for. This may have biased the result as all three variables have previously been found to impact motor activity in group comparisons.23,39 However, as our findings are results of state changes within subjects, the influential effect of these variables can likely be considered minor. Another possible weakness is the lack of a control group. However, the within-subject design of the study, where subjects are their own controls, presumably makes this a minor issue. Furthermore, the observed changes between states are considered too large to due to chance. Our results may also have been moderated by a seasonal effect. Humans are seasonal beings, and both social rhythms and durations of sleep generally follow a seasonal pattern similar to the annual changes in natural light and length of day.15 Haukeland University Hospital, Bergen, Norway is located at latitude 60.4, a location associated with substantial seasonal change in natural light and length of day. In the data analyzed in this study, the manic episodes were evenly distributed between winter and summer, however, 71 percent of the euthymic recordings were collected during the winter months. Therefore, seasonality may have impacted our findings to some degree. But at the same time, in a recent Norwegian survey,40 merely 20 % reported a high degree of seasonal variations in mood and behavior, while approximately 60 % reported low impact of seasonality. Our patient sample is highly educated, even more so than average in the highly educated Norwegian population.41 Regarding this, a study has investigated educational levels and socio-economic status among 257 Norwegian patients diagnosed with bipolar disorder.42 They found no relationship between educational level and burden of disease. Moreover, our sample ratios of individuals living alone or on disability pension are comparable to those reported in the study, although a higher percentage of the patients in our sample had a lifetime experience of psychosis. A hypothetical explanation for the skewed educational level in our sample could relate to an association between higher education and an understanding of innovational possibilities within bipolar disorder, as well as a selfless wish to contribute to enhanced scientific understanding of the disease. We have investigated hospitalized bipolar patients during an ongoing manic episode, confirmed and evaluated using a rating scale (YMRS). However, the YMRS scores could be subject to moderation due to the patients being hospitalized in a minimally rewarding environment and being prescribed antipsychotic and mood stabilizing medications. Euthymia, or remission, was defined as having an YRMS score below 10. This is a slightly stricter threshold than more commonly used 12 or below.43 MADRS scores are lightly elevated for the group at both measuring points, implying marginal depressive symptoms present in the groups.44 Depressive symptoms in mania can represent dysphoric features, which are commonly present in manic episodes.45 For clarification, agitated depressions and mixed episodes were not included in the study sample. We find it likely that the elevated MADRS scores in the euthymic group are related to residual symptoms, which are common in euthymic bipolar patients,46 and should not negatively affect the representability of the sample. Despite the declared limitations, our main findings remain robust and well-grounded; a significant intra-subject difference in complexity and variability measures of motor activity exists between manic and euthymic states in bipolar disorder. ### Future work Motor activity data possesses an innovative potential for the development of a tool or device for early detection of mood episodes in bipolar disorder. To realize this potential, it is necessary to explore the prospects of automatic real-time monitoring through machine learning.47 Our research group has previously revealed the promising capabilities of various machine learning techniques using motor activity data collected from depressed patients.39 Future work will further explore the classification capabilities of advanced machine learning models and the potential of applying automatic, real-time monitoring of motor activity for early detection of mood episodes in bipolar disorder. Of particular interest are graph neural networks and Bayesian neural networks. The former is perfectly suited to explore graph-like data structures and their dependencies,48,49 while the latter can help to understand decisions made by the model by quantifying its uncertainty.50 Motor activity recordings are usually recorded at a sampling rates around 32 Hz and analyzed in one minute epochs, similar to the approach of this study.4 It is conceivable that hidden information may disappear when analyzing the motor activity in one-minute epochs. Given this, another possible approach is to feed the machines with the absolute mean of the 3-axis’ activity counts per Hz, leaving it up to the algorithms themselves to decide appropriate epoch sizes. ## Conclusion In the present study we have compared motor activity data collected from hospitalized manic bipolar patients to motor activity data collected from the same individuals when in remission. We have applied commonly used linear and non-linear mathematical models, as well as the similarity graph algorithm. No previous studies have compared mania to euthymia intra-individually using such state-of-the-art accelerometer recordings while applying similar methods. We found that the motor activity patterns of the manic state are associated with altered complexity and variability, when compared to euthymia within subjects. Our findings are robust and comparable to results from previous studies describing bipolar manic patients to healthy controls. We also found the manic state to be associated with irregular circadian cycles when comparing morning and evening motor activity within both subject and mood state. Our results confirm findings from previous studies of circadian cycles and the mood states of bipolar disorder. ## Data Availability The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions. ## Data Availability Statement The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions. ## Acknowledgements We acknowledge and thank Christoffer Andreas Bartz-Johannessen for statistical consultation and Erlend Eindride Fasmer for developing the similarity graph algorithm software. This publication is part of the INTROducing Mental health through Adaptive Technology (INTROMAT) project, funded by the Norwegian Research Council (agreement 259293). * Received June 22, 2021. * Revision received June 22, 2021. * Accepted June 28, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. 1.De Crescenzo F, Economou A, Sharpley AL, Gormez A, Quested DJ. Actigraphic features of bipolar disorder: A systematic review and meta-analysis. Sleep Med Rev. 2017;33:58–69. 2. 2.Scott J, Murray G, Henry C, et al. Activation in bipolar disorders: A systematic review. JAMA Psychiatry. 2017;74(2):189–196. 3. 3.Tazawa Y, Wada M, Mitsukura Y, et al. Actigraphy for evaluation of mood disorders: A systematic review and meta-analysis. Journal of Affective Disorders. 2019;253:257–269. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 4. 4.Murray G, Gottlieb J, Hidalgo MP, et al. Measuring circadian function in bipolar disorders: Empirical and conceptual review of physiological, actigraphic, and self-report approaches. Bipolar Disorders. 2020:1398–5647. 5. 5.Yatham LN, Kennedy SH, Parikh SV, et al. Canadian Network for Mood and Anxiety Treatments (CANMAT) and International Society for Bipolar Disorders (ISBD) 2018 guidelines for the management of patients with bipolar disorder. Bipolar Disorders. 2018;20(2):97–170. 6. 6.Bauer M, Andreassen OA, Geddes JR, et al. Areas of uncertainties and unmet needs in bipolar disorders: clinical and research perspectives. The Lancet Psychiatry. 2018;5:930–939. 7. 7.Gershon A, Ram N, Johnson SL, Harvey AG, Zeitzer JM. Daily actigraphy profiles distinguish depressive and interepisode states in bipolar disorder. Clinical Psychological Science. 2016;4(4):641–650. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/2167702615604613&link_type=DOI) 8. 8.Dunster GP, Swendsen J, Merikangas KR. Real-time mobile monitoring of bipolar disorder: a review of evidence and future directions. Neuropsychopharmacology. 2021;46(1):197–208. 9. 9.Krane-Gartiser K, Henriksen TEG, Morken G, Vaaler A, Fasmer OB. Actigraphic assessment of motor activity in acutely admitted inpatients with bipolar disorder. PloS one. 2014;9(2):e89574. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0089574&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24586883&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 10. 10.Krane-Gartiser K, Asheim A, Fasmer OB, Morken G, Vaaler AE, Scott J. Actigraphy as an objective intra-individual marker of activity patterns in acute-phase bipolar disorder: a case series. International journal of bipolar disorders. 2018;6(1):8–8. 11. 11.Salvatore P, Ghidini S, Zita G, et al. Circadian activity rhythm abnormalities in ill and recovered bipolar I disorder patients. Bipolar Disorders 2008;10(2):256–265. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1399-5618.2007.00505.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18271904&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000252982300004&link_type=ISI) 12. 12.Gonzalez R, Tamminga CA, Tohen M, Suppes T. The relationship between affective state and the rhythmicity of activity in bipolar disorder. J Clin Psychiatry. 2014;75(4):e317–322. 13. 13.Moon J-H, Cho C-H, Son GH, et al. Advanced Circadian Phase in Mania and Delayed Circadian Phase in Mixed Mania and Depression Returned to Normal after Treatment of Bipolar Disorder. EBioMedicine. 2016;11:285–295. 14. 14.Alloy LB, Ng TH, Titone MK, Boland EM. Circadian Rhythm Dysregulation in Bipolar Spectrum Disorders. Current Psychiatry Reports. 2017;19(4):21. 15. 15.Rosenthal SJ, Josephs T, Kovtun O, McCarty R. Seasonal effects on bipolar disorder: A closer look. Neurosci Biobehav Rev. 2020;115:199–219. 16. 16.Melo MCA, Abreu RLC, Neto VBL, de Bruin Pfc, de Bruin Vms. Chronotype and circadian rhythm in bipolar disorder: A systematic review. Sleep Med Rev. 2017;34:46–58. 17. 17.Buijs FN, León-Mercado L, Guzmán-Ruiz M, Guerrero-Vargas NN, Romo-Nava F, Buijs RM. The Circadian System: A Regulatory Feedback Network of Periphery and Brain. Physiology. 2016;31(3):170–181. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1152/physiol.00037.2015&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27053731&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 18. 18.Blum ID, Zhu L, Moquin L, et al. A highly tunable dopaminergic oscillator generates ultradian rhythms of behavioral arousal. eLife. 2014;3:e05105. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7554/eLife.05105&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25546305&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 19. 19.Ashok AH, Marques TR, Jauhar S, et al. The dopamine hypothesis of bipolar affective disorder: the state of the art and implications for treatment. Molecular Psychiatry. 2017;22(5):666–679. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/mp.2017.16&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28289283&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 20. 20.Johnson SL, Edge MD, Holmes MK, Carver CS. The Behavioral Activation System and Mania. Annual Review of Clinical Psychology. 2012;8(1):243–267. 21. 21.Katz BA, Naftalovich H, Matanky K, Yovel I. The dual-system theory of bipolar spectrum disorders: A meta-analysis. Clinical Psychology Review. 2021;83:101945. 22. 22.Fasmer EE, Fasmer OB, Berle JØ, Oedegaard KJ, Hauge ER. Graph theory applied to the analysis of motor activity in patients with schizophrenia and depression. PloS one. 2018;13(4):e0194791. 23. 23.Fasmer OB, Fasmer EE, Mjeldheim K, et al. Diurnal variation of motor activity in adult ADHD patients analyzed with methods from graph theory. PLOS ONE. 2020;15(11):e0241991. 24. 24.Young R, Biggs J, Ziegler V, Meyer D. A rating scale for mania: reliability, validity and sensitivity. The British Journal of Psychiatry. 1978;133(5):429–435. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6ImJqcHJjcHN5Y2giO3M6NToicmVzaWQiO3M6OToiMTMzLzUvNDI5IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDYvMjgvMjAyMS4wNi4yMi4yMTI1OTMxNy5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 25. 25.Malhi GS, Ivanovski B, Hadzi-Pavlovic D, Mitchell PB, Vieta E, Sachdev P. Neuropsychological deficits and functional impairment in bipolar depression, hypomania and euthymia. Bipolar Disorders. 2007;9(1-2):114–125. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1399-5618.2007.00324.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17391355&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 26. 26.Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. The British Journal of Psychiatry. 1979;134(4):382–389. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6ImJqcHJjcHN5Y2giO3M6NToicmVzaWQiO3M6OToiMTM0LzQvMzgyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDYvMjgvMjAyMS4wNi4yMi4yMTI1OTMxNy5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 27. 27.Hergueta T, Baker R, Dunbar GC. The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):2233. 28. 28.Empatica Inc. E4 wristband [https://www.empatica.com/research/e4/](https://www.empatica.com/research/e4/). Published 2018 Accessed2018. 29. 29.Picard RW, Fedor S, Ayzenberg Y. Multiple Arousal Theory and Daily-Life Electrodermal Activity Asymmetry. Emotion Review. 2016;8(1):62–75. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1754073914565517&link_type=DOI) 30. 30.Von Neumann J, Kent R, Bellinson H, Hart B. The mean square successive difference. The Annals of Mathematical Statistics. 1941;12(2):153–162. 31. 31.van Beers RJ, van der Meer Y, Veerman RM. What Autocorrelation Tells Us about Motor Variability: Insights from Dart Throwing. PLOS ONE. 2013;8(5):e64332. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0064332&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23691199&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 32. 32.Richman JS, Moorman JR. Physiological time-series analysis using approximate entropy and sample entropy. American Journal of Physiology-Heart and Circulatory Physiology. 2000;278(6):H2039–H2049. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1152/ajpheart.2000.278.6.H2039&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=10843903&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000087573500038&link_type=ISI) 33. 33.Guzzetti S, Borroni E, Garbelli PE, et al. Symbolic dynamics of heart rate variability: a probe to investigate cardiac autonomic modulation. Circulation. 2005;112(4):465–470. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTQ6ImNpcmN1bGF0aW9uYWhhIjtzOjU6InJlc2lkIjtzOjk6IjExMi80LzQ2NSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzA2LzI4LzIwMjEuMDYuMjIuMjEyNTkzMTcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 34. 34.Lacasa L, Luque B, Ballesteros F, Luque J, Nuño JC. From time series to complex networks: The visibility graph. Proceedings of the National Academy of Sciences. 2008;105:4972. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMToiMTA1LzEzLzQ5NzIiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wNi8yOC8yMDIxLjA2LjIyLjIxMjU5MzE3LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 35. 35.1. Arbib M Jordan MI, Weiss Y. Graphical models: Probabilistic inference. In: Arbib M, ed. The handbook of brain theory and neural networks, 2nd Edition. Cambridge: MIT Press; 2002:490–496. 36. 36.Lee S, Lee DK. What is the proper way to apply the multiple comparison test? Korean J Anesthesiol. 2018;71(5):353–360. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4097/kja.d.18.00242&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30157585&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 37. 37.Kripke DF, Elliott JA, Welsh DK, Youngstedt SDJF. Photoperiodic and circadian bifurcation theories of depression and mania. F1000Research. 2015;4. 38. 38.Nováková M, Praško J, Látalová K, Sládek M, Sumová A. The circadian system of patients with bipolar disorder differs in episodes of mania and depression. Bipolar Disorders. 2015;17(3):303–314. 39. 39.Jakobsen P, Garcia-Ceja E, Riegler M, et al. Applying machine learning in motor activity time series of depressed bipolar and unipolar patients compared to healthy controls. PLOS ONE. 2020;15(8):e0231995. 40. 40.Bjorvatn B, Saxvig IW, Waage S, Pallesen S. Self-reported seasonality is strongly associated with chronotype and weakly associated with latitude. Chronobiology International. 2021;38(2):278–285. 41. 41. Statistics Norway. Educational attainment of the population. StatBank Norway. [https://www.ssb.no/en/statbank/table/11293](https://www.ssb.no/en/statbank/table/11293). Published 2020. Updated 2020-08-12. Accessed. 42. 42.Schoeyen HK, Birkenaes AB, Vaaler AE, et al. Bipolar disorder patients have similar levels of education but lower socio-economic status than the general population. Journal of Affective Disorders. 2011;129(1):68–74. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20832866&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) 43. 43.Tohen M, Jacobs TG, Grundy SL, et al. Efficacy of Olanzapine in Acute Bipolar Mania: A Double-blind, Placebo-Controlled Study. Archives of General Psychiatry. 2000;57(9):841–849. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/archpsyc.57.9.841&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=10986547&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000089179500004&link_type=ISI) 44. 44.Hawley CJ, Gale TM, Sivakumaran T. Defining remission by cut off score on the MADRS: selecting the optimal value. Journal of Affective Disorders. 2002;72(2):177–184. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0165-0327(01)00451-7&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12200208&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000178250300007&link_type=ISI) 45. 45.Dilsaver SC, Chen YR, Shoaib AM, Swann AC. Phenomenology of mania: evidence for distinct depressed, dysphoric, and euphoric presentations. American Journal of Psychiatry. 1999;156(3):426–430. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=10080559&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F06%2F28%2F2021.06.22.21259317.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000078969900014&link_type=ISI) 46. 46.Samalin L, de Chazeron I, Vieta E, Bellivier F, Llorca P-M. Residual symptoms and specific functional impairments in euthymic patients with bipolar disorder. Bipolar Disorders. 2016;18(2):164–173. 47. 47.Garcia-Ceja E, Riegler M, Nordgreen T, Jakobsen P, Oedegaard KJ, Tørresen J. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive and Mobile Computing. 2018;51:1–26. 48. 48.Zhou J, Cui G, Zhang Z, et al. Graph neural networks: A review of methods and applications. arXiv preprint arXiv:181208434. 2018. 49. 49.Wu Z, Pan S, Long G, Jiang J, Chang X, Zhang C. Connecting the dots: Multivariate time series forecasting with graph neural networks. Paper presented at: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining2020. 50. 50.Kendall A, Gal Y. What uncertainties do we need in bayesian deep learning for computer vision? Paper presented at: Advances in neural information processing systems2017; Long Beach, CA, USA.