Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Monitoring seizure cycles with seizure diaries

View ORCID ProfileAshley Reynolds, View ORCID ProfileRachel E. Stirling, View ORCID ProfileSamuel Håkansson, View ORCID ProfilePhilippa Karoly, View ORCID ProfileAlan Lai, View ORCID ProfileDavid B. Grayden, View ORCID ProfileMark J. Cook, View ORCID ProfileEwan Nurse, View ORCID ProfileAndre Peterson
doi: https://doi.org/10.1101/2024.08.28.24312758
Ashley Reynolds
1Department of Biomedical Engineering, The University of Melbourne, Melbourne, Australia
3Department of Neurosciences, St. Vincent’s Hospital, The University of Melbourne, Melbourne, Australia
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ashley Reynolds
  • For correspondence: ashleyr{at}student.unimelb.edu.au
Rachel E. Stirling
1Department of Biomedical Engineering, The University of Melbourne, Melbourne, Australia
4Graeme Clark Institute, The University of Melbourne, Melbourne, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Rachel E. Stirling
Samuel Håkansson
5Seer Medical, Melbourne VIC 3000, Australia
6Department of Clinical Neuroscience, Institute of Neuroscience and Physiology, Sahlgrenska Academy, Gothenburg University, Gothenburg, Sweden
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Samuel Håkansson
Philippa Karoly
1Department of Biomedical Engineering, The University of Melbourne, Melbourne, Australia
4Graeme Clark Institute, The University of Melbourne, Melbourne, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Philippa Karoly
Alan Lai
3Department of Neurosciences, St. Vincent’s Hospital, The University of Melbourne, Melbourne, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alan Lai
David B. Grayden
1Department of Biomedical Engineering, The University of Melbourne, Melbourne, Australia
2Department of Medicine, The University of Melbourne, Melbourne, Australia
4Graeme Clark Institute, The University of Melbourne, Melbourne, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David B. Grayden
Mark J. Cook
1Department of Biomedical Engineering, The University of Melbourne, Melbourne, Australia
2Department of Medicine, The University of Melbourne, Melbourne, Australia
3Department of Neurosciences, St. Vincent’s Hospital, The University of Melbourne, Melbourne, Australia
4Graeme Clark Institute, The University of Melbourne, Melbourne, Australia
5Seer Medical, Melbourne VIC 3000, Australia
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Mark J. Cook
Ewan Nurse
2Department of Medicine, The University of Melbourne, Melbourne, Australia
4Graeme Clark Institute, The University of Melbourne, Melbourne, Australia
5Seer Medical, Melbourne VIC 3000, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ewan Nurse
Andre Peterson
2Department of Medicine, The University of Melbourne, Melbourne, Australia
3Department of Neurosciences, St. Vincent’s Hospital, The University of Melbourne, Melbourne, Australia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Andre Peterson
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

Objective The periodicity of seizures, ranging from circadian to circannual cycles, is increasingly recognized as a significant opportunity to advance epilepsy management. Current methods for detecting seizure cycles rely on intrusive techniques or specialised biomarkers, limiting their accessibility.

Approach This study evaluates a non-invasive seizure cycle detection method using seizure diaries and compares its accuracy with cycles identified from intracranial electroencephalography (iEEG) seizures and interictal epileptiform discharges (IEDs). Using data from a previously published first in-human iEEG device trial (n=10), we analysed seizure cycles identified through diary reports, iEEG seizures and IEDs. Cycle similarities across diary reports, iEEG seizures and iEDs were evaluated at periods of 1 to 45 days using spectral coherence, accuracy, precision and recall scores.

Main results Spectral coherence of the raw signals averaged over frequencies and participants indicated moderately similar frequency components between diary seizures/day and iEEG seizures/day (Mean=0.62, SD=0.61,95% CI [0.59, 0.95]). In contrast, there was low coherence between diary seizures/day and IEDs/day (Mean=0.17, SD=0.17, 95% CI [0.18, 0.18]) and iEEG seizures/day and IEDs/day (Mean=0.18, SD=0.18, 95% CI [0.17, 0.19]). Mean accuracy, precision and recall of iEEG seizure cycles from diary seizure cycles was significantly higher than chance across all participants (Accuracy: Mean=0.95, SD=0.02; Precision: Mean=0.56, SD=0.19; Recall: Mean=0.56, SD=0.19). Accuracy, precision and recall scores between seizures cycles using diary or iEEG compared to IED cycles did not perform above chance, on average. Recall scores were compared across good diary reporters, under-reporters and over-reporters, with recall scores generally performing better in good reporters and under-reporters compared to over-reporters.

Significance These findings suggest that iEEG seizure cycles can be accurately identified with diary reports, even in both under- and over-reporters. This approach offers a practical, accessible alternative for monitoring seizure cycles compared to more invasive methods.

Key point

  1. Seizure cycles identified from seizure diaries can identify the same cycle periods to those detected by intracranial electroencephalography with high accuracy.

  2. Seizure under and overreporting reduces the accuracy of seizure cycle detection from diaries, which is dependent on the frequency of seizure self-reporting inaccuracies.

1. Introduction

The periodic occurrence of epileptic seizures has been reported throughout history, with recent advancements in technology able to quantitatively delineate these as seizure cycles1. With an estimated 80-90% of people with epilepsy having circadian seizure cycles2, 3, 60% multidien2, 4, and 12% circannual cycles4 there is a major research focus on investigating the utility of cycles for the management of epilepsy. Periodicity assists with forecasting unpredictable seizures, which assists with planning to improve quality of life5. There is also potential for these cycles to be used to time short term electroencephalography (EEG) monitoring to improve diagnostic yield6, for timing medication7, or to support the monitoring of anti-seizure medication efficacy8.

Currently, there are several methods that have been used to detect seizure cycles. These methods either use seizure times6, 9, or EEG waveforms that are specific epilepsy biomarkers such as interictal epileptiform activity4, 8, 10–16 and high frequency oscillations17. However, such biomarkers are not present in everyone with epilepsy18–21 and are not always a good marker for seizure timing2, 11, 22–24. Furthermore, continuous monitoring of epilepsy biomarkers presently requires invasive implanted devices like intracranial or sub-scalp EEG, though these are not yet widely available due to regulations and accessibility. Other potential physiological biomarkers of seizure cycles, such as resting heart rate, have been identified25, 26, but are not well understood in the context of epilepsy and seizure risk.

Due to the sparsity of seizures over time, cycle detection methods using seizure times require long durations of data to estimate the cycle period, which then informs fixed-period sinusoids to model the phase of seizure risk. However, seizure cycles appear almost-periodic, fluctuating between a range of periods27. Thus, using all available data and a fixed-period means previous methods that rely on seizure times do not perform as well as irregular cycles of interictal epileptiform activity when forecasting seizures12. However, cycles of interictal epileptiform activity are not a perfect seizure cycle biomarker and methods based on them suffer from various patient-specific rates of false positives and false negatives4, 11, 13, 15, 27. This highlights the problem that there is no perfect method to detect seizure cycles.

Improving upon a non-invasive diary-based cycle detection method would be highly desirable, as it could widen the clinical application of seizure cycles. Particularly because seizure diaries are a cornerstone of clinical practice and heavily relied upon for monitoring epilepsy and treatment response28. However, the accuracy of seizure diaries is highly variable between individuals, depending on seizure type, the state from which they occur (awake, drowsy, or asleep), the type of diary (electronic or paper) and who is making the report (patient or caregiver)29–35. Studies using video EEG to verify diary accuracy indicate 23-38% of people underreport seizures and of these people, 27-100% of seizures are not reported29–31, 33–35 36–40. Similar studies have also demonstrated 38-57% of patients overreport seizures, with 58% of all reported events being non-seizure events of uncertain origin30, 35. The inaccuracy of self-reported seizures causes inaccurate estimates of circadian seizure cycles32. However, evidence exists that multidien seizure cycles can be identified from diaries, despite their inaccuracies6, 41–43.

Therefore, our aim is to investigate an improved seizure cycle detection method based on seizures diaries and compare its ability to identify similar cycles to those identified by both intracranial EEG (iEEG) detected seizures and interictal epileptiform discharges (IEDs). We also aim to compare the similarities between methods when participants are stratified as good reporters, underreporters and overreporters. We hypothesise that people who self-report seizures with reasonable accuracy will have similar seizure cycles detected by both diary and by iEEG. However, the detected cycles will be less similar in people who under or overreport seizures. We also hypothesise cycles detected using iEEG seizures will identify similar cycle periods to IED cycles, but they will not be identical due to the variable relationship between interictal epileptiform discharges and seizures22, 23.

2. Methods

2.1 Study design

This study used the previously published NeuroVista dataset, a first-in-human longitudinal clinical trial of an implantable seizure advisory device for people with epilepsy33. Using this dataset we compared three methods to identify seizure cycle periods: 1. diary seizure cycles, defined as fixed-period cycles applied to sliding windows of participants’ self-reported seizure diaries, 2. iEEG seizure cycles, defined as fixed-period cycles applied to sliding windows of participants’ iEEG seizure records, and 3. IED cycles, detected using a wavelet transform of hourly iEEG detected IEDs. Strength of candidate cycles were defined by the synchronisation index (SI) values of seizure times mapped to phases of the cycle.

2.2 Participants

Trial participants were from Melbourne, Australia. They had drug-resistant focal epilepsy and were consistently taking the same anti-seizure medications and doses throughout the original trial. Participants were included in this study if they had >10 self-reported and iEEG seizures and >6 months of recording between 2010-2012 (n=10 of 15).

2.3 Seizure and interictal epileptiform discharge detection

Seizures and IEDs were confirmed by board-certified epileptologists. Both clinical and sub-clinical seizures (iEEG seizures associated with and without clinical symptoms, respectively) were included. We refer the reader to the original study33 for details.

2.4 Pre-processing iEEG data

Hourly counts of IEDs were used to detect IED cycles. For every hour of the total iEEG recording, the proportion of missing data during that hour was recorded. If the proportion of missing data was less than or equal to 50%, then the number of IEDs was normalised by this proportion2. Any hour where the proportion of missing data was greater than 50% was considered too unreliable and treated as completely missing. If there were adjacent hours of completely missing data, where the total duration was less than 20% of the cycle period of interest, then hourly IED values were imputed12. This involved linear interpolation between the means of the adjacent segments of data. The length of the adjacent segments was either five times the length of the missing segment or up to the nearest missing segment (whichever was shorter)12. For example, a missing segment of 2 hours was estimated from the means of adjacent segments up to 10 hours either side of the missing segment. Gaussian white noise with a standard deviation from the concatenated adjacent segments was added to the imputed values12. Hours of completely missing data lasting longer than 20% of the cycle period of interest were not interpolated and instead data before and after the gap were analysed independently15.

2.5 Cycle comparison

2.5.1 Spectral coherence of signals

We first investigated whether diary seizures/day, iEEG seizures/day, and IEDs/day share frequency components using spectral coherence. The magnitude-squared coherence provides a value between 0 and 1 for each frequency (i.e., inverse of period), indicating a level of correlation. A value of 0 signifies no correlation between the signals at a given frequency, while a value of 1 indicates perfect correlation. Statistically significant coherence values for each frequency were determined using a permutation test. In this test, each time-series was randomly shuffled to create 1000 permutations. We computed spectral coherence values for frequencies corresponding to cycle periods ranging from 0 to 45 days15. A 5% false discovery rate was set as the threshold for determining the critical coherence value.

2.5.2 iEEG and diary seizure cycle detection

Seizure cycle detection using seizures employs phase-locking to identify cyclical patterns in noisy data2. Phase-locking is the tendency for events to occur during a small range of phases in a cycle and can be measured by the synchronisation index (SI) value for a given cycle period. To calculate SI values, seizure start times were binned in intervals within a circular histogram (Figure 1), with the number of intervals defined by the cycle period x. The average of the circular histogram is the mean phase vector (MPV), with a magnitude between 0-1 and phase from 0 to 2π. The magnitude gives the SI value. A magnitude of 1 indicates seizures are perfectly phase-locked to a cycle with x period indicating seizure likelihood is certainly modulated by a cycle with x period2. A magnitude of 0 indicates seizures occur uniformly between 0 to 2π and is improbable that a cycle with x period modulates seizure timing. The phase of the MPV indicates where in the cycle seizures are more likely to occur.

Unlike previous methods2, 6, 9, all seizures, instead of only the first seizure in a cluster, were included to calculate SI values in this work. This modification was justified as there is no single definition of a seizure cluster44. A normalisation factor described by Andrzejak et al., (2023) was then applied to account for the number of samples influencing the SI45. Although this modification helps to reduce the bias in the SI, it does not completely account for shorter cycles being sampled more frequently than longer cycles. More repetitions of a cycle are akin to repeating experiments, which can smooth out fluctuations due to random noise and outliers. As the time for any analysis is finite, longer seizure cycles will always be under sampled compared to shorter cycles.

For each cycle, the SI was defined as: Embedded Image where N is the total number of seizures, n is the seizure number in sequence, θ is the phase of the nth seizure relative to the cycle of interest, and n is the imaginary number. γN is a correction factor45: Embedded Image SI values of seizure cycles were evaluated at periods between 1 and 45 days. To identify whether a circadian cycle exists, only a 24-hour period was considered, with seizure times binned in 1-hour intervals around the 24-hour clock. For multidien cycles, only integer cycle periods between 2 days to 45 days were considered15, using integer values with 1-day intervals. Integers were used to reduce computations and simplify the method for clinical use. Although this introduces inaccuracy for cycle periods fluctuating between integer days, 1-day intervals are more practical for clinical implementation where clinical review periods occur over months. If greater precision is needed, cycles that are fractions of a day could be included in future studies with sufficient computational resources. Circular histogram bin widths were 1-day, where the total number of bins depended on the cycle period (e.g., a 5- day cycle had 5 bins, whereas a 12-day cycle had 12 bins.

Figure 1.
  • Download figure
  • Open in new tab
Figure 1. The mean phase vector (MPV) and synchronisation index (SI).

(A) The weighted magnitude of the MPV, along the radial-axis of the unit circle, represents the SI value and indicates how influential this cycle period is in modulating seizure likelihood (effect size). The phase of the MPV indicates where in the cycle seizures have a tendency to occur. (B) An example of detecting a 4-day seizure cycle using the SI method. On the left side, seizure times are grouped into 4 1-day intervals on a circular histogram. The average of the histogram is the arrow, the MPV. Seizures occur clustered around day 1 of the 4-day cycle and the SI is close to 1, indicating seizure likelihood is probably modulated by a 4-day cycle. On the right side, seizure times are grouped into 5 1-day intervals. Seizures occur uniformly around the circle and the SI is close to 0, indicating seizure likehood is probably not modulated by a 5-day cycle. It should be noted that seizure rate will negatively influence the SI, as seizure rate affects the density of seizures occurring around the unit circle. In this example, one seizure every 4 days divides the unit circle in 4, producing less densly distributed seizures than one seizure every 5 days. Thus, a correction factor is applied to the magnitude of the MPV giving the weighted magnitude and SI value45.

Of the 45 possible seizure cycles periods, only those that were statistically likely to influence seizure probability were considered. This was based on a permutation test that set a period-specific SI threshold, to mitigate the period bias in the SI. Briefly, 1000 permutations of the null hypothesis, one without periodicity, were generated for each window of data by randomly shuffling seizure start times with their associated inter-seizure interval. SI values were calculated and a false discovery rate of 10% was used as the SI threshold to identify statistically significant seizure cycle periods12. Statistically significant periods that were within ±33.33% of a central period with peak SI, were assumed to be the same cycle and so only the period with the peak SI was considered15.

An approximate 135-day sliding window of data was used to detect seizure cycles over time. The window length was selected due to the sparsity of seizure data and to allow cycle periods to repeat a minimum of 3 times within a standard 4-month clinical review period28.

We slid the window by the number of days equivalent to the cycle period of interest and reran the analysis iteratively15. The window length was a multiple of the period and the timestep was equivalent to a full cycle period to prevent an incomplete cycle inaccurately influencing the MPV (Figure 2).

Figure 2.
  • Download figure
  • Open in new tab
Figure 2. Seizure cycle detection method.

To demonstrate the method, a simple simulated seizure diary is used. The diary has seizures initially occurring on average every 4 days. Three months later it changes to every 7 days. The first approximate 135-days of the diary are divided into the possible cycle periods of interest (in this example, 2–8-day cycles) and plotted as circular histograms. The weighted average of each histogram is the mean phase vector (MPV), represented as an arrow. The MPVs for all example cycle periods are plotted in the first column of the vector plot (y-axis). The window of data moves by one period length of interest and the analysis is re-run. The recalculated MPVs are plotted in the next column(s). E.g., for a 5-day cycle, the window moves by 5 days, and the 5-day cycle MPV is calculated and plotted repeatedly for the next 5 days along the x-axis. With each iteration, the change in the average phase (angle of the arrow) and magnitude (length of the arrow, synchronisation index (SI)) can be tracked over time (x-axis). Note, tiny vectors (seen for example at 6-days) indicate the SI values are close to 0, suggesting a very low likelihood that a cycle exists at this period. In the first 3 months the vectors are greatest at the 4-day cycle, indicating a 4-day cycle is likely. In the following months, the 4-day cycle vectors reduce in magnitude and the phase changes, the 7-day cycle vectors increase in magnitude and the phase changes; together this indicates a change in the dominant seizure cycle period and effect size. It is also important to observe the magnitude of the vectors of the 4-day cycle are always greater than the harmonic cycle periods (2 days in this example) in the first 3 months.

2.5.3 Interictal epileptiform discharge cycle detection

IED cycles were identified using continuously recorded iEEG-detected IEDs. A continuous analytic Morse wavelet transform of IEDs per hour was implemented15. The maximum period investigated was defined by the length of the data, but only integer periods of 1-45-days were included for methodological comparisons. A permutation test to identify significant cycles was used by randomly shuffling hourly IED values 1000 times. A threshold of the magnitude of the wavelet coefficient was calculated to identify significant cycles using a false discovery rate of 10%. Significant cycles were defined as peaks in the wavelet periodogram whose power values were above the significance threshold. Like seizure cycle detection, for two or more significant cycles within close proximity (within a ±33.33% range) of each other, only the period with the peak power value above the threshold was accepted as the significant cycle.

2.6 Comparing cycles detected by each method

Pairwise comparisons between diary seizure cycles, iEEG seizure cycles and IED cycles were made using accuracy (the number of true positives and true negatives out of all the total sample), precision (the number of true positives out of the number of true positives and false positives) and recall (the number of true positive out of the number of true positives and false negatives) scores. iEEG seizure cycles were used as the ground truth to compare diary seizure cycles and IED cycles. When comparing diary cycles to IED cycles, IED cycles were used as the ground truth.

Accuracy, precision and recall values of the cycle array (positive/negative cycle detection for each possible period) were calculated each day of the recording. The mean accuracy, precision and recall values across all days were reported for each participant. Statistical significance of accuracy, precision and recall values was determined using a permutation test. For each participant, 1000 permutations were generated each day by randomly shuffling the daily cycle array (i.e., keeping number of positives and negatives consistent) and the 90th percentile was used as the significance threshold (i.e., 10% false discovery rate). Mean significance thresholds across all days of the recording were calculated, and accuracy, precision and recall values above this threshold were determined to be significantly higher than chance.

It should be noted that the IED cycle method is a continuously sampled time-series with IED counts every hour. This allows for very flexible window sizes to calculate each scale magnitude for the wavelet transform, providing greater temporal resolution to detect cycle periods. Comparatively, the seizure cycle method cannot use as fine-grained temporal resolution, as it must maintain a relatively large window for sparse seizure data (more zero-seizure days than seizure days). Due to the different windowing methods, it is not expected that the identified cycles align at each timepoint, but we expect that we should observe alignment some of the time.

For a straightforward interpretation of results from spectral coherence and the performance metrics (accuracy, precision and recall), we categorised the values into four bins: very low (0.00-0.20), low (0.21-0.40), moderate (0.41-0.60), high (0.61-0.80), and very high (0.81-1.00).

2.7 Effect of overreporting and underreporting on cycle detection

To assess the effect of overreporting and underreporting on seizure diary cycle detection, the performance metric, recall, was grouped by the accuracy of self-reported seizures. All events, which included self-reported seizures with iEEG (i.e., electrographic) seizure correlate (correctly reported), iEEG seizures without self-reported seizure correlate (underreported), and self-reported seizures without iEEG correlate (overreported) were totalled. Participants were ‘good reporters’ if >95% of the total events were correctly reported. ‘Rare’ under or overreporting was defined as ≤5% of the total number of events were seizures without self-reported seizure correlate or self-reported seizures without iEEG correlate, respectively. ‘Occasional’ under or overreporting was defined as >5-≤10% of events were under or overreported. ‘Sometimes’ was >10-≤25% of events were under of overreported. Often was defined as >25-≤50% of all events were under of overreported. ‘Frequent’ was >50% of all events were under or overreported.

All analyses were undertaken using MATLAB (v2024b, MathWorks Inc., Natick, MA, USA) and the Circular Statistics Toolbox46.

3. Results

3.1 Spectral coherence

Figure 3 shows spectral coherence values per candidate period across comparison pairs of IEDs/day, iEEG seizures/day and diary seizures/day. When comparing IEDs/day and iEEG seizures/day, 9 out of 10 participants (all but S3) showed a small proportion of statistically significant correlations in the frequency domain, although not all periods were highly correlated. By observation, periodic components of 20 days or less tended to be more similar than longer periods. Average spectral coherence values between IEDs/day and iEEG seizures/day were 0.18 (SD=0.18, 95% CI [0.17, 0.19]) across all participants and candidate periods. A similar trend in spectral coherence was observed when comparing IEDs/day and diary seizures/day (Mean=0.17, SD=0.17, 95% CI [0.18, 0.18]). However, any differences in this trend were due to low correlations between iEEG seizures/day and diary seizures/day at certain frequencies. Overall, the frequency domains of diary and iEEG seizures were similar, with moderate to high spectral coherence values (Mean=0.62, SD=0.61,95% CI [0.59, 0.95]). Notably, 4 out of 10 participants had coherence values between 0.90 and 1.00 for periods longer than 20 days, suggesting that the periodic components of both seizure recording methods were almost identical in these participants (see Figure 3).

Figure 3.
  • Download figure
  • Open in new tab
Figure 3. Periodic components are similar but not identical between diary seizures/day iEEG seizures/day and IEDs/day.

Periodic components of IEDs/day were less similar to both iEEG and diary seizures/day. Similarities were also patient specific but tended to have more similar frequency components for shorter periods. Spectral coherence values above the critical value indicate statistically significant correlations. FDR: false discover rate.

3.2 Comparing cycle detection methods

The seizure diary method produced similar cycle results to the iEEG seizure cycle method over 1-2 years (Table 1). When comparing iEEG seizure cycles to diary seizure cycles, the mean accuracy across all participants was 0.95 (SD=0.02), whereas precision and recall scores had a mean of 0.56 (SD=0.19) across all participants. The moderate to high accuracy values were a reasonable result given the spectral coherence measures demonstrated the periodicity between the different signals were not perfectly aligned and were also patient specific.

Comparing the cycle periods detected by seizure diary and IEDs, the accuracy was 0.91 (SD=0.01) with poor precision (Mean=0.15, SD=0.08) and recall (Mean=0.16, SD=0.07). However, this was similar when comparing iEEG seizures cycles and IED cycles (accuracy Mean=0.91, SD=0.01, precision Mean=0.17, SD=0.07, and recall Mean=0.15, SD=0.07). These low values can be expected when put into context with the spectral coherence results, which demonstrated limited similarity between the periodicity of seizures (both iEEG and diary) and IEDs.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1. Seizure cycles detected using seizure diaries identify similar cycles to those detected by iEEG but are less similar to IED cycles.

The performance of diary seizure cycles and IED cycles compared to iEEG seizure cycles, assessed by accuracy, precision and recall. aground truth. *significantly better performance than 90% of random permutations.

3.3 Effect of overreporting and underreporting on cycle detection

The single good reporter who rarely underreported seizures had a recall of 0.78 for iEEG seizure cycles compared to diary seizure cycles (Table 2). Their recall value for iEEG and diary seizure cycles compared to IED cycles was also slightly higher compared to the rest of the cohort. Categorising participants by under and overreporting, indicates that frequent overreporting reduces recall values between the diary seizure cycles and iEEG seizure cycles. Underreporting of any frequency, rare through to frequent, produced average recall values between 0.70-0.78 of the diary seizure cycles compared to iEEG seizure cycles.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2. Frequent under or overreporting negatively affects seizure cycle detection.

Performance as assessed by recall, of methods to detect seizure cycles stratified by participants who under and/or overreport seizures.

4. Discussion

This study demonstrates that a non-invasive diary-based method can detect seizure cycles of 1-45 day period lengths with similar accuracy compared to iEEG detected seizure cycles.

As hypothesised, the level of accuracy was patient specific and depends on the amount of under and overreported seizures. Moreover, when comparing the seizure cycles that were detected by diary or iEEG, both detection methods intermittently identified similar cycle periods compared to the IED method. This was limited and may be attributed to the general low coherence observed between the periodicity of the original seizures and IED signals.

An accessible seizure cycle detection method is crucial for maximizing the potential benefits offered by seizure cycles. Although IED cycles can identify cycles of seizure risk, IED detection is unfortunately restricted to a small subset of people who have IEDs, as they are not present in every person with epilepsy18–21. There is also significant intra- and inter-individual variability in the relationship between IEDs and seizures2, 11, 22, 23, which our study agreed with.

It is possible that the discrepancies between IEDs and seizure cycles11 lie in the limitations of iEEG devices. There are a small number of studies investigating the relationship between IEDs and seizure timing over long timescales in participants using the NeuroVista device22, 47 and sub-scalp EEG systems11, 16, 41. However, most of the previous research in this field is conducted with the Responsive Neurostimulation (RNS) system (NeuroPace, Mountaint View, CA)4, 12, 13, 15. Interictal epileptiform activity detected using the RNS system included IEDs plus other waveforms48.Further, due to device storage capacity, the device only records interictal epileptiform activity during pre-set times or when triggered48. This may result in over-sampling of one cycle phase and under-sampling of others. In addition, RNS system study participants also receive neurostimulation that previous research indicates can alter both IED and seizure cycles10, 49. Thus, it remains unknown how a non-specific algorithm with non-uniform sampling and neurostimulation affects seizure cycle detection and generalisability.

However, these technological limitations are not the same for all devices and the IEDs detected in this study were specific and uniformly sampled. Therefore, it is likely that IEDs serve as biomarkers with constrained predictive capabilities, rather than representing the true underlying seizure cycle; particularly if there are other biological or environmental cycles influencing the temporal patterns of seizures1. This is supported by previous research demonstrating the highly varied, patient-specific relationship between seizure timing and IED counts22. Though we found it useful to compare the similarity in cycle results between the IED method and seizure method, it may not be necessary or even appropriate to compare one method to the other.

For people who cannot access the RNS system or other ultra-long EEG system in the future (e.g., because they do not have drug-refractory epilepsy; do not live in the correct location or have financial means; do not meet other specific device, surgical or anaesthetic criteria; or are unwilling to accept the risks of an intracranial implant) it is useful to know that diary-based cycle detection can be accurate. Also, it can be used in anyone who can maintain any kind of seizure diary (e.g., paper-based or electronic35) with reasonable accuracy (incorrect reports up to 25% of the time). Going forward, the current seizure cycle method could be further optimised by using more flexible window sizes and fractions of a day6, to improve the temporal resolution of cycle detection. Diary-cycle detection could also be supplemented by other biological cycle detection that utilise wearable devices to continuously record biosignals such as resting heart rate, heart rate variability, accelerometery, electrodermal activity and peripheral body temperature25, 50. It has been demonstrated in a small group of people with focal epilepsy and the RNS system that multiscale cycles present in these biosignals phase-lock with seizures50. However, given the small sample size and individual variability between biosignals and seizures, further investigations are required to examine the generalisability of results, as well as delineate any underlying mechanisms driving and linking their temporal structures.

Given we do not know the mechanisms underlying seizure cycles or the gold-standard method to track them, optimising a cycle detection method may be challenging. Comparing an imperfect seizure cycle method to an imperfect IED method can only give an indication of the similarities in detectable cycles. Though realistic seizure time simulators exist51, the cyclical component is modelled by non-physiological fixed-period sinusoids. Both options can only provide limited insight into how useful a diary-based cycle detector could be. Until we discover the sources of seizure cycles and how to monitor them, current methods will be limited in their clinical applications.

It should be noted that this study was limited by missing data, but interpolation methods were kept to a minimum, consistent with previously published work4, 10, 15. Moreover, although we investigated the effects of under and overreporting on cycle period detection, we did not investigate the effects of missing data on phase estimation, which has previously been demonstrated32, 52. This study did not investigate phase estimations due to the coarse time window of the seizure cycle method, which was only able to provide an average phase over the approximate 4-month window, thus unlikely to be informative for daily life. Addressing this limitation will require future methodological development.

5. Conclusion

A non-invasive diary-based seizure cycle detection method can identify cycles comparable to those found through invasive iEEG recorded seizures. This approach expands opportunities for monitoring seizure cycles, with potential benefits in clinical settings such as refining treatment evaluations, guiding chronotherapy, and providing patients with insights into seizure risk to better understand and manage their condition. Its significant accessibility could prove to be extremely beneficial for individuals with epilepsy who already maintain seizure diaries.

Author contributions

A.R. undertook the literature review, designed the methodology, undertook the analysis and results interpretation, wrote the manuscript, and created the figures and tables. R.E.S. assisted with methodological design and analysis, results interpretation, wrote and edited the manuscript. S.H. edited the manuscript. P.K. provided pre-processed NeuroVista data, assisted with interpretation of results and edited the manuscript. E.N. edited the manuscript. A.P., A.L., and D.B.G assisted with methodological design, assisted with interpretation of results, contributed to concepts, edited the manuscript, and supervised A.R. M.J.C. contributed to concepts, provided access to the data, assisted with interpretation of results, edited the manuscript, and supervised A.R.

All authors approved the final version of the manuscript. A.R., P.K., A.L., and M.J.C. had full access to the data. No author was precluded from accessing data in the study.

Potential conflicts of Interest

NeuroVista was not involved in the study design. M.J.C. is an employee and has financial interests in Epi-Minder a company that is developing a sub-scalp EEG device and Seer Medical a company that undertakes ambulatory EEG monitoring and launched an epilepsy health management mobile application. E.N. is an employee and has financial interest in Seer Medical. The remaining authors have no conflicts of interests.

Data availability

Deidentified NeuroVista data are available upon reasonable request to co-author Prof. Mark J. Cook (markcook{at}unimelb.edu.au).

Acknowledgments

A.R. receives funding from the Australian Government Research Training Program Scholarship from the University of Melbourne.

Footnotes

  • Co-author(s) details: Rachel E. Stirling: rachel.stirling{at}unimelb.edu.au, Samuel Håkansson: samuel.haakansson{at}hest.ethz.ch, Philippa Karoly: karoly.p{at}unimelb.edu.au, Ewan Nurse: ewan{at}seermedical.com, Alan Lai: alan.lai{at}unimelb.edu.au, David B. Grayden: grayden{at}unimelb.edu.au, Mark J. Cook: markcook{at}unimelb.edu.au, Andre Peterson: peterson{at}unimelb.edu.au

References

  1. 1.↵
    Karoly PJ, Rao VR, Gregg NM, Worrell GA, Bernard C, Cook MJ, et al. Cycles in epilepsy. Nature Reviews Neurology. 2021:1–18.
  2. 2.↵
    Karoly PJ, Goldenholz DM, Freestone DR, Moss RE, Grayden DB, Theodore WH, et al. Circadian and circaseptan rhythms in human epilepsy: a retrospective cohort study. The Lancet Neurology. 2018;17(11):977–85.
    OpenUrl
  3. 3.↵
    Ferastraoaru V, Goldenholz DM, Chiang S, Moss R, Theodore WH, Haut SR. Characteristics of large patient-reported outcomes: where can one million seizures get us? Epilepsia open. 2018;3(3):364–73.
    OpenUrlCrossRef
  4. 4.↵
    Leguia MG, Andrzejak RG, Rummel C, Fan JM, Mirro EA, Tcheng TK, et al. Seizure Cycles in Focal Epilepsy. JAMA Neurology. 2021;78(4):454–63.
    OpenUrl
  5. 5.↵
    Stirling RE, Nurse ES, Payne D, Naim-Feil J, Coleman H, Freestone DR, et al. User experience of a seizure risk forecasting app: A mixed methods investigation. Epilepsy & Behavior. 2024;157:109876.
  6. 6.↵
    Karoly PJ, Eden D, Nurse ES, Cook MJ, Taylor J, Dumanis S, et al. Cycles of self-reported seizure likelihood correspond to yield of diagnostic epilepsy monitoring. Epilepsia. 2021;62(2):416–25.
    OpenUrl
  7. 7.↵
    Khan S, Nobili L, Khatami R, Loddenkemper T, Cajochen C, Dijk D-J, et al. Circadian rhythm and epilepsy. The Lancet Neurology. 2018;17(12):1098–108.
    OpenUrl
  8. 8.↵
    Friedrichs-Maeder C, Proix T, Tcheng TK, Skarpaas T, Rao VR, Baud MO. Seizure Cycles under Pharmacotherapy. Annals of neurology. 2024.
  9. 9.↵
    Gregg NM, Nasseri M, Kremen V, Patterson EE, Sturges BK, Denison TJ, et al. Circadian and multiday seizure periodicities, and seizure clusters in canine epilepsy. Brain Communications. 2020;2(1).
  10. 10.↵
    Gregg NM, Sladky V, Nejedly P, Mivalt F, Kim I, Balzekas I, et al. Thalamic deep brain stimulation modulates cycles of seizure risk in epilepsy. Scientific reports. 2021;11(1):1–12.
    OpenUrl
  11. 11.↵
    Leguia MG, Rao VR, Tcheng TK, Duun-Henriksen J, Kjær TW, Proix T, et al. Learning to generalize seizure forecasts. Epilepsia. 2023;64:S99–S113.
    OpenUrl
  12. 12.↵
    Leguia MG, Rao VR, Kleen JK, Baud MO. Measuring synchrony in bio-medical timeseries. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2021;31(1):013138.
    OpenUrl
  13. 13.↵
    Proix T, Truccolo W, Leguia MG, Tcheng TK, King-Stephens D, Rao VR, et al. Forecasting seizure risk in adults with focal epilepsy: a development and validation study. The Lancet Neurology. 2021;20(2):127–35.
    OpenUrl
  14. 14.
    Proix T, Truccolo W, Leguia MG, King-Stephens D, Rao VR, Baud MO. Forecasting seizure risk over days. MedRxiv. 2019:19008086.
  15. 15.↵
    Baud MO, Kleen JK, Mirro EA, Andrechak JC, King-Stephens D, Chang EF, et al. Multi-day rhythms modulate seizure risk in epilepsy. Nature communications. 2018;9(1):1–10.
    OpenUrl
  16. 16.↵
    Stirling RE, Maturana MI, Karoly PJ, Nurse ES, McCutcheon K, Grayden DB, et al. Seizure Forecasting Using a Novel Sub-Scalp Ultra-Long Term EEG Monitoring System. Front Neurol. 2021;12:713794.
  17. 17.↵
    Chen Z, Grayden DB, Burkitt AN, Seneviratne U, D’Souza WJ, French C, et al. Spatiotemporal Patterns of High-Frequency Activity (80–170 Hz) in Long-Term Intracranial EEG. Neurology. 2021;96(7):e1070–e81.
    OpenUrl
  18. 18.↵
    Benjamin O, Colvin P, Kibuuka M, Alarcón G, Richardson MP, Terry JR. EEG frequency during spike-wave discharges may predict treatment outcome in patients with idiopathic generalized epilepsies. Epilepsia. 2011;52(6):e45–e8.
    OpenUrl
  19. 19.
    Stodieck S, Steinhoff B, Kolmsee S, Van Rijckevorsel K. Effect of levetiracetam in patients with epilepsy and interictal epileptiform discharges. Seizure. 2001;10(8):583–7.
    OpenUrlCrossRefPubMedWeb of Science
  20. 20.
    Di Bonaventura C, Fattouch J, Mari F, Egeo G, Vaudano AE, Prencipe M, et al. Clinical experience with levetiracetam in idiopathic generalized epilepsy according to different syndrome subtypes. Epileptic disorders. 2005;7(3):231–5.
    OpenUrlPubMed
  21. 21.↵
    Pro S, Vicenzini E, Pulitano P, Li Voti P, Zarabla A, Randi F, et al. Effects of levetiracetam on generalized discharges monitored with ambulatory EEG in epileptic patients. Seizure. 2009;18(2):133–8.
    OpenUrlPubMed
  22. 22.↵
    Karoly PJ, Freestone DR, Boston R, Grayden DB, Himes D, Leyde K, et al. Interictal spikes and epileptic seizures: their relationship and underlying rhythmicity. Brain. 2016;139(4):1066–78.
    OpenUrlCrossRefPubMed
  23. 23.↵
    Chvojka J, Kudlacek J, Chang W-C, Novak O, Tomaska F, Otahal J, et al. The role of interictal discharges in ictogenesis — A dynamical perspective. Epilepsy & Behavior. 2019:106591.
  24. 24.↵
    Bezerra DRM, de Carvalho Jatobá A, Ferreira LS. Electroencephalographic epileptiform alterations in individuals without epilepsy: literature review. Revista Neurociências. 2015;23(3):457–62.
    OpenUrl
  25. 25.↵
    Karoly PJ, Stirling RE, Freestone DR, Nurse ES, Maturana MI, Halliday AJ, et al. Multiday cycles of heart rate are associated with seizure likelihood: An observational cohort study. EBioMedicine. 2021;72.
  26. 26.↵
    Stirling RE, Grayden DB, D’Souza W, Cook MJ, Nurse E, Freestone DR, et al. Forecasting seizure likelihood with wearable technology. Frontiers in neurology. 2021;12:704060.
  27. 27.↵
    Rao VR, G Leguia M, Tcheng TK, Baud MO. Cues for seizure timing. Epilepsia. 2021;62:S15–S31.
    OpenUrlCrossRef
  28. 28.↵
    Baker GA, Camfield C, Camfield P, Cramer J, Elger C, Johnson A, et al. Commission on outcome measurement in epilepsy, 1994–1997. Epilepsia. 1998;39(2):213–31.
    OpenUrlCrossRefPubMedWeb of Science
  29. 29.↵
    Elger CE, Hoppe C. Diagnostic challenges in epilepsy: seizure under-reporting and seizure detection. The Lancet Neurology. 2018;17(3):279–88.
    OpenUrl
  30. 30.↵
    Hannon T, Fernandes KM, Wong V, Nurse ES, Cook MJ. Over-and underreporting of seizures: How big is the problem? Epilepsia. 2024.
  31. 31.↵
    Fisher RS, Blum DE, DiVentura B, Vannest J, Hixson JD, Moss R, et al. Seizure diaries for clinical research and practice: limitations and future prospects. Epilepsy & Behavior. 2012;24(3):304–10.
    OpenUrl
  32. 32.↵
    Schulze-Bonhage A, Richardson MP, Brandt A, Zabler N, Dümpelmann M, San Antonio-Arce V. Cyclical underreporting of seizures in patient-based seizure documentation. Annals of Clinical and Translational Neurology. 2023;10(10):1863–72.
    OpenUrl
  33. 33.↵
    Cook MJ, O’Brien TJ, Berkovic SF, Murphy M, Morokoff A, Fabinyi G, et al. Prediction of seizure likelihood with a long-term, implanted seizure advisory system in patients with drug-resistant epilepsy: a first-in-man study. The Lancet Neurology. 2013;12(6):563–71.
    OpenUrl
  34. 34.
    Li MC, Seneviratne UK, Nurse ES, Cook MJ, Halliday AJ. Diagnostic utility of prolonged ambulatory video-electroencephalography monitoring. Epilepsy & Behavior. 2024;153:109652.
  35. 35.↵
    Zabler N, Swinnen L, Biondi A, Novitskaya Y, Schütz E, Epitashvili N, et al. High precision in epileptic seizure self-reporting with an app diary. Scientific Reports. 2024;14(1):15823.
    OpenUrl
  36. 36.↵
    Blachut B, Hoppe C, Surges R, Elger C, Helmstaedter C. Subjective seizure counts by epilepsy clinical drug trial participants are not reliable. Epilepsy & Behavior. 2017;67:122–7.
    OpenUrl
  37. 37.
    Hoppe C, Poepel A, Elger CE. Epilepsy: Accuracy of Patient Seizure Counts. Archives of Neurology. 2007;64(11):1595–9.
    OpenUrlCrossRefPubMed
  38. 38.
    Blum DE, Eskola J, Bortz JJ, Fisher RS. Patient awareness of seizures. Neurology. 1996;47(1):260–4.
    OpenUrlCrossRef
  39. 39.
    Kerling F, Mueller S, Pauli E, Stefan H. When do patients forget their seizures? An electroclinical study. Epilepsy & Behavior. 2006;9(2):281–5.
    OpenUrl
  40. 40.↵
    Tatum WO, Rubboli G, Kaplan PW, Mirsatari SM, Radhakrishnan K, Gloss D, et al. Clinical utility of EEG in diagnosing and monitoring epilepsy in adults. Clinical Neurophysiology. 2018;129(5):1056–82.
    OpenUrlCrossRef
  41. 41.↵
    Karoly PJ, Freestone DR, Eden D, Stirling RE, Li L, Vianna PF, et al. Epileptic Seizure Cycles: Six Common Clinical Misconceptions. Frontiers in Neurology. 2021;12.
  42. 42.
    Karoly PJ, Cook MJ, Maturana M, Nurse ES, Payne D, Brinkmann BH, et al. Forecasting cycles of seizure likelihood. Epilepsia. 2020;61(4):776–86.
    OpenUrl
  43. 43.↵
    Goldenholz DM, Eccleston C, Moss R, Westover MB. Prospective validation of a seizure diary forecasting falls short. Epilepsia. 2024.
  44. 44.↵
    Jafarpour S, Hirsch LJ, Gaínza-Lein M, Kellinghaus C, Detyniecki K. Seizure cluster: definition, prevalence, consequences, and management. Seizure. 2019;68:9–15.
    OpenUrl
  45. 45.↵
    Andrzejak RG, Espinoso A, García-Portugués E, Pewsey A, Epifanio J, Leguia MG, et al. High expectations on phase locking: Better quantifying the concentration of circular data. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2023;33(9).
  46. 46.↵
    Berens P. Circular Statistics Toolbox (Directional Statistics). MATLAB Central File Exchang e2023.
  47. 47.↵
    Maturana MI, Meisel C, Dell K, Karoly PJ, D’Souza W, Grayden DB, et al. Critical slowing down as a biomarker for seizure susceptibility. Nature communications. 2020;11(1):1–12.
    OpenUrlCrossRef
  48. 48.↵
    Skarpaas TL, Jarosiewicz B, Morrell MJ. Brain-responsive neurostimulation for epilepsy (RNS® System). Epilepsy research. 2019;153:68–70.
    OpenUrlCrossRef
  49. 49.↵
    Anderson DN, Charlebois CM, Smith EH, Davis TS, Peters AY, Newman BJ, et al. Closed-loop stimulation in periods with less epileptiform activity drives improved epilepsy outcomes. Brain. 2024;147(2):521–31.
    OpenUrlCrossRef
  50. 50.↵
    Gregg NM, Tal, Nasseri M, Joseph B, Karoly P, Cui J, et al. Seizure occurrence is linked to multiday cycles in diverse physiological signals. Epilepsia. 2023;64(6):1627–39.
    OpenUrlCrossRef
  51. 51.↵
    Goldenholz DM, Westover MB. Flexible realistic simulation of seizure occurrence recapitulating statistical properties of seizure diaries. Epilepsia. 2022.
  52. 52.↵
    Alsammani A, Stacey WC, Gliske SV. Estimation of circular statistics in the presence of measurement bias. IEEE journal of biomedical and health informatics. 2023.
Back to top
PreviousNext
Posted August 30, 2024.
Download PDF
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Monitoring seizure cycles with seizure diaries
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Monitoring seizure cycles with seizure diaries
Ashley Reynolds, Rachel E. Stirling, Samuel Håkansson, Philippa Karoly, Alan Lai, David B. Grayden, Mark J. Cook, Ewan Nurse, Andre Peterson
medRxiv 2024.08.28.24312758; doi: https://doi.org/10.1101/2024.08.28.24312758
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Monitoring seizure cycles with seizure diaries
Ashley Reynolds, Rachel E. Stirling, Samuel Håkansson, Philippa Karoly, Alan Lai, David B. Grayden, Mark J. Cook, Ewan Nurse, Andre Peterson
medRxiv 2024.08.28.24312758; doi: https://doi.org/10.1101/2024.08.28.24312758

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)