Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Improved mTBI outcomes with a BCI Amplified CRT Training: A retrospective chart review

C.T. Cripe, P. Mikulecky, Rebecca Cooper, T. Eagan
doi: https://doi.org/10.1101/2020.09.10.20192237
C.T. Cripe
1Fordham University – Visiting Scholar
2NTLGroup, Inc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
P. Mikulecky
3Neurologics, Inc.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: licere{at}hotmail.com
Rebecca Cooper
2NTLGroup, Inc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
T. Eagan
3Neurologics, Inc.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

This study is a retrospective chart review of 200 clients who participated in a non-verbal restorative Cognitive Remediation Training (rCRT) program. The program was applied to effect proper neural functional remodeling needed to support resilient, flexible and adaptable behaviors after encountering a mild to medium closed head traumatic brain injury (mTBI). The r CRT training program focused on improving functional performance in executive cognitive control networks as defined by fMRI studies. All rCRT training activities were delivered in a semi-game-like manner, incorporating a Brain Computer Interface (BCI) that provided in-the-moment neural network performance integrity metrics (nPIMs) used to adjust the level of play required to properly engage long-term potentiation (LTP) and long term depreciation (LTD) network learning rules.

This study reports on t-test and Reliable Change Index (RCI) changes found within cognitive abilities’ performance metrics derived from the Woodcock Johnson Cognitive Abilities III Test. We compared pre and post scores from seven cognitive abilities considered dependent on executive cognitive control networks against seven non-executive control abilities. We observed significant improvements (p values 10 to 10-22) with large Cohen’s d effect sizes (0.78-1.20) across thirteen cognitive ability domains with a medium effect size (.49) on the remaining. The mean percent change for pooled trained domain was double that observed for pooled untrained domain, at 17.2% versus 8.3%, respectively. To further adjust for practice effects, practice effect RCI values were computed and further supported the effectiveness of the rCRT training (RCI-trained 1.4 - 4.8; untrained RCI 0.08-0.75).

1.0 Introduction

Mild to acute TBIs can lead to lingering changes in an individual’s neurologic performance, resulting in debilitating and far-reaching consequences in adaptive cognitive functioning. Annually, as many as 5.3 million people in the U.S. are thought to face challenges due to TBI-related disabilities [1]. However, the actual number of chronic TBI (> 6 months post-injury time) may be greater. This is due to limited testing sensitivity of typical testing methods for TBI based on conventional neuropsychological measures and/or conventional clinical imaging methods (e.g., CT, MRI scanning) coupled with a lack of public awareness with regard to mTBI symptoms [2,3].

Concussions represent 80% of the traumatic brain injuries (TBI) occurring each year in the United States [4-8]. Concussions are often related to sports injuries, but the bulk of concussions are due to motor vehicle accidents, falls, and situations involving sudden acceleration and/or deceleration of the head [4-8]. TBIs have been long considered an injury with little recourse, but recent awareness of the long-term effects of concussion has led to a renewed emphasis on treating TBI and concussions. If not treated properly, an instantaneous insult can be the beginning of a chronic disease process rather than just an isolated event. This disease process occurs across all levels of initial injury severity, from mild to severe [5-8]. For example, TBIs are implicated as a risk factor for cognitive impairments, reduced social functioning, psychiatric disorders, and chronic traumatic encephalopathy [9-13].

TBI Cognitive Deficits

Cognitive deficits are some of the most common and undermining after-effects of a TBI. Such deficits may drastically interfere with an individual’s adaptive resiliency or ability to adapt to social and vocational collaborations, especially under mild stress conditions [14,15]. After a TBI, many major cognitive disruptions are triggered due to impaired gray matter or white-matter connections, often incurred by diffuse axonal injuries (DAI) [16]. DAIs foster multi-focal disturbances to axons that provide the structural basis of spatially distributed brain networks [17-21]. Consequently, a DAI often leads to interruptions in brain network connectivities, where these interruptions can be reflected in behavioral performance [17-21].In the context of rehabilitation, both active brain network performance and resting state functional connectivity (rsFC) metrics (measured using EEG or fMRI methods) are promising tools to measure neuroplasticity changes within an injured brain after injury [22-37]. These metrics can also provide evidence for experience-induced neuroplasticity changes acquired using rCRT methods [17-37].

Brain network performance deficits and/or DAI dysfunctions are often rooted in neural networks that sub-serve communications between larger networks. These larger networks support foundational neurobehaviors such as attention, memory, and executive functioning. White matter (WM) substructures of these networks and the efficiency of neural network hub connections (nodal connections within neural networks) demonstrate significant relationships with behavioral performance scores on intelligence testing [38-44]. Higher IQ scores correlate with higher nodal efficiency in the right anterior insula (AI) and dorsal anterior cingulate cortex (dACC), two hub regions within the salience network, with both regions shown to be vulnerable to mTBIs [38-44] and implicated in various mental health conditions [45-51]. Likewise, higher scores are linked to lower nodal efficiency in the left temporo-parietal junction area (TPJ).

Disruptions or lack of resiliency within these foundational neurobehaviors can impact various cognitive functions and emotional regulation abilities [17-21]. Spontaneous neural network reorganization resulting in a partial motor and cognitive recovery is commonly thought to occur in the first 3 to 6 months postinjury [52]. However, recent studies indicate that many deficits linger and are present years later [53-56]. Equally important, EEG performance studies indicate that the brain remodels or reorganizes to achieve a more normal behavioral performance; the remodeling may or may not have long term negative impact, depending on how the remodeling occurs [22-37]. Cognitive rehabilitation studies suggest that significant proper remodeling can be achieved by using cognitive rehabilitation exercises to reduce the cognitive and behavioral consequences of a mTBI [54-56]. Such exercises are the subject of this paper.

Restorative Cognitive Rehabilitation Training (rCRT)

Cognitive rehabilitation training (CRT) methods are an organized, functionally oriented set of therapeutic activities based on a neural assessment. CRT treatments target the patient’s cognitive and behavioral deficits [54-56]. Fundamental to the CRT process is the brain’s ability to be remodeled through behavioral experience via neural plasticity changes, or the brain’s ability to reorganize and relearn, by redirecting maladaptive plasticity towards a more functional neural growth state [14-22]. CRT methods divide into restorative interventions (/CRT) and compensatory methods (cCRT). /CRT principally intervenes in cognitive disturbances or disrupted neural performance caused by brain impairment or disrupted function to promote brain performance normalization. cCRT seeks to establish alternative patterns of cognitive activity or create new patterns of movement through external support devices (e.g., adaptive aids, prosthesis) to improve the patient’s quality of life [54-56].

rCRTRemediation Change Markers - Reliable Change Index, Cognitive Abilities and Resilience

Intelligence (cognitive ability) characterizes the ability to solve problems unrelated to previously learned knowledge, an essential element in resilient behavioural expressions [57]. These abilities underwrite encoding and use of new information with its efficient manipulation, representing a critical component of human cognition [39-45;58,59]. Equally, these abilities strongly predict educational and professional success [59], making the neural networks that support these operations obvious training targets. Cognitive neuroscience research supports this choice. For example, Santarnecchi et al. (2015) documented the association between individual intelligence quotients (IQ) and brain resilience by simulating targeted (specific network nodes) and random attacks using resting-state fMRI and graph analysis methods (n= 102 healthy individuals). The authors found enhanced brain resilience to targeted attacks (TA) were correlated with higher IQs in networks belonging to language and memory processing regions, whereas regions related to emotional processing were mostly supported in lower IQ individuals. These results suggest that both pre and post changes in IQ scores may be useful training predictors for recovery.

Retrospective Chart Review Study

This study reviewed 200 clients who participated in a rCRT-based program to promote proper remodeling of neural function after a TBI. The approach employed the NeuroCoach® Training System, an automated rCRT activity/brain-computer interface system that develops targeted neural circuit responses towards resilient, flexible and adaptable behaviors. The approach applies algorithmically leveled brain training activities to support psychological resilience.

2.0 Methods

The study design employed a retrospective chart review to formulate results derived from participants who had previously participated in a BCI-augmented CRT program as a post-conventional treatment follow-on component of their mTBI recovery program. Our study protocol, 20-NEUR-101, was determined by an independent Institutional Review Board to be Exempt according to FDA 21 CFR 56.104 and 45CFR46.104(b)(4). Our use of data was retrospective, and data were processed for analysis in a manner which precluded identification of individuals. Informed consent was obtained in writing from all participants. To explore treatment effects, this study used a battery of Woodcock Johnson III (WJIIICA) assessments. Participant testing record results obtained from WJIIICA testing were structured with dependent pre- and post-test sampling using the same evaluation methods in both pre and post testing. Each participant received an individualized program designed to address neurobehavioral imbalances in their executive function and emotional regulation. Targeted treatment variables focused on remediating deficiencies observed in participants’ cognitive control, memory, attention, and executive function. Neurobehavioral imbalances were addressed using an advanced form of a CRT employing a BCI method to influence CRT training activities based on the cognitive information processing strength of each imbalance in real time [60-62]. Collection of data and subsequent analyses of those data were conducted by different persons, which helped both to ensure confidentiality and preclude bias from analysis.

Participants

The TBI treatment group was composed of 200 participant records (n=200: 110 males and 90 females). The following training inclusion criteria were used: (1) mTBI derived from Sports, MVA, work related, and or recreational activity related; (2)>180 days post injury; (3) no histories of schizophrenia, bipolar disorder, eating or obsessive-compulsive disorder. Each group received the same pretest and posttest. Adult participants (aged 18 or older) previously classified with a closed head injury TBI were recruited from outpatient programs and private practices. The mean age of participants was 31.3 years. All records were de-identified using standard safe-harbor methods to protect the anonymity of individual health information. Participants volunteered for pre- and post-testing with treatment based on a deliberate self-selection convenient sample method. Volunteering did not affect the type of treatment received; specifically, those who did not volunteer or qualify for the study received the same BCI Amplified CRT Training as those who did. The treatment group was tested before treatment and upon treatment completion. All participants paid identical fees for treatment.

Pre- and Post-Test Measures

This study employed neurophysiological performance, neurocognitive behavioral and psychometric measurements. The neurophysiological performance metrics were derived from resting and active state neuroelectric imaging methods, classic cognitive abilities task measures and from the Connor-Davidson Resilience Scale. Pre and post behavioral (classic task scores) and neural performance markers (age-normed Power Spectral Density (PSD) from resting state and event-related potentials) were obtained during the evaluation. Resting state neurometrics were derived from two FDA-registered databases (BrainDx, Neuroguide), using a z-score method to evaluate neurophysiological performance metrics. Active event-related potential neurometrics and z-score decision training metrics were obtained using a non-published proprietary database compiled from previous clinical and non-clinical cases (developed by the lead author). Access to the proprietary database for conducting neurometrics can be obtained by arrangment with the lead author at NTLGroup, Inc.

Figure 1 depicts the ten dependent (i.e., treatment) measures chosen from the Woodcock Johnson Cognitive Abilities III Assessment Battery (WJIII) [65] and five additional neurocognitive task measures derived from neurophysiological performance metrics. These measures were used to aid in rCRT exercise selection and in evaluating post training effectivness. The WJIII battery is a set of cognitive ability sub-tests based on the Cattell-Horn-Carroll (CHC) theory of cognitive abilities. The CHC theory provides a comprehensive framework for understanding the structure of cognitive information processing and the cognitive abilities required to support proper function. Five neurophysiological tasks were chosen to illuminate source-reconstructed neural network metric performance. These tasks included eyes-closed and eyes-open resting states, Flanker Task, Sternberg Working Memory Task and an Auditory Event Potential Task [66-72].

Neurophysical/NeuroCognitive (NeuroCodex®) Pre-Post Evaluation

To obtain behavioral and temporal neural performance metrics, CHC tasks were presented to participants by the EventID task management program. Participants were seated in front of a computer screen and performed a battery of tasks derived from the WJIII battery. Each participant performed the cognitive battery while attached to a 19-channel EEG monitor (impedence below 5 kOhms) to record neuroelectric measures of EEG during the testing activities. After artifact rejection was performed on the EEG, behavioral and temporal neural metric measures were computed using classical ICA/PCA methods to obtain metrics for each test listed in Figure 1. The testing procedure began with a resting state eyes-closed and eyes-open condition as a baseline measure. Classical age-normed neurometrics were obtained based on standardized resting state quantitative EEG (qEEG) measures. These age-normed measures were included as baselines, compared against active ERP task measures as outlined in Figure 1.

To further support changes in resilient function, neural metric performance measures were obtained from five key source-reconstructed canonical networks that are considered to fine-tune behavior under variable environmental conditions. These networks are implicated in maintaining proper task performance and in general mental health preservation [67-73]. The program uses the Gordon et al [69] description of three distinct sets of connector hubs which integrate brain functional activités to model neurofunctional interactions. These three are Control-Default hubs, Cross-Control Connector hubs and Control-Prococessing hubs.

The five key networks include: Working Memory - the primary network that supports reasoning, expanded thought, and awareness by providing the mind a conscious workspace for information [69,70]; Cognitive Control Networks (CCN) - cognitive control incorporates processes involved in producing and preserving appropriate task goals, including suppressing irrelevant mental and physical activities that distract from achieving the desired set of task [69,70]; CCN Subdivisions: (1) The Frontal-Parietal Network (FPN) provides active online control, allowing it to adaptively initiate and adjust control [69,70]; (2) the Cingulate-Opercular Network (CON) provides stable ‘set-maintenance’ (state maintenance) over the entire task epoch or behavioral strategy[69,70]; (3) the Salience Network (SN, the Attention Networks plus Insula Network) is involved in rapid detection of goal-relevant events and facilitation of access to appropriate cognitive resources by interacting with multiple functional systems, thereby supporting a wide range of cognitive processes[69,70]. The Default Mode Network (DMN) is implicated in the brain’s default resting state conditions and in its ability to sustain task performance. The DMN is composed of functionally specialized subsystems, with the anterior DMN (i.e., medial Prefrontal Cortex (PFC)) associated with identifying stimuli as self-salient, whereas the posterior DMN region (with the parahippocampal gyrus) is involved in autobiographical search and memory retrieval. Mechanisms within the DMN are implicated in regulating emotional reactivity and may play a key role in the empathic process by establishing a distinction between other- and self-related feelings [69-73]. Regarding congruent cognitive/behavioral health performance, a close relationship exists between empathy and executive regulatory mechanisms. Sluggish and/or poor (dis)engagement of the DMN is a noted biomarker within several mental health conditions, including depression and attention deficit disorders [69,73]. The opposing relationship between DMN and cognitive control networks may influence the ability to exert cognitive control [69,73] and play an important role in the regulation of mind-wandering and rumination that impacts task performance [73].

Fig 1.
  • Download figure
  • Open in new tab
Fig 1.

Neurocognitive Functions of Interest and Canonical Networks

Training Procedure

Immediately after initial evaluation, participants used the NeuroCoach® Training System three times per week for twelve weeks (approximately 30-40 minutes per session); participants were then reassessed. All participants completed a non-verbal cognitive enhancement/neuro-remodeling treatment program that monitors and evaluates a user’s defined neural networks system performance status in real-time. Between 48 and 80 sessions of extensive training (approximately 30-40 minutes per session) were completed before final re-evaluations were completed. The training system is rooted in modern rCRT methods, incorporating a neural network BCI monitoring interface. The BCI provides neural network performance integrity metrics (nPIMs), originated from one or more of the three control connector hub systems. The nPIMs inform the leveling training algorithm as it adjusts program training intensity levels. The BCI adjusts the difficulty level for each training activity based on in-the-moment brain performance metrics. Individual nPIMs are derived from the neural network systems that support various cognitive functions being trained and are user-selectable. The rCRT methodology is implemented through a selectable set of computer activities specific to individual needs and engages the desired brain network systems and cognitive functions. Each activity is based on classic neuroscience paradigms [60-69]. The BCI interface informs the trainer, the user, the rCRT activity in real time the current neural network performance integrity status based on the user’s present nPIMs state.

Each rCRT activity incorporates a performance leveling algorithm (PLA) to adjust the intensity of the activity by rendering the pursuit to be either more or less intense. Unique in our method is that the PLA encompasses both nPIMs and behavioral responses (e.g., response times, accuracy) to adjust the level of intensity of the activity. This adjustment is based on the real-time performance ability of the user, and targets the intensity required to properly engage long-term potentiation (LTP) and long-term depreciation (LTD) network learning rules [75-83]. Difficulty is adjusted based upon current responses, with the goal of a proper ratio of neurocircuit engagement as opposed to a certain level of correct responses. The intention of the performance-leveling algorithm is to adjust the level of pursuit play to a comfortable level, allowing the user to progress through the activity successfully while simultaneously focusing on developing and/or strengthening the performance integrity of the neural system being trained.

NeuroCoach® Training Module Example and Description

The Split-Attention application (a NeuroCoach® training module) is an adaptive process-based, nonverbal training technique designed to aid in re-setting/enhancing the attention (ATN), working memory (WMN), frontal parietal (FPN) and salience networks (SN). Split-Attention uses a relaxation and restorative framework that allows the trained networks to regain or obtain a natural homeostatic balance needed to maintain a desired level of performance as it drives the user towards increased capacity, neural efficiency and performance resilience. Neurobehaviorally, the application focuses on training the useful field of view (visual attention), working memory, cognitive speed, task switching, and multiple attention abilities, all in one application.

The lead author has used this application clinically for ten years with brain-injured and learning-disabled populations. The application promotes a relaxed sustained attentional focus in professional athletes and supports restorative cognitive enhancement. The Split-Attention exercise satisfies The Institute of Medicine’s Checklist criteria for brain training [39].

Analysis of Pre- and Post-rCRTScores

Scoring data for all participants were pooled within a Pandas data frame and analyzed as a batch for means, standard deviations and pre/post rCRT changes by means of a Python script. P-values comparing pre/post rCRT subject scores were calculated from entire population distributions by using the two-sided Kolmogorov-Smirnov algorithm within SciPy. This method consistently produced more conservative (i.e., larger) p-values than other methods which consider only population means and standard deviations.

Analysis of Practice Effects - RCI Calculations

The RCI technique used to correct for practice effects and measurement error is defined as ((X2−X1 − (M2 − M1))/SDD [74,75] where X1 is the measured pretest score, X2 the post-test score, SDD the standard deviation of the group test-retest difference, X1 the control group mean pretest score, and X2 the control group mean post-test score. As a retrospective chart review, the study did not use control subjects and therefore obtaining measures of M1 and M2 are not directly available. However, several studies have determined that the estimated change in cognitive test retest scores range between .25 and .33 of a typical standard deviation [74-76]. Applied to standard scores, M1 M2 values would range between 3.75 and 5.0. Table 2 presents results for the 14 Woodcock Johnson Variables and the RCI results from all tests.

View this table:
  • View inline
  • View popup
Table 1.

Summary of the Pre- and Post-299 treatment Training Results

Large-scale intrinsic and task-evoked circuits identified in published work. Fronto-parietal network (FPN) [31]: DLPFC = dorsolateral prefrontal cortex: IPL = inferior parietal lobule: DFC = dorsal frontal cortex: IPS = intraparietal sulcus: Precuneus; MCC = middle cingulate cortex. Cingulo-opercular network (CON) [31]: APFC = anterior prefrontal cortex: AIFO = anterior insula frontal operculum: dACC/MSFC = dorsal anterior cingulate cortex and medial superior frontal cortex; Thalamus*. Salience network (SN) [32]: dACC = dorsal anterior cingulate cortex; al = anterior insula; TP=temporal pole: SLEA = sublenticular extended amygdala*. Default mode network (DMN) [40]: aMPFC = anterior medial prefrontal cortex; AG = angular gyrus: PCC=posterior cingulate cortex (includes precuneus). Working memory network (WM) [39]: SPL = superior parietal lobule: DLPFC = dorsolateral prefrontal cortex; MPFC medial prefrontal cortex: VAC = ventral anterior cingulate area; AR = agranular retrolimbic area: DPC = dorsal posterior cingulate area; dACC = dorsal anterior cingulate cortex; Preg. = pregenual area (ACC); SG = supramarginal gyrus; Hip = Hippocampus*. Subcortical areas denoted by (*) are unlikely to be reliably measured using EEG, and may be excluded from our analysis.

3.0 Results

Subjects completed identical Woodcock Johnson III assessments before and after rCRT treatment. The battery included fourteen assessments in the following areas: General Intellectual Ability (GIA), Thinking Efficiency, Concept Formation, Working Memory, Numbers Reversed, Visual Auditory Learning, Visual Audio Delayed, Verbal Ability, Phonemic Awareness, Verbal Comprehension, Incomplete Words, Sound Blending, Spatial Relations and Visual Matching. rCRT treatment explicitly targeted development in neurocircuits related to the first seven of these areas but did not explicitly target development in the second seven areas. Given the absence of a control group in this retrospective chart review study, measuring performance in both targeted and untargeted areas provided some assessment of the magnitude of specific treatment effects.

Table 2 summarizes the pre- and post-treatment results across all Woodcock Johnson III assessments. Histograms of pre- and post-training scores for individual areas are available in Supplementary Materials (Figures S1-S14). Notably, we observed significant improvements (p values ranged from 10-4 to 10-22) across all Woodcock Johnson III areas, as might be expected after many sessions of intensive rCRT. To assess the differential impact of explicitly targeting an area within the rCRT program, we adjusted these observed improvements to reflect the percent change within each area, and compared the pooled percent changes observed in trained areas against those observed for untrained areas. Figure 1 displays histograms for these pooled changes. The mean percent change for trained areas was double that observed for untrained areas, at 17.2% versus 8.3%, respectively. Figure 2 shows percent changes observed across each area, ranked by magnitude, and highlights how consistently trained areas received a greater percent change than those observed for untrained areas.

We observed no significant correlation in pre-training, post-training or change scores as a function of subject sex or age, regardless of the area assessed (Supplementary Materials, Figures S1-S14).

Fig 2.
  • Download figure
  • Open in new tab
Fig 2.

Histogram of Pooled Changes

Fig 3.
  • Download figure
  • Open in new tab
Fig 3.

Percent Changes Observed Across each Area

4.0 Discussion

Previous mTBI CRT program meta-analyses report medium effect size training improvements [75-77]. As such, the study authors recommend CRT methods as a viable method for treating mTBIs [75-77]. Traditional mTBI treatment programs generally begin with neuropsychological behavioral testing that do not include a neuroimaging exam. As a result, training is focused on behavioral deficits found within attentional, memory, or other executive domains, without considering possible neural network performance interruptions nor possible reduced neural integrative effects. In contrast, this study explored possible neural network performance interruptions by choosing training targets based on possible neural network performance interruptions based on a standardized cognitive task-based neuroimaging exam. Additionally, to support optimal network remodeling during /CRT training, each training activity was guided by network performance nPIMs provided by a BCI interface in support of proper neural functional remodeling needed to support resilient, flexible and adaptable behaviors. More expressly, the /CRT training program focused on improving neural network functional performance to support long-term potentiation (LTP) and long-term depreciation (LTD) network learning rules during the training process.

Group level t-test and practice effect RCI value changes support significant positive changes within important cognitive abilities’ performance metrics known to support executive cognitive control abilities needed in resilient, flexible and adaptable behavioral expressions. /CRT training target selection focused on cognitive control training activities. We anticipated a positive training effect to occur in the all measured cognitive domains due to general cognitive improvement in cognitive network efficiency. However, we further expected a greater improvement in the executive function metrics due to the focus in the training. Pre and post scores from seven cognitive abilities considered dependent on executive cognitive control networks were compared against seven non-executive control abilities and supported our expectations. We observed significant improvements (p values 10-4 to 10-22) with large Cohen’s d effect sizes (.78-1.20) across thirteen cognitive ability domains with a medium effect size (.49) on the remaining. The mean percent change for pooled trained domain was double that observed for pooled untrained domain, at 17.2% versus 8.3%, respectively. To further adjust for practice effects, practice effect RCI values (based upon literature known adjustments) were computed and further supported the effectiveness of the /CRT training (RCI-trained 1.4 - 4.8; untrained RCI .08-.75) on the executive control networks.

In summary, this mTBI study demonstrates a strong possible increase in training effects over conventional rCRT methods. This was achieved by first using a neuroelectric imaging exam based on EEG source reconstructed neural network methods used in rCRT training target selection. Second, we augmented individual rCRT activities with a BCI interface to monitor and compute in-the-moment neural network performance integrity metrics (nPIMs) needed to align the level of activity engagement. Activity level computations were required to properly manage cognitive loads and to properly engage long-term potentiation (LTP) and long-term depreciation (LTD) network learning rules. From our experience, this automated approach to classical rCRT methods offers two extensions over traditional pen and pencil, or computer game CRT approaches: 1) tailoring the selection of the rCRT training procedures based on neural network performance metrics derived from EEG source reconstruction neuroelectric imaging evaluations to isolate underlying neural network disruptions; 2) amplifying neural network regional training by means of BCI treatment amplification.

In general, the training program assumes that coupling key, resilience-supporting neural circuits with proper problem-solving skills promotes the emergence of resilient, adaptive behaviors. Based upon program participant subjective reports, we found that in the context of daily living, this emergence means proper brain based behavioral health expressions that allow return to productive work, social reintegration and improvement in one’s quality of life. In other contexts, such as in sports, this emergence means increased sports performance for both injured and non-injured athletes.

This retrospective chart review was limited by the lack of a control group, although comparing explicitly trained versus untrained cognitive areas provided some measure of the effect of treatment. Future work will further “mine” retrospective data to inform the design and focus of controlled, prospective studies. In addition, customized individual rCRT programs will benefit from the insights gleaned from analysis of our database of retrospective data.

Data Availability

Raw qEEG and cognitive testing data cannot be shared publicly because of privacy issues. De-identified pre/post cognitive testing data which underlie the results of the study are available from Curtis Cripe, NTL Group, Inc., 602-799-2051, ctcripe{at}att.net

References

  1. 1.↵
    Frieden, T.R., Houry, D., Baldwin, G., 2015. Report to Congress on Traumatic Brain Injury in the United States: Epidemiology and Rehabilitation. Centers for Disease Control and Prevention, National Center for Injury Prevention and Control; Division of Unintentional Injury Prevention, Atlanta, GA.
  2. 2.↵
    Katz, D.I., Alexander, M.P., 1994. Traumatic brain injury: predicting course of recovery and outcome for patients admitted to rehabilitation. Arch. Neurol. 51, 661–670.
    OpenUrlCrossRefPubMedWeb of Science
  3. 3.↵
    Tellier, A., Marshall, S.C., Wilson, K.G., Smith, A., Perugini, M., Stiell, I.G., 2009. The heterogeneity of mild traumatic brain injury: where do we stand? Brain Inj. 23, 879–887.
    OpenUrlCrossRefPubMedWeb of Science
  4. 4.↵
    Faul, M., Xu, L., Wald, M.M., Coronado, V.G., 2010. Traumatic Brain Injury in the United States: Emergency Department Visits, Hospitalizations, and Deaths. Centers for Disease Control and Prevention, National Center for Injury Prevention and Control, Atlanta, GA.
  5. 5.↵
    Corrigan, J.D., Cuthbert, J.P., Harrison-Felix, C., Whiteneck, G.G., Bell, J.M., Miller, A.C., Coronado, V.G., Pretz, C.R., 2014. Us population estimates of health and social outcomes 5 years after rehabilitation for traumatic brain injury. J. Head Trauma Rehabil. 29, E1-E9.
    OpenUrlCrossRefPubMed
  6. 6.
    Masel, B.E., DeWitt, D.S., 2010. Traumatic brain injury: a disease process, not an event. J. Neurotrauma 27, 1529–1540.
    OpenUrlCrossRefPubMedWeb of Science
  7. 7.
    Whitnall, L., McMilan, T.M., Murray, G.D., Teasdale, G.M., 2006. Disability in young people and adults after head injury: 5-7 year follow up of a prospective cohort study. J. Neurol. Neurosurg. Psychiatry 77, 640–645.
    OpenUrlAbstract/FREE Full Text
  8. 8.↵
    Masel, B.E., DeWitt, D.S., 2010. Traumatic brain injury: a disease process, not an event. J. Neurotrauma 27, 1529–1540.
    OpenUrlCrossRefPubMedWeb of Science
  9. 9.↵
    Arciniegas, D.B., Held, K., Wagner, P., 2002. Cognitive impairment following traumatic brain injury. Curr. Treat. Options Neurol. 4, 43–57.
    OpenUrlCrossRefPubMed
  10. 10.
    Rabinowitz, A.R., Levin, H.S., 2014. Cognitive sequelae of traumatic brain injury. Psychiatr. Clin. N. Am. 37, 1–11.
    OpenUrlCrossRefPubMed
  11. 11.
    Temkin, N.R., Corrigan, J.D., Dikmen, S.S., Machamer, J., 2009. Social functioning after traumatic brain injury. J. Head Trauma Rehabil. 24, 460–467.
    OpenUrlCrossRefPubMed
  12. 12.
    Hesdorffer, D.C., Rauch, S.L., Tamminga, C.A., 2009. Long-term psychiatric outcomes following traumatic brain injury: a review of the literature. J. Head Trauma Rehabil. 24, 452–459.
    OpenUrlCrossRefPubMedWeb of Science
  13. 13.↵
    McKee, A.C., Stein, T.D., Nowinski, C.J., Stern, R.A., Daneshvar, D.H., Alvarez, V.E., Lee, H.-S., Hall, G., Wojtowicz, S.M., Baugh, C.M., Riley, D.O., Kubilus, C.A., Cormier, K.A., Jacobs, M.A., Martin, B.R., Abraham, C.R., Ikezu, T., Reichard, R.R., Wolozin, B.L., Budson, A.E., Goldstein, L.E., Kowall, N.W., Cantu, R.C., 2013. The spectrum of disease in chronic traumatic encephalopathy. Brain 136, 43–64.
    OpenUrlCrossRefPubMedWeb of Science
  14. 14.↵
    Laatsch L, Little D, Thulborn K. Changes in fMRI following cognitive rehabilitation in severe traumatic brain injury: a case study. Rehabil Psychol. 2004;49:262–267.
    OpenUrl
  15. 15.↵
    Voelbel GT, Genova HM, Chiaravalotti ND, Hoptman MJ. Diffusion tensor imaging of traumatic brain injury review: implications for neurorehabilitation. NeuroRehabilitation. 2012;31:281–293.
    OpenUrlCrossRefPubMedWeb of Science
  16. 16.↵
    Kou Z, Iraji A. Imaging brain plasticity after trauma. Neural Regen Res. 2014;9:693–700.
    OpenUrl
  17. 17.↵
    Whyte J, Polansky M, Fleming M, Coslett HB, Cavallucci C. Sustained arousal and attention after traumatic brain injury. Neuropsychologia. 1995;33:797–813.
    OpenUrlCrossRefPubMedWeb of Science
  18. 18.
    McAvinue L, O’Keeffe F, McMackin D, Robertson IH. Impaired sustained attention and error awareness in traumatic brain injury: implications for insight. Neuropsychol Rehabil. 2005;15:569–587.
    OpenUrlCrossRefPubMed
  19. 19.
    Ziino C, Ponsford J. Selective attention deficits and subjective fatigue following traumatic brain injury. Neuropsychology. 2006;20:383–390.
    OpenUrlCrossRefPubMedWeb of Science
  20. 20.
    Vakil E. The effect of moderate to severe traumatic brain injury (TBI) on different aspects of memory: a selective review. J Clin Exp Neuropsychol. 2005;27:977–1021.
    OpenUrlCrossRefPubMed
  21. 21.↵
    Kennedy MR, Coelho C, Turkstra L, et al. Intervention for executive functions after traumatic brain injury: a systematic review, meta-analysis and clinical recommendations. Neuropsychol Rehabil. 2008; 18:257-299.
    OpenUrlCrossRefPubMedWeb of Science
  22. 22.↵
    Amen DG, Wu JC, Taylor D, Willeumier K. Reversing brain damage in former NFL players: implications for traumatic brain injury and substance abuse rehabilitation. J Psychoactive Drugs. 2011;43:1–5.
    OpenUrlPubMedWeb of Science
  23. 23.
    Ianof, J. N., & Anghinah, R. (2017). Traumatic brain injury: An EEG point of view. Dementia & Neuropsychologia, 11(1), 3–5.
    OpenUrl
  24. 24.
    Lewine, J. D., Plis, S., Ulloa, A., Williams, C., Spitz, M., Foley, J., … Weaver, L. (2019). Quantitative EEG Biomarkers for Mild Traumatic Brain Injury: Journal of Clinical Neurophysiology, 36(4), 298–305.
    OpenUrl
  25. 25.
    McNerney, M. W., Hobday, T., Cole, B., Ganong, R., Winans, N., Matthews, D., … Lane, S. (2019). Objective Classification of mTBI Using Machine Learning on a Combination of Frontopolar Electroencephalography Measurements and Self-reported Symptoms. Sports Medicine - Open, 5(1).
  26. 26.
    Ledwidge, P. S., & Molfese, D. L. (2016). Long-Term Effects of Concussion on Electrophysiological Indices of Attention in Varsity College Athletes: An Event-Related Potential and Standardized Low-Resolution Brain Electromagnetic Tomography Approach. Journal of Neurotrauma, 33(23), 2081–2090.
    OpenUrl
  27. 27.
    Zhang, Y., Ma, Y., Chen, S., Liu, X., Kang, H. J., Nelson, S., & Bell, S. (2019). Long-Term Cognitive Performance of Retired Athletes with Sport-Related Concussion: A Systematic Review and Meta-Analysis. Brain Sciences, 9(8), 199.
    OpenUrl
  28. 28.
    Hudac, C. M., Cortesa, C. S., Ledwidge, P. S., & Molfese, D. L. (2018). History of concussion impacts electrophysiological correlates of working memory. International Journal of Psychophysiology, 132, 135–144.
    OpenUrl
  29. 29.
    Mayer, A. R., Mannell, M. V., Ling, J., Gasparovic, C., & Yeo, R. A. (2011). Functional connectivity in mild traumatic brain injury. Human Brain Mapping, 32(11), 1825–1835.
    OpenUrlCrossRefPubMedWeb of Science
  30. 30.
    Slobounov, S. M., Zhang, K., Pennell, D., Ray, W., Johnson, B., & Sebastianelli, W. (2010). Functional abnormalities in normally appearing athletes following mild traumatic brain injury: a functional MRI study. Experimental Brain Research, 202(2), 341–354.
    OpenUrlCrossRefPubMedWeb of Science
  31. 31.↵
    Papathanasiou, E. S., Cronin, T., Seemungal, B., & Sandhu, J. (2018). Electrophysiological testing in concussion: A guide to clinical applications. Journal of Concussion, 2, 205970021881263.
    OpenUrl
  32. 32.↵
    Urakami, Y. (2013). Electrophysiologic Evaluation of Diffuse Axonal Injury after Traumatic Brain Injury. Journal of Neurology & Neurophysiology, 04(03).
  33. 33.
    Thompson, J. W. (2006). EEG changes and balance deficits following concussion: one piece of the puzzle. In Foundations of sport-related brain injuries (pp. 341-374). Springer.
  34. 34.
    Dunkley, B. T., Urban, K., Da Costa, L., Wong, S. M., Pang, E. W., & Taylor, M. J. (2018). Default Mode Network Oscillatory Coupling Is Increased Following Concussion. Frontiers in Neurology, 9.
  35. 35.
    Cao, C., & Slobounov, S. (2010). Alteration of Cortical Functional Connectivity as a Result of Traumatic Brain Injury Revealed by Graph Theory, ICA, and sLORETA Analyses of EEG Signals. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 18(1), 11–19.
    OpenUrlCrossRefPubMedWeb of Science
  36. 36.
    Olson, R. L., Brush, C. J., Ehmann, P. J., Buckman, J. F., & Alderman, B. L. (2018). A history of sport-related concussion is associated with sustained deficits in conflict and error monitoring. International Journal of Psychophysiology, 132, 145–154.
    OpenUrl
  37. 37.↵
    Zhu, D. C., Covassin, T., Nogle, S., Doyle, S., Russell, D., Pearson, R. L., … Kaufman, D. I. (2015). A Potential Biomarker in Sports-Related Concussion: Brain Functional Connectivity Alteration of the Default-Mode Network Measured with Longitudinal Resting-State fMRI over Thirty Days. Journal of Neurotrauma, 32(5), 327–341.
    OpenUrlPubMed
  38. 38.↵
    Chen, T., Cai, W., Ryali, S., Supekar, K., & Menon, V. (2016). Distinct global brain dynamics and spatiotemporal organization of the salience network. PLoS Biology, 14(6), e1002469.
    OpenUrlCrossRef
  39. 39.↵
    Institute of Medicine (2015) Cognitive Aging: Progress in Understanding and Opportunities for Action. Washington, DC: The National Academies Press.
  40. 40.↵
    Cattell, R. B., & Cattell, R. B. (1987). Intelligence: its structure, growth, and action. Amsterdam_; New York_: New York: North-Holland_; Sole distributors for the U.S.A. and Canada, Elsevier Science Pub. Co.
  41. 41.
    Deary, I. (2008). Why do intelligent people live longer? Nature, 456(7219), 175–176. doi:10.1038/456175a
    OpenUrlCrossRefPubMedWeb of Science
  42. 42.
    Li, Yonghui, Yong Liu, Jun Li, Wen Qin, Kuncheng Li, Chunshui Yu, and Tianzi Jiang. “Brain Anatomical Network and Intelligence.” Edited by Olaf Sporns. PLoS Computational Biology 5, no. 5 (May 29, 2009): e1000395.
    OpenUrl
  43. 43.
    Santarnecchi, Emiliano, Alexandra Emmendorfer, and Alvaro Pascual-Leone. “Dissecting the Parieto-Frontal Correlates of Fluid Intelligence: A Comprehensive ALE Meta-Analysis Study.” Intelligence 63 (July 2017): 9-28.
    OpenUrl
  44. 44.↵
    Marsman, Anouk, René C. W. Mandl, Dennis W. J. Klomp, Wiepke Cahn, René S. Kahn, Peter R. Luijten, and Hilleke E. Hulshoff Pol. “Intelligence and Brain Efficiency: Investigating the Association between Working Memory Performance, Glutamate, and GABA.” Frontiers in Psychiatry 8 (September 15, 2017).
  45. 45.↵
    Hilger, Kirsten, Matthias Ekman, Christian J. Fiebach, and Ulrike Basten. “Efficient Hubs in the Intelligent Brain: Nodal Efficiency of Hub Regions in the Salience Network Is Associated with General Intelligence.” Intelligence 60 (January 2017): 10-25.
    OpenUrlCrossRef
  46. 46.
    Sha, Z., Wager, T. D., Mechelli, A., & He, Y. (2019). Common Dysfunction of Large-Scale Neurocognitive Networks Across Psychiatric Disorders. Biological Psychiatry, 85(5), 379–388.
    OpenUrl
  47. 47.
    Redish, A. D., & Gordon, J. A. (Eds.). (2016). Computational psychiatry: new perspectives on mental illness. Cambridge, Massachusetts: The MIT Press.
  48. 48.
    da Silva, A. G., Malloy-Diniz, L. F., Garcia, M. S., Figueiredo, C. G. S., Figueiredo, R. N., Diaz, A. P., & Palha, A. P. (2018). Cognition As a Therapeutic Target in the Suicidal Patient Approach. Frontiers in Psychiatry, 9.
  49. 49.
    Kesler, S., Hadi Hosseini, S. M., Heckler, C., Janelsins, M., Palesh, O., Mustian, K., & Morrow, G. (2013). Cognitive Training for Improving Executive Function in Chemotherapy-Treated Breast Cancer Survivors. Clinical Breast Cancer, 13(4), 299–306.
    OpenUrlCrossRefPubMedWeb of Science
  50. 50.
    Copersino, M. L. (2017). Cognitive mechanisms and therapeutic targets of addiction. Current Opinion in Behavioral Sciences, 13, 91–98.
    OpenUrl
  51. 51.↵
    Vinogradov, S., Fisher, M., & de Villers-Sidani, E. (2012). Cognitive Training for Impaired Neural Systems in Neuropsychiatric Illness. Neuropsychopharmacology, 37(1), 43–76.
    OpenUrlCrossRefPubMedWeb of Science
  52. 52.↵
    Chen AJW, D’Esposito M. Traumatic brain injury: from bench to bedside to society. Neuron. 2010;66:11–14.
    OpenUrlCrossRefPubMed
  53. 53.↵
    Tomaszczyk JC, Green NL, Frasca D, et al. Negative neuro-plasticity in chronic traumatic brain injury and implications for neurorehabilitation. Neuropsychol Rev. 2014;24:409–427.
    OpenUrlCrossRefPubMed
  54. 54.↵
    Chiaravalloti ND, Dobryakova E, Wylie GR, DeLuca J. Examining the efficacy of the modified story memory technique resonance imaging (fMRI): the TBI-MEM trial. J Head Trauma Rehabil. 2015;30:261–269.
    OpenUrl
  55. 55.
    Cicerone KD, Dahlberg C, Kalmar K, et al. Evidence-based cognitive rehabilitation: recommendations for clinical practice. Arch Phys Med Rehabil. 2000;81:1596–1615.
    OpenUrlCrossRefPubMedWeb of Science
  56. 56.↵
    Laatsch LK, Thulborn KR, Krisky CM, Shobat DM, Sweeney JA. Investigating the neurobiological basis of cognitive rehabilitation therapy with fMRI. Brain Inj. 2004;18:957–974.
    OpenUrlCrossRefPubMedWeb of Science
  57. 57.↵
    Dosenbach, N. U. F., Fair, D. A., Cohen, A. L., Schlaggar, B. L., & Petersen, S. E. (2008). A dual-networks architecture of top-down control. Trends in Cognitive Sciences, 12(3), 99–105
    OpenUrlCrossRefPubMedWeb of Science
  58. 58.↵
    Chen, T., Cai, W., Ryali, S., Supekar, K., & Menon, V. (2016). Distinct global brain dynamics and spatiotemporal organization of the salience network. PLoS Biology, 14(6), e1002469.
    OpenUrlCrossRef
  59. 59.↵
    Bathelt, J., G. Scerif, A.C. Nobre, and D.E. Astle. “Whole-Brain White Matter Organization, Intelligence, and Educational Attainment.” Trends in Neuroscience and Education 15 (June 2019): 38-47.
    OpenUrl
  60. 60.↵
    Cripe, C. (in review) Improved Sobriety Rates after Brain-computer Interface-based Cognitive Remediation Training
  61. 61.
    Cripe C. Neuroengineering: brain recovery methods-applied to substance abuse recovery. In Psychology’s New Design Science: Theory and Research. Imholz S, Sachter J, eds. Common Ground Publishing, 2014; 100-135.
  62. 62.↵
    Wykes T, Brammer M, Mellers J, Bray P, Reeder C, Williams C, Corner J. Effects on the brain of a psychological treatment: Effects on the brain of a psychological treatment: cognitive remediation therapy cognitive remediation therapy. British Journal of Psychiatry (2002) 144-152
  63. 63.
    Wykes T, Spaulding WD. Thinking about the future cognitive remediation therapy-what works, and could we do better? Schizophr Bull 2011;37(2):S80-90.
    OpenUrlCrossRefPubMedWeb of Science
  64. 64.
    Gunkelman J, Cripe C. Clinical outcomes in addiction: a neurofeedback case series. Biofeedback 2008;36(4):152-156.
    OpenUrl
  65. 65.↵
    Woodcock, R. W.; McGrew, K. S.; Mather, N (2001). Woodcock Johnson III. Itasca, IL: Riverside
  66. 66.↵
    Prichep, L. S., & John, E. R. (1992). QEEG profiles of psychiatric disorders. Brain Topography, 4(4), 249–257.
    OpenUrlCrossRefPubMed
  67. 67.↵
    Cole, M., Repovs, G., & Anticevic, A. (2014). The frontoparietal control system: A central role in mental health. The Neuroscientist, 1-13.
  68. 68.
    Gratton, G. (2018). Brain reflections: A circuit-based framework for understanding information processing and cognitive control. Psychophysiology, 55(3), e13038. https://doi.org/10.1111/psyp.13038
    OpenUrlCrossRef
  69. 69.↵
    Gordon, Evan M., Charles J. Lynch, Caterina Gratton, Timothy O. Laumann, Adrian W. Gilmore, Deanna J. Greene, Mario Ortega, Annie L. Nguyen, Bradley L. Schlaggar, and Steven E. Petersen. “Three Distinct Sets of Connector Hubs Integrate Human Brain Function.” Cell Reports 24, no. 7 (2018): 1687-1695
    OpenUrl
  70. 70.↵
    Cai, W., Chen, T., Ryali, S., Kochalka, J., Li, C.-S. R., & Menon, V. (2016). Causal Interactions Within a Frontal-Cingulate-Parietal Network During Cognitive Control: Convergent Evidence from a Multisite-Multitask Investigation. Cerebral Cortex, 26(5), 2140–2153. https://doi.org/10.1093/cercor/bhv046
    OpenUrlCrossRefPubMed
  71. 71.
    Sternberg, S. (1965). High Speed Scanning in Human Memory. J. Comp. Physiol. Psychol, 59, 439.
    OpenUrlCrossRefPubMedWeb of Science
  72. 72.↵
    Siemann, J., Herrmann, M., & Galashan, D. (2018). The effect of feature-based attention on flanker interference processing: An fMRI-constrained source analysis. Scientific Reports, 8(1). https://doi.org/10.1038/s41598-018-20049-1
  73. 73.↵
    Braboszcz, C., & Delorme, A. (2011). Lost in thoughts: Neural markers of low alertness during mind wandering. NeuroImage, 54(4), 3040–3047.
    OpenUrlCrossRefPubMed
  74. 74.↵
    Roitsch, J., Redman, R., Michalek, A. M. P., Johnson, R. K., & Raymer, A. M. (2019). Quality Appraisal of Systematic Reviews for Behavioral Treatments of Attention Disorders in Traumatic Brain Injury: Journal of Head Trauma Rehabilitation, 34(4), E42-E50.
    OpenUrl
  75. 75.↵
    Kennedy MR, Coelho C. Self-regulation after traumatic brain injury: a framework for intervention of memory and problem solving. Semin Speech Lang. 2005;26(4):242-55. doi:10.1055/s-2005-922103.
    OpenUrlCrossRefPubMed
  76. 76.↵
    Hallock H, Collins D, Lampit A, Deol K, Fleming J, Valenzuela M. Cognitive training for post-acute traumatic brain injury: a systematic review and meta-analysis. Front Hum Neurosci. 2016;10:537. doi:10.3389/fnhum.2016.00537.
    OpenUrlCrossRef
  77. 77.↵
    Cooper DB, Bunner AE, Kennedy JE, Balldin V, Tate DF, Eapen BC, Jaramillo CA. Treatment of persistent post-concussive symptoms after mild traumatic brain injury: a systematic review of cognitive rehabilitation and behavioral health interventions in military service members and veterans. Brain Imaging Behav.
Back to top
PreviousNext
Posted September 13, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Improved mTBI outcomes with a BCI Amplified CRT Training: A retrospective chart review
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Improved mTBI outcomes with a BCI Amplified CRT Training: A retrospective chart review
C.T. Cripe, P. Mikulecky, Rebecca Cooper, T. Eagan
medRxiv 2020.09.10.20192237; doi: https://doi.org/10.1101/2020.09.10.20192237
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Improved mTBI outcomes with a BCI Amplified CRT Training: A retrospective chart review
C.T. Cripe, P. Mikulecky, Rebecca Cooper, T. Eagan
medRxiv 2020.09.10.20192237; doi: https://doi.org/10.1101/2020.09.10.20192237

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)