Abstract
Background Increasingly more children and young people (CYP) present in mental health crises, many being hospitalised due to concerns around illness severity and lack of community services. To release the burden of admission, we systematically reviewed the literature on the effects of proposed alternatives to CYP in crises.
Methods Three databases (PsychInfo, PubMed and Web of Science) were searched for peer-reviewed papers in October 2020, with an updated search in May 2021.
Results We identified 19 papers of interventions delivered in the emergency department, the home, outside of home but outside of clinics and in hospital clinics. The best evidence came from in-home interventions, in particular multisystemic therapy (MST), which proved to be promising alternatives by improving psychological outcomes and decreasing length of inpatient stay. The quality of included studies was low, with less than half being randomised controlled trials and only half of these at low risk of bias.
Conclusions We could not recommend a particular intervention as an alternative to inpatient admission, however our review describes benefits across a range of types of inteventions that might be considered in multi-modal treatments. We also provide recommendations for future research, in particular the evaluation of new interventions as they emerge.
Background
Mental health disorders are a substantial burden for children and young people’s (CYP) health globally (Polanczyk, Salum, Sugaya, Caye, & Rohde, 2015), with suicide a leading cause of death (Wasserman, Cheng, & Jiang, 2005). In the UK, recent data has shown that 16% of CYP have a mental health disorder, with over half of older adolescents with a disorder having self- harmed or attempted suicide (Vizard, Sadler, & Ford, 2020). Similar prevalence rates have been reported in Europe and the United States (Kovess-Masfety et al., 2016; Merikangas et al., 2010). Many CYP with mental health disorders will present to health care providers with an acute (sometimes called psychiatric) crisis due to their mental health. Such crises can be defined as subjective experiences where a change in mental wellbeing occurs and the person becomes unstable or at risk to themselves or others (Jennings & Child). In high income countries, numbers of such presentations for CYP seemed to have increased, both to secondary and primary care (Mahajan et al., 2009; Morgan et al., 2017; Newton et al., 2009; Pittsenbarger & Mannix, 2014). Severity of illness, concern about risk (especially in relation to suicide) (Hawton et al., 2012), available community services (Lancet, 2020) and social circumstances (Paranjothy et al., 2018) may mean that such presentations result in an inpatient admission. Whilst hospitalization rates for most paediatric conditions in high income countries have decreased in recent years, admissions because of mental health have increased (Torio, Encinosa, Berdahl, McCormick, & Simpson, 2015).
Inpatient mental health admissions can provide important and vital services for significantly unwell CYP (Green et al., 2007), yet they can also carry substantial burden. Mental health admissions can be lengthy, in locations away from an usual place of residence, leading to disconnection from friends and family, and separation from education or employment. These burdens are especially amplified for CYP experiencing repeated admissions (Miller et al., 2020). Inpatient mental admissions are also more costly for health care systems (Green et al., 2007) versus outpatient care. Demand can also oustrip capacity (O’Herlihy et al., 2003), resulting in admissions of CYP in adult psychiatric wards or non-mental health inpatient settings such as paediatric medical wards (Worrall et al., 2004). Safe and effective interventions acting as alternatives to inpatient admissions for CYP presenting in crisis are therefore highly favourable. Policy makers have turned attention on to this issue, for example in the UK there are strategies in place to improve community services (Alderwick & Dixon, 2019).
Developing and implementing alternatives to inpatient mental health admissions for CYP presenting in crisis requires an up-to-date synthesis of the literature. Previous systematic reviews on this topic (Kwok, Yuan, & Ougrin, 2016; Shepperd et al., 2009) are now outdated (with the latest literature search performed in 2014) and also included papers of interventions with an admission component (such as short-term hospitalisations) which could be a confounder for the effects of proposed alternatives. We therefore systematically reviewed the literature for studies of interventions reported as alternatives to a mental health admission in CYP presenting with a significant mental health crisis. We specifically examined for:
1) effectiveness at avoiding admission or any impact on reducing the length of an inpatient stay if one followed.
2) Improvements in psychological parameters for CYP secondary to such interventions.
Methods
We searched three databases: PsychInfo, PubMed and Web of Science in October 2020, with an updated search in May 2021. We used search terms to encompass “children and young people”, “mental health crisis” and “potential locations of care” (appendix A). Searches were conducted individually by two researchers (DC and IL) who selected abstracts for inclusion or exclusion. Papers were then downloaded and considered independently, with LH providing adjudication. Reference lists within studies were also screened.
We included studies reporting outcomes of interventions specifically as alternatives to a mental health admission for CYP presenting with a mental health crisis. We defined admission as any hospitalization in any inpatient setting (including general medical settings). We excluded: 1) studies where some or all participants were >18 years; 2) studies not published in English; 3) reviews; 4) papers which did not provide any outcome measures or insufficient outcome measures, or only described interventions; 4) studies where the intervention included an admission.
Independent bias assessments were conducted by DC and IL using the Cochrane Review tools for assessing risk of bias in randomised trials (RCT) (Sterne et al., 2019) and non-RCT (Sterne et al., 2016). Discrepancies were discussed for agreement with final adjudication by LH.
Results
We found 782 papers in initial searches of databases and were left with 640 unique studies after duplicate removal. 71 papers were retrieved, with 60 excluded based on full text assessment. We found an additional 8 studies from screening reference lists. We included a total of 19 studies. A summary of the search with numbers is shown in figure 1.
PRISMA flow diagram of included and excluded studies
8 studies were RCTs, 4 studies were service evaluations, 4 studies used an uncontrolled pre- post-treatment investigation, 2 papers used pre-intervention historical/retrospective control groups, and 1 paper used a matched control group. 14 papers were conducted in the USA, 2 papers were conducted in Germany, 2 papers were conducted in Canada and 1 paper was conducted in the UK. 2 studies reported on interventions specifically for CYP with suicidal risk, 1 for psychosis, 1 for disruptive behaviour/externalising crisis presentations and 15 were for mixed types of crisis mental health presentations. For RCTs, we found 4 papers at low risk of bias, 2 raising some concerns and 2 at high risk of bias, and for non-RCTs we found 1 paper at low risk of bias, 2 papers at moderate risk, 6 papers at serious risk of bias and 2 papers at critical risk. Detailed summaries of included studies, including bias assessment are shown in table 1. Detailed rationale for classifying final bias category for each study is shown in Appendix B.
Summary of the studies included
Included papers did not allow sufficiently robust information to perform meta-analysis and so we present findings here narratively, with interventions grouped by: 1) Single-session interventions for emergency department crisis presentations; 2) Community-based crisis interventions (as i. exclusively in-home interventions, ii. interventions outside of the home but outside clinics, iii. exclusively clinic-based outpatient interventions, including intensive day treatment).
Single-session interventions for emergency department crisis presentations
We found three papers which evaluated the effectiveness of single-session urgent response consultations in emergency departments. Two papers were service evaluations (Gillig, 2004; Parker et al., 2003), and one paper used a pre-intervention historical/retrospective control group (Wharff, Ginnis, & Ross, 2012). One paper was at critical risk of bias (Gillig, 2004), one at serious risk of bias (Parker et al., 2003) and one at low risk of bias (Wharff et al., 2012). Gillig (2004) investigated the effects of offering an emergency evaluation interview and a brief therapeutic intervention at a maximum of 24 hours after CYP presentation, using a supportive, reality-based and present-focused therapeutic approach. They reported that only 10% (n = 5) of the patients seen by the emergency consultation team were hospitalised right after the input was received, no patients were hospitalised in the month following the input and 4.2% (n = 2) patients were hospitalised 6 months later. Parker et al. (2003) analysed a Rapid Response Model (RRM) which offered consultations to CYP in acute mental health crises within 48 hours of their presentation to the ED, focusing on the crisis and risk. They used two sites: one site studied outcomes over four years (with pre-RRM, during RRM implementation, post-RRM termination and during RRM re-implementation as four time periods); another over two years (pre-RRM and post-RRM as two time periods). Findings were mixed. For the first site, no change was reported in the number of admissions over the four time periods but RRM stage had a significant effect on the monthly average length of inpatient stay: F(1, 42) = 3.1, p < .05). For the second site, there was a reported decrease in the percentage of admissions, with a reduction from 22% at pre-RRM to 2% at post-RRM (χ2 = 31.6, N = 340, d.f. = 1, p < .001). Wharff et al. (2012) investigated a single-session family- based crisis intervention (FBCI) for suicidal adolescents, delivered in a paediatric ED and focusing on constructing a safety plan and encouraging family communication. They reported a reduction in numbers admitted during the implementation of FBCI (55% to 35%, p < .0001).
Community-based treatments
We found fourteen papers investigating the effectiveness of community-based treatments for CYP presenting in crisis. Nine were of home interventions, three were community interventions outside of the home but outside clinics and two were exclusively clinic-based outpatient interventions, including day treatment.
i) Exclusively in-home interventions
We found nine papers studying in home interventions – five studying multi-systemic therapy (MST), and four papers of other family-based interventions in the home.
Five papers investigated the effectiveness of multisystemic therapy (MST) delivered at home and which combined a range of therapeutic approaches. All five papers were RCTs, although four were in effect different outcomes from one single trial (Henggeler et al., 2003; Henggeler et al., 1999; Huey et al., 2004; Schoenwald, Ward, Henggeler, & Rowland, 2000). The risk of bias assessment revealed that four papers were at low risk of bias (Henggeler et al., 2003; Henggeler et al., 1999; Huey et al., 2004; Rowland et al., 2005; Schoenwald et al., 2000) while one raised some concerns (Rowland et al., 2005).
The effects of MST on admission rates and length of stay were investigated by two papers in two separate trials (Rowland et al., 2005; Schoenwald et al., 2000). In one RCT, in a sample of CYP in mental health crisis assessed to require an admission, MST was compared to hospitalization (Schoenwald et al., 2000). At the end of treatment, 44% of those assigned to the MST group (approximately 4 months post-referral), were admitted to hospital and mean length of stay was lower than the hospitalized control group (mean days 2.39 versus 8.82, t = 3.91, p = .001). In a second RCT, CYP at risk of out-of-home placement (e.g. inpatient hospitalization, group homes, foster care) were randomly assigned to receive either MST or usual care (Rowland et al., 2005). The study did not report on the number of patients hospitalised following the intervention in either group. However, number of days spent in out-of-home placement per month were lower in the intervention group (mean days 3.75 versus 11.83, F = 5.68, p = .025).
Potential psychological benefits of MST were investigated in four papers, three reporting outcomes from a single trial comparing MST to inpatients, and one from another trial comparing MST to usual care. Compared to hospitalisation (Henggeler et al., 1999; Huey et al., 2004), MST was reported to have superiority in improving a number of psychological measures. Post intervention changes were superior compared to admission controls for the caregiver rated externalising symptoms (F(1,102) = 6.55, p < .011), teacher rated externalising symptoms (F(1, 45) = 4.10, p < .048), youth reported family adaptability (F(2, 220) = 3.28, p = .039), caregiver rated family cohesion (F(2, 206) = 6.56, p < .001) and youth reported suicide attempts (t = 3.60, p < .001). However a further paper of 12-16 month follow-up revealed that generally superiority was not sustained (Henggeler et al., 2003). Change in self-esteem was initially superior in the hospitalized group (F(1, 109) = 7.72, p = .006), however again this was not sustained at 12–16-month follow-up. For MST compared to treatment as usual, (Rowland et al., 2005) there was superior change in youth-rated externalising symptoms (F(1, 25) = 4.62, p = .041) and internalising symptoms (F(1,28) = 6.05, p = .021) for the MST group.
We found four papers of other family-based interventions delivered at home which reported on psychological outcomes. One was an RCT (Wilmshurst, 2002), one was a study using a matched sample control group (Schmidt, Lay, Göpel, Naab, & Blanz, 2006) and two were uncontrolled studies investigating pre- to post-treatment changes (Lay, Blanz, & Schmidt, 2001; Mosier et al., 2001). Bias assessment revealed that two papers were at serious risk of bias (Lay et al., 2001; Mosier et al., 2001), one paper was at moderate risk (Schmidt et al., 2006) while the other paper raised some concerns (Wilmshurst, 2002). Neither paper described proportions of CYP receiving the alternative interventions who required admission In the RCT, Wilmshurst (2002) reported that the in-home treatment was superior to a 5-day residential programme in improving internalising symptoms at follow-up (F (2,62) = 3.92, p = .025). Comparing the intervention to a matched control group receiving hospitalisation, Schmidt et al. (2006) reported that by the end of treatment, hospitalisation was superior at improving psychological symptoms related to major DSM-IV diagnoses (p < .001), child-rated behaviour (p = .02), parent-rated behaviour (p = .03), and increased functioning in more domains (family, peers, interests, and autonomy) than the in-home treatment (family, interests, autonomy). Lay et al. (2001) compared pre- and post-treatment outcomes in a sample of CYP requiring an intervention as an alternative to admission presenting with high- risk externalising behaviours. Improvements were reported in the total symptoms related to major DSM-IV diagnoses (p < .001) and child-rated psychosocial functioning (p < .001). Mosier et al. (2001) also compared pre- and post-treatment outcomes of an in-home famility therapy for CYP requiring restrictive and intensive mental health treatment. In comparison to pre- treatment, post-treatment improvements were reported in clinical symptoms for a number of CYP, with some being reported to have recovered. No statistical tests were conducted for this comparison. The end-of-treatment mean clinical symptoms of the group was compared to the normative scores of patients receiving inpatient/outpatient treatment, but no significant differences were reported.
ii) Interventions outside of the home but outside of hospital clinics
We found three papers which evaluated the effectiveness of community interventions outside of the home but away from clinic settings. The stated aim of these interventions was to stabilize the patients by offering an array of services, delivered flexibly in the community depending on need (e.g., schools). One paper was an RCT (Winsberg, Bialer, Kupietz, Botti, & Balka, 1980) and two papers were service evaluations (Darwish, Salmon, Ahuja, & Steed, 2006; Vanderploeg, Lu, Marshall, & Stevens, 2016). The risk of bias assessment revealed that one paper was at high risk of bias (Winsberg et al., 1980), one was at critical risk (Vanderploeg et al., 2016) and one was at serious risk (Darwish et al., 2006). Only one of these papers, Darwish et al. (2006), reported on admission outcomes for their intervention, reporting that their community intensive therapy decreased admissions compared to a pre-intervention historical group (decreasing to 1 person per year over 5 years versus 6 people per year at pre- implementation, no statistics presented). Two papers reported on psychological outcomes. Winsberg et al. (1980) reported pre and post intervention scales and hospitalization on a group of CYP in crisis, on a range of psychological parameters. Post-intervention, the community treatment improved aggressivity symptoms (t = 2.58, p < .05), inattentiveness (t = 3.53, p < .01), hyperactivity (t = 4.27, p < .01), school behaviour (t = 2.58, p < .05), and overall child behaviour (t = 2.22, p < .05). In comparison, hospitalisation improved only inattentiveness (t = 2.32 p < .05). There was however no comparison of differences between the interventions and hospitalized groups. Vanderploeg et al. (2016) studied changes in a sample of CYP receiving emergency mobile psychiatric services however they did not compare their outcomes to a control group. They reported that improvements were achieved in parent-rated problem severity (t = -8.53, p < .001), clinician-rated problem severity (t = -21.24, p < .001) parent-rated child functioning (t = 4.70, p < .001) and clinician-rated child functioning (t = 14.96, p < .001).
iii) Exclusively clinic-based interventions, including intensive day treatment
We found four papers which evaluated the effects of interventions in clinic-based settings (one including intensive day treatment) in CYP presenting in crisis as alternatives to hospitalization. One paper was an RCT (Silberstein, Mandell, Dalack, & Cooper, 1968), one paper used a matched sample control group (Greenfield, Hechtman, & Tremblay, 1995) and two papers were uncontrolled pre-post intervention studies (Asarnow, Berk, Hughes, & Anderson, 2015; Kiser et al., 1996). The risk of bias assessment revealed that one paper was at moderate risk of bias (Asarnow et al., 2015), one at high risk of bias (Silberstein et al., 1968), one at serious risk of bias (Greenfield et al., 1995) and one at critical risk (Kiser et al., 1996).
Silberstein et al. (1968) compared 4 separate groups of CYP presenting with psychosis receiving: 1) parental counselling with or 2) without medication; 3) no counselling plus medication; and 4) no counselling plus placebo. There were no differences in rates of admissions between groups. Greenfield et al. (1995) investigated the outcomes of implementing an emergency room follow-up team, and reported that in comparison to a period before its implementation, the admission rate of CYP presenting to the emergency room in psychiatric crisis decreased by 16% (p < .001). No statistical difference was reported between the two groups in the number of hospitalizations occuring per patient after a second emergency room visit.
Kiser et al. (1996) reported on psychological outcomes of an outpatient day program for CYP in mental health crisis as an alternative to admission. Post-intervention, improvements were reported in being withdrawn (parent report: t = 5.25, p < .001; CYP report : t = 2.91, p = .005), somatic complaints (parent report: t = 3.11, p = .003; CYP report: t = 2.76, p = .008), anxious/depressed (parent report: t = 3.95, p < .001; CYP report: t = 3.95, p < .001), social problems (parent report: t = 2.70, p = .008; CYP report: t = 2.38, p = .021), thought problems (parent report: t = 5.66, p < .001; CYP report: t = 3.28, p = .002), attention problems (parent report: t = 4.28, p < .001; CYP report: t = 2.89, p = .06), delinquent behaviour (parent report: t = 32.49, p = .015; CYP report: t = 3.77, p < .001), aggressive behaviour (parent report: t = 4.49, p < .001; CYP report t = 3.59, p < .001); sex problems (significant for CYP report only: t = 4.66, p < .001), total problems (parent report: t = 6.24, p < .001; CYP report t = 5.58, p < .001), internalising (parent report: t = 4.90, p < .001; CYP report: t = 4.94, p < .001) and externalising (parent report: t = 4.84, p < .001; CYP report t = 4.90, p < .001). Both parents and CYP also reported that at follow-up, family functioning was improved in the following domains: roles (parent report only: t = 2.68, p = .009), affective involvement (CYP report only: t = 2.24, p = .03) and behaviour control (parent report: t = 3.41, p = .001; CYP report: t = 3.48, p = .001). Follow-up improvements were also reported in rates of school suspensions (from 39% to 36%, χ2 = 8.78, df = 1, p < .01), CYP being a good-quality friend (from 65% to 88%, χ2 = 6.45, df =1, p < .05), incarceration rates (from 4.7% to 6.3%, χ2 = 19.6, df = 1, p < .01) and trouble with the police (from 13.4% to 16.4%, χ2 = 11.6, df = 1, p < .01). Asarnow et al. (2015) reported on psychological outcomes of an outpatient intervention (the SAFETY program) delivered to adolescent suicide attempters. They reported pre- to post-treatment improvements in all outcomes measured: suicide attempts (t = 2.42, p = .019, d = .64), active suicide behaviour and ideation (t = 2.63, p = .019, d = .59), passive suicide ideation (t = 2.56, p = .016, d = .39), total suicidality score (t = 2.70, p = .011, d = .46), CYP reported youth depression symptoms (t = 4.53, p < .001, d = .91), parent-reported parental depression symptoms (t = 3.47, p = .002, d = .71), hopelessness (t = 5.58, p < .001, d = 1.01), social adjustment total score (t = 6.13, p < .001, d = 1.27), social adjustment at school (t = 3.53, p = .002, d = .90), social adjustment with peers (t = 5.36, p < .001, d = 1.11), social adjustment with the family (t = 2.79, p = .009, d = .66) and social adjustment in the spare time (t = 2.76, p = .01, d = .52).
Discussion
In this systematic review of studies of alternatives to inpatient admissions for CYP presenting with a mental health crisis, we found a range of published studies on interventions in different settings. We found studies describing interventions in emergency departments, the home, other community settings and hospital-based clinics. In general, the level of evidence was poor with less than half of included studies RCTs, of which only half were considered of low risk of bias in bias assessments. Studies also varied with regard to consistency of reporting on measures on preventing admissions and psychological outcomes. This meant that robust data for meta-analysis was insufficient. The greatest level of evidence came from home treatments, in particular MST. MST was reported as improving a range of psychological parameters associated with risk for CYP (such as suicide attempts) and benefits for families (adaptation and cohesion though not maintained at 4 months); and though a large proportion of CYP appeared to still ultimately be admitted (in one study 44%), there was evidence that length of stay from these admissions was reduced compared to admission alone. We found some evidence suggesting that brief emergency department-based interventions could have a beneficial impact on admission rates, but none of these studies were RCTs, and there was no information on impact upon psychological parameters in any paper. Evidence for other community interventions, and clinic-based interventions were scarce, and generally of low quality. However, we found some evidence for reduction in admission rates and improvements in post-intervention symptom severity, child and family functioning, although these were not compared to outcomes of control groups.
Our review did not find sufficient amount of quality data to recommend a specific type of intervention for CYP presenting in crisis, a similar conclusion to the two other systematic reviews on this topic which included searches from over 6 years ago (Kwok et al., 2016; Shepperd et al., 2009). However, the evidence we have presented provides useful information for the development of new and existing services, including the potential for mix- models of care, or “menus” of care for individual patients’ needs by understanding variable benefits of different models. Given the challenges associated with the complexity of such CYP presenting in crisis, especially with regard to risk, the limited availability of good quality data is perhaps understandable. However, with such presentations increasing, and pressure on inpatient units rising (Children’s Commissioner, 2020), this is clearly an area which needs to see an increase in research as a priority. With new emphasis on improvement for CYP with mental health disorders, especially those presenting in crisis (Ougrin et al., 2018), it is likely that new models will develop. It is important that as they do so, they are robustly evaluated, in particular with comparison to controls (including for example pre-intervention controls), with consistent measurement and reporting of success at reducing absolute numbers of admissions, duration of admissions and also psychological impacts for CYP and families.
Studies should also report detail on change between groups of intervention and control, for a large proportion of studies we found in our review presented only pre and post values for intervention and control separately, and this impedes the opportunity for an appropriate pooling of studies in meta-analysis (Higgins, Churchill, Chandler, & Cumpston, 2017).
Beyond the limitations which we have highlighted above, our review has a number of strengths. We used an a priori search strategy of multiple databases, with defined inclusion and exclusion criteria for the studies and two independent researchers performed searches. We also investigated on a large range of intervention types by also including non-RCTs, in comparison to previous reviews that looked at RCTs only. We reported on all outcomes described and had two independent researchers to conduct thorough bias assessments, with a third providing final adjucation.
In conclusion, although we found a range of interventons in different settings, the quality of studies was insufficient to allow for an overall recommendation. Interventions using multi- systemic therapy at home had the best quality, with evidence suggesting benefits around avoiding admissions, length of admission and psychological outcomes. However, these interventions generally failed to show long-term effects. New models of care should be robustly evaluated using consistent outcomes.
Data Availability
This is a systematic review, we are willing to share studies found.
Declaration of conflicting interest
The Authors declare that there is no conflict of interests.
Appendix A
Search terms used for all databses: ((children and adolescents OR children OR adolescents OR youth) AND mental health AND (crisis OR crises)) AND (emergency department OR a&e OR ‘alternatives to hospital admission’ OR ‘home treatment’ OR ‘community based crisis’ OR ‘alternative care’ OR ‘short stay hospital’ OR ‘acute day hospital’ OR ‘acute ward’ OR ‘crisis houses’ OR ‘family based treatment’ OR ‘multisystemic therapy’ OR ‘crash pad*’ NOT (homeless OR homelessness))