Can computer simulation support strategic service planning? Modelling a large integrated mental health system on recovery from COVID-19 ======================================================================================================================================= * Livia Pierotti * Jennifer Cooper * Charlotte James * Kenah Cassels * Emma Gara * Rachel Denholm * Richard Wood ## Abstract **Background** COVID-19 has had a significant impact on people’s mental health and mental health services. During the first year of the pandemic, existing demand was not fully met while new demand was generated, resulting in large numbers of people requiring support. To support mental health services to recover without being overwhelmed, it was important to know where services will experience increased pressure, and what strategies could be implemented to mitigate this. **Methods** We implemented a computer simulation model of patient flow through an integrated mental health service in Southwest England covering General Practice (GP), community-based ‘talking therapies’ (IAPT), acute hospital care, and specialist care settings. The model was calibrated on data from 1 April 2019 to 1 April 2021. Model parameters included patient demand, service-level length of stay, and probabilities of transitioning to other care settings. We used the model to compare ‘do nothing’ (baseline) scenarios to ‘what if’ (mitigation) scenarios, including increasing capacity and reducing length of stay, for two future demand trajectories from 1 April 2021 onwards. **Results** The results from the simulation model suggest that, without mitigation, the impact of COVID-19 will be an increase in pressure on GP and specialist community based services by 50% and 50-100% respectively. Simulating the impact of possible mitigation strategies, results show that increasing capacity in lower-acuity services, such as GP, results in demand being shifted to other parts of the mental health system while decreasing length of stay in higher acuity services is insufficient to mitigate the impact of increased demand. **Conclusion** In capturing the interrelation of patient flow related dynamics between various mental health care settings, we demonstrate the value of computer simulation for assessing the impact of interventions on system flow. Keywords * Computer modelling * Computer simulation * COVID-19 * Coronavirus * Service design * Mental health services ## Background The COVID-19 pandemic has had a significant impact on people’s mental health and mental health services. During the pandemic, difficulties in accessing services have suppressed existing demand while new demand has been generated by the social and financial consequences of lockdown, bereavement, virus anxiety, and trauma in healthcare workers (Jia et al., 2020; Mazza et al., 2020; Shevlin et al. 2020). Consequently, as mental health services re-open, a surge in demand is expected (Xiang et al., 2020). For mental health services to recover from the pandemic and meet demand, knowing which components of a service will experience increased pressure is essential, alongside whether changes in service design could mitigate such effects. Computer simulation, a digital model that replicates real-life processes, has a proven track record in informing and improving the management of health services (Salleh et al, 2017; Mohiuddin et al, 2020; Vázquez-Serrano et al,2021). Simulations can be used to understand relationships, feedback pathways and processes across multi-organisation systems, and assess how these would behave if a change occurred. As they are both safer and cheaper than conducting experiments in a real-world setting, they are useful for testing the potential impact of changes in service design. Simulation modelling has been under-used in mental health service planning and development, compared to other clinical disease pathways (Long, 2017). While existing studies have implemented system dynamic modelling for improving mental health services during the pandemic (Katikireddi, 2022; Currie et al, 2020), simulation has only previously been applied to decision-making in treatment evaluation, cost-effectiveness analysis and epidemiological studies (Long, 2017). In this study, we use a Discrete Time Simulation (DTS) model to evaluate the impact of the COVID-19 pandemic on mental health services. Using the model, we assess where the pandemic-related surge in demand will lead to increased pressure, and the effect of possible mitigation strategies to reduce this pressure. Our study demonstrates how simulation modelling can be used to inform decisions regarding changes to capacity and structure of mental health pathways, to best meet the needs of patients on recovery from the pandemic and beyond. To address these questions, we first described the flow of patients across multiple mental health services in the system by developing a schematic representation of the mental health pathways using linked electronic patient-level data up to 1 April 2021. The pathway maps resulting from this exercise in ‘process mining’ were used to configure the structure of the DTS, in terms of the mental health services covered – GP, Improving Access to Psychological Therapy (IAPT) care, acute hospital, and specialist care settings – and the various parameters relating to patient flow between these services – arrival rates, lengths of stay, and transition probabilities. The model also captures the effect of escalating need should demand not be met in a timely manner. With the model calibrated on data to 1 April 2021, this study then explores the potential effects of two different scenarios relating to future mental health demand on recovery from the Covid-19 pandemic; first on a ‘do nothing’ (baseline) basis, and then through considering service-level mitigatory measures through a ‘what if’ (intervention) analysis. In addition, baseline and intervention scenarios can be compared in terms of whether needs are adequately met for each patient, which can be evaluated by looking at patients exiting the pathway without having received treatment. ## Methods ### Study Setting Bristol, North Somerset, and South Gloucestershire (BNSSG) Integrated Care System (ICS) is a healthcare system in southwest England, with a population of approximately one million residents. As with other NHS systems, BNSSG ICS is a network of healthcare providers covering primary, secondary, mental health, community, and social care. The healthcare system serves a mixture of metropolitan areas and rural and coastal locations. The large metropolitan area of Bristol contains a higher proportion of younger individuals and is culturally and ethnically diverse. Rural and coastal areas contain a greater proportion of older individuals and pockets of severe deprivation (Ministry of Housing Communities & Local Government, 2019). ### Population The study population included all patients aged 18 years and over referred to mental health services in BNSSG between 1 April 2019 to 1 April 2021. Patients were excluded if they were in community mental health services for children. ### Data Analysis was conducted using the BNSSG System Wide Dataset (SWD) from 1 April 2019 to 1 April 2021. The SWD provides patient-level linkable primary, secondary and community health data for the BNSSG population (BNSSG Healthier Together, 2021). Primary Care data is obtained via a bespoke extract from general practitioners, collated by OneCare, which is a General Practice (GP) federation operating in BNSSG. Sourced from Egton Medical Information Systems (EMIS) GP administration systems, the extract contains data on GP attendances and prescriptions. Secondary Uses Service (SUS) contains information on all NHS acute trust outpatient consultations, inpatient admissions, and emergency department attendances, with detailed data on date of attendance, ward specialty and clinical indications. The Community Services Data Set (CSDS), maintained by NHS Digital, includes intermediate care admissions and patient visits to and from community service teams. Mental health data, covering consultations and admitted stays, is available from the Mental Health Services Data Set (MHSDS) also maintained by NHS Digital. A full specification of the System Wide Dataset is publicly available (BNSSG Healthier Together, 2021) including the data dictionary. To mitigate any risks associated with the holding of patient identifiable data, all records are pseudonymised by the regional Commissioning Support Unit before being added to the SWD. The dataset also contains no patient names or full addresses. The SWD contains two data tables: attributes and activities, linkable using the pseudonymised patient identifier. The attribute table is a monthly data flow of social demographic factors (i.e., sex, age, LSOA, ethnicity) and clinical factors from patients registered to participating GPs within BNSSG. The activity table contains information on date of medical appointment, prescription and the specific healthcare service that the patient had appointment for. The SWD was linked to IAPT care data. The IAPT programme is a large-scale initiative that aims to greatly increase the availability of National Institute for Health and Care Excellence (NICE) (NICE, 2011) recommended psychological treatment for depression and anxiety disorders within the NHS. It offers a range of talking therapies in addition to those that the NHS can offer. This includes interpersonal therapy, couples therapy, and counselling for depression. Through IAPT services, approximately one million individuals per year start treatment (NHS Digital, 2020). A full description of measures and conditions treated under IAPT services can be found via the IAPT manual (National Collaborating Centre for Mental Health, 2019). ### Derived variables #### Clinical severity Using the attribute table within the SWD, we define mental health severity using 3 categories: severe, moderate and mild. A patient’s mental health severity is categorised as severe if they are suffering from a chronic mental health condition, such as depression, post-traumatic stress disorder or an eating disorder. A patient without a diagnosis of a mental health condition, but living with an associated condition, such as drug or alcohol dependency, autism, or ADHD, is categorised as moderate. Patients without any specific mental health or associated diagnoses are categorised as mild. ### Level of care To enable mental health clinical pathways to be mapped across the system, services were grouped into six levels according to clinical need (Figure 1), defined by clinical, managerial, and analytical stakeholders from across the BNSSG mental health system. Level 1 represents the lowest level of care required and 6 the highest. Of the six levels of care identified, only services in levels 2-5 were included in the study. Level 1 services (community support) were excluded as they cover a very broad array of services. It was not possible to recover reliable data for level 6 services. ![Figure 1:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/07/23/2023.07.19.23292289/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/F1) Figure 1: Description of six ‘levels of need’ for mental health services in the healthcare system studied, detailing the setting, means of access, and type of resource. The colours represent the level of intensity of care services, where the lighter colours represent the least intensity. ### Process mining Patients experience mental health care pathways as causally linked sequences of activities. However, in the data, these activities are recorded separately as discrete events. To reconstruct patient pathways from the SWD and IAPT data, we implemented process mining, a technique commonly used for extracting clinical pathways from administrative data (Rojas et al, 2016). The mental health pathway in BNSSG, obtained through process mining, is displayed as a network map in Figure 2. Here, nodes represent services within the pathway and directed edges represent possible routes a patient can take between services. Using the reconstructed pathways, we calculated arrival rates, lengths of stay, and transition probabilities between levels of care and services to be used as parameters of the DTS. We also calculated the waiting time for each service and the ’reneging’ rate – i.e., the rate at which patients leave the waiting list for a specific service without treatment and are transferred elsewhere – as additional DTS parameters. ![Figure 2:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/07/23/2023.07.19.23292289/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/F2) Figure 2: Figure and online schematic representation (NHS BNSSG Analytics, 2022) of a sample of 10,000 entries of the mental health services to be modelled. Service nodes were aligned to the six considered levels of need as detailed in Figure 1. GP: General Practice; IAPT: Improving Access to Psychological Therapies; MHP: Mental Health Provider. ### Computer simulation A DTS model, developed by Murch et al (2021), was used to simulate patient flow across the reconstructed mental health pathway. The DTS models a patient’s pathway through the mental health service as a series of events. Both the time between two events, and the next event in a patient’s pathway, are determined by sampling from probability distributions. The probability distributions are parameterised by the arrival rates and lengths of stay for each service, and transition probabilities between services, obtained from the reconstructed pathway. For a technical description of the DTS methodology see Murch et al (2021). Events simulated in the DTS include: a patient previously not known to mental health services presenting with a mental health condition; a patient moving from one service to another; a patient queuing for capacity in a service. Patients enter the model when there is available capacity in a service. The time a patient remains in a service is sampled from the length of stay distribution for that service. After a patient’s length of stay has elapsed, they move to a different service. The service a patient moves to is determined using the transition probabilities between the service they are in and all other services. Patients leave the model if they are either successfully treated or are referred to another service for ongoing care. To capture patient deconditioning associated with long waits incurred during the pandemic, after a specified amount of time waiting for a service, patients can ‘renege’ from the queue they are in and join the pathway of a higher-level service or discharge themselves from the pathway without treatment. Using the DTS, patient events were simulated for each day within the post-lockdown study period (Figure 3). For each simulated day, the number of patients in each service, the number of patients waiting for each service, and the number of patients that reneged were recorded. This resulted in a time series for each of these measures over the study period. ![Figure 3:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/07/23/2023.07.19.23292289/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/F3) Figure 3: Scenario Timeline. The study used data for the pre and during lockdown periods (from 1 April 2019 to 1 April 2021, representing week 1 to week 207 of the study period) to obtain model parameters, and simulated baseline and intervention scenarios for the post lockdown period (from 1 April 2021 to 1 April 2024, from week 208 to week 364 of the study period assumed for this study). As daily arrivals at each service, lengths of stay, and service transitions are randomly sampled from distributions, one simulation of the study period represents only one way in which events could pan out. To capture the range of possible outcomes over the study period, 35 replications of the simulation were performed, each using a different random seed. Results from each simulation were averaged over all replications. ### Scenarios The DTS was used to evaluate scenarios to mitigate waiting time and capacity at different mental health services after lockdown. Four scenarios were modelled: two baseline and two interventions. Baseline scenarios represent hypothesised changes to patient flow post-lockdown (from April 2021), as described in the literature (Tojesen, 2020; Hood et al, 2020). The demand profiles (i.e., external arrival rates) in the DTS were adjusted according to each baseline scenario to model the different problem(s) that mental health services might encounter, such as where large queues may form, as they recover from the pandemic. For each baseline scenario, a plausible intervention scenario was simulated to estimate the impact possible measures to mitigate pressure could have (Table 1). The DTS was used to simulate demand trajectories from the 1 April 2021 to April 2024 (Figure 3) for each scenario. View this table: [Table 1:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/T1) Table 1: The four simulation scenarios considered in this study (two baseline scenarios and two intervention scenarios). Baseline scenarios were obtained from literature. The two intervention scenarios were related to the results of the two simulated baseline scenarios. The DTS was used to simulate baseline scenarios and assess the impact of increased demand on patient waiting times, service occupancy, and reneging rate. Estimates of demand in each service (mean and 95% confidence intervals (CI)) were obtained from 35 replications of the DTS. Estimated demand profiles were scaled by true demand in each service on 1 April 2021, allowing future demand to be assessed relative to this timepoint. Intervention scenarios (Intervention A and B, Table 1) were used to investigate the impact of increasing capacity, reducing length of stay or re-routing patients to different services, on service occupancy, waiting times and reneging rate. ## Results ### Data There were 289,666 attendances by 188,682 patients recorded in the mental health pathway between 1 April 2019 and 1 April 2021 (Table 2). Of the attendances, 254,208, (88%) were in primary care level 2 and level 3, 33,830, (12%) were in secondary care outpatient level 4 and 1% were in AWP inpatients level 5. 100,915 (35%) of the patients within the pathway were referred during April 2020 to April 2021. The cohort was predominately female (61%) and white (85%) and aged 40–59-year-old (30%). Those who needed the highest level of service (level 4 and 5), were from the most deprived groups. Almost 90% of the patients waiting at level 5 inpatients have experienced at least one moderate mental health condition and 26% of those had experience at least one severe mental health condition. View this table: [Table 2.](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/T2) Table 2. Demographic of study patients by level of need. ### Baseline Simulation Modelling Results from using the DTS to model waiting list size, service occupancy and reneging rates under Baseline Scenarios A and B are displayed in Figure 4. Simulation results suggest the waiting list size (Figure 4, top row), when compared to pre-pandemic size, will increase in level 2 services (GP) by up to 50% for both baseline scenarios. Under Scenario B, results suggest there will also be moderate increases in waiting list size for level 3 services (IAPT) and increases of 50-150% in community based (level 4) mental health services. As a result, the occupancy of these specific services tends to increase (Figure 4, second row), creating blockages because the services do not have the capacity to handle the sharp increase in demand post-lockdown. Due to increased waiting times and high service occupancy in community services, results suggest an increased tendency to renege from these services under both scenarios (Figure 4, third row). Both baseline scenarios showed an increase in reneging to GP services, whereas only Scenario B showed an increase in reneging to MHP crisis (Figure 4, bottom row). ![Figure. 4:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/07/23/2023.07.19.23292289/F4.medium.gif) [Figure. 4:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/F4) Figure. 4: Summary of the simulation results of the queue size, occupancy, and renege output measures at each service (per week) for Baseline Scenarios A (red) and B (green), modelled pre-, during, and post-lockdown. Solid lines represent mean demand profiles obtained from 35 replications of the DTS, relative to demand at the end of the lockdown period, and the shaded area represents a 95% confidence interval in scaled demand. Results were omitted for services which display negligible change over the course of these three periods. ### Intervention Simulation Modelling Table 3 shows the results from using the DTS to simulate two intervention scenarios for mitigating increased pressure following lockdown. To estimate the effectiveness of each intervention, we report the percentage change in the mean and maximum values of waiting list size, service occupancy and reneging rates compared to the baseline scenarios. View this table: [Table 3:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/T3) Table 3: Summary of the impact of Interventions A and B on mental health system performance from 1 April 2021. Results represent the maximum and mean percentage change between baseline and intervention scenarios. Given the large increase in waiting times for GP (level 2) services post-lockdown under Baseline Scenario A, Intervention A focusses on increasing capacity in GP services to reduce waiting times and decreasing length of stay in IAPT therapy and level 4 services. The purpose of decreasing length of stay in these services is to prevent demand being shifted from level 2 services because of increased capacity. To simulate Intervention A using the DTS, capacity in level 2 services was increased by 30% for the period April 2021 to October 2022 and length of stay in IAPT therapy and level 4 services was decreased by 20% for the period April 2022 to October 2022. Results from the DTS show that increasing GP capacity would lead to waiting list size for high intensity GP services decreasing by an average of 7% compared to Baseline Scenario A and service occupancy would increase by only 1% (Table 3). However, despite decreasing length of stay in IAPT therapy and level 4 services, simulations show demand would still be shifted: waiting list size would increase by over 10% in all of these higher level services (Table 3, Figure S1). This suggests that reducing length of stay by 20% is insufficient to absorb the extra demand on these services generated by increased capacity in level 2. Results from the DTS show increased capacity in level 2 does, however, have a positive impact on reneging: decreasing waiting times for GP services leads to fewer patients reneging compared to Baseline Scenario A (Table 3). Intervention B was an extension of Intervention A, to mitigate the impact of both the increased demand due to lockdowns, and the shifts in demand from level 2 to level 4 services following Intervention A. To decrease the waiting times for services that were blocked as a consequence of the mitigations in Intervention A, Intervention B additionally involved: increasing capacity at MHP community general and specialist services by 20 and 30 % respectively ; decreasing length of stay by 10% in the MHP community specialist; increasing patient flow by 30 % from MHP community specialist to MHP general mental health and crisis services. These additional interventions were simulated for the period April 2021 to October 2022. Using the DTS to simulate Intervention B, results show a decrease in waiting list size, occupancy, and reneging rate for the MHP specialist service compared to Baseline Scenario B (Table 3, Figure S2). Compared to Intervention A, the additional measures are successful in mitigating some of the pressure on the IAPT therapy service, however both waiting times and service occupancy are greater than Baseline Scenario B (Table 3). ## Discussion Our work demonstrates how simulation modelling may be used to assess the impact of interventions on mental health service pathways. We used process mining to develop a schematic representation of mental health pathways using linked electronic patient-level data up to April 2021. The resulting pathway maps were used to obtain parameters of a DTS model, in terms of mental health services covered (GP, IAPT) care, acute hospital, and specialist care settings) and patient flow between these services (arrival rates, lengths of stay, and transition probabilities). The model also captures the effect of escalating need should demand not be met in a timely manner (reneging). We calibrated the model with data to April 2021, and used it to assess the impact future demand may have on mental health services under different scenarios; first on a ‘do nothing’ basis (Baseline Scenarios A and B), and through considering service-level mitigatory measures through a ‘what if’ analysis (Intervention scenarios A and B). To model mental health service demand following the pandemic, we used two different baseline scenarios influenced by existing literature (Tojesen, 2020; Hood et al, 2020). This allowed us to forecast demand at each service during a time when the true impact of COVID on mental health services was unknown and derive realistic intervention scenarios to mitigate the impact of this demand. On comparing the intervention scenarios with baseline projections, we found that the intervention scenarios considered in our study are not sufficient for mitigating pressure due to increased demand on mental health services following lockdown. Instead, we found that while pressure may be reduced in one service, the consequence is an increase in pressure in other services. These results suggest that isolated capacity increases in particular parts of a mental health pathway do not necessarily benefit the system: changes in capacity can unblock part of a pathway, allowing unserved demand to flow into other services, increasing utilization and queueing. Our results highlight the need for strategic decision making around changes to service capacity, to ensure that improvements in one service do not have a negative impact on other services and wider system flow. For both intervention scenarios, we found that increasing capacity in level 2 would reduce waiting list size and service occupancy for these services. As this change to the pathway had a negative impact on higher level services (IAPT Therapy and level 4 services, Table 3), one extension to the interventions considered would be to increase capacity in these services in addition to level 2. However, in the local system the plausibility of this increase is unrealistic: simulations of baseline scenarios suggest a 50-150% increase in demand for level 4 services without any changes to level 2 capacity (Figure 4). Increasing existing capacity in higher level services to meet this increased demand is therefore not a plausible intervention, and as with increases to GP capacity, changes may result in blockages further along the pathway requiring further capacity increases. A key assumption of the DTS used in this study is that a patient can only be in one service at any given time. While this assumption allows us to model mental health services using DTS, it is also a limitation of the approach: in mental health systems patients can simultaneously be in receipt of care from multiple services at any one time. A further assumption of the model is that patients queuing for a service are seen on a first-come first-served basis. However, when patients are referred to a mental health service, they are assigned a priority which determines the order in which they are seen: patients are not seen in the order in which they are referred (Dehghan et al, 2017). In the future, the DTS framework implemented in this study could be extended to relax these assumptions. Extending the framework in this way would improve the accuracy of simulations and ensure results are representative of the way in which mental health services operate. In the UK, the use of simulation modelling for mental health service design and delivery is limited by the availability of high-quality data (Jacobs et al, 2019). Data capture and linkage across services means there are often large gaps and inconsistencies in patients’ pathways. As this data was required for validating the model, for our study the help of system stakeholders with expert knowledge of service delivery was necessary for parameterisation of the model. This highlights the need for improvements in data capture and linkage with healthcare systems: incentives to improve data quality in local systems will ensure computational techniques, such as simulation modelling, can be utilised for service improvement. Our work demonstrates the potential value of computer modelling and simulation for supporting strategic service planning within mental health care. Highlighting the benefits of simulation, the approach contained in this paper may serve as a blueprint for conducting similar modelling exercises in any healthcare systems. With regards to system recovery following the pandemic, we have demonstrated the potential of simulation as an aid to strategic decision making and service planning: modelling realistic scenarios for local healthcare systems can provide useful and actionable insight to clinicians and managers on the ground at a time crucially important for effective future planning. ## Conclusion In this study, we have demonstrated the value of simulation modelling for assessing the impact of changes in service delivery on mental health pathways. Our results have informed decisions regarding the resourcing and restructuring of capacity and pathways in the local mental health service, to best meet the needs of patients during the pandemic and beyond. ## Data Availability No data are available. This study used a discrete event simulation tool purpose built for modelling patient pathways. Model code used for this study is freely available at [https://github.com/nhs-bnssg-analytics](https://github.com/nhs-bnssg-analytics). [https://github.com/nhs-bnssg-analytics/simulation-dts-renege](https://github.com/nhs-bnssg-analytics/simulation-dts-renege) ## Ethics approval and consent to participate ### NA ## Consent for publication ### NA ## Availability of data and materials This study used a discrete event simulation tool purpose built for modelling patient pathways. Model code used for this study is freely available at [https://github.com/nhs-bnssg-analytics](https://github.com/nhs-bnssg-analytics). ## Competing interests No potential conflict of interest was reported by the author(s). ## Funding This work was partially supported by Elizabeth Blackwell Institute. ## Authors’ contributions Concept, methodology and design: Wood, Pierotti, Cooper, Data curation: Cooper, Pierotti Analysis and interpretation of data: Pierotti, Wood, Cassels, Gara Writing-original draft preparation: Pierotti Software, Validation: Wood, Pierotti Writing reviewing and editing: Wood, Denholm, James Funding acquisition: Denholm, Wood, Cooper Project administration: Cooper, Pierotti Supervision: Wood ## Supplementary tables and figures View this table: [Table S1:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/T4) Table S1: Services type for primary and secondary care mental health outpatients services. ![Figure S1:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/07/23/2023.07.19.23292289/F5.medium.gif) [Figure S1:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/F5) Figure S1: Summary of Weekly Queue size for services modelled post ‘lockdown’ (mean and 95% confidence bands) for the simulation scenarios A. ![Figure S2:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2023/07/23/2023.07.19.23292289/F6.medium.gif) [Figure S2:](http://medrxiv.org/content/early/2023/07/23/2023.07.19.23292289/F6) Figure S2: Summary of Weekly Queue size for services modelled post ‘lockdown’ (mean and 95% confidence bands) for the simulation scenarios B. ## Acknowledgements This work was supported by the Elizabeth Blackwell Institute, University of Bristol, the Welcome Trust Institutional Strategic Support Fund and the Rosetrees Trust. ## List of abbreviations NHS : National Health Scotland BNSSG ICS : Bristol, North Somerset and South Gloucestershire healthcare Integrated Care System SWD : System Wide Dataset MH : mental health AWP : Avon and Wilshire Mental Health Partnership NHS trust MHP : Mental Health Provide IAPT : Improving Access to Physiological Therapy GP : general practice CI : Confidence Intervals DTS : Discrete time simulation. * Received July 19, 2023. * Revision received July 19, 2023. * Accepted July 23, 2023. * © 2023, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. 1.Xiang, Y.T., Yang, Y., Li, W., Zhang, L., Zhang, Q., Cheung, T., Ng, C.H. (2020). Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed. Lancet Psychiatry 7 (3), 228–229. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F07%2F23%2F2023.07.19.23292289.atom) 2. 2.Jia, R., Ayling, K., Chalder, T. (2020) . Mental health in the UK during the COVID-19 pandemic: cross sectional analyses from a community cohort study. BMJ open 10 (9). [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F07%2F23%2F2023.07.19.23292289.atom) 3. 3.Mazza, C., Ricci, E., Biondi, S., Colasanti, M., Ferracuti, S., Napoli, C., Roma, P. (2020). A nationwide survey of psychological distress among italian people during the COVID-19 pandemic: Immediate psychological responses and associated factor. International Journal Environmental Research Public Health 17 (9) 4. 4.Shevlin, M., McBride, O., Murphy, J., Miller, J.G., Hartman, T.K., Levita, L., Mason, L., Martinez, A.P., McKay, R., Stocks, T.V.A., Bennett, K.M., Hyland, P, Karatzias, T., Bentall, R.P. (2020). Anxiety, depression, traumatic stress, and COVID-19 related anxiety in the UK general population during the COVID-19 pandemic. PsyArXiv. 5. 5.Salleh, S., Thokala, P., Brennan, A. Hughes, R., Booth, A.(2017).Simulation Modelling in Healthcare: An Umbrella Review of Systematic Literature Reviews. PharmacoEconomics 35, 937–949. 6. 6.Vázquez-Serrano, J.I., Peimbert-García, R.E., Cárdenas-Barrón, L.E.(2021) Discrete-Event Simulation Modeling in Healthcare: A Comprehensive Review. Int J Environ Res Public Health.;18(22) 7. 7.Naylor, C., Bell, A., Baird, B., Heller, A., Gilburt, H.(2020). Mental health and primary care networks Understanding the opportunities. [PDF]. theking’sfund. [https://www.kingsfund.org.uk/sites/default/files/2020/Mental%20Health%20and%20PCNs%20onne%20version_1.pdf](https://www.kingsfund.org.uk/sites/default/files/2020/Mental%20Health%20and%20PCNs%20onne%20version_1.pdf) 8. 8.Davies, J. (2020). Mental health, We are monitoring trends in the quality of mental health care. Nuffieldtrust.[https://www.nuffieldtrust.org.uk/news-item/mental-health-2](https://www.nuffieldtrust.org.uk/news-item/mental-health-2) 9. 9.City Council. (2019). Deprivation in Bristol 2019. Ministry of Housing Communities & Local Government. [https://www.bristol.gov.uk/files/documents/1905-deprivation-in-bristol-2019/file](https://www.bristol.gov.uk/files/documents/1905-deprivation-in-bristol-2019/file) 10. 10.BNSSG Healthier Together (2021) A system-wide dataset for Bristol, North Somerset, and South Gloucestershire. Available at: [https://bnssghealthiertogether.org.uk/population-health-management/](https://bnssghealthiertogether.org.uk/population-health-management/) 11. 11.Cole, C.L., Waterman, S., Stott, J., Saunders, R., Buckman, J.E.J., Pilling, S., Wheatley, J. (2020). Adapting IAPT services to support frontline NHS staff during the Covid-19 pandemic: the Homerton Covid Psychological Support(HCPS) pathway. Cogn. Behav. Ther. 13 12. 12.Clark, D.(2011). Implementing NICE guidelines for the psychological treatment of depression and anxiety disorders: the IAPT experience. International Review of Psychiatry, 23, 318–327. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3109/09540261.2011.606803&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22026487&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F07%2F23%2F2023.07.19.23292289.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000296233100003&link_type=ISI) 13. 13.NICE (2011). Common mental health disorders: identification and pathways to care. Clinical Guideline 13. Retrieved from: [www.nice.org.uk/guidance/cg123Google](http://www.nice.org.uk/guidance/cg123Google) Scholar 14. 14.National Collaborating Centre for Mental Health (2019). The Improving Access to Psychological Therapies Manual. Retrieved from: [https://www.england.nhs.uk/wp-content/uploads/2019/12/iapt-manual-v3.pdfGoogle](https://www.england.nhs.uk/wp-content/uploads/2019/12/iapt-manual-v3.pdfGoogle) Scholar 15. 15.NHS BNSSG analytics GitHub. mental health modelling. animated pathway.(2022). GitHub - nhs- bnssg-analytics/mental-health-modelling: Modelling of BNSSG mental health services on recovery from the COVID-19 pandemic 16. 16.NHS Digital (2020). Psychological Therapies: Reports on the Use of IAPT Services, England – January 2020. Retrieved from: https://digital.nhs.uk/data-and information/publications/statistical/psychological-therapies-report-on-the-use-of-iapt-services/january-2020-final-including-reports-on-the-iapt-pilots 10. Long, K, M., Meadows, G, N., (2017) Simulation modelling in mental health: A systematic review. Journal of simulation. 12 (1) 76–85. 17. 17.Katikireddi, V. (2022). Understanding the impacts of income and welfare policy responses to COVID-19 on inequalities in mental health: a microsimulation model. The Health Foundation. Retrieved from: [https://www.health.org.uk/funding-and-partnerships/programmes/understanding-the-impacts-of-income-and-welfare-policy-response-covid](https://www.health.org.uk/funding-and-partnerships/programmes/understanding-the-impacts-of-income-and-welfare-policy-response-covid) 18. 18.Currie, C, S., Fowler, J, W., Kotiadis, K., Monks, T., Onggo, B.S., Duncan A. Robertson, D, A., Tako, A.A. (2020) How simulation modelling can help reduce the impact of COVID-19, Journal of simulation. 14 (2) 83–97. 19. 19.Mohiuddin, S., Gardiner, R., Crofts, M., Muir, P., Steer, J., Turner, J., Wheeler, H., Hollingworth, W., Horner, P.J.(2020). Modelling patient flows and resource use within a sexual health clinic through discrete event simulation to inform service redesign. BMJ open. 10 (7). 20. 20.Murch, B ., Cooper, J.A., Hodgett, T.J., Gara, E.L., Walker, J.S., Wood, R.M.(2021). Modelling the effect on the first wave covid on mental health services. Elsevier. 30–100311. 21. 21.Jacobs, R., Chalkley, M., Böhnke, J.R., Clark, .M., Moran, V., Aragón, M.J.(2019).Measuring the activity of mental health services in England: variation in categorising activity for payment purposes. Administration and Policy in Mental Health and Mental Health Services Research. Springer Link. 46 847–857. 22. 22.Murch, B. (2020).NHS BNSSG Analytics GitHub repository for discrete time simulation model. [https://github.com/nhs-bnssg-analytics/simulation-dts-renege](https://github.com/nhs-bnssg-analytics/simulation-dts-renege). 23. 23.Cooper, J. (2021). NHS BNSSG Analytics Github. Automated discovery of clinical pathways from routinely collected electronic health record data. [https://github.com/nhs-bnssg-analytics/process-mining-clinical-pathways](https://github.com/nhs-bnssg-analytics/process-mining-clinical-pathways) 24. 24.Rojas, E., Munoz-Gama, J., Sepúlveda, M., Capurro, D.(2016). Process mining in healthcare: A literature review. Journal of Biomedical Informatics.61:224–36. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jbi.2016.04.007&link_type=DOI) 25. 25.Green, L. (2006). Queueing analysis in healthcare. In Patient flow: reducing delay in healthcare delivery (pp. 281–307). Springer, Boston, MA. 26. 26.Pidd, M. (1989). Computer modelling for discrete simulation. John Wiley & Sons, Inc. 605 Third Ave 27. 27.Torjesen, J. (2020). Covid-19: Mental health services must be boosted to deal with “tsunami” of cases after lockdown. BMJ. 369:m1994. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE4OiIzNjkvbWF5MTVfMTkvbTE5OTQiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8wNy8yMy8yMDIzLjA3LjE5LjIzMjkyMjg5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 28. 28.Hood, A., Jemmett, T., Yu, V., Lawles, A. (2020). Estimating the impacts of COVID-19 on mental health services in England. [PDF].Strategyunitwm, https://www.strategyunitwm.nhs.uk/sites/default/files/2020-11/Modelling%20covid-20%20%20MH%20services%20in%20England\_20201109\_v2.pdf. 29. 29.Wood, R.M., McWilliams, C.J., Thomas, M.J. (2020).COVID-19 scenario modelling for the mitigation of capacity-dependent deaths in intensive care. Springer 23. 30. 30.Wood, R.M.(2022).Modelling the impact of COVID-19 on elective waiting times. Journal of simulation. 16 (1), 101–105. 31. 31.Dehghan, A., Nowar, M.A., Molodynski, A.(2017).Improving the referral process from primary care to an AMHT.Prog. Neurol. Psychiatry 21 (3), 22–25. 32. 32.Ellis, L.A., Churruca, K., Braithwaite, J.(2017). Mental health services conceptualised as complex adaptive systems: what can be learned? International Journal of Mental Health System. 11(43) 33. 33.Moss, S.J., Vasilakis, C., Wood, R.M.(2022).Exploring financially sustainable initiatives to address out- of-area placements in psychiatric ICUs: a computer simulation study.Journal of Mental Health..DOI: 10.1080/09638237.2022.2091769 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/09638237.2022.2091769&link_type=DOI) 34. 34.Murch, B.J., Hollier, S.E., Kenward, C., Wood, R.M.(2020). Use of linked patient data to assess the effect of Long-COVID on system-wide healthcare utilisation. Health Information Management Journal. ().