Abstract
Background To improve access to mental health care for children and adolescents, it is necessary to identify the barriers faced by their caregivers. The aim of this study is to identify these barriers in Greece and to investigate the reliability and validity of the modified version of the Barriers to Access to Care Evaluation scale (BACE) - the BACE Proxy Report (BACE-PR).
Methods A total of 265 caregivers completed the BACE-PR. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were used to investigate the factor structure of the instrument. Item parameters were assessed via Item Response Theory. Interpretability was assessed by linking summed scores to IRT-based scores.
Results Caregivers reported care costs as the major barrier to access. Obsessive compulsive symptoms and self-harm were the conditions for which caregivers reported the highest level of barriers. EFA and CFA suggested that a one-factor solution fit the data well (RMSEA = 0.048, CFI = 0.991, TLI = 0.990). Internal consistency was found to be high (ω=0.96). Average z-scores provided five meaningful levels of caregivers’ perceived barriers compared to the national average.
Conclusions Caregivers face a variety of barriers to access mental health care for their children and this could partly explain the treatment gap in the Greek mental health sector. Our study provides evidence for the reliability and validity of the BACE-PR scale, which can aid to identify caregiver-perceived barriers and to design interventions to improve access to mental health care.
Introduction
Nearly half of mental disorders emerge before the age of 18 [1]. It is well established that mental disorders are leading causes of disability and, if left untreated, may have a serious impact in educational achievement and social functioning [2–4]., Studies from all over the world, also suggest that a great proportion of children with treatable mental health disorder do not receive the treatment they need to get better [5–8]. This treatment gap highlights the significant barriers to accessing care within each country’s mental health system.. To increase the access to mental health care services for children and adolescents, it is crucial to understand the factors that facilitate or inhibit their ability to receive care.
In child and adolescent mental health, caregivers play a major role in facilitating help-seeking and often serve as the primary point of contact with mental health services [9, 10]. For in-person help seeking services, research has been found that family is the dominant influence for adolescents [11]. Caregivers, as key facilitators of their children’s entry into mental health care, may encounter various barriers, including difficulties in recognizing symptoms, attitudes and stigma towards mental health that influence decisions to seek treatment, and lack of knowledge about the appropriate type of care to look for [10, 12–15].
The literature on barriers to access mental health care is limited in at least two important ways. First, quantitative studies typically using lists of barriers for caregivers to indicate their presence or absence or to rate them on a Likert scale, usually lack validation [16–21]. Second, although tools for measuring self-reported barriers in the adult population have validation studies, they are usually limited to specific contexts or populations [22, 23].
One of the tools that have the potential to overcome some of these challenges is the Barriers to Access to Care Evaluation (BACE v3) [24]. The instrument may be used to identify key barriers to care experienced by individuals who currently use or have recently used secondary mental health services, and it shows potential utility for use with general population samples [24]. Moreover, it assesses changes in barriers following intervention programs. The BACE has been developed as a self-report measure for adults experiencing mental health conditions, still leaving a gap for the barriers encountered on children and adolescents’ mental health care.
Given this gap, as well as the fact that barriers may vary across countries due to cultural differences as well as differences in mental health system structure and facilities, the aim of the current study is twofold. First, we aim to investigate the children/adolescents caregivers’ main perceived barriers to access to mental health care in Greece. Second, we aim to test the psychometric properties of the adapted version of BACE - PR scale as a proxy measure exploring its validity to be used by caregivers of children in need of mental health care.
Methods
Participants
We used data from a 2022/2023 cross-sectional survey from the Child and Adolescent Mental Health Initiative (CAMHI) on the current state and needs for child and adolescent mental health in Greece based on multiple viewpoints [25]. A nationwide sample of 1,756 caregivers participated in the online survey, answering questions related to service use and access, literacy and stigma, parenting practices, and mental health needs of their children/adolescents. Out of them, 265 caregivers answered affirmatively to the question “Does this child/adolescent have any mental health difficulty (any psychological problem, any problem with his behavior or learning) that you are aware of?”. Subsequently they completed the BACE-PR scale. Recruitment occurred through an online respondent panel provided by the research company IQVIA OneKey. This panel was developed based on census quotas, reaching participants online via social media and website campaigns, search engine optimization, panelists’ friends referrals, and affiliate networks [26]. To avoid self-selection, the online surveys were automatically routed to respondents based on a specific algorithm. Data was collected and preserved according to the General Data Protection Regulation (GDPR) National Policy [27]. Ethical approval was granted by the Research Ethics Committee of the Democritus University of Thrace [approval number: ΔΠΘ/ΕΗΔΕ/42772/307].
Instrument
The Barriers to Access to Care Evaluation (BACE) scale was developed in the Health Services and Population Research Department of the Institute of Psychiatry, Psychology and Neuroscience, King’s College, England [24]. The BACE scale was originally developed as a 30-item self-report instrument conceived to evaluate barriers to access to mental health. Originally, authors suggest two subscales, the stigma subscale consisting of 12 items and the non-stigma consisting of the 18 remaining items. In the current study we used a modified version, adapted for assessing barriers to care for children and adolescents as reported by caregivers. The King’s College London original lead author granted special consent for the adaptation.
BACE adaptation to be a proxy measure in Greece
BACE was culturally adapted and translated in Greek, following reported detailed guidelines of a five-stage cultural adaptation process (https://osf.io/crz6h/). Five stages included forward translation, synthesis of versions, back translation, expert committee review and pilot testing with population. The questions were modified to focus on children; eg “Being unsure where to go to get professional care” was modified to “Being unsure where to go to get professional care for my child/adolescent”. Work-related questions were modified to reflect child/adolescent contexts e.g. “Concern about what people at work might think, say or do” was modified to “ Concern about what people at the school of my child/adolescent might think, say, or do”. The process is described in detail in Karagiorga et al. [28]. As for the self-report (patient adult) measure, respondents (caregivers) should indicate whether each item has ever stopped or delayed or discouraged him/her from getting or continuing with mental health professional care for the child/adolescent they are responsible for (modified instruction to reflect children and adolescents). Scoring includes checking one of four possible answers: not at all (0), a little (1), quite a lot (2), or a lot (3) with higher scores indicating a greater barrier. For each barrier, according to authors, three different scores may be given; (a) the mean of the response scores, (b) the percentage reporting they have experienced the barrier to any degree (i.e. the % circling 1, 2 or 3) and (c) the percentage experiencing the barrier as a major barrier (i.e. the % circling 3).
Statistical analysis
For the description of the BACE items we used the mean score for each item and percentages as suggested by authors of the original scale. To explore which mental health difficulties seem to face more barriers, we plotted a heatmap of the mental health difficulties versus each barrier (item) of the BACE scale, representing the proportion of participants with a mental health difficulty that experience each of the BACE listed barriers. We included only difficulties that have been reported in more than 5 participants, therefore delusions were excluded (N=2).
Our psychometric assessment included several steps. First, since there are no studies that adapted the BACE scale to a proxy version, we performed an Exploratory Factor Analysis (EFA) to explore its underlying structure by using the Maximum Likelihood Estimator (ML) and Geomin Oblique Rotation. The selection of factors was based on the scree plot of eigenvalues and on the factor loadings. After selection of the best model, a Confirmatory Factor Analysis (CFA) was performed to explore the fit of the model to our sample, by using the Pairwise Maximum Likelihood Estimator (PML). Model fit was evaluated with the following fit indices: the Comparative Fit Index (CFI), the Tucker-Lewis Index (TLI), the Root Mean Square Error of Approximation (RMSEA), and the Standardized Root Mean-square Residual (SRMR). A good fit is indicated by the following values: SRMR < 0.6; RMSEA < 0.06; TLI and CFI > 0.95 [29]. Reliability analysis was performed using Cronbach alpha and by Omega (ω) coefficient for our model. Cronbach alpha assumes equal loadings (essential tau equivalence) and a value of 0.7 is considered acceptable [30]. Omega estimates the proportion of variance in the observed total score attributable to all “modeled” sources of common variance. A value of >0.8 is considered strong [31].
For interpretability-the degree to which one can assign qualitative meaning to an instrument’s quantitative scores or change in scores [32]-BACE has polytomous response options and therefore the graded response model (GRM) was used to estimate item parameters. We also conducted unidimensional item response theory assessments to determine where BACE provides information according to the latent trait. Moreover, we estimated the IRT factor scores of the latent variable to rank them into percentiles aiming to provide a meaningful scoring to stakeholders and researchers.
Analysis was performed using the software RStudio version 2023.12.1 [32, 33] and the packages lavaan [34], psych [35], ltm [36] , and semTools [37]. Database sheets and the code is openly available at our repository (https://osf.io/crz6h/).
Results
Participants
Sample characteristics are shown in Table 1. The majority of the respondents were female (59.6%), and were in a relationship (83.0%). Nearly all participants (98.1%) have finished the mandatory (9 years) education in Greece. The majority of caregivers reported that their child had learning difficulties (N=95), attention-deficit/hyperactivity disorder (N=86) and anxiety (N=77).
Barriers to access to care: descriptive assessment
Mean scores of each item of BACE are presented in Table 2, while percentages reported each item as a barrier to any degree and as a major barrier are presented in Figure 1. All scores lie between 0.61 and 1.49 indicating that caregivers face overall barriers to a small degree. The barrier with the highest mean score is “Not being able to afford the financial costs involved” which concurrently is also the item with the highest percentage reporting this as a barrier to any degree as well as reporting it as a major barrier. Other highly reported barriers include the fear that the child might be seen as weak, the willingness of the caregivers to solve the difficulties by themselves, the uncertainty of where they should ask for help and the future consequences relating to job applications.
Caregivers ratings in each response (in percentage) of how much (“a lot”, “quite a lot”, “a little”, “not at all”) each item ever stopped, delayed or discouraged them from getting, or continuing with, professional care for a mental health problem. Descending order based on the percentage reported as a major barrier (circling “A lot”).
Figure 2 presents the barrier heatmap according to each mental health difficulty reported. Obsessive compulsive disorder was the disorder that most caregivers faced the most barriers. Caregivers face almost every barrier for their children when they present with obsessions and compulsions. Other difficulties that face a lot of barriers in high degree are self-harm and intellectual disability. On the other hand, difficulties with a low level of barriers are mainly behavioral disorders as well as attention-deficit/hyperactivity disorder and autism spectrum disorder.
Percentage of caregivers reporting each barrier to any degree (answer: “A little”, “Quite a lot”, “A lot”) in each diagnosis. Order of BACE items according to percentage reported to any degree (descending left to right). Order of the mental health difficulties according to the overall level of barriers based on the mean BACE item scores (descending up to bottom). Mental health difficulties were plotted if N ≥ 5.
Exploratory Factor Analysis
The results of the scree plot (Figure S1, Supplementary Material) favored a unidimensional solution. All 30 factor loadings were very high (>0.6) except two that displayed values of 0.38 and 0.59, although still significant.
Confirmatory Factor Analysis
The unidimensional model (barriers to access to care) showed very good fit indices to the data (RMSEA = 0.048, CFI = 0.991, TLI = 0.990, SRMR = 0.061). Factor loadings were high, ranging from 0.38 to 0.89 (Table 3).
Reliability
Unidimensional model presented with high reliability with values of 0.96 to McDonald’s ω as well as Cronbach’s alpha, indicating excellent internal consistency (Table 3).
Interpretability
Unidimensional Item Performance Analysis
Item response function curves and item information curves for each item can be found in Figures S3 and S4, supplemental material. Test information function plot (Figure S5) shows that BACE proxy version provides the most information about slightly-above-than-average barrier levels (the peak is around θ=1).
Linking summed score to IRT-based z-scores
Factor score from the IRT of the BACE proxy version as shown in Figure 3 follows the normal distribution. The z-scores for the latent variable (Table 4) provide a reference point to assess interpretability of the BACE. Based on those scores, we classified the amount of barriers that caregivers face as: (1) No barriers (BACE total = 0); (2) slight barriers (BACE total 1-31); (3) mild barriers (BACE total 32-44); (4) moderate barriers (BACE total 45-63); and (5) severe barriers (BACE total over 64).
Histogram of the BACE Factor score from the Item Response Analysis
Discussion
The aim of this study was to identify the barriers that caregivers face to access mental health care in Greece for their children and to explore the reliability and validity of the culturally adapted BACE-PR in a nationwide sample of caregivers with mental health concerns of their children. The top five major barriers to access care in Greece were "Not being able to afford the financial costs involved", "Wanting to solve the problem of my child/adolescent on my own’’, "Concern that my child/adolescent might be seen as weak for having a mental health problem", "Being unsure where to go to get professional care for my child/adolescent" and "Concern that it might harm the child/adolescent’s chances when applying for jobs in the future". We showed consistent evidence for the reliability and validity of BACE-PR as a unidimensional construct. We also provide practical recommendations for interpretability of the BACE-PR by means of using IRT based scores (z-scores).
One of the most important findings of this study is that three quarters of the caregivers reported financial costs as a barrier for accessing mental health care. This is likely to relate to the consequences of 12 years of continuous financial crisis in Greece, which seemed to be worsened by the increasing demands of the sector after the COVID-19 pandemic. During the crisis years, unemployment rates were increased and loss of income was noted in the majority of professions. Moreover, mental health is known to be particularly vulnerable to rapid economic fluctuations [38–40]. Therefore, an increase in demand for mental health services was noted, while at the same time public mental health services operated with fewer employees with long waiting lists [41]. Although the public mental health system is mainly free of charge, many caregivers look for care in the private sector. However, the cost of private treatment for children with mental and neurodevelopmental disorders is only partially covered by the national insurance fund, thus caregivers often have to pay out-of-pocket costs for their child’s treatment. Our finding is consistent with the international literature where in many studies the cost represents a major barrier [42–44].
Another significant finding of our study is that a set of barriers to mental health access among caregivers of children with mental health problems in Greece are related to attitudes and stigma. Several studies in the literature suggest that these types of barriers are noted among caregivers [45–47]. To our knowledge, up to now, no relevant studies exploring caregivers’ beliefs on their children’s mental health services barriers have been conducted in Greece. However, stigma for mental illness is prevalent in Greek culture according to a systematic review [48]. Finally, the lack of knowledge about where to refer for help also represents a barrier in our study, consistent with the literature [47, 49, 50]. This may reflect the fragmentation of the Greek mental health system and the overall challenges the system faces in Greece [51, 52]. Current initiatives are trying to mitigate those barriers by making information easily accessible to the Greek population (www.camhi.gr).
Based on our study, in Greece caregivers of children with obsessive compulsive symptoms (OCS), self-harm behaviors, or intellectual disability (ID) seem to face the most barriers and to a higher level compared to caregivers of children with other disorders in our sample. These conditions are severe, often associated with severe impairment in everyday functioning and may need specialized services. Parents of children with OCD found themselves caught in “loops” in which they engaged in repeated process steps due to the emergence of barriers, when they assess exposure therapy. They also feel isolated and guilty because of the burden of finding treatment for their children [53]. Moreover, poor mental health literacy and stigmatizing attitudes are considered main parameters for the delayed help seeking behavior in OCD [54]. Similar reasons seem to apply to help seeking for young people at risk of self-harm [55, 56]). It is well known that stigma is high for youth’s self-harm behaviors and the care they receive in the emergency departments is often inadequate [56–58]. Caregivers of children with ID also indicate they face high levels of barriers that might be related to the barriers they also face in educational settings. Furthermore, when ID is comorbid with other disorders, such as autism spectrum disorders (ASD), it increases the likelihood of unmet mental health care needs [59]. Moreover, in the case of Greece we should also highlight structural barriers such as the lack of specialized services providing evidence-based treatment for these conditions, especially in the public sector. On the other hand, our findings showed that behavioral disorders and other neurodevelopmental disorders such as autism spectrum disorder and attention deficit hyperactivity disorder face a lower level of barriers when compared to other mental health concerns. We hypothesize that externalizing problems as well as communication deficits and social impairment in ASD are more likely to prompt caregivers to ask for help and that there are many private services in Greece that provide care for these conditions.
We also found that the psychometric testing of the BASE-PR provides good evidence for data quality and internal consistency. The unidimensional model fits well the data indicating that the BACE-PR can be used to measure the barriers that the caregivers face when they need to access mental health care for their children. The unidimensional solution seems in contrast with the literature considering that the original version of the BACE divides the items as stigma non-related and stigma [24], which was corroborated by the Arabic, the Japanese (excluding 6 items and with marginal fit indices) and the French versions [60–62]. Our unique finding of unidimensionality might be explained by the fact that our tool represents a modified proxy version. Based on that, we suggest that the BACE-PR scale should be treated as a measure of the overall perceived barriers. In terms of practicality and interpretability, the results of this study can be used by stakeholders to understand the quality and quantity of the barriers caregivers face. Reliability of our proxy version was also found very high, consistent with the above-mentioned translations.
Limitations and strengths
Our study has important limitations. First, the sample size is small to conceptualize which barriers caregivers face in Greece. This also prevented us from doing EFA and CFA in distinct samples, as recommended by the literature for psychometric assessment of psychological instruments [63, 64]. Second, this is an online panel based sample, thus implying representative bias for groups without internet access. Our study also has strengths that should be highlighted. To the best of our knowledge this is the first study using a modified version of BACE, providing to the international community a tool to assess barriers to access care in children and adolescents. In addition, it is the first study in Greece exploring the barriers that caregivers face in access to mental health care. Second, we followed a rigorous cross-adaptation process for the instrument. Third, item performance analyses in a nationwide survey, provided psychometric evidence of BACE-PR adequacy on an item-based approach, surpassing the limitations of classical test theory analyses. Finally, our study provides to the Greek service providers and stakeholders a valid tool to record caregivers’ perceived barriers to design interventions to address them.
Conclusions
In this study, we developed and validated the BACE-PR tool, addressing a gap of tools for caregiver report of barriers to child and adolescent mental health care. Caregivers of children with mental health concerns may encounter numerous barriers when help from mental health professionals is needed. Identifying them is important to understand the treatment gap at both the national and at the local level considering the different needs across the country, especially in terms of the uneven distribution of services and professionals. The present study highlights the need for free of charge specialized interventions to address the financial barriers. Moreover, interventions to fight stigma and to guide caregivers on how to access the available services (e.g. with detailed service mapping) are necessary in Greece. To improve access to treatment and to provide early and comprehensive services, we need also to explore variations in the perceived barriers among caregivers of children across different mental health disorders and different ages. Finally, the present study supports the use of BACE-PR to identify perceived barriers. Future studies in larger scale populations based on this tool are needed to confirm our findings. Furthermore, appropriate interventions may be applied by policy makers to address the barriers and longitudinal studies may evaluate their effect on childrens’ mental health in Greece. Moreover, specifically addressing barriers at a more regional level can also be a positive strategy for fighting barriers considering the different needs across the country, especially in terms of the uneven distribution of services and professionals. Diminishing the barriers and therefore increasing access to mental health care would be extremely beneficial for children and adolescents, since it will allow for early intervention and overall decrease the treatment gap.
Data Availability
The dataset statistical codes supporting the conclusions of the current study are openly available in the CAMHI Open Science Framework repository [http://doi.org/10.17605/OSF.IO/CRZ6H]
Declarations
Funding
This work was fully funded by The Stavros Niarchos Foundation through The Child and Adolescent Mental Health Initiative (CAMHI).
Competing interests
There is no conflict of interest related to this work.
Availability of data and materials
The dataset is openly available in the CAMHI Open Science Framework repository [http://doi.org/10.17605/OSF.IO/CRZ6H]
Code availability
The statistical codes supporting the conclusions of the current study are openly available in the CAMHI Open Science Framework repository [http://doi.org/10.17605/OSF.IO/CRZ6H]
Authors’ contribution
KK and GS have drafted the work. Data analysis was performed by KK and GS. Material preparation and data curation were performed by KK, JS, LM, AT, AM, GT and AS. Formal analysis was performed by KK, MH and GS. Project administration was performed by KK, KP, MB, AS, AK and GS. GS supervised the work. All authors contributed to data presentation; visualization by KK, CC and GS. All authors substantially contributed to interpretation of data, reviewed and edited the work. All authors read and approved the final manuscript. All authors have agreed both to be personally accountable for the author’s own contributions and ensure that questions related to the accuracy or integrity of any part of the work, even ones in which they are not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.
Ethical approval
Ethical approval was granted by the Research Ethics Committee of the Democritus University of Thrace [approval number: ΔΠΘ/ΕΗΔΕ/42772/307].
Consent to participate
Informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable
Acknowledgments
The Stavros Niarchos Foundation (SNF) under its Global Health Initiative has partnered with the Child Mind Institute and a countrywide Network of mental health providers in the public system to jointly design, launch, and deliver the Child and Adolescent Mental Health Initiative (CAMHI) in Greece, which supports this work. The authors would like to thank SNF’s Co-President Andreas C. Dracopoulos and CMI’s President Dr. Harold Koplewicz for their leadership in creating, launching, and supporting this project. We would also like to thank Ms. Elianna Konialis, Ms. Dimitra Moustaka and Mr. Panos Papoulias for their critical role in multiple steps of the conceptualization and implementation of the CAMHI objectives. Finally, thanks to CAMHI hub leaders and hub members that participated in multiple stages of this work and participants and their families for their contribution.
Footnotes
Mailing address: Child Mind Institute. 215 E 50th St, New York, NY 10022, USA
References
