Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A protocol for a critical realist systematic synthesis of interventions to promote pupils’ wellbeing by improving the school climate in Low- and Middle-Income Countries

View ORCID ProfilePamela Abbott, View ORCID ProfileRachel Shanks, Isabel Stanley, View ORCID ProfileLucia D’Ambruoso
doi: https://doi.org/10.1101/2023.05.18.23290176
Pamela Abbott
1Centre for Global Development, University of Aberdeen, Aberdeen, UK
2School of Education, University of Aberdeen, Aberdeen, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Pamela Abbott
  • For correspondence: p.abbott{at}abdn.ac.uk
Rachel Shanks
1Centre for Global Development, University of Aberdeen, Aberdeen, UK
2School of Education, University of Aberdeen, Aberdeen, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Rachel Shanks
Isabel Stanley
1Centre for Global Development, University of Aberdeen, Aberdeen, UK
2School of Education, University of Aberdeen, Aberdeen, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lucia D’Ambruoso
1Centre for Global Development, University of Aberdeen, Aberdeen, UK
3Aberdeen Centre for Data Science, University of Aberdeen, Aberdeen, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lucia D’Ambruoso
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Introduction The review described in this protocol will be the first critical realist review of the literature reporting on the impact of interventions to promote pupils’ wellbeing by improving the school climate in Low- and Middle-Income Countries. The review is being carried out to inform the programme theory for a critical realist evaluation of a whole school mindfulness intervention in Ethiopia and Rwanda to improve pupils’ mental wellbeing. Our initial programme theory hypothesises that pupils’ (and teachers’) responses to the mindfulness intervention as well as changing the behaviour and attitudes of individual pupils and teachers, will change the ‘school climate’ in ways that have a positive impact on mental wellbeing. This literature review will facilitate the identification of mechanisms for change working at the level of the whole school climate, something which is only infrequently discussed in evaluations of mindfulness interventions.

Methods and analysis A critical realist review methodology will be used to provide a causal interdisciplinary understanding of how school climate can promote the wellbeing of pupils. This will be done through a systematic literature review and extrapolating context, agency, intervention, mechanisms, and outcome configurations and synthesising these to provide a conceptual understanding of the impact of interventions to improve school climate.

Discussion The review findings will inform a critical realist evaluation of a mindfulness intervention in schools that we will be carrying out. The findings from the review will enable us to focus more precisely and transparently on what policymakers and other stakeholders need to know about how school climate changes due to introducing mindfulness to the curriculum and how this impacts pupils’ wellbeing [and for which pupils]. We will publish the findings from the review in academic and professional publications, policy briefs, workshops, conferences, and social media.

PROSPERO registration number CRD42023417735

Introduction

The review described in this protocol will be the first systematic critical realist review of the literature reporting on the impact of the ‘school climate’ (defined here as schools’ structural, interpersonal relations and teaching practices, and cultural norms and values) on pupils’ wellbeing in Low- and Middle-Income Countries (LMICs). The review is being carried out to inform the programme theory for a critical realist evaluation of a whole school-based mindfulness intervention (SBMI) in Ethiopia and Rwanda on pupils’ mental wellbeing (1,2). Our initial programme theory hypothesises that pupils (and teachers) will be able to use the psychological resources they gain through the mindfulness intervention to change the ‘school climate’ in ways that positively impact pupils’ mental wellbeing.

Our review is novel. Existing literature on the impact of mindfulness interventions focuses on individual psychological outcomes. It rarely considers the pathways to improved mental wellbeing through changes in the social structural or cultural contexts due to changes in the behaviour of pupils and teachers wrought by mindfulness interventions (3–5). This literature review will yield a framework of existing theories as a guide to identifying and understanding the underlying process (mechanisms) that shape the ‘school climate’ and identify those that may be triggered by a whole school mindfulness intervention and promote pupils’ mental wellbeing.

Critical realists recognise that not every intervention will work for each person in the same way or different contexts in the same way. While traditional reviews have been concerned with descriptive outcomes and average effects, critical realists are more concerned with exploring how interventions work, for whom and under what circumstances. The broad purpose of the review is to move from empirical observation to develop a theorised understanding of the impact of school climate on pupils’ wellbeing in LMICs and identify aspects of school climate that can be linked to mechanisms triggered by mindfulness interventions. This will produce knowledge that enables us to make recommendations to improve practice, that is, improve the school climate and deliver mindfulness interventions in schools (6). The main purpose is to build a middle-range theory (7) that models the underlying mechanisms influencing the school climate. We will use the critical realist RRRIREI© (resolution, redescription, retroduction, retrodiction, elimination, identification, correction) framework for explanatory interdisciplinary research (8,9). The findings will enable us to refine the programme theory for research we are carrying out examining the potential for school-based mindfulness interventions to promote the mental wellbeing of children and adolescents in Rwanda and Ethiopia. The findings will also support policymakers and others to implement policies to improve the school climate and promote the wellbeing of children and adolescents in LMICs more generally by providing an understanding of under what conditions and for which pupils’ interventions make the school climate more positive.

The quality of school life (the school climate) is determined by a combination of the structural, interpersonal relations and teaching practices, and the cultural norms and values of the school as influenced by the wider social (‘laminated’) system (Table 1) in which it is embedded (10). It is crucial for promoting safer, more supportive and more civil schools (11). School climate improvement measures make schools friendlier, pupils (and teachers) more connected to the school and prevent dropout (11–14). Four sub-constructs of the school climate have been identified in the literature that impacts pupils’ wellbeing: safety (feeling safe in school), relationships (e.g. school connectedness/engagement, social support, leadership and pupils’ perception of the school climate), teaching and learning (academic environment) and the institutional environment (school connectedness) (11–14). The authors argue that these four sub-constructs are interconnected, influencing each other and being influenced by the broader context (laminated system) in which schools are located.

View this table:
  • View inline
  • View popup
Table 1:

Critical Realist Terminology

Schools contain both risk and protective factors for pupils’ wellbeing. An extensive body of evidence, mainly from research carried out in the global North, shows that the school climate impacts pupils’ and their teachers’ wellbeing and that there is an association between a positive school climate and wellbeing (11,12,14–29). A positive school climate influences academic outcomes (11,22–24), reduces the rates of violence in schools (11,21,22,25,26), supports skills development (21,27), promotes wellbeing and reduces the risk of mental health disorders (11,12,21,28,29). Systematic reviews have found the strongest association between pupils’ psychological wellbeing, mental health and risk behaviours on the one hand and the quality of their relationships with their fellow pupils and teachers on the other (12,14,17,19,22). Bullying and harassment, particularly, are associated with poor wellbeing and low educational achievement. A positive school climate also promotes teachers’ wellbeing and improves their relationship with pupils, which positively impacts pupils’ wellbeing (16).

While much of the research is non-experimental and cross-sectional, experimental and longitudinal research has found that the school-level socio-educational environments at baseline predict students’ wellbeing at three years follow-ups. Student perceptions of the socio-educational environment also predict their wellbeing (15,29). However, it should be noted that there is possibly a publication bias as the findings from research on interventions that have not led to improvements in the school climate are less likely to be published.

Nevertheless, the evidence is sufficient to indicate an established ‘demi-regularity’ that there is, at least in some contexts and for some pupils, an association between an intervention designed to make the school climate more positive and improving pupils’ wellbeing. It is this that needs to be explained (30).

The evidence base for a relationship between school climate and student wellbeing outcomes in LMICs is more limited. A recent (end date of search January 2019) systematic review of the association between school climate and socio-cultural, behavioural, and academic outcomes in LMICs found 35 peer-reviewed articles that met their inclusion criteria (20). All but two of the included studies reported a positive association between an intervention to improve the school climate and positive outcomes, with similar associations found as in research in high-income countries (HICs). More specifically, the findings from the review suggest a relationship between a negative school climate and bullying and violence and a positive school climate and academic achievement and wellbeing. Only seven studies included a low-income country.

However, few studies address the question of how school-based climate interventions work. Systematic reviews (and the studies included in the reviews) examine the empirical evidence on the health, behavioural and attainment effects of school environments. Still, they do not usually consider what theories might explain those changes or how they came about. One systematic review of theories of how school-based climate interventions (SBCIs) work built a comprehensive interdisciplinary theory of school effects drawing on 24 theories that partially explain the pathway from SBCIs to impact. This enabled the authors to integrate upstream, medical and downstream aspects of causal pathways (31) and test the interdisciplinary theory they built in a randomised control trial (32). The integrated theoretical model takes account of complexity and feedback loops and theorises that school climate influences pupils at multiple interacting levels: student-school commitment, student peer-commitment, student cognition and student behaviours. Imperfect measures constrained the trial. A low teacher response rate, the positive impact on pupils’ health outcomes and positive views on the changes in the school climate only became evident at the end of the trial. Nevertheless, the findings suggest that observed positive changes in pupils’ health, including mental health were the outcome of modifying the school climate.

Aim and Objectives

This review will build on previous research on the relationship between school climate and pupil wellbeing by:

  1. Including all documents from LMICs that can help with answering our research questions, including the grey literature, reports of reviews of research and discussions of theories relevant to the impact of school climate on pupil’s wellbeing;

  2. Using a critical realist methodology to build a theory of what makes SBCIs work, how, where, with whom, and to what extent, focusing on LMICs.

  3. Identifying context and intervention mechanisms to inform the programme theory of change for SBMI designed to promote the mental wellbeing of children and adolescents in Rwanda and Ethiopia.

The aims of the review are to:

  1. describe plausible explanations for the effectiveness of SBCIs designed to promote pupils’ wellbeing in LMICs;

  2. create transferable theories that can inform programme design and implementation in different settings;

  3. use the findings together with our findings from systematic reviews of mindfulness interventions and theories explaining how SBMIs impact pupils’ mental wellbeing to refine our initial programme theory of how mindfulness interventions work to promote pupils’ mental wellbeing.

To achieve the aims, the objectives are to identify:

  • theories about how SBCIs work in schools;

  • the contexts and mechanisms that may facilitate or hinder implementation;

  • how pupils and teachers respond to SBCIs (agency);

  • how school contexts (social, structural, and cultural) influence the agency of pupils in responding to SBCIs and trigger mechanisms that change the context and lead to positive outcomes;

  • how the school system changes (roles and relationships), including pupil-teacher relations and pupil-pupil-relations;

  • how school attitudes and values change (culture), and;

  • the outcomes resulting from the interventions.

Methodology

Introduction

To achieve our aims and objectives, we will conduct a systematic critical realist synthesis review to identify how SBCIs promote pupils’ wellbeing. A critical realist review is explanatory; it seeks to explain how interventions work and generate different outcomes in different contexts (33,34). We will explore how SBCIs are supported or inhibited by contextual mechanisms in schools, how pupils and teachers respond to them and the outcomes that result from the interaction between the intervention and contextual mechanisms and the response of pupils and teachers. In doing so, we will identify the ‘demiregularities’, the contexts over time and space in which SBCIs enable pupils’ agency to trigger mechanisms that promote their wellbeing and improve their attainment (30). Because critical realism affirms the reality of objects, agents, and mechanisms, which cannot be viewed directly but only deduced from their effects, it seeks to identify, by retroduction and retrodiction, and judgemental rationalism, the middle-range interdisciplinary theory(s) (Table 1) that most comprehensively explain how SBCIs work. Such theories are always open to refinement in the light of new evidence.

There is no agreed standard or guide for critical realist reviews. However, a critical realist meta-theory underpins them, and they draw on some elements of the realist review methodology of Roy Pawson (6). We have adapted the standard for realist reviews (35,36) and taken into account recommendations for traditional systematic reviews (37–39).

PRISMA offers transparency, validity, replicability, and updateability (Additional Material 1).

A critical realist research paradigm

Our methodology is informed by critical realist meta-theory. It has informed the development of methods for systematic reviews and impact evaluations that are designed to explain how and why interventions work in the ways they do (40–43). It also provides guidelines for inter/transdisciplinary research (9,44–46), including research on promoting wellbeing (9,47).

Wellbeing is a bio-psycho-social phenomenon, and the outcomes of SBCIs are likely due to the complex interaction of biological, psychological, social-structural and cultural mechanisms and require the development of middle-range theories that integrate theories from these disciplines (47–50).

The main elements of critical realism are: a depth ontology, that society is real but is only knowable through its effects; a relativist epistemology, that our understanding of the real is always partial and open to refinement or refutation; rational judgment is used to determine what explanations (social theories) are most plausible; that structure and agency are both important; that people are shaped by the context in which they live but that they can change it through their agency; that the social world is an open system and complex; and a commitment to social justice, to improve the lives of people.

Critical realism has influenced a number of approaches to carrying out social and health research, and our approach draws on Margaret Archer’s practical morphogenic approach (51,52). This methodology complements critical realism’s social ontology (53). She argues that every theory about the social involves understanding the relationship between structure, agency, and culture. The context in which agents live shapes their beliefs, desires, and opportunities and limits their agency – contextual conditioning. However, the interaction between context and agency shapes and reshapes the context; agency can change the context (morphogenesis) or reproduce it (morphostasis). An intervention designed to improve the school climate gives pupils and teachers the resources to trigger mechanisms that can lead to material and cultural change. Their responses to the intervention are shaped, but not determined, by the context, and individuals generate outcomes through actions and interactions. When actors trigger new mechanisms (material and/or cultural), the context changes. However, pupils and teachers can resist, redefine, repudiate, suspend, or circumvent engagement with the intervention.

Methods/Design

Step 1: establishing the scope of the work

The review will focus on SBCIs designed to promote the wellbeing of pupils in LMICs. We will document differences between SBCIs underpinned by different theories, aims, approaches and techniques and delivered differently for various lengths of time (54,55). The review will also capture other individual differences and programme characteristics that can affect programme reception by pupils and teachers and impact (56). We will only include documents relevant to the relationship between pupils’ academic achievement, behavioural, cognitive, and mental wellbeing and outcomes. Nevertheless, outcomes will likely vary by the precise nature of the SBCIs.

Step 2: search for evidence

Search techniques

A rigorous systematic Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) approach will be used to search for literature (57). A PRISMA diagram will show the steps of the inclusion and exclusion of documents (Additional Material 2). The literature search will be in three phases: searching electronic databases, searching other sources such as relevant journals and core publishers, and citation tracking to ensure all relevant studies are included. The aim is to include as wide a range as possible of academic and grey literature without restrictions on study type or publication date. Literature from all LMICs will be included. Databases that index health, psychology, sociology and/or education literature will be searched. The search will be restricted to publications in the English language. The search terms and the databases used are based on the advice of an academic librarian.

The Search terms will be:

‘school’ or ‘educational context’ and ‘ethos’ or’ environment’ or ‘culture’ or ‘governance’ or ‘context’ or ‘climate’ or ‘structure’ or ‘relations’ or ‘relationships’ and ‘children’ or ‘adolescents’ or ‘youth’ or ‘young people’ or ‘juvenile’ or ‘teen’ or ‘young adult’ or ‘teenager’ or ‘pupils’ and ‘wellbeing’ or ‘mental health’ or ‘resilience’ or ‘attainment’ or’ school grades’ or ‘motivation’ or ‘connectedness’ or ‘engagement’ or ‘suicidal behaviour’ or ‘depression’ or ‘suicidal ideation’ or ‘prosocial behaviour’ or ‘risk’ or ‘risk behaviour’ or ‘burnout’ or ‘school adjustment’ or ‘attitudes’ or ‘psychosomatic complaints’ or ‘Post-traumatic stress disorder’ or ‘life satisfaction’ or ‘quality of life’ or ‘emotional’ or ‘communication’ or ‘supportive’ or ‘support’ or ‘caring’ or ‘respect’ or ‘belonging’ or’ quality of education’ or ‘anxiety’ or ‘conflict’ or ‘conduct’ or ‘bullying’ or ‘harassment’ or’ violence’ or ‘aggression’ or ‘corporal punishment’ or ‘discipline’ or ‘disruptive behaviour’ or ‘rules’ or ‘safety’ or ‘inclusive’ or ‘teaching practices’ or ‘involvement’ and ‘mechanisms’ or ‘theory’ or ‘theorisation’ or ‘conceptual’ or conceptualisation’ or ‘concept’ or ‘mediators’ or ‘moderators’ or ‘process’ or ‘effects’ or ‘scholarship’ or ‘drivers’ or ‘correlation’ or ‘causation’ or ‘association’ or ‘impact’ or ‘causal pathway’ and ‘low income’ or ‘middle income’ or ‘low and middle income’ or [list of low- and middle-income countries in 2023].

Inclusion/exclusion criteria

Inclusion
  • Study design: Any that provides evidence to help with answering our research questions.

  • Documents: LMICs.

  • Publication date: any.

  • Document type: any document type that will inform the review.

  • Population: includes pupils aged 7-16 years.

  • Type of report: reporting primary research, a review of research or a theory relevant to the impact of school climate on pupils’ wellbeing in LMICs.

  • Setting: conducted in statutory education settings in LMICs.

  • Language: English.

Exclusion
  • Studies reporting only on curricular-based interventions or designed to improve individual knowledge.

  • Studies report only on interventions designed to improve the physical infrastructure of the school or classroom.

  • Studies containing information on the school climate and wellbeing but not examining the links between the two.

  • Studies that do not provide sufficient detail to allow identification of specific aspects of the school climate and wellbeing.

  • Not a study of the effects of the school climate on pupils

  • Only includes special needs schools.

  • Only includes pupils outside the 7-16 years age range.

  • In languages other than English.

Article screening

Covidence will be used to manage article screening and data extraction.

  1. Remove duplicates and citations without abstracts or summaries;

  2. Two reviewers (PA and RS) will review the titles and abstracts of all retrieved documents captured by our search strategy and code them as ‘potentially relevant’ and ‘not relevant’. Any disagreements will be resolved by discussion or, if necessary, bringing in a third reviewer (LD);

  3. Download the full text of potentially relevant documents.

Step 3: document appraisal and data extraction

Extract information from the documents, as relevant, that potentially meet our inclusion criteria into an Excel spreadsheet:

  1. Document details – title, authors, year of publication, location of study;

  2. Country, income group (low, lower-middle, upper-middle) (country income group classified as at the time the research was done);

  3. Journal discipline;

  4. Aims and objectives of the study;

  5. The description – details of the intervention, trainers, design, aim/purpose, length of training;

  6. Sample characteristicsage of pupils, sex/gender, socioeconomic status, ethnicity, type of school;

  7. The study design and if it is fit for purpose (quality/rigour);

  8. The conceptualisation of school climate;

  9. Rational for SBCCIs, including any social justice framing;

  10. Inner contextual factors (mechanisms) (i.e. the structure, culture and resources of schools that support or inhibit the effectiveness of measures taken to improve the school climate before the intervention was introduced);

  11. Outer contextual factors (i.e. the cultural, administrative and policy context within which schools operate that support or inhibit the effectiveness of measures taken to improve the school climate before the intervention was introduced);

  12. Proximal outcomes measured;

  13. How proximal outcomes were measured – instruments used to measure dimensions of school climate and wellbeing;

  14. Student outcomes, behaviour, and experience of interventions;

  15. Teacher outcomes, behaviour, and experience of interventions;

  16. Agency, stakeholders, including pupils’, teachers’ and parents’ interactions and responses to interventions designed to improve the school climate;

  17. Generative mechanisms triggered by the intervention that could have supported change (positive mechanisms), e.g. increased student engagement;

  18. Generative mechanisms triggered by the intervention that could have restricted/prevented change (negative mechanisms), e.g. resistance by pupils;

  19. Contextual mechanisms that could have supported change (positive mechanisms) commitment of school administration to positive change;

  20. Contextual mechanisms that restricted/prevented change (negative mechanisms) ingrained norms and values which support bullying and harassment;

  21. Any theoretical explanations identified for explaining the outcomes and the level of the explanation that is, psychological or social;

  22. Changes in context following the introduction of SBCIs.

The extraction tool will be piloted. PA, RS, LD, and IS will independently read two documents and complete the extraction table. They will then meet, compare their extraction tables, and agree on necessary modifications.

PA will extract all information. PA will remove any documents containing insufficient relevant data to inform how and why the intervention worked (or did not work) and/or not using credible and trustworthy methods. Documents will be considered relevant if they can help to answer the research questions; that is, they report findings from research on school climate. They will be included as credible if the methods used are adequate for generating the findings; documents will be excluded if they are not based on credible research or are purely anecdotal. The reasons for the exclusion of any document will be noted. A critical realist synthesis does not require that two independent reviewers complete screening for quality or data relevance. However, RS will review any documents PA identifies as not contributing or not using credible and trustworthy methods, with differences being resolved by discussion and, if necessary, by bringing in a third reviewer, LD.

We will provide a descriptive narrative summary of the findings from this stage of the review.

Step 5: Analysis and Reporting

The analysis will aim to identify a middle-range interdisciplinary theory that explains how school climate impacts pupils’ wellbeing. It will ‘open the black box’ and identify the mechanisms the interventions triggered that explain how the interventions caused the reported outcomes using the critical realist framework for interdisciplinary research resolution, redescription, retroduction, elimination, identification and refinement (RRREIR) (Table 3) (8,9). An interdisciplinary middle-range theory will then be developed that explains how SBCCIs work, recognising that outcomes will likely differ in different contexts.

View this table:
  • View inline
  • View popup
Table 2:

Search Terms for SciELO Citation Index and Scopus

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3:

RRREIc Stages for Interdisciplinary Research

To do this, we will mine the findings from the review to identify the changes that have occurred as a result of the intervention (outcomes), the mechanisms that were triggered by pupils’ (and teachers’) agency and how the context supported or restricted the impact of the interventions CAIMO configurations (40,58) and develop the hypothetical causal links between context, agency, mechanisms and outcomes. To do this, we will use Template Analysis to code the data and identify relevant context, agency, mechanisms and outcomes because it permits using predetermined codes as well as identifying new codes (59). Within each category, findings will be broken down thematically and reported narratively to distinguish between different contexts, agency responses, mechanisms triggered, and outcomes. The key themes that describe processes and causal mechanisms for explaining SBCI outcomes in schools will then be identified. Hypothetical links will then be made between the CAIMO themes, creating potential pathways that account for the impacts of SBCCIs on pupils and why, for whom and under what circumstances these impacts occur.

To account for complexity, it will be necessary to develop non-linear pathways of change showing how the complex interaction of mechanisms (context mechanisms that predate the intervention and those triggered by the intervention) leads to the observed outcomes (43,60– 62). To do this, we will use feedback loop diagrams to model change, showing both mechanisms triggered by the intervention that cause change, those already in the context that supported change (+ve mechanism) and those already in the context and mechanisms triggered by the intervention that restricted or prevented change (-ve mechanisms).

Outcomes will likely be more complex than a dichotomy between morphogenesis (structural change) and morphostasis (structural reproduction) (Table 1; Figuure1).

Figure 1:
  • Download figure
  • Open in new tab
Figure 1: The Morphogenetic Cycle, CAIMO Configuration

Ethics

Formal ethics approval is not required for a literature review. However, ethical approval has been obtained from the University of Aberdeen (20th June 2022), Addis Ababa University Ref 111/22/Psy, 21st December 2022), and the University of Rwanda (Ref 03/DRI-CE/012/EN/gi/2023, 25th January 2023) for the research programme, of which this critical realist review forms an integral element.

Dissemination

We will publish at least one article in a peer review journal reporting the findings from the literature review, conforming to RAMESES publication standards (36) and a policy brief intended for policymakers with the target audience including WHO, UNESCO, UNICEF, the Rwandan and Ethiopian Governments, and the UK and Scottish Governments. Findings from the review will be disseminated via an article in The Conversation, seminar and conference presentations, and podcasts posted on the project website and disseminated by social media.

Discussion

Our review will be the first critical realist review of the literature on SBCCIs. In the review, we aim to identify the generative mechanisms and social structures that explain how and why SBCCIs promote the wellbeing of pupils. This will enable policymakers and school leaders to understand under what circumstances SBCIs promote pupils’ wellbeing and improve their attainment and for which pupils they work.

The main challenges are likely to be that: there will be little information in the documents on the pre-existing context, and; the documents may not include details of the theoretical reasoning underpinning interventions to enable us to develop middle-range theories.

Data Availability

N/A

Ethics approval and consent to participate

Not required for a literature review

Consent for publication

Not required

Availability of data and materials

No data was used in preparing this protocol. The data sets that the project generates will be deposited with the UK National Data Archive within six months of the completion of the project under a Creative Commons Attribution 4.0 Unported (CC BY 4.0) license. The training materials produced by the project will be made available under a Creative Commons Attribution 4.0 Unported (CC BY 4.0) license on the project website: https://www.abdn.ac.uk/education/research/cgd/nihr-camw-subsaharan-africa/index.php

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

Authors’ Contributions: PA, RS, and LD contributed to the NIHR grant application. PA led the research design and the protocol’s writing and produced the first draft. RS, IS and LD revised drafts and agreed on the final text of this paper.

Funding

The research is funded by the National Institute for Health and Care Research (NIHR133712) using UK aid from the UK Government to support global health research.

Disclaimer

The views expressed in this protocol are the views of the authors alone. They do not necessarily represent the views of the National Institute for Health and Care Research, the UK Government, the Court of the University of Aberdeen, the Board of Directors of the University of Rwanda, or the Board of Addis Ababa University.

Open access

This is an open-access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and an indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

References

  1. 1.↵
    Abbott P, D’Ambruoso L, Yared M, McNamee P, Hailu T, Nzabalirwa W. A Critical Realist informed pilot cluster control trial evaluating the effectiveness of a mindfulness intervention for promoting child and adolescent mental wellbeing in Rwanda and Ethiopia. Res Regist [Internet]. 2023;8799. Available from: https://www.researchregistry.com/browse-the-registry#home/?view_2_search=8799&view_2_page=1
  2. 2.↵
    Abbott P, D’Ambruoso L, Yared M, McNamee P, Nzabalirwa W. Study protocol for a Critical Realist pilot cluster-randomised controlled trial of a whole-school-based mindfulness intervention (SBMI) promoting child and adolescent mental wellbeing in Rwanda and Ethiopia. medRxiv. 2023; May.
  3. 3.↵
    Abbott P, Stanley I, Nixson G, D’Ambruoso L. A protocol for a systematic critical realist synthesis of school mindfulness interventions designed to promote pupils’ mental wellbeing. CRD42023410484 [Internet]. PROSPERO. 2023 [cited 2023 Apr 5]. Available from: https://www.crd.york.ac.uk/PROSPERO/#searchadvanced
  4. 4.
    Brito R, Joseph S, Sellman E. From Instrumental to Integral Mindfulness: Toward a More Holistic and Transformative Approach in Schools. Stud Philos Educ. 2022;41(1):91–109.
    OpenUrl
  5. 5.↵
    Callen-Davies RJ, Bristow J, Gazder T, Griffith GM, Noorani Y, Crane RS. Mindfulness-based programmes and ‘bigger than self’ issues: protocol for a scoping review. BMJ Open. 2023;13(3):e067819.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    Edgley A, Stickley T, Timmons S, Meal A. Critical realist review: exploring the real, beyond the empirical. J Furth High Educ [Internet]. 2016;40(3):316–30. Available from: http://dx.doi.org/10.1080/0309877X.2014.953458
    OpenUrl
  7. 7.↵
    Merton RK. On Sociological Theories of the Middle Range. In: Social Theory and Social Structure [Internet]. New York, NY: Simon & Schuster, The Free Press; 1949. Available from: http://www.csun.edu/~snk1966/Robert K Merton - On Sociological Theories of the Middle Range.pdf
  8. 8.↵
    Bhaskar R. Enlightened Common Sense: The Philosophy of Critical Realism [Internet]. Abingdon: Routledge; 2016. Available from: https://www.amazon.co.uk/Enlightened-Common-Sense-Ontological-Explorations/dp/0415583799/ref=sr_1_1?keywords=Enlightened+Common+Sense%3A+The+Philosophy+of+Critical+Realism&qid=1646410466&sr=8-1
  9. 9.↵
    Bhaskar R, Danermark B, Price L. Interdisciplinarity and Wellbeing: A Critical Realist General Theory of Interdisciplinarity [Internet]. London and New York, NY: Routledge; 2018. Available from: https://www.amazon.co.uk/Interdisciplinarity-Wellbeing-Critical-Realist-Routledge/dp/0415403715/ref=sr_1_1?crid=4O3D8WANEIEM&keywords=critical+realism+wellbeing&qid=1662303252&s=books&sprefix=critical+realism+wellbeing+%2Cstripbooks%2C70&sr=1-1
  10. 10.↵
    Tikly L. What works, for whom, and in what circumstances? Towards a critical realist understanding of learning in international and comparative education [Internet]. Vol. 40, International Journal of Educational Development. 2015. p. 237–49. Available from: https://www.sciencedirect.com/science/article/pii/S0738059314001163
    OpenUrl
  11. 11.↵
    Thapa A, Cohen J, Guffey S, Higgins-D’Alessandro A. A Review of School Climate Research. Rev Educ Res. 2013;83(3):357–85.
    OpenUrl
  12. 12.↵
    Aldridge JM, McChesney K. The relationships between school climate and adolescent mental health and wellbeing: A systematic literature review. Int J Educ Res [Internet]. 2018;88(February):121–45. Available from: https://doi.org/10.1016/j.ijer.2018.01.012
    OpenUrl
  13. 13.
    Wang M Te, Degol JL. School Climate: a Review of the Construct, Measurement, and Impact on Student Outcomes [Internet]. Vol. 28, Educational Psychology Review. Educational Psychology Review; 2016. 315–352 p. Available from: http://dx.doi.org/10.1007/s10648-015-9319-1
    OpenUrl
  14. 14.↵
    Kutsyuruba B, Klinger DA, Hussain A. Relationships among school climate, school safety, and student achievement and well-being: a review of the literature. Rev Educ. 2015;3(2):103–35.
    OpenUrl
  15. 15.↵
    Leurent B, Dodd M, Allen E, Viner R, Scott S, Bonell C. Is positive school climate associated with better adolescent mental health? Longitudinal study of young people in England. SSM - Ment Heal [Internet]. 2021;1(October):100033. Available from: https://doi.org/10.1016/j.ssmmh.2021.100033
    OpenUrl
  16. 16.↵
    Gray C, Wilcox G, Nordstokke D. Teacher Mental Health, School Climate, Inclusive Education and Student Learning: A Review. Vol. 58, Canadian Psychology. 2017. p. 203–10.
    OpenUrl
  17. 17.↵
    Troy D, Anderson J, Jessiman PE, Albers PN, Williams JG, Sheard S, et al. What is the impact of structural and cultural factors and interventions within educational settings on promoting positive mental health and preventing poor mental health: a systematic review. BMC Public Health [Internet]. 2022;22(1):1–16. Available from: https://doi.org/10.1186/s12889-022-12894-7
    OpenUrl
  18. 18.
    Voight A, Nation M. Systematic and evaluative review of school climate instruments for students, teachers, and parentsPractices for Improving Secondary School Climate: A Systematic Review of the Research Literature. Am J Community Psychol. 2016;58(1–2):174–91.
    OpenUrl
  19. 19.↵
    Jamal F, Fletcher A, Harden A, Wells H, Thomas J, Bonell C. The school environment and student health: A systematic review and meta-ethnography of qualitative research. BMC Public Health. 2013;13(1):1–11.
    OpenUrlCrossRefPubMed
  20. 20.↵
    Larson KE, Nguyen AJ, Orozco Solis MG, Humphreys A, Bradshaw CP, Lindstrom Johnson S. A systematic literature review of school climate in low and middle income countries. Int J Educ Res. 2020;102(June).
  21. 21.↵
    Theron LC. The everyday ways that school ecologies facilitate resilience: Implications for school psychologists. Sch Psychol Int. 2016;37(2):87–103.
    OpenUrlCrossRef
  22. 22.↵
    Bonell C, Jamal F, Harden A, Wells H, Parry W, Fletcher A, et al. Systematic review of the effects of schools and school environment interventions on health: evidence mapping and synthesis. Public Heal Res. 2013;1(1):1–320.
    OpenUrl
  23. 23.
    Lombardi E, Traficante D, Bettoni R, Offredi I, Giorgetti M, Vernice M. The impact of school climate on well-being experience and school engagement: A study with high-school students. Front Psychol. 2019;10(OCT):1–11.
    OpenUrlCrossRef
  24. 24.↵
    Wang M-T, Holcombe R. Adolescents’ perceptions of school environment, engagement, and academic achievement in middle school. Am Educ Res J. 2010;47(3):633–62.
    OpenUrlCrossRef
  25. 25.↵
    Wilson D. The interface of school climate and school connectedness and relationships with aggression and victimisation. J Sch Health. 2004;74(7):293–9.
    OpenUrlCrossRefPubMedWeb of Science
  26. 26.↵
    Cook CR, Williams KR, Guerra NG, Kim TE, Sadek S. Predictors of bullying and victimisation in childhood and adolescence: A meta-analytic investigation. Sch Psychol Q. 2010;25(2):65–83.
    OpenUrlCrossRefWeb of Science
  27. 27.↵
    Wong MD, Dosanjh KK, Jackson NJ, Rünger D, Dudovitz RN. The longitudinal relationship of school climate with adolescent social and emotional health. BMC Public Health. 2021;21(1):1–8.
    OpenUrlCrossRefPubMed
  28. 28.↵
    Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The Impact of Enhancing Students’ Social and Emotional Learning: A Meta-Analysis of School-Based Universal Interventions. Child Dev. 2011;82(1):405–32.
    OpenUrlCrossRefPubMedWeb of Science
  29. 29.↵
    Brière FN, Pascal S, Dupéré V, Janosz M. School environment and adolescent depressive symptoms: A multilevel longitudinal study. Pediatrics. 2013;131(3).
  30. 30.↵
    Lawson T. Economics and Reality. London: Routledge; 1997.
  31. 31.↵
    Bonell C, Fletcher A, Jamal F, Wells H, Harden A, Murphy S, et al. Theories of how the school environment impacts on student health: Systematic review and synthesis. Heal Place [Internet]. 2013;24:242–9. Available from: http://dx.doi.org/10.1016/j.healthplace.2013.09.014
    OpenUrl
  32. 32.↵
    Bonell C, Allen E, Opondo C, Warren E, Elbourne DR, Sturgess J, et al. Examining intervention mechanisms of action using mediation analysis within a randomised trial of a whole-school health intervention. J Epidemiol Community Health. 2019;73(5):455–64.
    OpenUrlAbstract/FREE Full Text
  33. 33.↵
    Clegg S. Evidence-based practice in educational research: A critical realist critique of systematic review. Br J Sociol Educ. 2005;26(3):415–28.
    OpenUrlCrossRefWeb of Science
  34. 34.↵
    Mingers J, Standing C. Why things happen – Developing the critical realist view of causal mechanisms. Inf Organ. 2017;27(3):171–89.
    OpenUrl
  35. 35.↵
    Greenhalgh T, Pawson R, Wong G, Westhorp G, Greenhalgh J, Manzano A, et al. Protocols and realist evaluation. 2017;1–4. Available from: https://www.ramesesproject.org/Standards_and_Training_materials.php
  36. 36.↵
    Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med [Internet]. 2016;14(1):1–18. Available from: http://dx.doi.org/10.1186/s12916-016-0643-1
    OpenUrl
  37. 37.↵
    Gough D, Oliver S, Thomas J. Learning From Research : Systematic Reviews for Informing Policy Decisions [Internet]. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2013. Available from: https://apo.org.au/sites/default/files/resource-files/2013-12/apo-nid71119.pdf
  38. 38.
    Moher D, Liberati A, Tetzlaff J, Altman DGG. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA statement. Ann Intern Med [Internet]. 2009;151(4):264–9. Available from: https://doi.org/10.7326/0003-4819-151-4-200908180-00135
    OpenUrl
  39. 39.↵
    Lockwood C, Munn Z, Porritt K. Qualitative research synthesis: Methodological guidance for systematic reviewers utilising meta-aggregation. Int J Evid Based Healthc. 2015;13(3):179–87.
    OpenUrlCrossRefPubMed
  40. 40.↵
    Danermark B, Ekström M, Karlsson JC. Explaining Society: Critical Realism in the Social Sciences. London and New York, NY: Routledge; 2019.
  41. 41.
    Porter S. The uncritical realism of realist evaluation. Evaluation. 2015;21(1):65–82.
    OpenUrlCrossRef
  42. 42.
    Porter S, McConnell T, Reid J. The Possibility of Critical Realist Randomised Controlled Trials. Trials. 2017;18:133.
    OpenUrl
  43. 43.↵
    Hinds K, Dickson K. Realist synthesis: a critique and an alternative. J Crit Realis [Internet]. 2021;20(1):1–17. Available from: https://doi.org/10.1080/14767430.2020.1860425
    OpenUrl
  44. 44.↵
    Price L. Critical realist versus mainstream interdisciplinarity. J Crit Realis. 2014;13(1):52–76.
    OpenUrl
  45. 45.
    Stigendal M, Novy A. Founding transdisciplinary knowledge production in critical realism: implications and benefits. J Crit Realis [Internet]. 2018;17(3):203–20. Available from: https://doi.org/10.1080/14767430.2018.1514561
    OpenUrl
  46. 46.↵
    Danermark B. Applied interdisciplinary research: a critical realist perspective. J Crit Realis. 2019;18(4):368–82.
    OpenUrl
  47. 47.↵
    Pilgrim D. Preventing mental disorder and promoting mental health: some implications for understanding wellbeing. J Crit Realis. 2021;20(5):557–73.
    OpenUrl
  48. 48.
    Pilgrim D. Some implications of critical realism for mental health research. Soc Theory Heal. 2014;12(1):1–21.
    OpenUrl
  49. 49.
    Powers P. The Philosophical Foundations of Foucaultian Discourse Analysis. Crit Approaches to Discourse Anal across Discip. 2012;1(2):18–34.
    OpenUrl
  50. 50.↵
    Malhotra S, Sahoo S. Antecedents of depression in children and adolescents. Ind Psychiatry J. 2018;27(11).
  51. 51.↵
    Archer M. Culture and Agency: The Place of Culture in Social Theory [Internet]. 2nd ed. Cambridge: Cambridge University Press; 1998. Available from: https://www.cambridge.org/core/books/culture-and-agency/D73435BFB89EF16E49E0BFB6BC9F6ACF
  52. 52.↵
    Archer M. Realist Social Theory: The Morphogenetic Approach. Cambridge: Cambridge University Press; 2008.
  53. 53.↵
    1. Róna P,
    2. Zsolnai L, editors
    Archer M. The Morphogenetic Approach: Critical Realism’s explanatory framework approach. In: Róna P, Zsolnai L, editors. Agency and Causal Explanation in Economics [Internet]. Cham: Springer; 2020. Available from: https://link.springer.com/book/10.1007/978-3-030-26114-6
  54. 54.↵
    Semple RJJ, Droutman V, Reid BAA. Mindfulness Goes To School: Things Learned (So Far) From Research and Real-World Experiences. Psychol Sch. 2017;54(1):29–52.
    OpenUrl
  55. 55.↵
    Hart R, Ivtzan I, Hart D. Mind the gap in mindfulness research: A comparative account of the leading schools of thought. Rev Gen Psychol. 2013;17(4):453–66.
    OpenUrl
  56. 56.↵
    Carsley D, Khoury B, Heath NL. Effectiveness of Mindfulness Interventions for Mental Health in Schools: A Comprehensive Meta-analysis. Mindfulness (N Y) [Internet]. 2018;9(3):693–707. Available from: https://doi.org/10.1177/0020764020973684
    OpenUrl
  57. 57.↵
    Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. PRISMA 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. BMJ. 2021;372.
  58. 58.↵
    Blom B, Morén S. Explaining social work practice - the CAIMeR theory. J Soc Work [Internet]. 2010;10(1):98–119. Available from: https://journals.sagepub.com/doi/abs/10.1177/1468017309350661?journalCode=jswa
    OpenUrl
  59. 59.↵
    Brooks J, McCluskey S, Turley E, King N. The Utility of Template Analysis in Qualitative Psychology Research. Qual Res Psychol. 2015;12(2):202–22.
    OpenUrlPubMed
  60. 60.↵
    Hatt K. View of Considering Complexity_Toward A Strategy for Non-linear Analysis. Can J Sociol. 2009;34(2):313–47.
    OpenUrl
  61. 61.
    Bellazzecca E, Teasdale S, Biosca O, Skelton DA. The health impacts of place-based creative programmes on older adults’ health: A critical realist review. Heal Place [Internet]. 2022;76(January):102839. Available from: https://doi.org/10.1016/j.healthplace.2022.102839
    OpenUrl
  62. 62.↵
    Mukumbang F, De Souza D, Liu H, Uribe G, Moore C, Fotheringham P, et al. Unpacking the design, implementation and uptake of community-integrated health care services: A critical realist synthesis. BMJ Glob Heal [Internet]. 2022;7(8):1–14. Available from: https://gh.bmj.com/content/bmjgh/7/8/e009129.full.pdf
    OpenUrl
Back to top
PreviousNext
Posted May 18, 2023.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A protocol for a critical realist systematic synthesis of interventions to promote pupils’ wellbeing by improving the school climate in Low- and Middle-Income Countries
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A protocol for a critical realist systematic synthesis of interventions to promote pupils’ wellbeing by improving the school climate in Low- and Middle-Income Countries
Pamela Abbott, Rachel Shanks, Isabel Stanley, Lucia D’Ambruoso
medRxiv 2023.05.18.23290176; doi: https://doi.org/10.1101/2023.05.18.23290176
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
A protocol for a critical realist systematic synthesis of interventions to promote pupils’ wellbeing by improving the school climate in Low- and Middle-Income Countries
Pamela Abbott, Rachel Shanks, Isabel Stanley, Lucia D’Ambruoso
medRxiv 2023.05.18.23290176; doi: https://doi.org/10.1101/2023.05.18.23290176

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Public and Global Health
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)