Abstract
Whilst improving hygiene and sanitation behaviours is key to cost-effective and sustainable WASH interventions, measuring behaviour change remains a challenge. This study assessed the validity and reliability of pictorial 24-hour recall (P24hR), a novel method using unprompted recall of past activities through pictures, compared to structured observation for measuring handwashing with soap (HWWS) and safe child faeces disposal in rural Malawi. Data were collected from 88 individuals across 74 households in Chiradzulu district using both methods over a two-day period, with the recall period of the P24hR corresponding to the period of structured observation completed the previous day. Results showed poor agreement between P24hR and observations in detection of hygiene opportunities and behaviours. P24hR under-reported handwashing opportunities when frequency was high and over-reported them when frequency was low. The 95% limits of agreement for handwashing opportunities estimated through Bland-Altman analysis (-7.62 to 4.89) were unacceptably wide given median 5 opportunities observed per participant. P24hR also over-reported HWWS and safe child faeces disposal, and kappa statistics indicated agreement no better than by chance. Structured observation remains the preferred method for measuring hygiene behaviours despite its known limitations, including potential reactivity bias.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
OR was the recipient of a travel grant from the London School of Hygiene and Tropical Medicine to support travel and field data collection costs. No other specific funding supported this work.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by National Committee on Research in the Social sciences and Humanities in Malawi (Protocol No. P.01/23/718) as well as the Ethical Review Committee at the London School of Hygiene and Tropical Medicine (LSHTM MSc Ethics Ref: 28743).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All data produced in the present study are available upon reasonable request to the authors
1Abbreviations
- P24hR
- pictorial 24-hour recall
- HWWS
- handwashing with soap
- TA
- traditional authority
- NGO
- non-governmental organisation
- LOA
- limits of agreement
- PPV
- positive predictive value
- NPV
- negative predictive value
