Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Automated detection and staging of malaria parasites from cytological smears using convolutional neural networks

View ORCID ProfileMira S. Davidson, Sabrina Yahiya, Jill Chmielewski, View ORCID ProfileAidan J. O’Donnell, View ORCID ProfilePratima Gurung, View ORCID ProfileMyriam Jeninga, Parichat Prommana, Dean Andrew, View ORCID ProfileMichaela Petter, View ORCID ProfileChairat Uthaipibull, Michelle Boyle, View ORCID ProfileGeorge W. Ashdown, View ORCID ProfileJeffrey D. Dvorin, View ORCID ProfileSarah E. Reece, View ORCID ProfileDanny W. Wilson, View ORCID ProfileD. Michael Ando, View ORCID ProfileMichelle Dimon, View ORCID ProfileJake Baum
doi: https://doi.org/10.1101/2021.01.26.21250284
Mira S. Davidson
1Department of Life Sciences, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Mira S. Davidson
Sabrina Yahiya
1Department of Life Sciences, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jill Chmielewski
2Research Centre for Infectious Diseases, School of Biological Sciences, University of Adelaide, Adelaide, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aidan J. O’Donnell
3Institute of Evolutionary Biology, and Institute of Immunology and Infection Research, School of Biological Sciences, University of Edinburgh, Edinburgh, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Aidan J. O’Donnell
Pratima Gurung
4Division of Infectious Diseases, Boston Children’s Hospital, Boston, Massachusetts, USA and Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Pratima Gurung
Myriam Jeninga
5Mikrobiologisches Institut–Klinische Mikrobiologie, Immunologie und Hygiene, Universitätsklinikum Erlangen, Friedrich-Alexander- Universität (FAU) Erlangen-Nürnberg, Erlangen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Myriam Jeninga
Parichat Prommana
6National Center for Genetic Engineering and Biotechnology (BIOTEC), Pathum Thani, Thailand
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dean Andrew
7QIMR Berghofer Medical Research Institute, Herston, QLD, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michaela Petter
5Mikrobiologisches Institut–Klinische Mikrobiologie, Immunologie und Hygiene, Universitätsklinikum Erlangen, Friedrich-Alexander- Universität (FAU) Erlangen-Nürnberg, Erlangen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michaela Petter
Chairat Uthaipibull
6National Center for Genetic Engineering and Biotechnology (BIOTEC), Pathum Thani, Thailand
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Chairat Uthaipibull
Michelle Boyle
7QIMR Berghofer Medical Research Institute, Herston, QLD, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
George W. Ashdown
1Department of Life Sciences, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for George W. Ashdown
Jeffrey D. Dvorin
4Division of Infectious Diseases, Boston Children’s Hospital, Boston, Massachusetts, USA and Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jeffrey D. Dvorin
Sarah E. Reece
3Institute of Evolutionary Biology, and Institute of Immunology and Infection Research, School of Biological Sciences, University of Edinburgh, Edinburgh, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sarah E. Reece
Danny W. Wilson
2Research Centre for Infectious Diseases, School of Biological Sciences, University of Adelaide, Adelaide, Australia
8Burnet Institute, 85 Commercial Road, Melbourne, Victoria, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Danny W. Wilson
D. Michael Ando
9Google Research, Applied Science Team
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for D. Michael Ando
Michelle Dimon
9Google Research, Applied Science Team
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michelle Dimon
Jake Baum
1Department of Life Sciences, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jake Baum
  • For correspondence: jake.baum{at}imperial.ac.uk
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Microscopic examination of blood smears remains the gold standard for diagnosis and laboratory studies with malaria. Inspection of smears is, however, a tedious manual process dependent on trained microscopists with results varying in accuracy between individuals, given the heterogeneity of parasite cell form and disagreement on nomenclature. To address this, we sought to develop an automated image analysis method that improves accuracy and standardisation of cytological smear inspection but retains the capacity for expert confirmation and archiving of images. Here we present a machine-learning method that achieves red blood cell (RBC) detection, differentiation between infected and uninfected RBCs and parasite life stage categorisation from raw, unprocessed heterogeneous images of thin blood films. The method uses a pre-trained Faster Region-Based Convolutional Neural Networks (R-CNN) model for RBC detection that performs accurately, with an average precision of 0.99 at an intersection-over-union threshold of 0.5. A residual neural network (ResNet)-50 model applied to detect infection in segmented RBCs also performs accurately, with an area under the receiver operating characteristic curve of 0.98. Lastly, using a regression model our method successfully recapitulates intra-erythrocytic developmental cycle (IDC) stages with accurate categorisation (ring, trophozoite, schizont), as well as differentiating asexual stages from gametocytes. To accelerate our method’s utility, we have developed a mobile-friendly web-based interface, PlasmoCount, which is capable of automated detection and staging of malaria parasites from uploaded heterogeneous input images of Giemsa-stained thin blood smears. Results gained using either laboratory or phone-based images permit rapid navigation through and review of results for quality assurance. By standardising the assessment of parasite development from microscopic blood smears, PlasmoCount markedly improves user consistency and reproducibility and thereby presents a realistic route to automating the gold standard of field-based malaria diagnosis.

Significance Statement Microscopy inspection of Giemsa-stained thin blood smears on glass slides has been used in the diagnosis of malaria and monitoring of malaria cultures in laboratory settings for >100 years. Manual evaluation is, however, time-consuming, error-prone and subjective with no currently available tool that permits reliable automated counting and archiving of Giemsa-stained images. Here, we present a machine learning method for automated detection and staging of parasite infected red cells from heterogeneous smears. Our method calculates parasitaemia and frequency data on the malaria parasite intraerythrocytic development cycle directly from raw images, standardizing smear assessment and providing reproducible and archivable results. Developed into a web tool, PlasmoCount, this method provides improved standardisation of smear inspection for malaria research and potentially field diagnosis.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was funded with support from the Bill & Melinda Gates Foundation (OPP1181199) with additional support coming from Wellcome (Investigator Award to JB, 100993/Z/13/Z JB), University of Adelaide scholarship to JC and Hospital Research Foundation Fellowship to DW.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This work described requires the use of human red blood cells (RBCs) for the propagation of Plasmodium falciparum in in vitro culture. Baum laboratory research grade RBCs are obtained commercially from the National Health Service (NHS) Blood Transfusion Service. These RBCs are given anonymously, and no clinical history is required since their use is solely for research use to facilitate parasite growth and development. No information on any donors is recorded or kept. Sourcing of RBCs in this manner, including informed consent are entirely handled by NHSBT. Imperial College London has determined that this does not represent human subjects research, so no independent ethical approval is required, however, the use of RBCs sourced from the NHSBT is approved by the College-wide BioSafety Committee. Human RBCs for use by the Wilson Laboratory were provided by the Australian Red Cross Blood Bank with ethics approval for use of the cells obtained from the University of Adelaide Human Ethics Committee. Human RBCs for use by the Boyle Laboratory were provided by the Australian Red Cross Blood Bank with ethics approval for use of the cells obtained from the Human Research and Ethics Committee of the QIMR-Berghofer Institute of Medical Research. Human RBCs for use by the Uthaipibull Laboratory were obtained from donors after providing informed written consent, following a protocol approved by the Ethics Committee, National Science and Technology Development Agency, Pathum Thani, Thailand, document no. 0021/2560. Anonymous human RBCs used by the Dvorin Laboratory were obtained from a commercial vendor (Valley Biomedical, Winchester, Virginia, USA). The Boston Children's Hospital Institutional Review Board has determined that this does not represent human subjects research as defined in US federal regulations and therefore does not require ethical approval. All procedures involving P. chabaudi in the Reece laboratory were carried out in accordance with the UK Home Office regulations (Animals Scientific Procedures Act 1986; project licence number 70/8546) and approved by the University of Edinburgh.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Original imaging data, experimental metadata and pseudolabels will be available from a publicly accessible Image Data Repository (pending upload and URL to be provided).

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted January 31, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Automated detection and staging of malaria parasites from cytological smears using convolutional neural networks
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Automated detection and staging of malaria parasites from cytological smears using convolutional neural networks
Mira S. Davidson, Sabrina Yahiya, Jill Chmielewski, Aidan J. O’Donnell, Pratima Gurung, Myriam Jeninga, Parichat Prommana, Dean Andrew, Michaela Petter, Chairat Uthaipibull, Michelle Boyle, George W. Ashdown, Jeffrey D. Dvorin, Sarah E. Reece, Danny W. Wilson, D. Michael Ando, Michelle Dimon, Jake Baum
medRxiv 2021.01.26.21250284; doi: https://doi.org/10.1101/2021.01.26.21250284
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Automated detection and staging of malaria parasites from cytological smears using convolutional neural networks
Mira S. Davidson, Sabrina Yahiya, Jill Chmielewski, Aidan J. O’Donnell, Pratima Gurung, Myriam Jeninga, Parichat Prommana, Dean Andrew, Michaela Petter, Chairat Uthaipibull, Michelle Boyle, George W. Ashdown, Jeffrey D. Dvorin, Sarah E. Reece, Danny W. Wilson, D. Michael Ando, Michelle Dimon, Jake Baum
medRxiv 2021.01.26.21250284; doi: https://doi.org/10.1101/2021.01.26.21250284

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)