Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Field performance and cost-effectiveness of a point-of-care triage test for HIV virological failure in Southern Africa

Anna Saura-Lázaro, Peter Bock, Erika van den Bogaart, Jessie van Vliet, Laura Granés, Kerry Nel, Vikesh Naidoo, Michelle Scheepers, Yvonne Saunders, Núria Leal, Francesco Ramponi, René Paulussen, Tobias Rinke de Wit, Denise Naniche, Elisa López-Varela
doi: https://doi.org/10.1101/2023.09.18.23295705
Anna Saura-Lázaro
1Barcelona Institute for Global Health (ISGlobal), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Bock
2Department of Pediatrics and Child Health, Desmond Tutu TB Centre, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Erika van den Bogaart
3Mondial Diagnostics, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jessie van Vliet
3Mondial Diagnostics, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laura Granés
4Department of Preventive Medicine and Epidemiology, Hospital Clínic de Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kerry Nel
2Department of Pediatrics and Child Health, Desmond Tutu TB Centre, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vikesh Naidoo
2Department of Pediatrics and Child Health, Desmond Tutu TB Centre, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michelle Scheepers
2Department of Pediatrics and Child Health, Desmond Tutu TB Centre, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yvonne Saunders
2Department of Pediatrics and Child Health, Desmond Tutu TB Centre, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Núria Leal
1Barcelona Institute for Global Health (ISGlobal), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Francesco Ramponi
1Barcelona Institute for Global Health (ISGlobal), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
René Paulussen
3Mondial Diagnostics, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tobias Rinke de Wit
5Amsterdam Institute for Global Health and Development (AIGHD), Amsterdam, The Netherlands. Amsterdam University Medical Center (UMC) location University of Amsterdam, Department of Global Health, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Denise Naniche
1Barcelona Institute for Global Health (ISGlobal), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elisa López-Varela
1Barcelona Institute for Global Health (ISGlobal), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: elisa.lopez{at}isglobal.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Introduction Antiretroviral therapy (ART) monitoring using viral load (VL) testing is challenging in high-burden, limited-resources settings. Chemokine IP-10 (interferon gamma-induced protein 10) strongly correlates with human immunodeficiency virus (HIV) VL. Its determination could serve to predict virological failure (VF) and to triage patients requiring VL testing. We assessed the field performance of a semi-quantitative IP-10 lateral flow assay (LFA) for VF screening in South Africa, and the cost-effectiveness of its implementation in Mozambique.

Methods A cross-sectional study was conducted between June and December 2021 in three primary health clinics in the Western Cape. Finger prick capillary blood was collected from adults on ART for ≥1 year for direct application onto the IP-10 LFA (index test) and compared with a plasma VL result ≤1 month prior (reference test). We estimated the area under the receiver operating characteristic curves (AUC), sensitivity and specificity, to evaluate IP-10 LFA prediction of VF (VL>1,000 copies/mL). A decision tree model was used to investigate the cost-effectiveness of integrating IP-10 LFA combined with VL testing into the current Mozambican ART monitoring strategy. Averted disability-adjusted life years (DALYs) and HIV infections, and incremental cost-effectiveness ratios were estimated.

Results Among 209 participants (median age 38 years and 84% female), 18% had VF. Median IP-10 LFA values were higher among individuals with VF compared to those without (24.0 vs. 14.6; p<0.001). The IP-10 LFA predicted VF with an AUC=0.76 (95% confidence interval (CI) 0.67–0.85), 91.9% sensitivity (95%CI 78.1%–98.3%) and 35.1% specificity (95%CI 28.0%– 42.7%). Integrating the IP-10 LFA in a setting with 20% VF prevalence and 61% VL testing coverage could save 13.0% of costs and avert 14.9% of DALYs and 55.7% new HIV infections. Furthermore, its introduction was estimated to reduce the total number of routine VL tests required for ART monitoring by up to 68%.

Conclusions The IP-10 LFA is an effective VF triage test for routine ART monitoring. Combining a highly sensitive, low-cost IP-10 LFA-based screening with targeted VL confirmatory testing could result in significant healthcare quality improvements and cost savings in settings with limited access to VL testing.

Introduction

For people living with human immunodeficiency virus (PLHIV) on antiretroviral therapy (ART), viral load (VL) testing is the gold standard approach to timely monitor treatment effectiveness, identify virological failure (VF) and establish the need to switch to a second-line ART regimen [1]. Prior to the roll-out of dolutegravir in 2019, reported VF rates in Sub-Saharan Africa (SSA) varied from 5% to 25% [2,3]. VF has severe clinical consequences due to the resulting immunosuppression; in addition 80-90% of subjects with detectable viremia may eventually harbor viruses resistant to first-line ART [2–4]. In the absence of adequate ART monitoring tools, PLHIV who have VF can remain on failing regimens with clinical deterioration, onward HIV transmission and gradual loss of ART effectiveness on individual and population levels.

The recent and rapid scale-up of ART coverage, with 28.7 million PLHIV receiving ART in 2021 [5], has increased the demand for VL tests. Access to VL testing is limited in many low- and middle-income countries (LMIC) with high HIV burden, particularly in SSA, due to costs and lack of qualified human resources and infrastructure [6,7]. Data from 2018 showed that in 6 SSA countries assessed the mean proportion of PLHIV on ART receiving at least one VL test was below 75%, and <55% in two of them [8]. Enabling routine access to VL testing to promptly detect VF is critical to reduce HIV burden, morbidity and mortality. In LMIC where widespread use of nucleic acid-based VL tests is not a realistic option, reliance on dried blood spots (DBS), point-of-care (POC) technologies, or other alternative specimen types or technologies is necessary to expand access to VL testing.

IP-10 (interferon gamma-induced protein 10) is a human chemokine that strongly correlates with HIV VL [9]. Its assessment in plasma can serve as a highly sensitive screening tool to identify PLHIV on ART at risk of VF [10,11]. Mondial Diagnostics in The Netherlands developed an IP-10 rapid test for finger prick capillary blood samples and plasma, in collaboration with the Barcelona Institute for Global Health (ISGlobal) and the Amsterdam Institute for Global Health and Development (AIGHD). This semi-quantitative lateral flow assay (LFA) consists of a dried detection reagent deposited in a test tube and a dipstick with a test line to measure IP-10 and a control line to confirm assay validity. We aimed to evaluate the field performance of this first IP-10 LFA prototype as a VF screening test in PLHIV on ART in Cape Town, South Africa. We also assessed the cost-effectiveness of implementing the IP-10 LFA in three different ART monitoring algorithms in a setting with limited access to routine VL testing using Mozambique as an example

Methods

Study design, setting and population

A cross-sectional study was conducted between June and December 2021 in three primary health clinics, Kraaifontein Community Health Centre, Ivan Toms Centre for health and Bloekombos Clinic, in the Cape Metro, Western Cape, South Africa. The Cape Metro district has approximately 48,400 PLHIV on ART, a relatively high VL coverage of 72-89% [12,13], and an overall VL suppression rate, defined as undetectable VL, of 84% among individuals with VL result [14]. HIV treatment and care are offered free of charge and VL testing for ART monitoring is recommended to be performed annually [15]. We strategically selected these clinics due to their relatively high programmatic VL coverage, which facilitated the effective evaluation of the IP-10 LFA’s field performance by utilizing existing VL data and infrastructure.

PLHIV aged ≥18 years on ART for at least 12 months without treatment interruptions in the previous 3 months attending the clinic were pre-screened for study participation pursuing an enriched enrolment of PLHIV experiencing VF to ensure 85% statistical power. Assuming a VF prevalence of 25% and a sensitivity of the IP-10 LFA above 90%, we calculated that a sample size of 35 PLHIV experiencing VF would provide a significant level of 0.05 and a confidence interval (CI) with a half-width of 0.1. Individuals presenting with symptoms suggestive of COVID-19, such as cough, shortness of breath, sore throat, anosmia, ageusia, conjunctivitis, and weight loss >1.5kg, were excluded [16].

Study visit procedures

After obtaining informed consent, a research assistant collected participants’ socio-demographic and clinical information by using an electronic survey. Each participant underwent phlebotomy and finger prick capillary blood testing with the IP-10 LFA (index test) performed by a trained nurse.

The IP-10 LFA was performed in a controlled temperature environment as follows: i) 50 µL of assay fluid were dispensed into the test tube, followed by 2 µL of freshly collected capillary blood using a precision pipette; ii) the dipstick was immersed into the reaction mixture for 20 minutes; iii) after time elapsed, the dipstick was removed from the test tube and added to the clean, portable, battery-operated LFA reader (Cube Reader, Chembio Diagnostics, Germany), which provided a numeric readout in arbitrary units (scale: 0-10,000, 0.1 increments) proportional to the IP-10 concentration in the test sample. The IP-10 LFA result was not shared with the participant.

If the participant had a routine VL completed in the 30 days prior to visit, this result was accessed and captured in the study database. If no routine VL result was available, the study team completed a VL test through using an aliquot of the venous blood collected.

Anti-coagulated venous blood samples were transported to the Clinical Laboratory Services in Cape Town where plasma was separated and cryopreserved within 4 hours of sample collection, prior to being shipped to Mondial Diagnostics for further test validation.

Laboratory procedures

Plasma HIV RNA levels (VL result) were determined according to routine practice using the Abbott Real-Time HIV1/2 Polymerase Chain Reaction (PCR) (reference test). Quantitative measurement of IP-10 concentrations in plasma samples was conducted at Mondial Diagnostics using the Human CXCL10/IP-10 Quantikine ELISA kit (R&D Systems, USA), according to manufacturer’s specifications. Plasma specimens were also blindly assayed with the IP-10 LFA using 1 µL of plasma sample from the same test batch as the one used for capillary blood at study sites. The outcome was determined by Cube Reader as well as visually by two independent readers (scale: 0-4, 0.5 increments). When the Cube Reader results differed ≥2-fold between plasma and capillary blood, the IP-10 LFA was repeated, and the average result of both tests was included in the analysis. The IP-10 LFA was validated using both capillary blood and plasma against HIV RNA levels and ELISA IP-10 measurements.

Statistical analysis

Proportions for categorical variables and the median and interquartile range (IQR) for continuous variables were calculated and compared using X2 and nonparametric Mann-Whitney U test, respectively. Spearman test was used to assess correlation coefficients for continuous variables. Logistic regression analysis with penalized likelihood was performed to assess the capacity of the IP-10 LFA and the socio-demographic and clinical variables to predict VF [17], defined as VL>1,000 copies/mL. A multivariable logistic regression model was built by including all variables with a p-value <0.20 in the bivariable analyses (IP-10 LFA values were fixed), followed by backward stepwise selection, where variables with p-values <0.05 could enter the model whereas a p-value <0.10 was required to be retained. A 5-fold cross-validation was used to estimate average accuracy. Receiver operating characteristic analyses were conducted to obtain the area under the curve (AUC), as well as sensitivity, specificity and predictive values for different IP-10 LFA cut-off values. Optimal cut-off values to screen for VF were selected prioritizing a sensitivity above 90%, as the IP-10 LFA was validated as a triage test. Stata version 16 was used for the analyses.

Cost-effectiveness analysis

We developed a decision tree model (Figure 1) to compare the current standard of care of using VL testing only for ART monitoring (Strategy 1, Supplementary Figure 1) with 3 alternative strategies integrating the IP-10 LFA combined with a confirmatory VL test (Supplementary Figure 2): i) IP-10 LFA + VL test performed immediately after an IP-10 positive result (Strategy 2a), ii) IP-10 LFA + VL test performed 3 months after an IP-10 positive result and after receiving enhanced adherence counselling (EAC) (Strategy 2b), and iii) IP-10 LFA + a second IP-10 LFA 3 months after an IP-10 positive result and EAC + VL test performed only among clients who test positive for the second IP-10 LFA (Strategy 2c). Considering that the IP-10 LFA was developed to be implemented in settings where access to VL testing is limited, we assessed its cost-effectiveness in Mozambique, where the global VL testing coverage was 61% with a VF prevalence of 20% in 2021 [18].

Figure 1.
  • Download figure
  • Open in new tab
Figure 1. 1a) A decision tree model for antiretroviral therapy (ART) monitoring comparing the standard of care of using viral load (VL) testing only in a two-step algorithm recommended by the World Health Organization with three proposed algorithms where the IP-10 lateral flow assay (LFA) is integrated combined with VL confirmatory testing: 1b) immediately after performing the IP-10 LFA; 1c) 3 months later after receiving enhanced adherence counselling (EAC); 1d) 3 months later after receiving EAC and after a second positive IP-10 LFA result.

Each branch depicts individual steps of ART monitoring algorithm and is conditional on the previous step. The grey square node represents a decision node, grey circular nodes represent chance nodes, and grey triangles illustrate terminal nodes. PLHIV: people living with HIV, VF: virological failure.

The analysis was conducted from the healthcare system perspective. We adopted a life-time horizon and simulated a cohort of 1,000 adults living with HIV who initiated ART at 25 years of age. Effects on health were measured using disability-adjusted life years (DALYs) averted, and new HIV infections averted (HIA). DALYs were derived from the disability weights according to the Global Burden of Disease Study 2019 [19]. We made the assumption that transmission only occurred from our cohort of 1,000 individuals to a number (n) of other individuals, with n taking values of 1 or 4 (low and high transmission scenarios, respectively). We assumed that all PLHIV with undiagnosed VF, and therefore untreated, generated new HIV cases. Costs included treatment (both first and second-line ART regimens) and monitoring, and we used unit costs of US$3 for IP-10 LFA and of US$51 for VL test (including reagents, transport and staff) [20]. Costs were expressed in 2022 US$ and we applied a 3% discount rate [21,22]. All data used are detailed in Supplementary Table 1. Results were expressed as incremental cost-effectiveness ratios (ICER), calculated as the additional costs to avert one disability-adjusted life year (DALY) or a new HIV infection. A one-way sensitivity analysis was undertaken to investigate the effect of uncertainty in model parameters. Microsoft Excel 2019 was used for the analyses.

Ethical considerations

The study protocol was approved by the University Health Research Ethics Committee in Cape Town (Approval Nr. N20/02/25) and the Clinical Research Ethical Committee of the Hospital Clinic in Barcelona (Approval Nr. HCB/2021/0656). All study participants completed informed consent.

Results

Participant characteristics

We enrolled 209 participants with a median age of 38 years (IQR, 31-44), of whom 83.7% (n=175) were women (Table 1). Median time since HIV diagnosis was 7 years (IQR, 4-10) and median time on ART was 6.5 years (IQR, 4.2-9.4). The most common treatment regimen was Tenofovir/Lamivudine/Dolutegravir (83.3%), and 87.1% reported not missing any ART dose during the last month.

View this table:
  • View inline
  • View popup
Table 1. Socio-demographic and clinical characteristics associated with virological failure (VF) (viral load >1,000 copies/mL) among study participants (n=209). Adjusted odds ratios from logistic regression analyses.

Median time since last VL determination was 7 days (IQR, 4-14). A total of 17.7% (95% CI, 12.5-22.9) had VF and among those, median VL was 10,615 copies/mL (IQR, 3,698-49,311). We excluded one participant from the evaluation of the IP-10 LFA performance analysis due to an invalid reading value.

Field performance

Median IP-10 LFA reading values, hereinafter referred to as ‘IP-10 LFA values’, were significantly higher among individuals with VF (24.0 vs 14.6; p<0.001). Among individuals (n=57) with detectable VL (>50 copies/mL), IP-10 LFA values showed a significant moderate correlation with VL (ρ=0.46, p<0.001).

Multivariable analysis revealed that IP-10 LFA values, self-reported ART adherence and time since HIV diagnosis were associated with VF (Table 1). The univariable analysis (Supplementary Table 2) showed that IP-10 LFA values were associated with VF (odds ratio (OR), 2.38 per 10 units-increase; 95%CI, 1.66-3.40). The estimated AUC was 0.76 (95%CI, 0.67-0.85) and the averaged 5-fold cross validated AUC was 0.77 (95%CI, 0.64-0.84).

Since no differences were found between the AUC of univariable and multivariable models, the former was selected for assessing the accuracy of IP-10 LFA in predicting VF at various cut-off values (Figure 2a). Using an IP-10 LFA value of ≥12.8, the model identified VF with 91.9% sensitivity (95%CI, 78.1%-98.3%) and 35.1% specificity (95%CI, 28.0%-42.7%) (Figure 2b) resulting in a positive predictive value (PPV) of 23.4% (95%CI, 16.8%-31.2%) and a negative predictive value (NPV) of 95.2% (95%CI, 86.7%-99.0%) in the current study population (17.7% VF prevalence) (Supplementary Figure 3).

Figure 2.
  • Download figure
  • Open in new tab
Figure 2. Performance of the IP-10 lateral flow assay (LFA) reading values (arbitrary units, Cube Reader) models in predicting virological failure (VF).

(a) Comparison between the area under the curve (AUC) for univariable and multivariable models. (b) Univariable model cut-off IP-10 LFA reading values with their respective sensitivity and specificity values.

Laboratory validations

Validation of the IP-10 LFA either on capillary blood or plasma against IP-10 ELISA demonstrated a good level of correlation between the two assays, which was higher when the IP-10 LFA was performed on plasma (ρ=0.89, p<0.001) compared to finger prick capillary blood (ρ=0.74, p<0.001) (Supplementary Figure 4). Overall, IP-10 LFA values measured in plasma were lower than in capillary blood but remained significantly higher among individuals with VF (median values of 16.6 vs. 11.9; p<0.001).

The AUC of the IP-10 LFA in plasma to detect VF was similar to capillary blood, regardless of whether the test was read by Cube Reader (0.77; 95%CI, 0.67-0.86) or visually (0.78; 95%CI, 0.69-0.87). When using a cut-off value of 10.7 for the Cube Reader and of 1.5 for visual results, the IP-10 LFA on plasma predicted VF with the same sensitivity as in blood, but the specificity increased to 43.6% (95%CI, 36.1%-51.4%) and 48.8% (95%CI, 41.2%-56.6%), respectively (Table 2).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2. Diagnostic accuracy of the IP-10 LFA compared to Real Time-Polymerase Chain Reaction (PCR) for the detection of virological failure (VF), defined as viral load >1,000 copies/mL.

Cost-effectiveness analysis

Costs and health outcomes associated with various ART monitoring strategies are reported in Table 3, ranked by costs in ascending order. In a low transmission scenario (1:1), Strategy 2b was the least expensive strategy with the greatest number of DALYs averted. Compared to the current standard of care (Strategy 1), Strategy 2b could reduce 1.1% of life-time costs and 10.1% of the DALYs associated with HIV. In a high transmission scenario (1:4), Strategy 2b was still the least expensive, associated not only with 13.0% lower costs compared to current standard of care, but also with 14.9% DALYs and 55.7% new HIV infections fewer. Compared to Strategy 2b, Strategy 2c was more expensive, but offered better health outcomes, so it was associated to an ICER of US$1,995and US$2,827 per DALY and HIA averted, respectively. Strategies 2b and 2c were estimated to reduce up to 46.9% and 67.9% respectively, of the total routine VL tests necessary for ART monitoring.

View this table:
  • View inline
  • View popup
Table 3. Health (DALYs and new HIV infections averted) and economic outcomes of antiretroviral therapy (ART) monitoring strategies. Strategies are listed and compared in order of lowest to highest cost, by low and high HIV transmission scenarios (1:1 and 1:4, respectively).

When comparing Strategy 2c against 2b, the one-way sensitivity analysis (Figure 3) showed that in a high transmission scenario when using the minimum value estimated for VF (10%) in Mozambique in 2021 [13], Strategy 2c was even more expensive but more effective than 2b with an ICER over US$7,500/DALY averted. However, when using the maximum value estimated for VF prevalence of 31% [13], Strategy 2c dominated Strategy 2b as it had lower costs and improved outcomes. Strategy 2c also dominated when decreasing VL coverage to 48% or VL specificity to 96.1%, and when increasing IP-10 LFA sensitivity to 98.3%. Lastly, we found that as the VL suppression rate after EAC decreased, the ICER comparing Strategy 2c against 2b also decreased. Results are detailed in Supplementary Table 3.

Figure 3.
  • Download figure
  • Open in new tab
Figure 3. Tornado diagram illustrating fluctuations on the incremental cost-effectiveness ratios (ICER) between the minimum (low) and maximum (high) values of individual model parameters in univariate sensitivity analysis in a high transmission scenario (1:4).

ICERs were estimated comparing Strategy 2c against Strategy 2b. Value for each parameter is substituted one by one. Dark grey colour represents the low value (lower 95% CI bound or minimum), while light grey colour represents the high value (upper bound of the 95% CI or maximum) of each of the parameters. The black vertical solid line represents the baseline value of the ICER (1,995 US$/DALY averted). The area shaded dotted grey represents a dominant scenario by Strategy 2c (lower costs and improved outcomes). Parameters that have the highest impact on the model are shown at the top, while the least impact is displayed at the bottom. *Strategy 2b dominated Strategy 2c (lower costs and improved outcomes), so the ICER was not estimated. DALY: disability-adjusted live years, EAC: enhanced adherence counselling, LFA: lateral flow assay, VL: viral load.

Discussion

This study demonstrated that the IP-10 LFA performed as a highly sensitive VF screening test and a cost-saving tool for ART monitoring in settings with limited access to VL testing. Integrating the IP-10 LFA combined with a confirmatory VL test would allow to rule out VF in PLHIV who are stable and test negative for IP-10 LFA, thus allowing to prioritize available VL capacity for those for whom treatment failure is suspected. Compared to the standard of care, the implementation of IP-10 LFA would expand access to better health outcomes for lower costs. The choice of using IP-10 LFA once (Strategy 2b) or twice (Strategy 2c) in the WHO-aligned algorithm is context-specific and would depend on local factors as well as the cost-effectiveness threshold.

Even though most of PLHIV with VF were identified by IP-10 testing, up to 8% yielded a false negative result. Especially in LMIC the consequences of such VF misdiagnosis need to be weighed against the morbidity and mortality risks associated with a higher proportion of PLHIV not having access to ART monitoring at all. Self-reported treatment adherence was a strong predictor of VF in this study; further investigation should explore if its assessment integrated in the algorithm can help identify IP-10 false negative results.

Regarding specificity, IP-10 is not specific to HIV and increases in other infections such as tuberculosis or COVID-19 [23,24]. With a moderate specificity, such as that observed in this study, approximately 43% of participants without VF would be correctly identified as such with the IP-10 test when using plasma, while the remaining 57% without VF would have a positive IP-10 LFA. HIV VL is also sensitive to conditions which activate the immune system such as co-infections and vaccines [25,26]. Nevertheless, based on the proposed implementation algorithms, individuals with a positive IP-10 result would receive EAC followed by a 3-month confirmatory VL testing, a non-invasive intervention of which the only consequence could be to reinforce their adherence to treatment.

This IP-10 LFA prototype performed as well as an ELISA test with a sensitivity >90% and a moderate specificity, which improved when using plasma (43%) instead of capillary blood (35%). This is likely due to the interindividual variation in hematocrit levels that affects the actual plasma volume being tested from a drop of capillary blood. Nevertheless, moderate specificity is a common feature of screening tests which typically require confirmation with a more specific diagnostic test [27].

Based on the economic evaluation, we estimated that the ART monitoring algorithm integrating the IP-10 LFA is superior to the standard of care DBS-based VL testing only in terms of costs and health outcomes. Despite the necessity of confirming positive IP-10 LFA results with VL testing, the introduction of the IP-10 LFA as a VF screening test could reduce more than a half the number of VL tests for routine ART monitoring.

The IP-10 LFA integrated in Strategy 2b was estimated to yield the lowest costs and to avert the greatest number of DALYs in a setting with low HIV transmission. In a high HIV transmission setting, Strategy 2c was demonstrated to be more effective than Strategy 2b, but at the expense of additional costs, US$1,995 for each additional DALY averted and US$2,827for each additional new HIA. Both ICERs were above the recommended cost-effectiveness threshold (CET) of US$250 to US$750 (0.5 to 1.5 times the gross domestic product per capita of Mozambique in 2021 [28,29], and alternative CET estimates based on opportunity costs [30,31]). Strategy 2c was hence not cost-effective when compared to Strategy 2b, although it was still less expensive with better health outcomes than standard of care. However, Strategy 2c demonstrated superiority to 2b (cheaper and more effective) when it was modelled in a scenario with a higher VF prevalence (parameter with the largest impact on the ICER), higher sensitivity of the IP-10 LFA (screening test) and lower specificity and coverage of the VL test (confirmatory test), the key determinants of the utility of a screening program prompting the use of a second screening with the IP-10 LFA [32]. Additionally, Strategy 2c appeared to be potentially cost-effective with an ICER of US$755 when the rate of VL suppression after receiving EAC was lower. This suggests that the use of the IP-10 LFA twice may be cost-effective in settings with a high prevalence of HIV drug resistance.

The major limitation of this study is the small sample size of PLHIV experiencing VF, resulting in relatively wide confidence intervals, especially for the sensitivity and NPV. Another potential limitation may be the interference of unidentified COVID-19 infections, participants with asymptomatic infections may have entered the study, and other undiagnosed co-infections. Future studies should explore the role of co-infections recruiting a higher number of PLHIV with VF to decrease the uncertainty of the estimates. Regarding the cost-effectiveness analysis, the model was static so the number of HIA may be underestimated [33]. Lastly, we found major pricing discrepancies of VL testing across the literature [34–37], but the cost of VL testing had only a minor effect on the ICER.

The IP-10 LFA is a low-cost and easy-to-read rapid test which can be performed by minimally trained personnel. It also offers the advantage of providing results to patients on the same day the test is performed, which can potentially have a positive influence on their behavior and adherence. Therefore, the IP-10 LFA represents a true POC screening test for VF [38] compared with the several POC VL testing technologies developed in recent years, including the WHO-prequalified Cepheid GeneXpert® and Abbott m-PIMA™, which are device-based semi-POC tests with limited portability and increased costs (US$25-US$30, reagents only) [37,39–41]. Moreover, the test read visually performed as well as when using a Cube Reader, with the potential of simplifying its use without the need of an extra device.

The advent of POC technologies coincides with the rollout of the differentiated HIV care models in many LMIC, new less resource-demanding and more client-centered services which typically focused on providing ART to stable PLHIV. The implementation of the IP-10 LFA would expand and improve the access to differentiated HIV care by a quicker triage of PLHIV on ART into differentiated care pathway, same-day results, fewer clinical visits and faster clinical making-decision [42]. The IP-10 LFA may also be amenable to community-based and self-testing, which helps improve access to ART monitoring particularly in hard-to-reach populations, such as people who inject drugs, migrants and PLHIV living in remote or conflict settings [43,44].

Conclusions

Combining a highly sensitive, low-cost IP-10 LFA-based VF screening with VL confirmatory testing in an optimized algorithm could provide a greatly needed ART monitoring tool with the potential to fill the gap in VL testing access in LMIC. Successful integration of the IP-10 LFA into HIV services must consider PLHIV needs, co-infections, clinic flows, staff training, quality control and supply chain management at decentralized sites. Thus, future studies to evaluate sustainability, acceptability and feasibility of this new IP-10 LFA, as well as to explore its utility in other potential high-risk groups, like children, adolescents, and pregnant women are highly recommended.

Competing interests

E.B and J.V. are employed by Mondial Diagnostics (Amsterdam, The Netherlands). R.P. is managing director of Mondial Diagnostics (Amsterdam, The Netherlands). All other authors have no conflict of interests to declare.

Authors’ contributions

P.B., T.R.W., D.N. and E.L.V. were responsible for conceptualization and study design. K.N., V.N., M.S. and Y.S. recruited subjects and collected and validated clinical data. K.N., V.N., M.S. and Y.S. coordinated sample collection and processing at the field. E.B. and J.V. performed biomarker quantification at the laboratory and validation of the data. A.S.L., E.B. and L.G. performed the statistical analysis. A.S.L., N.L. and F.R. performed the cost-effectiveness analysis. A.S.L., P.B., E.B., L.G., N.L., F.R., D.N. and E.L.V. interpreted the data. A.S.L. drafted the paper. P.B., E.B., M.S., R.P., T.B.W., D.N. and E.L.V, performed the critical data review and revision of manuscript writing. All authors read and approved the final version of the manuscript.

Funding

This work was supported by Mondial Diagnostics (Amsterdam, The Netherlands), the Severo Ochoa predoctoral fellowship by the Barcelona Institute of Global Health (ISGlobal) to A.S.L. and the European Respiratory Society (ERS) and the European Union (EU)’s H2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement [847462] to E.L.V (This publication reflects only the author’s view. The ERS, Research Executive Agency and EU are not responsible for any use that may be made of the information it contains).

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Supporting Information

Supporting Information file 1: Supplementary Table 1

Supporting Information file 2: Supplementary Table 2

Supporting Information file 3: Supplementary Table 3

Supporting Information file 4: Supplementary Figure 1

Supporting Information file 5: Supplementary Figure 2

Supporting Information file 6: Supplementary Figure 3

Supporting Information file 7: Supplementary Figures Legends

Acknowledgements

We acknowledge support from the Spanish Ministry of Science and Innovation and State Research Agency through the “Centro de Excelencia Severo Ochoa 2019-2023” Program (CEX2018-000806-S), and support from the Generalitat de Catalunya through the CERCA Program. The authors gratefully acknowledge the staff at the Kraaifontein Community Health Centre, the Ivan Toms Centre for health and the Bloekombos Clinic, in the Cape Metro, South Africa, who worked to collect and manage the data, our research team, collaborators, and especially all communities and participants involved.

Footnotes

  • E-mail addresses of authors:

    ASL: anna.saura{at}isglobal.org

    PB: peterb{at}sun.ac.za

    EB: erika.vandenbogaart{at}mondialdx.com

    JV: jessie23_09{at}hotmail.com

    LG: granes{at}clinic.cat

    KN: klnel{at}sun.ac.za

    VN: vikeshn{at}sun.ac.za

    MS: michellebuzzzinter{at}gmail.com

    YS: ysaunders{at}sun.ac.za

    NL: nuleal.roca{at}gmail.com

    FR: francesco.ramponi{at}isglobal.org

    RP: rene.paulussen{at}mondialdx.com

    TRW: t.rinkedewit{at}pharmaccess.org

    DN: denise.naniche{at}isglobal.org

List of abbreviations

AIGHD
Amsterdam Institute for Global Health and Development
ART
antiretroviral therapy
AUC
area under the curve
CI
confidence interval
DALY
disability-adjusted live years
DBS
dried blood spots
EAC
enhanced adherence counselling
HIA
HIV infections averted
ICER
incremental cost-effectiveness ratios
IQR
interquartile range
IP-10
interferon gamma-induced protein 10
ISGlobal
Barcelona Institute for Global Health
LFA
lateral flow assay
LMIC
low- and middle-income countries
OR
odds ratio
PCR
Polymerase Chain Reaction
PLHIV
people living with human immunodeficiency virus
POC
point-of-care
PPV
positive predictive value
NPV
negative predictive value
SSA
Sub-Saharan Africa
VF
virological failure
VL
viral load

References

  1. 1.↵
    Updated Recommendations on Service Delivery for the Treatment and Care of People Living with HIV. Updat Recomm Serv Deliv Treat Care People Living with HIV [Internet]. 2021 [cited 2021 Oct 8]; Available from: https://www.ncbi.nlm.nih.gov/books/NBK570385/
  2. 2.↵
    Rupérez M, Pou C, Maculuve S, Cedeño S, Luis L, Rodríguez J, et al. Determinants of virological failure and antiretroviral drug resistance in Mozambique. J Antimicrob Chemother [Internet]. 2015 Sep 1 [cited 2022 Oct 23];70(9):2639–47. Available from: https://pubmed.ncbi.nlm.nih.gov/26084302/
    OpenUrl
  3. 3.↵
    Gupta RK, Gregson J, Parkin N, Haile-Selassie H, Tanuri A, Andrade Forero L, et al. HIV-1 drug resistance before initiation or re-initiation of first-line antiretroviral therapy in low-income and middle-income countries: a systematic review and meta-regression analysis. Lancet Infect Dis [Internet]. 2018 Mar 1 [cited 2022 Oct 23];18(3):346–55. Available from: https://pubmed.ncbi.nlm.nih.gov/29198909/
    OpenUrl
  4. 4.↵
    Hamers RL, Rinke de Wit TF, Holmes CB. HIV drug resistance in low-income and middle-income countries. Lancet HIV [Internet]. 2018 Oct 1 [cited 2022 Oct 23];5(10):e588–96. Available from: http://www.thelancet.com/article/S2352301818301735/fulltext
    OpenUrl
  5. 5.↵
    Global HIV & AIDS statistics — Fact sheet | UNAIDS [Internet]. [cited 2022 Nov 2]. Available from: https://www.unaids.org/en/resources/fact-sheet
  6. 6.↵
    Pham MD, Nguyen H V., Anderson D, Crowe S, Luchters S. Viral load monitoring for people living with HIV in the era of test and treat: progress made and challenges ahead – a systematic review. BMC Public Health [Internet]. 2022 Dec 1 [cited 2022 Oct 23];22(1):1–23. Available from: https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-022-13504-2
  7. 7.↵
    Lecher S, Williams J, Fonjungo PN, Kim AA, Ellenberger D, Zhang G, et al. Progress with Scale-Up of HIV Viral Load Monitoring — Seven Sub-Saharan African Countries, January 2015–June 2016. MMWR Morb Mortal Wkly Rep. 2019 Dec 2;65(47):1332–5.
    OpenUrl
  8. 8.↵
    Lecher SL, Fonjungo P, Ellenberger D, Toure CA, Alemnji G, Bowen N, et al. HIV Viral Load Monitoring Among Patients Receiving Antiretroviral Therapy — Eight Sub-Saharan Africa Countries, 2013–2018. MMWR Morb Mortal Wkly Rep [Internet]. 2021 May 28 [cited 2022 Dec 5];70(21):775–8. Available from: https://www.cdc.gov/mmwr/volumes/70/wr/mm7021a2.htm
    OpenUrl
  9. 9.↵
    Pastor L, Casellas A, Carrillo J, Alonso S, Parker E, Fuente-Soro L, et al. IP-10 Levels as an Accurate Screening Tool to Detect Acute HIV Infection in Resource-Limited Settings. Sci Rep [Internet]. 2017 Dec 1 [cited 2022 Feb 12];7(1). Available from: https://pubmed.ncbi.nlm.nih.gov/28808319/
  10. 10.↵
    Pastor L, Casellas A, Rupérez M, Carrillo J, Maculuve S, Jairoce C, et al. Interferon γ Inducible Protein 10 (IP-10) as a Screening Tool to Optimize Human Immunodeficiency Virus RNA Monitoring in Resource-Limited Settings. Clin Infect Dis [Internet]. 2017 Nov 15 [cited 2022 Feb 12];65(10):1670–5. Available from: https://pubmed.ncbi.nlm.nih.gov/29020145/
    OpenUrl
  11. 11.↵
    Kroeze S, Wit FW, Rossouw TM, Steel HC, Kityo CM, Siwale M, et al. Plasma Biomarkers of Human Immunodeficiency Virus–Related Systemic Inflammation and Immune Activation in Sub-Saharan Africa Before and During Suppressive Antiretroviral Therapy. J Infect Dis [Internet]. 2019 Sep 9 [cited 2022 Oct 23];220(6):1029. Available from: /pmc/articles/PMC6688057/
    OpenUrl
  12. 12.↵
    Kehoe K, Boulle A, Tsondai PR, Euvrard J, Davies MA, Cornell M. Long-term virologic responses to antiretroviral therapy among HIV-positive patients entering adherence clubs in Khayelitsha, Cape Town, South Africa: a longitudinal analysis. J Int AIDS Soc. 2020;23(5).
  13. 13.↵
    Euvrard J, Schulz T, Hilderbrand K, Bosland M, Osler M, Boulle A, et al. How accurately do routinely reported HIV viral load suppression proportions reflect progress towards the 90-90-90 target in the population on antiretroviral treatment in Khayelitsha, South Africa? South African Med J. 2019;109(3):174–7.
    OpenUrl
  14. 14.↵
    Western Cape Department of Health. Routine antiretroviral programme report. 2021. Cape Town; 2021.
  15. 15.↵
    The Western Cape Consolidated Guidelines for HIV Treatment: Prevention of Mother- to- Child Transmission of HIV (PMTCT), Children, Adolescents and Adults. 2020. 2020.
  16. 16.↵
    Risk Assessment: COVID-19 | Covid-19 Response [Internet]. Available from: https://coronavirus.westerncape.gov.za/risk-assessment-covid-19
  17. 17.↵
    Firth D. Bias reduction of maximum likelihood estimate. Biometrika; 1993. 80:27–38.
    OpenUrlCrossRefWeb of Science
  18. 18.↵
    Ministério de Saúde de Moçambique. Serviço Nacional de Saúde. Relatório Anual das Actividades Relacionadas a HIV-SIDA 2021. Maputo, Moçambique; 2022.
  19. 19.↵
    WHO methods and data sources for global burden of disease estimates 2000-2019 [Internet]. Geneva; 2020. Available from: http://www.who.int/healthinfo/statistics/GlobalDALYmethods_2000_2011.pdf?ua=1
  20. 20.↵
    Korenromp EL, Gobet B, Fazito E, Lara J, Bollinger L, Stover J. Impact and Cost of the HIV/AIDS National Strategic Plan for Mozambique, 2015-2019—Projections with the Spectrum/Goals Model. PLoS One [Internet]. 2015 Nov 1 [cited 2022 Oct 23];10(11):e0142908. Available from: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0142908
    OpenUrl
  21. 21.↵
    Lipscomb J, Weinstein M, Torrance G. Time preference. In: Gold M, Siegel J, Russell L, Weinstein M, editors. Cost-Effectiveness in Health and Medicine. Oxford, New York; 1996.
  22. 22.↵
    Basu A, Ganiats T. Discounting in Cost-Effectiveness Analysis. In: Neumann P, Sanders G, Russel L, JE S, Ganiats T, editors. Cost-Effectiveness in Health and Medicine. Second Edi. New York: Oxford University Press; 2017. p. 277–88.
  23. 23.↵
    Liu M, Guo S, Hibbert JM, Jain V, Singh N, Wilson NO, et al. CXCL10/IP-10 in infectious diseases pathogenesis and potential therapeutic implications. Vol. 22, Cytokine and Growth Factor Reviews. 2011. p. 121–30.
    OpenUrlCrossRefPubMedWeb of Science
  24. 24.↵
    Haroun RAH, Osman WH, Eessa AM. Interferon-γ-induced protein 10 (IP-10) and serum amyloid A (SAA) are excellent biomarkers for the prediction of COVID-19 progression and severity. Life Sci [Internet]. 2021 Mar 15 [cited 2022 Oct 23];269. Available from: https://pubmed.ncbi.nlm.nih.gov/33454365/
  25. 25.↵
    Yek C, Gianella S, Plana M, Castro P, Scheffler K, García F, et al. Standard vaccines increase HIV-1 transcription during antiretroviral therapy HHS Public Access. AIDS. 2016;30(15):2289–98.
    OpenUrl
  26. 26.↵
    Bentwich Z. Concurrent infections that rise the HIV viral load. J HIV Ther. 2003;8(3):72– 75.
    OpenUrlPubMed
  27. 27.↵
    Screening programmes: a short guide. Increase effectiveness, maximize benefits and minimize harm. Copenhagen; 2020.
  28. 28.↵
    Iino H, Hashiguchi M, Hori S. Estimating the range of incremental cost-effectiveness thresholds for healthcare based on willingness to pay and GDP per capita: A systematic review. PLoS One [Internet]. 2022 Apr 1 [cited 2022 Nov 8];17(4):e0266934. Available from: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0266934
    OpenUrl
  29. 29.↵
    GDP per capita (current US$) - Mozambique | Data [Internet]. [cited 2022 Nov 8]. Available from: https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?locations=MZ
  30. 30.↵
    Woods B, Revill P, Sculpher M, Claxton K. Country-Level Cost-Effectiveness Thresholds: Initial Estimates and the Need for Further Research. Value Heal. 2016 Dec 1;19(8):929–35.
    OpenUrlCrossRef
  31. 31.↵
    Ochalek J, Lomas J, Claxton K. Estimating health opportunity costs in low-income and middle-income countries: a novel approach and evidence from cross-country data. BMJ Glob Heal [Internet]. 2018 [cited 2022 Nov 29];3:964. Available from: doi:10.1136/bmjgh-2018-000964
    OpenUrlCrossRef
  32. 32.↵
    Maxim LD, Niebo R, Utell MJ. Screening tests: a review with examples. Inhal Toxicol [Internet]. 2014 Nov 1 [cited 2022 Nov 10];26(13):811. Available from: /pmc/articles/PMC4389712/
  33. 33.↵
    WHO guide for standardization of economic evaluations pf immunization programmes [Internet]. Geneva; 2019. Available from: https://www.who.int/immunization/documents/who_ivb_19.10/en/
  34. 34.↵
    Médecins Sans Frontières (MSF). Achieving undetectable: what questions remain in scaling-up HIV. MSF Issue Br. 6, 1–20 (2015).
  35. 35.
    Médecins Sans Frontières (MSF). How low can we go? Pricing for HIV viral load testing in low- and middle-income countries. 41, 8 (2013).
  36. 36.
    Roberts T, Cohn J, Bonner K, Hargreaves S. Scale-up of Routine Viral Load Testing in Resource-Poor Settings: Current and Future Implementation Challenges. Clin Infect Dis [Internet]. 2016 Apr 4 [cited 2022 Nov 7];62(8):1043. Available from: /pmc/articles/PMC4803106/
    OpenUrl
  37. 37.↵
    Girdwood SJ, Crompton T, Sharma M, Dorward J, Garrett N, Drain PK, et al. Cost-effectiveness of adoption strategies for point of care HIV viral load monitoring in South Africa. EClinicalMedicine [Internet]. 2020 [cited 2022 Nov 7];28:100607. Available from: http://creativecommons.org/licenses/by/4.0/
  38. 38.↵
    Nichols JH. Utilizing Point-of-Care Testing to Optimize Patient Care. EJIFCC [Internet]. 2021 [cited 2022 Oct 23];32(2):140. Available from: /pmc/articles/PMC8343046/
    OpenUrl
  39. 39.↵
    Boeke CE, Joseph J, Atem C, Banda C, Coulibaly KD, Doi N, et al. Evaluation of near point-of-care viral load implementation in public health facilities across seven countries in sub-Saharan Africa. 2021 [cited 2022 Nov 7]; Available from: http://onlinelibrary.wiley.com/doi/10.1002/jia2.25663/full
  40. 40.
    WHO list of prequalified in vitro diagnostic products. Geneva: World Health Organization; 2020.
  41. 41.↵
    Id KS, Sharma M, Id JD, Naidoo J, Dlamini N, Moodley P, et al. Comparative cost analysis of point-of-care versus laboratory-based testing to initiate and monitor HIV treatment in South Africa. 2019 [cited 2022 Nov 7]; Available from: doi:10.1371/journal.pone.0223669
    OpenUrlCrossRef
  42. 42.↵
    Dorward J, Drain PK, Garrett N. Point-of-care viral load testing and differentiated HIV care. Lancet HIV [Internet]. 2018 Jan 1 [cited 2022 Dec 5];5(1):e8–9. Available from: http://www.thelancet.com/article/S2352301817302114/fulltext
    OpenUrl
  43. 43.↵
    Moyo S, Mohammed T, Wirth KE, Prague M, Bennett K, Holme MP, et al. Point-of-Care Cepheid Xpert HIV-1 Viral Load Test in Rural African Communities Is Feasible and Reliable. J Clin Microbiol [Internet]. 2016 Dec 1 [cited 2022 Oct 23];54(12):3050. Available from: /pmc/articles/PMC5121399/
    OpenUrl
  44. 44.↵
    Grimsrud A, Barnabas R V., Ehrenkranz P, Ford N. Evidence for scale up: The differentiated care research agenda. Vol. 20, Journal of the International AIDS Society. 2017.
Back to top
PreviousNext
Posted September 18, 2023.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Field performance and cost-effectiveness of a point-of-care triage test for HIV virological failure in Southern Africa
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Field performance and cost-effectiveness of a point-of-care triage test for HIV virological failure in Southern Africa
Anna Saura-Lázaro, Peter Bock, Erika van den Bogaart, Jessie van Vliet, Laura Granés, Kerry Nel, Vikesh Naidoo, Michelle Scheepers, Yvonne Saunders, Núria Leal, Francesco Ramponi, René Paulussen, Tobias Rinke de Wit, Denise Naniche, Elisa López-Varela
medRxiv 2023.09.18.23295705; doi: https://doi.org/10.1101/2023.09.18.23295705
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Field performance and cost-effectiveness of a point-of-care triage test for HIV virological failure in Southern Africa
Anna Saura-Lázaro, Peter Bock, Erika van den Bogaart, Jessie van Vliet, Laura Granés, Kerry Nel, Vikesh Naidoo, Michelle Scheepers, Yvonne Saunders, Núria Leal, Francesco Ramponi, René Paulussen, Tobias Rinke de Wit, Denise Naniche, Elisa López-Varela
medRxiv 2023.09.18.23295705; doi: https://doi.org/10.1101/2023.09.18.23295705

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • HIV/AIDS
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)