Skip to main content

Performance of four HRP-2/pLDH combination rapid diagnostic tests and field microscopy as screening tests for malaria in pregnancy in Indonesia: a cross-sectional study

Abstract

Background

Malaria in pregnancy poses a major public health problem in Indonesia with an estimated six million pregnancies at risk of Plasmodium falciparum or Plasmodium vivax malaria annually. In 2010, Indonesia introduced a screen and treat policy for the control of malaria in pregnancy at first antenatal visit using microscopy or rapid diagnostic tests (RDTs). A diagnostic study was conducted in Sumba, Indonesia to compare the performance of four different RDTs in predominately asymptomatic pregnant women under field condition.

Methods

Women were screened for malaria at antenatal visits using field microscopy and four HRP-2/pLDH combination RDTs (Carestart™, First-Response®, Parascreen® and SD-Bioline®). The test results were compared with expert microscopy and nested PCR. End user experience of the RDTs in the field was assessed by questionnaire.

Results

Overall 950 were recruited and 98.7 % were asymptomatic. The prevalence of malaria was 3.0–3.4 % by RDTs, and 3.6, 5.0 and 6.6 % by field microscopy, expert microscopy and PCR, respectively. The geometric-mean parasite density was low (P. falciparum = 418, P. vivax = 147 parasites/µL). Compared with PCR, the overall sensitivity of the RDTs and field microscopy to detect any species was 24.6–31.1 %; specificities were >98.4 %. Relative to PCR, First-Response® had the best diagnostic accuracy (any species): sensitivity = 31.1 %, specificity = 98.9 % and diagnostic odds ratio = 39.0 (DOR). The DOR values for Carestart™, Parascreen®, SD-Bioline®, and field microscopy were 23.4, 23.7, 23.5 and 29.2, respectively. The sensitivity of Pan-pLDH bands to detect PCR confirmed P. vivax mono-infection were 8.6–13.0 %. The sensitivity of the HRP-2 band alone to detect PCR confirmed P. falciparum was 10.3–17.9 %. Pan-pLDH detected P. falciparum cases undetected by the HRP-2 band resulting in a better test performance when both bands were combined. First Response® was preferred by end-users for the overall practicality.

Conclusion

The diagnostic accuracy to detect malaria among mostly asymptomatic pregnant women and perceived ease of use was slightly better with First-Response®, but overall, differences between the four RDTs were small and performance comparable to field microscopy. Combination RDTs are a suitable alternative to field microscopy to screen for malaria in pregnancy in rural Indonesia. The clinical relevance of low density malaria infections detected by PCR, but undetected by RDTs or microscopy needs to be determined.

Background

Malaria in pregnancy poses a major public health problem in Indonesia, where annually an estimated 6.3 million pregnancies are potentially at risk of Plasmodium falciparum or Plasmodium vivax malaria [1] and the corresponding risk of malaria associated maternal anaemia and low birth weight due to pre-term delivery or intra-uterine growth retardation [24]. Early detection and effective management of asymptomatic and symptomatic malaria is essential to reduce the burden of malaria in pregnancy.

Indonesia introduced a screen and treat policy for the control of malaria in pregnancy in 2010 [5]. It consists of screening all pregnant women for malaria at their first antenatal visit using microscopy or rapid diagnostic test (RDT), regardless of the presence or absence of symptoms. At subsequent antenatal visits, testing for malaria is done only in women with symptoms of malaria. Malaria positive women are treated with artemisinin-based combination therapy (ACT, dihydroartemisinin–piperaquine), except in the first trimester when quinine is used. Microscopy, remains the gold standard for malaria diagnosis in most health facilities. RDTs are used in the village based antenatal clinics.

The common immuno-chromatography based malaria RDTs detect the histidine rich protein-2 (HRP-2) antigen or parasite lactate dehydrogenase (pLDH) enzyme. The HRP-2/pLDH combination RDTs are commonly used in Indonesia and other Asian countries where multiple Plasmodium species are endemic. The HRP-2 antigen is specific for P. falciparum and Pan-pLDH detects all human infecting species [6, 7].

RDTs are essential for the success of the malaria in pregnancy screening programme. Numerous studies have shown the ability of HRP-2 based RDTs to detect P. falciparum in symptomatic population in areas of varying transmissions [813]. Few studies have evaluated RDTs in pregnancy [1416] and fewer as a screening test in pregnant women [1720], specially to detect P. vivax in asymptomatic women [2123], and under field conditions. The study aimed to assess the ability of RDTs to detect P. falciparum and P. vivax, in mostly asymptomatic pregnant women and to compare it against the performance of standard field microscopy. For this, a cross-sectional study was conducted in eastern Indonesia comparing four combination RDTs and field microscopy against expert microscopy and PCR to identify the RDT with highest diagnostic accuracy and field practicality to use as a screening test in rural antenatal clinics.

Methods

Study area and facilities

The study was conducted between March and July 2012 in south-west Sumba district in eastern Indonesia where malaria transmission is low and seasonal and varies substantially across sub-districts [24]. Prevalence of malaria in the general population (all age groups) in the rainy season (December–March) is 6.8 % with a predominance of P. falciparum. In the dry season (April–November) both P. falciparum and P. vivax are present in equal proportions with an overall prevalence of 4.9 % by PCR.

The study was conducted in ‘Posyandus’, which are village based community integrated activities held monthly that include provision of outreach antenatal care services provided by the primary health centres (Puskesmas). A total of 45 Posyandus were involved in the study, served by four Puskesmas in the sub-districts of Bondo-Kodi, Kori, Wallandimu and Pannengo-ede, each covering a catchment population of approximately 30,000 people and 10–11 villages.

Participant enrolment

Pregnant women of any gravidity aged between 15 and 49 years who attended the Posyandu for routine antenatal care were enrolled. A questionnaire consisting of socio-demographic information, obstetric history, history of fever and drug use, including malaria prevention measures was completed and the axillary temperature recorded. A finger prick blood sample was taken to simultaneously test the four RDTs, malaria microscopy and dried blood spots for PCR. Women testing positive for malaria with any RDT were treated according to the national policy which was a 3 day course of ACT (dihydroartemisinin–piperaquine) in the second and third trimester and 7 days of oral quinine in the first trimester.

Microscopy

Thick and thin smears were made on the same slide and stained with 5 % Giemsa. For the ‘field microscopy’, the smears were read by the staff microscopist at each of the four Puskesmas who were unaware of the RDT results. Thin smears were used to identify species. Expert microscopy consisted of re-examination of all the slides by the senior microscopist at the Malaria Laboratory-1, Eijkman Institute in Jakarta, who was blinded to field microscopy and RDT results. In cases of disagreement between field and expert microscopy, PCR result was taken as final. A slide was declared negative if parasites were absent after examining 200 high power fields. Parasite density was quantified against 300 leukocytes on an assumed leukocyte count of 8000 per µL of blood. Sub-microscopic infection was defined as parasites detected by PCR, but not by expert microscopy or RDT respectively.

Rapid diagnostic tests

The four RDTs included Parascreen Rapid Test Pan/Pf® (Zephyr Biomedical System, India, Catalogue No: 50310025), SD Bioline Malaria Ag Pf/Pan® (Standard Diagnostic Inc. Suwon City, South Korea, Catalogue No: 05FK60), the two RDTs used in the malaria control programme in Indonesia at the time of the study, and First Response Malaria pLDH/HRP-2 combo® (Premier Medical Corporation Ltd, India, Catalogue No: l16FRC30) and CareStart Malaria pLDH/HRP2 combo™ (Access Bio Inc., NJ, USA, Catalogue No: G0131), two of the best performing RDTs indicated in the WHO/FIND round 1–3 report [25]. Trained study staff performed and interpreted the RDTs according to the manufacturer’s instructions.

Accordingly, four drops of buffer were used for SD Bioline® and read within 15 min; for the other three RDTs two drops of buffer were used and was read within 20 min. Malaria positivity was defined if any of the HRP-2 or pLDH bands were visible (plus the control band). If only HRP-2 band plus control band was visible it was considered as a P. falciparum infection and visibility of only Pan-pLDH band was considered a P. vivax infection. When both bands were positive simultaneously it was considered a P. falciparum infection or a mixed infection.

Polymerase chain reaction

Nested PCR was performed on all samples to detect malaria parasites and for speciation. A blood sample was spotted on Whatman grade-1 filter paper, air-dried, placed in a plastic bag and transported to Jakarta. DNA was extracted with a 20 % Chelex solution and stored at −20 °C. Nested PCR based on the principle described by Snounou et al. [26] was used for genus and species specific analysis of P. falciparum and P. vivax. All ribosomal PCR positives samples were confirmed using mitochondrial DNA based PCR. Repeat mitochondrial PCR was performed for discordant P. vivax samples using KAPA2G™ Fast ReadyMix (2×) (KAPA Bio systems) containing all components for the PCR and the primers MitoPf-F 307 and MitoPf-R 5904 and adding 2 µL of DNA template. Species identification was done on PCR-Restriction Fragment Length Polymorphism (Rflp) using the restriction endonuclease enzyme Acl1. The amplicon was electrophoresed on 2 % agarose gel and the species specific DNA bands were viewed. Staff unaware of the microscopy and the RDT results performed PCR.

Quality control measures and RDT transport and storage

Room temperature and humidity in the RDT storage rooms in the Puskesmas were monitored and recorded using Tinytag™ Data Loggers with alarms set at 40 °C, the upper limit of temperature stability for SD Bioline®. The recorded data was saved into the main database and verified fortnightly. The maximum humidity recorded was 82.1 rh % and temperature ranged between 22.8 and 28.5 °C during the study period. To follow real-life field situations, environmental conditions in storage facilities were not controlled although excessive exposure to direct sunlight was avoided during RDT transportation. Individual kits were opened only at the time of testing and were checked for the presence of the desiccant. A single batch of each RDT with same LOT number purchased directly from the manufacturer was used.

End user experience

The ease of use and practicality of the study RDTs in the field situation was explored mid-way of the study. The Puskesmas midwives/nurses trained for the study were given a questionnaire to assess the readability and print clarity of information on the package exterior, ease of using the blood collecting devices, transferring blood to the RDT cassette and addition of buffer drops. Each parameter was scaled from easy, moderately easy and hard and the response frequency to each category calculated.

Sample size

A sample size of 940 pregnant women were estimated to be sufficient to compare RDTs with expert microscopy and PCR. Allowing for a 10 % loss of samples or unsuccessful tests a target sample size of 1045 women was estimated. An anticipated malaria prevalence of 10 % detectable by PCR was considered with reference to a previous study in the area [27]. This assumption would allow the detection of a sensitivity and specificity of 0.97 with a lower 95 % confidence limit >0.9 with 95 % probability.

Statistical analysis

Data were double entered and verified using XAMPP Windows 1.7.7. Frequencies and proportions were calculated using SPSS version 20.0. The results of the four RDTs and field microscopy were first compared against expert microscopy as the reference test. In subsequent analysis the RDTs, field and expert microscopy were compared against PCR (all samples) as the reference test, for any species (overall) and by specific RDT bands (HRP-2 and pLDH) against the species identified by PCR. For both sets of analyses, the sensitivity, specificity, positive and negative predictive values and likelihood ratios (LR) were calculated with corresponding 95 % confidence intervals (CI) using an online calculator which uses the efficient score method to calculate 95 % CI suitable for situations where the proportion is small and prevalence is low [28]. The diagnostic odds ratio (DOR) was used as a single summary indicator of test effectiveness independent of prevalence combining sensitivity and specificity, where DOR was defined as the ratio of the odds of positivity in those with malaria (defined by PCR or expert microscopy) relative to the odds of positivity in those without malaria. The DOR is also the ratio of the positive and negative likelihood ratio (LR+/LR−) [29].

Ethical approval

The study was approved by the Research and Ethical Committees of the Eijkman Institute for Molecular Biology, Indonesia and the Liverpool School of Tropical Medicine, UK. Written informed consent was obtained.

Results

A total of 950 women who attended the study Posyandus for antenatal care were enrolled between March and July 2012. Most women were indigenous to southwest Sumba (97.5 %) and lived in rural areas (100 %). Their mean age (SD) was 28.8 (6.2) years and 17.8 % were primigravidae. The proportion of women reporting ownership of long lasting insecticide treated nets (LLINs) was 29.9 % of whom 93.3 % reported to have slept under the net the previous night. A documented fever (≥37.5 °C) was present in 12 of 949 women (1.3 %) and 157 (16.5 %) reported a history of fever in the previous week of whom 31 (19.7 %) reported taking anti-malarial drugs.

Malaria prevalence detected by RDTs, microscopy and PCR

Overall a full set of results for the RDTs, blood smears and PCR samples were available from 934 of the 950 women. The remaining 16 women (1.7 %) were excluded from analysis because not all four RDT tests were successful or no microscopy results were available.

Malaria positivity by RDT (HRP2 or pLDH) ranged from 3.0 % (28 women) with Carestart™ to 3.4 % (32 women) with Parascreen® (Table 1). The higher number of positives with Parascreen® relative to Carestart™ was due to a higher number of positives by the HRP-2 band (21 versus 15). Overall, differences in results were greatest for the single Pan-pLDH band (which in the absence of a positive HRP-2 band is indicative of non-falciparum malaria infections) and positivity varied from 6.6 % with SD Bioline® to 21.4 % with Carestart™.

Table 1 Malaria detected by the four RDTs (HRP-2 and pLDH bands), microscopy and PCR

There were 34 (3.6 %) and 47 (5.0 %) malaria (any species) positives detected by field and expert microscopy respectively when both asexual and sexual stages were considered. Overall, 5 of the 34 (14.7 %) and 8 of the 47 (17.0 %) were positive for gametocytes by field and expert microscopy respectively. Expert microscopy detected 5 (10.6 %) mono infections with Plasmodium malariae and 5 (10.6 %) mixed infections with P. falciparum and P. vivax.

Overall infection prevalence by PCR was 6.6 % (all species) and 3.9 % were sub-patent infections (microscopy or RDT negative). Of the 62 positives identified by PCR, 39 (62.9 %) were with P. falciparum (32 mono-infections and seven mixed with P. vivax), and 23 (37.0 %) were P. vivax mono-infections. No infections with P. malariae were detected.

There were 31 women who had reported to have taken antimalarial drug in the previous week. Out of these, one women had all four RDTs positives, two women had a positive microscopy (6.4 %) and three women had a positive PCR (9.6 %) for any malaria.

Discriminating ability of the RDTs and field microscopy

PCR as reference test

Malaria overall (any species) (Table 2): The sensitivity and specificity of the RDTs to detect malaria (any species) (positive HRP-2 or Pan-pLDH band) against PCR was relatively similar for all four RDTs. The sensitivity ranged between 25.8 and 32.3 %. The specificity was >98.3 % for all RDTs. First Response® had the highest combination of sensitivity and specificity, reflected in the highest LR-positive, lowest LR-negative scores and the highest DOR value (41.0, 95 % CI 16.9–101.2). The DOR of Carestart™ (24.9), Parascreen® (−25.0) and SD Bioline® (24.9) were similar. The sensitivity of field microscopy was comparable to First Response®, but the specificity and the DOR (29.1) was lower.

Table 2 Accuracy indices of the RDTs and Field microscopy compared with expert microscopy and PCR to detect any malaria (HRP-2 or pLDH band; P. falciparum or P. vivax)

Plasmodium falciparum and single HRP-2 band (Table 3): The performance of the HRP-2-bands alone (i.e. ignoring the results of the Pan-pLDH band) to detect P. falciparum infections assessed by PCR, showed that the overall sensitivity ranged from 10.3 % with Carestart™ to 17.9 % with Parascreen® and First Response®. The PPV and DOR indices were highest for First Response® reflected by less false positives compared to other RDTS.

Table 3 Accuracy indices of the HRP-2 band and Field microscopy compared with expert microscopy and PCR to detect P. falciparum

Plasmodium falciparum and single Pan-pLDH band (Table 4): The accuracy of pLDH band alone to detect P. falciparum was assessed against PCR detected mono- P. falciparum (after exclusion of P. vivax mono or mixed infection from the analysis). The sensitivity ranged from 18.8 % with Parascreen® to 25.0 % with First Response®. The DOR was highest for SD Bioline® followed by First Response®.

Table 4 Accuracy indices of the pLDH band compared with expert microscopy and PCR to detect P. falciparum

Plasmodium falciparum and the combined HRP-2 and Pan-pLDH bands (Table 5): The accuracy of HRP-2 and pLDH positive bands to detect P. falciparum was evaluated with PCR confirmed P. falciparum (any). The sensitivities ranged between 30.7 and 41.0 %. The LR positive and DOR values ranged between 17.2 and 24.5 % for Carestart™ and 26.2 and 44.4 % for First Response®, respectively.

Table 5 Accuracy indices of the RDTs (HRP-2 and pLDH) bands compared with PCR to detect P. falciparum

Plasmodium vivax and Pan-pLDH band (Table 6): The performance of RDT to detect P. vivax was evaluated with PCR detected P. vivax mono-infections (after exclusion of P. falciparum mono or mixed infection from the analysis). The sensitivity to detect P. vivax was lower than for P. falciparum ranging from 8.7 % with SD Bioline® to 13.0 % with the other three RDTs. The DOR values ranged from 10.8 % with SD Bioline® to 16.9 % with Parascreen®. The field microscopy indices were relatively better for P. vivax detection with higher DOR values.

Table 6 Accuracy indices of the pLDH bands and Field microscopy compared with expert microscopy and PCR for the detection of P. vivax

Expert microscopy as reference test

Similar results were found when RDTs and field microscopy were compared against expert microscopy to detect any malaria (Table 2). Overall, the sensitivity remained modest for all four RDTs and for field microscopy with SD Bioline® scoring better LR-positive and DOR values. When the ability to detect P. falciparum by HRP-2 band was assessed, First Response® had a lower false positive score reflected by higher PPV and LR-positive relative to the other RDTs (Table 3). SD Bioline® indices to detect P. vivax by pLDH band were relatively better than the other RDTs.

RDT detection of malaria at different parasite densities

The geometric mean parasite density of P. falciparum assessed by expert microscopy was 418 parasites/µL (range 27–13,387 parasites/uL) and of P. vivax was 147 parasites/µL (range 27–5733 parasites/µL). Out of the 12 PCR confirmed expert microscopy positive P. falciparum cases, there was one case of mono-infection with P. falciparum at density <100 parasite/µL and this was negative by all four RDTs. Similarly, there were 6 cases out of the 11 P. vivax PCR confirmed positives which has densities of <100 parasites/µL detected by expert microscopy; none were detected by the RDTs (Fig. 1). The ability to detect low-density P. falciparum infections (101–499/μL) was comparable between Carestart™ (6/6) and First Response® (6/6) relative to Parascreen® and SD Bioline®. The detection of low-density P. vivax infections (100–499/μL) was similar in all RDTs (33.3 %).

Fig. 1
figure 1

Detection of Plasmodium falciparum and Plasmodium vivax by the HRP-2 and pLDH bands at different parasite densities. a P. falciparum detection by HRP-2bands in PCR positive cases stratified by microscopy density. Figures above the bars are HRP-2 positive bandscorresponding to each parasite threshold out of the total 12 PCR versus expert microscopy confirmed P. falciparum results; excludes mixed RDT infection. b. P. vivax detection by pLDH band in PCR positive cases stratified by microscopy density. Figures above the bars are the pLDH bands corresponding to each parasite threshold out of the total 11 PCR versus expert microscopy confirmed P. vivax results; none of the PCR confirmed vivax positives had parasite density >1000/μL; excludes mixed RDT infection

End user experience

The user practicality of the RDTs was evaluated among all the 50 study midwives/nurses performing RDTs in the study. Most respondents cited the pipette of SD Bioline® was the easiest to draw blood with (86.0 %) (Table 7), but to add blood into a sample well and for the overall ease of use of pipette, First Response® scored 88.0 and 96.0 % respectively followed by SD Bioline®. The least easy pipette to draw and dispense blood with was that of Parascreen®. All respondents found the buffer bottles comparatively easy to use and add the right amount of drops. First Response® scored highest for overall ease of use, whereas SD Bioline® scored highest for clarity and readability of printed information provided with the RDT.

Table 7 Response frequencies of the parameters assessed for end user practicality of the four RDTs

Discussion

The performance of SD Bioline®, Carestart™, First Response® and Parascreen® RDTs to screen mostly asymptomatic antenatal women for malaria were evaluated in four sub-districts of South west Sumba, Indonesia as a potential alternative to field microscopy. Overall the diagnostic accuracy, suggested that First Response® RDT had the best combined ability to detect both P. falciparum and P. vivax infections when compared against PCR. The diagnostic odds ratio (DOR) value for First Response®, as a single summary indicator of test performance, was lower than that observed for expert microscopy but higher than the 23–29 DOR values observed for the other RDTs. First Response® was also considered the easiest to use by the clinic staff. Nevertheless, the overall differences in performance of the four RDTs to detect malaria were small and importantly, comparable to field microscopy. Any of the four brands would probably be suitable as a potential alternative to field microscopy or for use in the clinics where microscopy is not available.

However, of note was the low sensitivity (26–32 %) of all four RDTs (and field microscopy) relative to PCR, which detected 2–3 additional infections for each infection detected by RDT. These findings are consistent with the known limitations of this current generation of RDTs and highlight the challenge of applying them as a screening test in asymptomatic pregnant women who on average will have much lower parasite densities when infected than symptomatic malaria patients, the intended population for whom most RDTs are used. The geometric mean parasite densities in those with detectable parasites by expert microscopy were low for both species, especially for P. vivax (418 parasites/µL for P. falciparum and 147 parasites/µL for P. vivax by expert microscopy). None of the infections (any species) below 100 parasites/µL were detected by RDTs, around the threshold level of detection for many RDTs [25].

The sensitivity was also low when compared against expert microscopy (43.0–47.0 %, any species) and lower than reported in previous studies in asymptomatic pregnant women during pregnancy and at delivery [13]. In addition to the low mean parasite densities mentioned above, other methodological differences could explain the lower sensitivity. First, the expert microscopist declared a slide negative after examining 200 instead of the commonly used 100 high power fields, thus doubling the volume of blood that was examined to enhance the sensitivity of microscopy. Second, several previous studies showed that diagnostic studies with imperfect gold standard such as microscopy can lead to bias, the direction of which depends on the correlation between the index and reference test [30]. To overcome this, some studies comparing RDT against microscopy use PCR as the resolver test. However, when PCR is conducted on discrepant samples only, it has potential for upward bias overestimating sensitivity and specificity [3133] compared to studies that also test a random sample of concordant negative samples as recommended by WHO [34], or conduct PCR on all samples regardless of the RDT and microscopy results, as done in this study. E.g. if only PCR was used for the discordant RDT-microscopy samples in our study, the sensitivity of the RDTs against expert microscopy would increase from 40–50 % to 75.0–87.0 %, comparable to findings in other low transmission areas such as in India where P. falciparum and P. vivax co-exist [10].

The sensitivity of the Pan-pLDH band to detect (PCR confirmed) P. vivax mono-infections (Table 6) was particularly low relative to PCR whereas field microscopy performed slightly better as indicated by higher DOR value (40 for field microscopy versus 10–12 for the Pan-pLDH RDTs bands). Six out of 11 infections detected by expert microscopy had densities below 100 parasites per/μL and none of them were detected by RDTs. The low parasite densities of P. vivax might explain the low sensitivity of the pLDH bands to detect P. vivax. Studies in Myanmar and Madagascar with comparable transmission level to Indonesia also found decreased accuracy of Pan-pLDH to P. vivax with decreasing parasite density [21, 35].

Interestingly, Pan-pLDH detected P. falciparum cases that were negative by the HRP-2 band resulting in a better test performance when results of both bands were combined (Table 5). It is not known whether genetic variation in P. falciparum histidine rich protein, such as described in parasites from the Peruvian Amazon [36], some of which lack PfHRP2 or PfHRP3, and the extensive variation observed recently as a possible cause of variable sensitivity of the HRP2 band among Indian P. falciparum parasite populations [37] exist in Indonesia and if they affect PfHRP concentrations.

The low parasite densities for P. vivax may also explain the lack of agreement between expert and field microscopy as none of the 8 smears classified as P. vivax by field microscopy (4 of which were PCR confirmed) were confirmed by expert microscopy, and none of the 13 P. vivax infections detected by expert microscopy (11 of which were PCR confirmed) were detected by field microscopy.

Comparison between other RDT studies in pregnancy and this study was problematic because of the differences in transmission level, endemic species, RDT brands and analysis method used. Earlier studies have used RDTs to diagnose placental malaria at delivery [15, 16, 38]. Most African studies have used HRP-2 based RDTs to diagnose malaria in pregnancy and assessed for P. falciparum detection [3941]. Other studies that used RDTs to screen pregnant women have used different brands at different transmission settings [18, 20].

To qualify for an effective screening test used in low malaria prevalent population, the RDTs should have an acceptable balance to “rule-out” and “rule-in” infections in asymptomatic women. The RDTs demonstrated these qualities for any malaria detection and their performance overall (any species) was similar to field microscopy. The high specificity and NPV indicated that the RDTs correctly identified non-infected women, which would avoid treating women without malaria.

The perceived ease of use by the field staff for the four RDTs were comparable. When the package readability was accounted for, SD Bioline® was favoured whereas First Response® was preferred for overall practicality including ease of blood transfer pipette and buffer usage. The loop pipette for blood transferring found in Parascreen® kit was preferred least, similar to studies elsewhere [42]. A very useful advantage of the RDTs over microscopy was that women could be shown the RDT results, which made the RDTs more acceptable to asymptomatic women and which is likely to enhance compliance with any 3-day ACT regimen required to treat the malaria infection.

Limitations of our study included the cross sectional study design, which limited determining when sub-microscopic infections may become patent and we were unable to follow women until delivery to correlate antenatal RDT findings with placental malaria. Batch quality Lot testing prior to using the RDTs was not performed. The study environment with dedicated research staff who were trained for the study and attention given to operational conditions, might not reflect the routine field situations.

Conclusions

The diagnostic accuracy to detect malaria among mostly asymptomatic pregnant women and perceived ease of use by field staff was slightly better with First Response®, but overall differences between the four RDTs were small and performance was comparable to field microscopy. Best test performance to detect P. falciparum was achieved by combining the results of both pLDH and the HRP-2 bands. Combination RDTs are a suitable alternative to field microscopy to screen for malaria in pregnancy in rural Indonesia. However both RDTs and field microscopy missed many infections detected by PCR, especially P. vivax infections. The clinical relevance of these low density infection needs to be determined further, as it may help determine whether preventive strategies such as intermittent preventive therapy in pregnancy (IPTp) may be more effective than single or repeated screening with RDTs during pregnancy.

References

  1. Dellicour S, Tatem AJ, Guerra CA, Snow RW, ter Kuile FO. Quantifying the number of pregnancies at risk of malaria in 2007: a demographic study. PLoS Med. 2010;7:e1000221.

    Article  PubMed Central  PubMed  Google Scholar 

  2. Desai M, ter Kuile FO, Nosten F, McGready R, Asamoa K, Brabin B, Newman RD. Epidemiology and burden of malaria in pregnancy. Lancet Infect Dis. 2007;7:93–104.

    Article  PubMed  Google Scholar 

  3. Poespoprodjo JR, Fobia W, Kenangalem E, Lampah DA, Warikar N, Seal A, McGready R, Sugiarto P, Tjitra E, Anstey NM, Price RN. Adverse pregnancy outcomes in an area where multidrug-resistant Plasmodium vivax and Plasmodium falciparum infections are endemic. Clin Infect Dis. 2008;46:1374–81.

    Article  PubMed Central  PubMed  Google Scholar 

  4. Nosten F, McGready R, Simpson JA, Thwai KL, Balkan S, Cho T, Hkirijaroen L, Looareesuwan S, White NJ. Effects of Plasmodium vivax malaria in pregnancy. Lancet. 1999;354:546–9.

    Article  CAS  PubMed  Google Scholar 

  5. Syafruddin DAR. The burden of malaria in pregnancy in south west sumba and Yayapura District, Papua in Eastern Indonesia. Jakarta: UNICEF; 2010.

    Google Scholar 

  6. Bell D, Wongsrichanalai C, Barnwell JW. Ensuring quality and access for malaria diagnosis: how can it be achieved? Nat Rev Microbiol. 2006;4:682–95.

    Article  CAS  PubMed  Google Scholar 

  7. Moody A. Rapid diagnostic tests for malaria parasites. Clin Microbiol Rev. 2002;15:66–78.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  8. Bell DR, Wilson DW, Martin LB. False-positive results of a Plasmodium falciparum histidine-rich protein 2-detecting malaria rapid diagnostic test due to high sensitivity in a community with fluctuating low parasite density. Am J Trop Med Hyg. 2005;73:199–203.

    CAS  PubMed  Google Scholar 

  9. Hopkins H, Bebell L, Kambale W, Dokomajilar C, Rosenthal PJ, Dorsey G. Rapid diagnostic tests for malaria at sites of varying transmission intensity in Uganda. J Infect Dis. 2008;197:510–8.

    Article  PubMed  Google Scholar 

  10. Singh N, Shukla MM, Shukla MK, Mehra RK, Sharma S, Bharti PK, Singh MP, Singh A, Gunasekar A. Field and laboratory comparative evaluation of rapid malaria diagnostic tests versus traditional and molecular techniques in India. Malar J. 2010;9:191.

    Article  PubMed Central  PubMed  Google Scholar 

  11. Taylor WRJ, Widjaja H, Basri H, Fryauff DJ, Ohrt C, Taufik, Tjitra E, Hoffman SL, Baso S, Richie TL. Assessing the Parasight (R)-F test in northeastern Papua, Indonesia, an area of mixed Plasmodium falciparum and Plasmodium vivax transmission. Am J Trop Med Hyg. 2002;66:649–52.

    PubMed  Google Scholar 

  12. Tjitra E, Suprianto S, Dyer M, Currie BJ, Anstey NM. Field evaluation of the ICT malaria P.f/P.v immunochromatographic test for detection of Plasmodium falciparum and Plasmodium vivax in patients with a presumptive clinical diagnosis of malaria in eastern Indonesia. J Clin Microbiol. 1999;37:2412–7.

    PubMed Central  CAS  PubMed  Google Scholar 

  13. Kattenberg JH, Ochodo EA, Boer KR, Schallig HD, Mens PF, Leeflang MM. Systematic review and meta-analysis: rapid diagnostic tests versus placental histology, microscopy and PCR for malaria in pregnant women. Malar J. 2011;10:321.

    Article  PubMed Central  PubMed  Google Scholar 

  14. Leke RFG, Djokam RR, Mbu R, Leke RJ, Fogako J, Megnekou R, Metenou S, Sama G, Zhou Y, Cadigan T, et al. Detection of the Plasmodium falciparum antigen histidine-rich protein 2 in blood of pregnant women: implications for diagnosing placental malaria. J Clin Microbiol. 1999;37:2992–6.

    PubMed Central  CAS  PubMed  Google Scholar 

  15. Mankhambo L, Kanjala M, Rudman S, Lema VM, Rogerson SJ. Evaluation of the OptiMAL rapid antigen test and species-specific PCR to detect placental Plasmodium falciparum infection at delivery. J Clin Microbiol. 2002;40:155–8.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  16. Singer LM, Newman RD, Diarra A, Moran AC, Huber CS, Stennies G, Sirima SB, Konate A, Yameogo M, Sawadogo R, et al. Evaluation of a malaria rapid diagnostic test for assessing the burden of malaria during pregnancy. Am J Trop Med Hyg. 2004;70:481–5.

    PubMed  Google Scholar 

  17. Dhorda M, Piola P, Nyehangane D, Tumwebaze B, Nalusaji A, Nabasumba C, Turyakira E, McGready R, Ashley E, Guerin PJ, Snounou G. Short report: performance of a histidine-rich protein 2 rapid diagnostic test, Paracheck Pf (R), for detection of malaria infections in Ugandan pregnant women. Am J Trop Med Hyg. 2012;86:93–5.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Tagbor H, Bruce J, Agbo M, Greenwood B, Chandramohan D. Intermittent screening and treatment versus intermittent preventive treatment of malaria in pregnancy: a randomised controlled non-inferiority trial. PLoS One. 2010;5:e14425.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  19. Tagbor H, Bruce J, Browne E, Greenwood B, Chandramohan D. Performance of the OptiMAL dipstick in the diagnosis of malaria infection in pregnancy. Ther Clin Risk Manag. 2008;4:631–6.

    PubMed Central  PubMed  Google Scholar 

  20. VanderJagt TA, Ikeh EI, Ujah IO, Belmonte J, Glew RH, VanderJagt DJ. Comparison of the OptiMAL rapid test and microscopy for detection of malaria in pregnant women in Nigeria. Trop Med Int Health. 2005;10:39–41.

    Article  CAS  PubMed  Google Scholar 

  21. Ashley EA, Touabi M, Ahrer M, Hutagalung R, Htun K, Luchavez J, Dureza C, Proux S, Leimanis M, Lwin MM, et al. Evaluation of three parasite lactate dehydrogenase-based rapid diagnostic tests for the diagnosis of falciparum and vivax malaria. Malar J. 2009;8:241.

    Article  PubMed Central  PubMed  Google Scholar 

  22. Cooke AH, Chiodini PL, Doherty T, Moody AH, Ries J, Pinder M. Comparison of a parasite lactate dehydrogenase-based immunochromatographic antigen detection assay (Optimal (R)) with microscopy for the detection of malaria parasites in human blood samples. Am J Trop Med Hyg. 1999;60:173–6.

    CAS  PubMed  Google Scholar 

  23. Iqbal J, Muneer A, Khalid N, Ahmed MA. Performance of the optimal test for malaria diagnosis among suspected malaria patients at the rural health centers. Am J Trop Med Hyg. 2003;68:624–8.

    PubMed  Google Scholar 

  24. Syafruddin D, Krisin, Asih P, Sekartuti, Dewi RM, Coutrier F, Rozy IE, Susanti AI, Elyazar IR, Sutamihardja A, et al. Seasonal prevalence of malaria in West Sumba district, Indonesia. Malar J. 2009;8:8.

  25. Who T. FIND: Malaria rapid diagnostic test performance : results of WHO product testing of malaria RDTs : round 3 (2010–2011). Geneva: World Health Organization; 2010.

    Google Scholar 

  26. Snounou G, Viriyakosol S, Zhu XP, Jarra W, Pinheiro L, Dorosario VE, Thaithong S, Brown KN. High-sensitivity of detection of human malaria parasites by the use of nested polymerase chain reactions. Mol Biochem Parasitol. 1993;61:315–20.

    Article  CAS  PubMed  Google Scholar 

  27. Rijken MJ, McGready R, Boel ME, Poespoprodjo R, Singh N, Syafruddin D, Rogerson S, Nosten F. Malaria in pregnancy in the Asia-Pacific region. Lancet Infect Dis. 2012;12:75–88.

    Article  PubMed  Google Scholar 

  28. Clinical Calculator-1. (http://vassarstats.net/clin1.html). Accessed 2 Oct 2015.

  29. Two way contingency table. (http://statpages.org/ctab2x2.html). Accessed 2 Oct 2015.

  30. Rutjes AWS, Reitsma JB, Di Nisio M, Smidt N, van Rijn JC, Bossuyt PMM. Evidence of bias and variation in diagnostic accuracy studies. Can Med Assoc J. 2006;174(4):469–76.

    Article  Google Scholar 

  31. Hadgu A. Discrepant analysis is an inappropriate and unscientific method. J Clin Microbiol. 2001;38:4301–2.

    Google Scholar 

  32. McAdam AJ. Discrepant analysis: how can we test a test? J Clin Microbiol. 2000;38:2027–9.

    PubMed Central  CAS  PubMed  Google Scholar 

  33. Hawkins DM, Garrett JA, Stephenson B. Some issues in resolution of diagnostic tests using an imperfect gold standard. Stat Med. 2001;20:1987–2001.

    Article  CAS  PubMed  Google Scholar 

  34. Bell D, Peeling RW. WHO-Regional Office for the Western Pacific/TDR: evaluation of rapid diagnostic tests: malaria. Nat Rev Microbiol. 2006;4:S34–8.

    Article  PubMed  Google Scholar 

  35. Ratsimbasoa A, Randriamanantena A, Raherinjafy R, Rasoarilalao N, Menard D. Which malaria rapid test for Madagascar? Field and laboratory evaluation of three tests and expert microscopy of samples from suspected malaria patients in Madagascar. Am J Trop Med Hyg. 2007;76:481–5.

    PubMed  Google Scholar 

  36. Cheng Q, Gatton ML, Barnwell J, Chiodini P, McCarthy J, Bell D, Cunningham J. Plasmodium falciparum parasites lacking histidine-rich protein 2 and 3: a review and recommendations for accurate reporting. Malar J. 2014;13:283.

    Article  PubMed Central  PubMed  Google Scholar 

  37. Kumar N, Singh JP, Pande V, Mishra N, Srivastava B, Kapoor R, Valecha N, Anvikar AR. Genetic variation in histidine rich proteins among Indian Plasmodium falciparum population: possible cause of variable sensitivity of malaria rapid diagnostic tests. Malar J. 2012;11:298.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  38. Mockenhaupt FP, Ulmen U, von Gaertner C, Bedu-Addo G, Bienzle U. Diagnosis of placental malaria. J Clin Microbiol. 2002;40:306–8.

    Article  PubMed Central  PubMed  Google Scholar 

  39. Kattenberg JH, Tahita CM, Versteeg IA, Tinto H, Traore Coulibaly M, D’Alessandro U, Schallig HD, Mens PF. Evaluation of antigen detection tests, microscopy, and polymerase chain reaction for diagnosis of malaria in peripheral blood in asymptomatic pregnant women in Nanoro, Burkina Faso. Am J Trop Med Hyg. 2012;87:251–6.

    Article  PubMed Central  PubMed  Google Scholar 

  40. Manirakiza A, Serdouma E, Heredeibona LS, Djalle D, Madji N, Moyen M, Soula G, Le Faou A, Delmont J. Rational case management of malaria with a rapid diagnostic test, Paracheck Pf(R), in antenatal health care in Bangui, Central African Republic. BMC Public Health. 2012;12:482.

    Article  PubMed Central  PubMed  Google Scholar 

  41. Minja DT, Schmiegelow C, Oesterholt M, Magistrado PA, Bostrom S, John D, Pehrson C, Andersen D, Deloron P, Salanti A, et al. Reliability of rapid diagnostic tests in diagnosing pregnancy-associated malaria in north-eastern Tanzania. Malar J. 2012;11:211.

    Article  PubMed Central  PubMed  Google Scholar 

  42. Luchavez J, Lintag ME, Coll-Black M, Baik F, Bell D. An assessment of various blood collection and transfer methods used for malaria rapid diagnostic tests. Malar J. 2007;6:149.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Authors’ contributions

RA, FtK, WH, DS conceived the study and RA, FtK designed it. RA led the field work, data analysis, interpretation and drafted the first manuscript. EIL was engaged in data collection, cleaning, analysis and contributed to data interpretation. JDJ contributed to data collection, data entry and cleaning. SSM assisted in field work and performed the PCR with input from PBSA. IER set up and managed the data entry screen. DS supervised the laboratory procedures and PCR quality control. FtK oversaw the study design and provided input to data analysis, interpretation and the drafting of first manuscript. All authors contributed to the final submitted version of the manuscript. All authors read and approved the final manuscript.

Acknowledgements

We thank the pregnant women who participated in the study, the study staff for data collection, the field and expert microscopist for examining the slides and Dr Fatmawaty Ahmad for her role in the field work. We appreciate the cooperation of the Heads of the Community Health Centres (Puskesmas) and midwife coordinators of the participating Puskesmas. We acknowledge the support of the Head of District Health Office and Malaria Section of the District Health Office, SW Sumba. Funding for this work was supported by a Special Service Agreement (SSA No: SSA/IDSA/2011/00002000-1) between the Liverpool School of Tropical Medicine, UK and UNICEF, Indonesia. The findings and conclusions in this paper are those of the authors and do not necessarily represent the views of the UNICEF, Indonesia.

Competing interests

The authors declare they have no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rukhsana Ahmed.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahmed, R., Levy, E.I., Maratina, S.S. et al. Performance of four HRP-2/pLDH combination rapid diagnostic tests and field microscopy as screening tests for malaria in pregnancy in Indonesia: a cross-sectional study. Malar J 14, 420 (2015). https://doi.org/10.1186/s12936-015-0943-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12936-015-0943-5

Keywords