Email updates

Keep up to date with the latest news and content from Malaria Journal and BioMed Central.

Open Access Highly Accessed Research

Evaluation of a rapid diagnostic test (CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test) for the diagnosis of malaria in a reference setting

Jessica Maltha1, Philippe Gillet2*, Emmanuel Bottieau2, Lieselotte Cnops2, Marjan van Esbroeck2 and Jan Jacobs12

Author Affiliations

1 Department of Medical Microbiology, Faculty of Health, Medicine and Life Sciences (FHML), Maastricht, The Netherlands

2 Department of Clinical Sciences, Institute of Tropical Medicine (ITM), Antwerp, Belgium

For all author emails, please log on.

Malaria Journal 2010, 9:171  doi:10.1186/1475-2875-9-171

The electronic version of this article is the complete one and can be found online at: http://www.malariajournal.com/content/9/1/171


Received:19 January 2010
Accepted:18 June 2010
Published:18 June 2010

© 2010 Maltha et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Malaria Rapid Diagnostic Tests (RDTs) are widely used for diagnosing malaria. The present retrospective study evaluated the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test targeting the Plasmodium falciparum specific antigen histidine-rich protein (HRP-2) and the pan-Plasmodium antigen lactate dehydrogenase (pLDH) in a reference setting.

Methods

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test was evaluated on a collection of samples obtained in returned international travellers using microscopy corrected by PCR as the reference method. Included were P. falciparum (n = 320), Plasmodium vivax (n = 76), Plasmodium ovale (n = 76), Plasmodium malariae (n = 23) and Plasmodium negative samples (n = 95).

Results

Overall sensitivity for the detection of P. falciparum was 88.8%, increasing to 94.3% and 99.3% at parasite densities above 100 and 1,000/μl respectively. For P. vivax, P. ovale and P. malariae, overall sensitivities were 77.6%, 18.4% and 30.4% respectively. For P. vivax sensitivity reached 90.2% for parasite densities above 500/μl. Incorrect species identification occurred in 11/495 samples (2.2%), including 8/320 (2.5%) P. falciparum samples which generated only the pan-pLDH line. For P. falciparum samples, 205/284 (72.2%) HRP-2 test lines had strong or medium line intensities, while for all species the pan-pLDH lines were less intense, especially in the case of P. ovale. Agreement between observers was excellent (kappa values > 0.81 for positive and negative readings) and test results were reproducible. The test was easy to perform with good clearing of the background.

Conclusion

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test performed well for the detection of P. falciparum and P. vivax, but sensitivities for P. ovale and P. malariae were poor.

Background

With an estimated 247 million cases yearly, malaria is one of the most prevalent infectious diseases, killing 881,000 persons annually [1]. Early diagnosis and treatment are necessary to prevent severe malaria and death. Microscopy still is the reference method for diagnosis, though expertise may be lacking in both endemic and non-endemic settings [2]. Malaria Rapid Diagnostic Tests (RDTs) were introduced in the nineties and have undergone many improvements. Initially two-band tests were used, consisting of a control line and a P. falciparum specific test line, either histidine-rich protein-2 (HRP-2) or P. falciparum specific lactate dehydrogenase (Pf-pLDH). The later developed three-band RDTs detect both a P. falciparum specific antigen and an antigen of the four Plasmodium species, either aldolase or pan Plasmodium-specific pLDH (pan-pLDH) [2]. By now more than 60 RDT brands and over 200 different products have been developed. Of those, the WHO and Foundation for Innovative New Diagnostics (FIND) evaluated 70 from 26 manufacturers [3,4]. Of these products, 39 are three-band tests that detect and differentiate P. falciparum from non-falciparum species. The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test is a three-band RDT detecting HRP-2 and pan-pLDH. The aim of the present study was to evaluate its performance in reference conditions when challenged against a collection of stored clinical samples comprising the four Plasmodium species.

Methods

Study design

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test was retrospectively evaluated in a reference laboratory on a panel of stored blood samples obtained in international travellers suspected of malaria. The reference method was microscopy corrected by Polymerase Chain Reaction (PCR). The study design was in compliance with the STARD guidelines for presentation of diagnostic studies [5].

Patients and Materials

A panel was selected from a collection of EDTA-blood samples stored at -70°C at the Institute of Tropical Medicine (ITM), Antwerp, Belgium. Between January 1996 and May 2009 these samples were obtained in patients suspected of malaria, including international travellers and, to a lesser extent, natives of endemic countries returning from visiting friends and relatives. Most of these samples were obtained in patients attending the outpatient clinic of the ITM, another part was sent by other Belgian laboratories to ITM for confirmation in the scope of the national reference laboratory. The samples collected at ITM were aliquoted and frozen at -70°C the day of collection. Between collection and storage, the samples remained a maximum of 8 hours at laboratory temperature (below 25°C). The samples submitted by Belgian laboratories for confirmation, were sent by mail and had been exposed to ambient temperature for the period of shipment (generally 24 hours, with a maximum of 48 hours). The delay and processing before storage at -70°C had been validated and were compliant with routine laboratory procedures. The selected panel included samples with the four malaria species at varying parasite densities as well as malaria-negative samples. The samples were classified in regions according to the United Nations classification of geographical region and composition [6].

Reference Method

All samples were blindly analyzed by microscopy and real-time polymerase chain reaction for diagnosis of malaria, species identification and determination of parasite density, as described previously [7]. A species-specific PCR was adapted from Rougemont et al as described previously [7,8]. In case of discordant results between microscopy and PCR, the result of PCR was used as the reference method.

Test platforms

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test is a lateral flow antigen detection test in a cassette format. It is a three-band RDT targeting HRP-2 and pan-pLDH. The presence of a unique HRP-2 line indicates an infection with P. falciparum, whereas a unique pan-pLDH line is found in infection with one or more of the non-falciparum species. The presence of both HRP-2 and pan-pLDH lines indicates an infection with P. falciparum or a mixed infection with P. falciparum and one or more of the non-falciparum species.

For the evaluation of CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test, test kits from four different lot numbers were used for evaluation, supplied in two kit presentations : a self-test kit containing 60 individually wrapped packages including cassette, lancet, assay buffer, sample pipette and instructions, and a kit designed for laboratory use with 25 individually packed cassettes. The test kits had been stored between 18°C and 24°C before use. All malaria tests carried out at ITM are accredited in accordance with the requirements of the standard NBN EN ISO 15189:2007.

Test procedures

Tests were performed according to the instructions of the manufacturer, except that the plastic transfer straws supplied in the kit were replaced by a transfer pipette (Finnpipette, Helsinki, Finland). Readings were carried out at daylight assisted by a standard electric bulb by three subsequent observers, of whom the first always was the one performing the tests. The first observer performed readings at 20 minutes (which is the reading time recommended by the manufacturer), followed by observers 2 and 3 within an additional 10 minutes. The observers were blinded to each other's readings and to the results of microscopy and PCR.

In case no control line appeared the test was considered invalid and was repeated. To score line intensities we used a scoring system of five categories as defined previously [7]: none (no line visible), faint (barely visible line), weak (paler than the control line), medium (equal to the control line) or strong (stronger than the control line). The test results were based on consensus agreement, which means that an identical result read by at least two out of three observers was withheld. In case of no consensus, the results of the first reader were considered.

To assess inter-observer agreement, results of positive and negative readings as well as line intensities were considered. Test reproducibility was evaluated by testing 15 samples representing all species at variable parasite densities on five consecutive occasions.

Statistical Analysis

Sensitivity and specificity were calculated separately for P. falciparum and the non-falciparum species with 95% confidence intervals (C.I.). The interpretation of test results for P. falciparum and the non-falciparum species is shown in Table 1. Samples with pure gametocytaemia were included among the P. falciparum species. The Pearson Chi-square test was used to determine significance of results, or in case of small sample size, a two-tailed Fisher's exact test. A p-value < 0.05 was considered as significant.

Table 1. Interpretation of test results

Inter-observer agreements for line intensities and positive and negative test results were expressed by kappa values for each pair of observers and by the percentage of overall agreement between the three observers. To assess strength of associations between line intensity readings and parasite densities Cramer's V for categorical variables was used [7]. To assess the potential interference of sample storage on test sensitivity, multivariate analysis (logistic regression) was used for each Plasmodium species separately. It was hypothesized that sensitivity declined in relation to (i) decreasing parasite densities (ii) longer duration of storage at -70°C and (iii) that there was an interaction between the parasite densities and the duration of storage (antigen degradation related to the amount of antigen present at the beginning). For the multivariate analysis, parasite densities were included after log10 transformation and declines of sensitivity were expressed as Odds ratios. Analyses were conducted using Stata11 (Stata Corporation, Texas, USA).

Analysis of species mismatch

In case of species mismatch (P. falciparum diagnosed as non-falciparum, or non-falciparum diagnosed as P. falciparum), the sample was retested with the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test and with two other RDTs (based on HRP-2 and HRP-2/pan-pLDH).

Ease of use

The technicians who performed the tests were asked to evaluate the kit's content and instructions for clarity, and problems and incidents during test performance were consequently recorded.

Ethical review

The study was approved by the Institutional Review Board of ITM and by the Ethical Committee of Antwerp University, Belgium.

Results

Sample collection

The samples were selected from the ITM collection, which consists of 1,200 samples. Mixed infections were excluded and only the first sample of each patient was considered. For P. falciparum, which is the most frequently retrieved species at ITM, a panel representing the different parasite densities, stages (including only gametocytes) and geographical origin, was selected. The final panel consisted of 590 samples including infections with P. falciparum (n = 320), Plasmodium vivax (n = 76), Plasmodium ovale (n = 76), Plasmodium malariae (n = 23) and Plasmodium negative samples (n = 95) (Table 2). These samples were obtained in 590 patients with a male:female ratio of 2.16:1. The median age was 35 years (range 1 - 84 years), only 15 patients (2.5%) were children under the age of five years. Table 3 shows the results of the microscopic identification corrected by PCR: of the 76 P. ovale samples, seven (9.2%) had originally been diagnosed as P. vivax by microscopy, and four out of 76 (5.3%) P. vivax samples had originally been diagnosed as P. ovale. The geographical distribution of the samples used is shown in Table 2. Samples were obtained in Africa (n = 444), Asia (n = 54), Latin America and the Caribbean (n = 12) and Oceania (n = 4). Of 76 samples no data on the geographic origin were known and could not be retrieved. Most (268/320, 83.8%) P. falciparum infections had been acquired in sub-Saharan Africa.

Table 2. Species distribution and geographical origin of the 590 samples used for evaluation of the CareStartTM Malaria HRP-2/pLDH (Pf/pan) Combo Test

Table 3. Samples tested: results of species identification by microscopy versus PCR

Test characteristics

No invalid test results were observed. One cassette was broken, and one blister contained no cassette. Table 4 shows the number of positive HRP-2 and pan-pLDH lines for all species. Tables 5 and 6 show the test characteristics according to parasite density. For P. falciparum, the overall sensitivity was 88.8%. Sensitivity was related to parasite density: it was 69.6% at parasite densities below 100/μl and increased to 94.3% and 99.3% at parasite densities above 100 and 1,000/μl respectively. Nineteen out of 28 false-negative samples had a parasite density below 100/μl (including five samples with pure gametocytaemia), eight had parasite densities ranging from 120 - 467/μl and the remaining sample had a parasite density of 703/μl. All of these infections had been acquired in sub-Saharan Africa. Eight (2.5%) P. falciparum samples only reacted with the pan-pLDH line and consequently represented species mismatch, as they were incorrectly diagnosed as non-falciparum species. Parasite densities of these samples ranged from 32 - 371/μl, except for one sample with a parasite density of 1,123/μl; all had been acquired in sub-Saharan Africa (Tables 3, 4 and 6). The species mismatch results were reproducible upon retesting with CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test. Additional testing of these samples with two other RDT brands (HRP-2 and HRP-2/pan-pLDH) scored five of them as P. falciparum; the three other samples, obtained in travellers returning from Ghana and DRC, were negative (parasite densities were 32, 70 and 210/μl).

Table 4. Test line results of the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test for all samples (n = 590)

Table 5. Sensitivities and specificities of CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test for the detection of P. falciparum

Table 6. Sensitivities and specificities of CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test for the detection of non-falciparum species

For the non-falciparum species, there were 80/175 (45.7%) samples correctly identified, two samples had both a visible HRP-2 and pan-pLDH line, a single sample showed a unique HRP-2 line and 91 samples showed no test line (Table 4). Species mismatch results were reproducible upon retesting with the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test: upon testing with two other RDT brands they were diagnosed as non-falciparum species. Overall sensitivities for P. vivax, P. ovale and P. malariae were 77.6%, 18.4% and 30.4% respectively (Table 6). None of the Plasmodium negative samples was scored as positive.

Line intensity reading

Tables 7 and 8 list the line intensity readings related to parasite density. For P. falciparum, the majority (205/284, 72.2%) of positive HRP-2 test lines was read as strong or medium, and 27.8% (79/284) were read as weak or faint. Pan-pLDH test lines were read as strong and medium in 129 (51.4%) and as weak or faint in 122 (48.6%) of 251 positive test lines. For the pan-pLDH line intensity in non-falciparum species, there was a clear difference between the three species: the P. vivax samples generated strong and medium line intensities in half (30/61, 49.2%) of positive samples, whereas P. ovale uniquely showed weak or faint lines. For P. malariae, 3 out of 7 positive pan-pLDH lines were read as medium line intensity.

Table 7. Line intensity consensus reading for the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test for HRP-2 according to parasite densities

Table 8. Line intensity consensus reading for the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test for pan-pLDH according to parasite densities

For both the HRP-2 and the pan-pLDH test lines, there was a significant relation between line intensity and parasite density with a substantial correlation (HRP-2: V = 0.353, p < 0.001; pan-pLDH: V = 0.590, p < 0.001), but there was considerable overlap between categories. For P. falciparum, faint HRP-2 lines occurred exclusively at parasite densities below 1,000/μl, whereas a strong HRP-2 line intensity indicated a parasite density higher than 100/μl in a vast majority of samples (128/139, 92.1%). In addition a pan-pLDH line of strong intensity indicated in all but four (114/117, 96.6%) P. falciparum samples a parasite density exceeding 1,000/μl. Of the latter four samples one had a parasite density of 930/μl and the three other samples had pure gametocytaemia. In case of species mismatch for both P. falciparum and non-falciparum species, line intensity readings were faint or weak for the discordant test lines.

Inter-observer agreement and reproducibility

For both HRP-2 and pan-pLDH lines, overall agreement and kappa values between pairs of observers for positive and negative readings were excellent, for line intensities they were good (Table 9). Most differences in line intensity readings between two observers occurred within one category of difference (218/231 (94.4%) and 288/294 (98.0%) for HRP-2 and pan-pLDH respectively).

Table 9. Overall agreement and inter-observer agreement between pairs of observers for the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test assay

The first observer (who read the test exactly within the recommended reading time of 20 minutes) tended to score weaker pan-pLDH test lines and less positive results compared to observer 2 and 3 (Figure 1), although the differences did not reach statistical significance. As a result, sensitivities for non-falciparum species were slightly higher for observers 2 and 3 (49.1% and 48.6%) compared to observer 1 (44.6%). On the other hand, observer 2 and 3 scored, on different occasions, two times a faint positive pan-pLDH test line in case of a negative sample. For HRP-2 no such tendencies in differences were observed.

thumbnailFigure 1. Pan-pLDH line intensity readings per observer.

Tables 10 and 11 list the results of reproducibility for HRP-2 and pan-pLDH. The results for HRP-2 and pan-pLDH lines were reproducible. For the HRP-2 lines, all differences occurred within a single category of intensity. In two samples this resulted in subsequent faint and negative readings. For the pan-pLDH lines, differences occurred within one (n = 5) and two (n = 2) line intensity categories, and two samples showed subsequent faint and negative readings.

Table 10. Reproducibility of the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test: HRP-2 line intensities

Table 11. Reproducibility of the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test: pan-pLDH line intensities

Effect of parasite density and duration of storage on test sensitivity

As suspected by the sensitivities shown in Tables 5 and 6, the relation between parasite densities and test sensitivities was statistically significant in a multivariate model for all four Plasmodium species (Table 12). In the same model, an effect of storage, i.e. lower sensitivities for samples stored for long versus short periods, was noted only for P. ovale. If only samples stored from 2001 onwards were considered, sensitivity for P. ovale (n = 38) was 29.0% (95% C.I. 15.4% - 45.9%).

Table 12. Effect of duration of storage and parasite density on the sensitivity for each Plasmodium species, multivariate analysis

Ease of use

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test was scored as easy to perform. The clearing of the test strip was good, and the test lines were easy visualized. The HRP-2 and pan-pLDH test lines showed slightly different color tones (more blue) as compared to the control line. The test instructions in the package insert were scored as clear and the use of pictures was well appreciated. There were slight discordances in interpretation of the test results between the instructions of the self-test kits and the laboratory kits. For instance, the former stated that only the absence of both the control line and the test lines should be read as invalid, whereas the instructions of the laboratory test mentioned the absence of the control line by itself as an invalid test. In addition, the self-test mentioned a positive HRP-2 and pan-pLDH line as positive for P. falciparum, whereas the laboratory test added the option of mixed infection with P. falciparum as well. Finally, the unique presence of a pan-pLDH test line should be considered as a P. vivax infection according to the instructions of the self-test kit, whereas the laboratory test more correctly mentioned the possibility of (mixed) infections by the three non-falciparum species.

Discussion

In this study, the performance of the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test was retrospectively evaluated on a large panel (n = 590) of samples obtained in returned travellers suspected of malaria. Overall sensitivity for the detection of P. falciparum was 88.8%, reaching 94.3% and 99.3% in samples with parasite densities above 100/μl and 1,000/μl respectively. Overall sensitivities for P. vivax, P. ovale and P. malariae were 77.6%, 18.4% and 30.4% respectively, reaching 90.2%, 31.7% and 50.0% for parasite densities above 500/μl. No positive results occurred among the Plasmodium negative samples; species mismatches occurred in 2.2% (11/495) of samples. Agreement between observers was good and test results were reproducible. The test was easy to perform with good clearing of the background. Test line intensities for the HRP-2 line were strong and medium in the majority of cases, but line intensities for the pan-pLDH lines were lower, especially in the case of P. ovale.

The evaluation of an RDT in a reference setting is a logical step preceding evaluations in field trials [9], but this retrospective approach has its limitations [7,10]. For instance, it was not possible to explore discordant or unexpected test results by reviewing patient files or by testing for interferences such as the rheumatoid factor. In addition, test conditions in the reference setting are more favourable compared to the field setting. Further, an influence of sample storage was apparent for P. ovale, resulting in a possible underestimation of the actual sensitivity. For the other species, no such effect was noted, and a previous prospective study showed no effect of storage on the stability of the HRP-2 antigen [11]. Finally, stringent criteria were used for defining test characteristics: the eight P. falciparum samples that showed only a pan-pLDH line were scored as "species mismatches", as this result represents a major diagnostic error, i.e. the misdiagnosis of a P. falciparum infection as a non-falciparum infection. However, these results could also be considered as a correct diagnosis of "malaria", thereby increasing the overall sensitivity up to 91.3%.

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test has recently been evaluated as part of the WHO/FIND Malaria RDT Evaluation Program [3]. This evaluation showed for P. falciparum and P. vivax detection rates (percentage of naturally infected diluted human samples detected by the product) of respectively 97.5% and 90.0% at parasite densities of 200/μl, and detection rates of 100.0% and 95.0% at parasite densities of 2,000-5,000/μl [3].

The detection rates as demonstrated by WHO/FIND are slightly higher as compared to the sensitivities found in the present study, but the differences were not statistically significant. Comparisons are difficult as the present study included unprocessed clinical samples with a wild range of parasite densities and the WHO/FIND evaluation used series of diluted samples at fixed parasite densities (200/μl and 2,000-5,000/μl).

A similar product of the same company, the CareStart™ Pf/Pv Combo (detecting HRP-2 and P. vivax-specific pLDH) has been evaluated in Ethiopia [12]. This study reported higher sensitivities for P. falciparum (99.4%). However, it included exclusively P. falciparum samples with parasite densities above 100/μl, which is above the detection threshold of most RDTs. In addition, small differences may also be explained by the fact that we included P. falciparum samples with pure gametocytaemia as positive samples: in the scope of travel medicine this is a reasonable option [13], but in the present study five out of 17 samples did not react with the HRP-2 line and hence decreased overall sensitivity. Another product of the same company, the CareStart™ Malaria pLDH (Pf/pan) Combo Test has been evaluated in a field study in Madagascar [14]. This study reported sensitivities for P. falciparum that are comparable to the present one, including low values at parasite densities < 100/μl (60,0%) and increasing sensitivity at higher parasite densities (100% at > 500/μl). For P. vivax there were only nine samples included, making comparison difficult. The same product (CareStart™ Malaria pLDH (Pf/pan) Combo Test) and another product of the CareStart™ brand (Malaria pLDH (pan)) have recently been evaluated in Myanmar [15]. Reported sensitivities for the detection of P. vivax were significantly higher than those found in the present study in case of the CareStart™ Malaria pLDH (pan) (91.0%), but for the CareStart™ Malaria pLDH (pan/Pf) they were in line with the present findings (78.5%). Studies evaluating other RDTs in non-endemic countries report similar sensitivities as those found for the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test in the present study: for P. falciparum they ranged from 87.5-99.0%, with one exception of 76.2% [7,10,16-21]. For P. vivax, RDTs detecting pan-pLDH showed sensitivities of 33.5% and 62.0%-95.0%,[7,10,13,18,20,22] compared to 46.0%-93.0% [13] for those RDTs targeting aldolase. The increase of sensitivities at higher parasite densities is a well-known phenomenon with breakpoints around 100/μl (P. falciparum) and 500/μl (P. vivax) [7,10,13,22,23].

Unlike the WHO/FIND evaluation, the present study included P. ovale and P. malariae samples, for which sensitivities were poor. Previous studies that included P. ovale or P. malariae species reported sensitivities for these species combined between 36 - 95% for pan-pLDH and 7 - 80% for aldolase based RDTs [13]. In addition, a previous study with a study design similar to the present one reported sensitivities for P. ovale and P. malariae of 76.3% and 45.2% respectively [7]. Even taken into account an underestimation of the sensitivity for P. ovale (due to an effect of sample storage), the presently found low sensitivities for P. ovale and P. malariae are of concern given the name and the claimed performance of the test. In a field study however, a related RDT of the same company, the CareStart™ two-band RDT targeting pan-pLDH, detected all six P. malariae infections, though parasite densities were not given [24].

Of note, in the present study there were eight P. falciparum samples (2.5%) that gave a reaction only with the pan-pLDH line but not with the HRP-2 line. Geographic origin of samples probably did not contribute to the species mismatch, as all eight samples were from patients on their return from sub-Saharan Africa where HRP-2 mutations have not yet been described [25]. Low parasite densities close to the detection threshold may explain for the failure of HRP-2 detection of these samples. This species mismatch is of concern, because misdiagnosis of P. falciparum infection and therefore treatment with ineffective drugs can have fatal consequences [26].

In line with studies on other RDTs [7,16,27,28], there was a correlation between line intensities and parasite densities, and there were, although to a lesser extent than observed for another RDT [7], diagnostic clues to parasite densities when scoring line intensities (such as a strong HRP-2 line intensity indicating a parasite density > 100/μl). The low intensities of the pan-pLDH lines, especially for the non-falciparum species, are of concern especially when extrapolating the present findings to field settings in both endemic and non-endemic settings, where disregarding faint test lines as negative results is a common mistake [29-33].

The agreement between observers was excellent for positive and negative readings and good for line intensity readings, and test reproducibility was also good. Of interest is the observation that reading beyond the reading time increased the number of positive pan-pLDH lines, with an increase in sensitivity (although not significantly) at the expense of a slightly lower specificity. Antigen-antibody reactions are time dependent, explaining for the increase in sensitivity, but on the other hand, the so-called backflow phenomenon (non-specific binding) may have interfered, explaining for the apparently false-positive reactions observed by one out of three readers in the Plasmodium negative samples [34].

The CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test was scored as easy to perform by the present team. The good clearance of the background facilitated reading of faint and weak test lines but the difference in color tone between control and test lines hindered reading of test line intensity. Slight improvements to the package insert and manufacturer's instructions are to be expected, especially with regards to interpretation of the test results. This is of particular concern in the case of the self-test kit, designed for travellers or expatriates, who are among the most inexperienced end-users [19,35].

In conclusion, the present study demonstrated that the CareStart™ Malaria HRP-2/pLDH (Pf/pan) Combo Test performs well for the detection of P. falciparum and P. vivax infections, but poorly for P. ovale and P. malariae. The occasional species mismatches, in particular P. falciparum samples identified as non-falciparum species, are to be explored and improvements in test instructions should be made.

List of abbreviations

CI: Confidence interval; EDTA: Ethylene diamine tetra-acetic acid; FIND: Foundation for Innovative New Diagnostics; HRP-2: Histidine-rich protein 2; ITM: Institute of Tropical Medicine; pan-pLDH: pan Plasmodium-specific parasite lactate dehydrogenase; PCR: Polymerase chain reaction; Pf-pLDH: Plasmodium falciparum-specific parasite lactate dehydrogenase; pLDH: Plasmodium-specific parasite lactate dehydrogenase; Pv-pLDH: Plasmodium vivax-specific parasite lactate dehydrogenase; RDT(s): Rapid diagnostic test(s); STARD: Standards for reporting of diagnostic Accuracy; WHO: World Health Organization.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

JM, PG and JJ designed the study protocol. MvE and EB organized prospective sample collection. JM and PG carried out the test evaluations, LC performed PCR analysis. JM, PG and JJ analyzed and interpreted the results and JM drafted the manuscript. JM performed statistical analysis. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank the staff of the Central Laboratory of Clinical Biology (ITM, Antwerp) for technical support.

References

  1. World Health Organization: World Malaria Report 2008. [http://www.who.int/malaria/wmr2008/malaria2008.pdf] webcite

    2008.

  2. Moody A: Rapid diagnostic tests for malaria parasites.

    Clin Microbiol Rev 2002, 15:66-78. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. World Health Organization: Malaria Rapid Diagnostic Test Performance; Results of WHO product testing of malaria RDTs: Round 1 (2008). [http:/ / www.finddiagnostics.org/ resource-centre/ reports_brochures/ malaria-diagnostics-report-2009.htm l] webcite

    2009.

  4. World Health Organization: Malaria Rapid Diagnostic Test Performance; Results of WHO product testing of malaria RDTs: Round 2 (2009). [http:/ / www.finddiagnostics.org/ resource-centre/ reports_brochures/ malaria-diagnostic-test-report-roun d2.html] webcite

    2010.

  5. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Moher D, Rennie D, de Vet HC, Lijmer JG: The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. The Standards for Reporting of Diagnostic Accuracy Group.

    Croat Med J 2003, 44:639-650. PubMed Abstract | Publisher Full Text OpenURL

  6. United Nations: Composition of macro geographical (continental) regions, geographical sub-regions, and selected economic and other grouping. [http://unstats.un.org/unsd/methods/m49/m49regin.htm] webcite

    2010.

  7. Van der Palen M, Gillet P, Bottieau E, Cnops L, Van Esbroeck M, Jacobs J: Test characteristics of two rapid antigen detection tests (SD FK50 and SD FK60) for the diagnosis of malaria in returned travellers.

    Malar J 2009, 8:90. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  8. Rougemont M, Van Saanen M, Sahli R, Hinrikson HP, Bille J, Jaton K: Detection of four Plasmodium species in blood from humans by 18S rRNA gene subunit-based and species-specific real-time PCR assays.

    J Clin Microbiol 2004, 42:5636-5643. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Bell D, Wongsrichanalai C, Barnwell JW: Ensuring quality and access for malaria diagnosis: how can it be achieved?

    Nat Rev Microbiol 2006, 4:682-695. PubMed Abstract | Publisher Full Text OpenURL

  10. Gillet P, Bosselaers K, Cnops L, Bottieau E, Van Esbroeck M, Jacobs J: Evaluation of the SD FK70 malaria Ag Plasmodium vivax rapid diagnostic test in a non-endemic setting.

    Malar J 2009, 8:129. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  11. Mayxay M, Pukrittayakamee S, Chotivanich K, Looareesuwan S, White NJ: Persistence of Plasmodium falciparum HRP-2 in successfully treated acute falciparum malaria.

    Trans R Soc Trop Med Hyg 2001, 95:179-182. PubMed Abstract | Publisher Full Text OpenURL

  12. Sharew B, Legesse M, Animut A, Jima D, Medhin G, Erko B: Evaluation of the performance of CareStart Malaria Pf/Pv Combo and Paracheck Pf tests for the diagnosis of malaria in Wondo Genet, southern Ethiopia.

    Acta Trop 2009, 111:321-324. PubMed Abstract | Publisher Full Text OpenURL

  13. Marx A, Pewsner D, Egger M, Nuesch R, Bucher HC, Genton B, Hatz C, Juni P: Meta-analysis: accuracy of rapid tests for malaria in travelers returning from endemic areas.

    Ann Intern Med 2005, 142:836-846. PubMed Abstract OpenURL

  14. Ratsimbasoa A, Randriamanantena A, Raherinjafy R, Rasoarilalao N, Menard D: Which malaria rapid test for Madagascar? Field and laboratory evaluation of three tests and expert microscopy of samples from suspected malaria patients in Madagascar.

    Am J Trop Med Hyg 2007, 76:481-485. PubMed Abstract | Publisher Full Text OpenURL

  15. Ashley EA, Touabi M, Ahrer M, Hutagalung R, Htun K, Luchavez J, Dureza C, Proux S, Leimanis M, Lwin MM, Koscalova A, Comte E, Hamade P, Page AL, Nosten F, Guerin PJ: Evaluation of three parasite lactate dehydrogenase-based rapid diagnostic tests for the diagnosis of falciparum and vivax malaria.

    Malar J 2009, 8:241. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  16. Farcas GA, Zhong KJ, Lovegrove FE, Graham CM, Kain KC: Evaluation of the Binax NOW® ICT test versus polymerase chain reaction and microscopy for the detection of malaria in returned travelers.

    Am J Trop Med Hyg 2003, 69:589-592. PubMed Abstract | Publisher Full Text OpenURL

  17. Gatti S, Gramegna M, Bisoffi Z, Raglio A, Gulletta M, Klersy C, Bruno A, Maserati R, Madama S, Scaglia M: A comparison of three diagnostic techniques for malaria: a rapid diagnostic test (NOW Malaria), PCR and microscopy.

    Ann Trop Med Parasitol 2007, 101:195-204. PubMed Abstract | Publisher Full Text OpenURL

  18. Grobusch MP, Hanscheid T, Gobels K, Slevogt H, Zoller T, Rogler G, Teichmann D: Comparison of three antigen detection tests for diagnosis and follow-up of falciparum malaria in travellers returning to Berlin, Germany.

    Parasitol Res 2003, 89:354-357. PubMed Abstract | Publisher Full Text OpenURL

  19. Jelinek T, Grobusch MP, Nothdurft HD: Use of dipstick tests for the rapid diagnosis of malaria in non-immune travelers.

    J Travel Med 2000, 7:175-179. PubMed Abstract | Publisher Full Text OpenURL

  20. Wiese L, Bruun B, Baek L, Friis-Moller A, Gahrn-Hansen B, Hansen J, Heltberg O, Hojbjerg T, Hornstrup MK, Kvinesdal B, Gomme G, Kurtzhals JA: Bedside diagnosis of imported malaria using the Binax Now malaria antigen detection test.

    Scand J Infect Dis 2006, 38:1063-1068. PubMed Abstract | Publisher Full Text OpenURL

  21. Wongsrichanalai C, Barcus MJ, Muth S, Sutamihardja A, Wernsdorfer WH: A review of malaria diagnostic tools: microscopy and rapid diagnostic test (RDT).

    Am J Trop Med Hyg 2007, 77:119-127. PubMed Abstract | Publisher Full Text OpenURL

  22. De Monbrison F, Gerome P, Chaulet JF, Wallon M, Picot S, Peyron F: Comparative diagnostic performance of two commercial rapid tests for malaria in a non-endemic area.

    Eur J Clin Microbiol Infect Dis 2004, 23:784-786. PubMed Abstract | Publisher Full Text OpenURL

  23. Richardson DC, Ciach M, Zhong KJ, Crandall I, Kain KC: Evaluation of the Makromed dipstick assay versus PCR for diagnosis of Plasmodium falciparum malaria in returned travelers.

    J Clin Microbiol 2002, 40:4528-4530. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  24. Fogg C, Twesigye R, Batwala V, Piola P, Nabasumba C, Kiguli J, Mutebi F, Hook C, Guillerm M, Moody A, Guthmann JP: Assessment of three new parasite lactate dehydrogenase (pan-pLDH) tests for diagnosis of uncomplicated malaria.

    Trans R Soc Trop Med Hyg 2008, 102:25-31. PubMed Abstract | Publisher Full Text OpenURL

  25. Baker J, McCarthy J, Gatton M, Kyle DE, Belizario V, Luchavez J, Bell D, Cheng Q: Genetic Diversity of Plasmodium falciparum Histidine-Rich Protein 2 (PfHRP2) and Its Effect on the Performance of PfHRP2-Based Rapid Diagnostic Tests.

    J Infect Dis 2005, 192:870-877. PubMed Abstract | Publisher Full Text OpenURL

  26. World Health Organization: Guidelines for the treatment of malaria. [http://www.who.int/malaria/docs/TreatmentGuidelines2006.pdf] webcite

    2006.

  27. Mason DP, Kawamoto F, Lin K, Laoboonchai A, Wongsrichanalai C: A comparison of two rapid field immunochromatographic tests to expert microscopy in the diagnosis of malaria.

    Acta Trop 2002, 82:51-59. PubMed Abstract | Publisher Full Text OpenURL

  28. Pieroni P, Mills CD, Ohrt C, Harrington MA, Kain KC: Comparison of the ParaSight™-F test and the ICT Malaria Pf™ test with the polymerase chain reaction for the diagnosis of Plasmodium falciparum malaria in travellers.

    Trans R Soc Trop Med Hyg 1998, 92:166-169. PubMed Abstract | Publisher Full Text OpenURL

  29. Craig MH, Bredenkamp BL, Williams CH, Rossouw EJ, Kelly VJ, Kleinschmidt I, Martineau A, Henry GF: Field and laboratory comparative evaluation of ten rapid malaria diagnostic tests.

    Trans R Soc Trop Med Hyg 2002, 96:258-265. PubMed Abstract | Publisher Full Text OpenURL

  30. Harvey SA, Jennings L, Chinyama M, Masaninga F, Mulholland K, Bell DR: Improving community health worker use of malaria rapid diagnostic tests in Zambia: package instructions, job aid and job aid-plus-training.

    Malar J 2008, 7:160. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  31. Mayxay M, Newton PN, Yeung S, Pongvongsa T, Phompida S, Phetsouvanh R, White NJ: Short communication: An assessment of the use of malaria rapid tests by village health volunteers in rural Laos.

    Trop Med Int Health 2004, 9:325-329. PubMed Abstract | Publisher Full Text OpenURL

  32. McMorrow ML, Masanja MI, Abdulla SM, Kahigwa E, Kachur SP: Challenges in routine implementation and quality control of rapid diagnostic tests for malaria--Rufiji District, Tanzania.

    Am J Trop Med Hyg 2008, 79:385-390. PubMed Abstract | Publisher Full Text OpenURL

  33. Rennie W, Phetsouvanh R, Lupisan S, Vanisaveth V, Hongvanthong B, Phompida S, Alday P, Fulache M, Lumagui R, Jorgensen P, Bell D, Harvey S: Minimising human error in malaria rapid diagnosis: clarity of written instructions and health worker performance.

    Trans R Soc Trop Med Hyg 2007, 101:9-18. PubMed Abstract | Publisher Full Text OpenURL

  34. World Health Organization. Regional Office for the Western Pacific: Malaria Rapid Diagnosis: Making it Work. [http://www.searo.who.int/LinkFiles/Malaria_MalariaRDT.pdf] webcite

    2003.

    Meeting report 20-23 January 2003. Manila, the Philippines. 2003.

  35. Whitty CJM, Armstrong M, Behrens RH: Self-testing for falciparum malaria with antigen-capture cards by travelers with symptoms of malaria.

    Am J Trop Med Hyg 2000, 63:295-297. PubMed Abstract | Publisher Full Text OpenURL