Skip to main content

Assessing malaria transmission in a low endemicity area of north-western Peru

Abstract

Background

Where malaria endemicity is low, control programmes need increasingly sensitive tools for monitoring malaria transmission intensity (MTI) and to better define health priorities. A cross-sectional survey was conducted in a low endemicity area of the Peruvian north-western coast to assess the MTI using both molecular and serological tools.

Methods

Epidemiological, parasitological and serological data were collected from 2,667 individuals in three settlements of Bellavista district, in May 2010. Parasite infection was detected using microscopy and polymerase chain reaction (PCR). Antibodies to Plasmodium vivax merozoite surface protein-119 (PvMSP119) and to Plasmodium falciparum glutamate-rich protein (PfGLURP) were detected by ELISA. Risk factors for exposure to malaria (seropositivity) were assessed by multivariate survey logistic regression models. Age-specific antibody prevalence of both P. falciparum and P. vivax were analysed using a previously published catalytic conversion model based on maximum likelihood for generating seroconversion rates (SCR).

Results

The overall parasite prevalence by microscopy and PCR were extremely low: 0.3 and 0.9%, respectively for P. vivax, and 0 and 0.04%, respectively for P. falciparum, while seroprevalence was much higher, 13.6% for P. vivax and 9.8% for P. falciparum. Settlement, age and occupation as moto-taxi driver during previous year were significantly associated with P. falciparum exposure, while age and distance to the water drain were associated with P. vivax exposure. Likelihood ratio tests supported age seroprevalence curves with two SCR for both P. vivax and P. falciparum indicating significant changes in the MTI over time. The SCR for PfGLURP was 19-fold lower after 2002 as compared to before (λ1 = 0.022 versus λ2 = 0.431), and the SCR for PvMSP119 was four-fold higher after 2006 as compared to before (λ1 = 0.024 versus λ2 = 0.006).

Conclusion

Combining molecular and serological tools considerably enhanced the capacity of detecting current and past exposure to malaria infections and related risks factors in this very low endemicity area. This allowed for an improved characterization of the current human reservoir of infections, largely hidden and heterogeneous, as well as providing insights into recent changes in species specific MTIs. This approach will be of key importance for evaluating and monitoring future malaria elimination strategies.

Background

Despite recent reduction in its estimated incidence, malaria remains the most important human arthropod-borne disease, worldwide and in the Americas [1]. In Peru, malaria incidence has fluctuated dramatically over the last 50 years. Between 1954 and 1967, malaria was well under control by coordinated eradication efforts (resulting in only 1,500 cases in 1965) [2], but returned to high levels when eradication campaigns ceased. Following the occurrence of drug-resistant Plasmodium falciparum strains to chloroquine (CQ) and sulphadoxine-pyrimethamine (SP) [3, 4] and the spread of Anopheles darlingi in the Amazon Region [5], malaria re-emerged in the 1990s, reaching a peak of more than 200,000 cases in 1998 after the El Niño Southern Oscillation (ENSO) climatologic phenomenon [6]. Between 2000 and 2005, the annual incidence fluctuated between 70,000 and 80,000 cases followed by a steady decrease until 2011, when 22,877 cases were reported [7]. This achievement can be attributed to the strengthening of the National Malaria Control Programme (NMCP) and to the implementation of comprehensive interventions such as the use of artemisinin-based combination therapy (ACT), the distribution of long-lasting insecticidal mosquito nets (LLINs), and health education campaigns with the strong support of international donors, e g, US Agency for International Development (USAID), and the Global Fund for Aids, Tuberculosis and Malaria (GFATM) [810].

In Peru, the significant decline in malaria incidence over the past decade has modified its epidemiological profile and consequently calls for adapted control strategies. Currently, there is the need for targeting interventions and surveillance to foci of residual transmission in the north-west coast as well as in the Peruvian Amazon region. A key element for this re-orientation will be the availability of accurate measurement of malaria transmission intensity (MTI) and its evolution in space and time [11, 12]. However, it is not clear how best to monitor changes in transmission and disease burden in low endemicity areas [13].

Traditional methods to measure MTI include the collection of entomological and parasitological parameters. However, in areas of low endemicity, these measures are often subject to fluctuations for reasons other than true changes in transmission. For example, the improvement of case detection methods usually leads to an artificial increase in malaria incidence, which makes difficult the comparison between pre- and post-intervention data. Furthermore, entomological (entomological inoculation rate (EIR)) and parasitological measures (infections detected by microscopy) estimated through community surveys require very large sample sizes and are therefore extremely time and money consuming, while not able to catch seasonal variations [14, 15]. Moreover, parasitological surveys using microscopy cannot detect subpatent infections which are commonly reported in areas of low transmission [16, 17]. Molecular tests such as polymerase chain reaction (PCR) are much more sensitive for the detection of low parasite-density infections, and will become increasingly important for malaria elimination programmes [18, 19].

Serological markers have recently been used in several endemic areas across the world to estimate MTI [2024] and monitor its changes over time following interventions [25]. Serological techniques are particularly suited to low endemic areas as antibodies remain in the blood longer than malaria parasites and are thus easier to detect and less subject to seasonal variations. This paper reports on population-based estimates of P. falciparum and Plasmodium vivax prevalence and seroprevalence in an area of low endemicity in the north-west coast of Peru. The combination of molecular and serological tools is aimed at improving the detection of current malaria infections as well as recent exposure, in order to get insights into the residual transmission dynamics.

Methods

Study area

The study was conducted in Bellavista, a small district of Sullana province located in Piura department, north-western coast of Peru (Figure 1). Piura is historically considered an important focus of malaria transmission in Peru [26]. Bellavista district is a peri-urban settlement (37,000 inhabitants in 2010) directly connected to Sullana city, at 30 km from Piura, the fifth largest city in Peru. Three contiguous squatter settlements were selected for the study: Pavletich (PAV, nine blocks of houses), Jose Carlos Mariátegui (JCM, 12 blocks) and Nuevo Porvenir (NP, 13 blocks) based on their malaria endemicity (between 2008 and 2010 most of the district malaria cases occurred in these settlements) and their proximity to the largest water drain called Boqueron (=big hole). Situated at the eastern edge of the settlements, this artificially created drain flows from south to north for about 2 km (maximum width 100 m, depth 30 m) to end into the Chira River.

Figure 1
figure 1

Study area in Bellavista district (Piura department, northwestern coast of Peru) including three settlements. Pavletich (PAV), Jose Carlos Mariátegui (JCM) and Nuevo Porvenir (NP).

The winter season is from May to November and the hot and rainy summer from December to April. This seasonal pattern is periodically altered by the ENSO phenomenon [27] with torrential rain and strong winds that can cause flooding and landslides. In 2010, annual rainfall, average relative humidity and average temperature were 103 mm, 76% and 24.2°C, respectively [28]. The main vector is Anopheles albimanus and the vast majority of malaria cases are due to P. vivax[29]. The main occupations in the area are informal trade, agriculture and small animal farming.

Data collection

A full census of the study population was carried out in April 2010, collecting individual data on sociodemographic (age, gender, education, economic activities, income) as well as on malaria prevention characteristics. Each house was identified with a unique code number and georeferenced using a handheld global positioning system (GPS) device (Garmin’s GPSMAP 60CSx) that also calculated the closest distance to the water drain. Each individual was given a seven-digit unique code number combining the village, household and individual code.

The cross-sectional survey was carried out in May 2010 and included all residents in the study area. Each household was visited, and a written informed consent was sought from each participant. If part of, or the whole household, was absent at the time of survey, the study team would return within the next two days to maximize subject participation. Each participant was examined for fever and malaria symptoms, and a finger-prick blood sample was taken for immediate microscopy (thick and thin blood smears) and later serological and molecular tests at Institute of Tropical Medicine Alexander von Humboltd, Lima (ITM-AvH). Filter paper (Whatman grade 3, Whatman, Springfield Mill, USA) dried blood samples were individually stored at 4°C with desiccant until processed at the ITM-AvH. Infected individuals (presence of Plasmodium trophozoites) were treated according to the national guidelines.

Additionally, retrospective data on annual malaria incidence by species from 1990 to 2010, registered by the Office of Epidemiology at Regional Health Direction of Piura, were obtained from the National Institute of Statistics and Informatics [7, 28]. In Peru, weekly notification of confirmed malaria cases (by standard microscopy) at health facilities and data aggregation at district and at departmental level are mandatory. Patients presenting with symptoms compatible with malaria at health facilities are systematically tested by microscopy and treated following national guidelines.

Laboratory procedures

Microscopy

Thick and thin smears were stained for 10 min with a 10% Giemsa solution, and parasite density was expressed as the number of parasites/μl, after counting a total of 200 white blood cells (WBC) (or 500 WBCs if less than ten parasites/field), and assuming an average of 6,000 WBCs/μl according to the national guidelines [30]. Microscopy examination was performed immediately after sample collection at the Reference Laboratory in Sullana, and later quality control was done blindly on all positive slides and 10% of randomly chosen negative slides by a senior technician at ITM-AvH. Any discordant results were reread by a second senior technician until agreement.

Species-specific polymerase chain reaction (ss-PCR)

Parasite DNA was extracted using the saponin Chelex 100 method [31]. Briefly, filter-paper blood spots containing approximately 20 μl of blood were cut into pieces of approximately 5 sq mm, and incubated with 20 μl of 0.05% saponin at room temperature for four hours. Then, 10 μl of 20% Chelex 100 solution was added, and the sample was incubated for 10 min at 95°C, followed by a centrifugation at 11,000 g. The supernatant (DNA) was transferred into a new tube and stored at −20°C until PCR was performed. The DNA was amplified by a semi-nested multiplex PCR method targeting the 18S rDNA region, as described by Rubio et al[32]. PCR products were analysed in a 2% agarose gel with a standard 100 bp DNA lader, using ethidium bromide staining (0.5 μg/ml) and a data image Analyzer with UV trans-illuminator.

Serology

Plasmodium falciparum glutamate-rich protein (PfGLURP) and P. vivax merozoite surface protein119 (PvMSP119) antibodies were detected using an ELISA protocol published elsewhere [33]. Briefly, dried blood filter-paper samples (5 mm diameter disc/sample) were eluted overnight at 4°C in 2 ml of PBS-Blotto-Tween. Two hundred μl of the eluate were added in duplicate to blocked ELISA plates (Plate Chamaleon, Hydex) coated separately with P. falciparum GLURP R2 [34] and P. vivax MSP1-19[35]. Pooled sera from five P. falciparum- or P. vivax-infected patients, and from five non-infected control group were diluted at 1:400 in PBS-Blotto, as positive and negative control, respectively. Goat anti-human IgG (H + L) peroxidase (Sigma, affinity purified) diluted to 1: 20,000 in PBS-Tween was used as conjugate and incubated for one hour before development of the ELISA using 200 μl ABTS substrate-chromogen solution. Optical densities (ODs) were read at 405 nm, and corrected OD values were computed by subtracting the mean OD of the antigen negative control wells from the mean OD of the corresponding antigen containing wells. To ensure a standardization of the sample results across ELISA plates, the percent positivity (PP) of each specimen was calculated using the OD of the positive control serum as 100%. Quality control was done blindly at ITM-AvH on 5% of randomly chosen samples. The cut-off for positivity was generated using a mixture model as previously described by Corran et al. [36].

Data management and statistical analysis

Data were double entered, validated and cleaned in Excel (Microsoft Corp, USA), and data analysis was performed with Stata v.11 (Stata Corp, College Station, USA) and R v.2.15 software (R Development Core Team, R Foundation for Statistical Computing, Austria).

Malaria infection by PCR was defined as an individual with a positive PCR result, regardless of symptoms. Clinical malaria was defined as a patient with fever (body temperature >37.5°C), and/or history of fever in the previous two days, and positive for malaria by microscopy and/or PCR. As maternally derived antibodies can be found in young infants [37], malaria exposure was defined as an individual older than six months with a positive ELISA test for either or both P. falciparum and P. vivax. Descriptive statistics were used to calculate malariometric indices (parasite and antibody prevalence). Uni- and multivariate adjusted analyses were performed using survey logistic regression to determine risk factors for malaria infection (PCR positive) or malaria exposure (serology positive) adjusting for all potential confounders such as: settlement, gender, age, income, education, occupation during previous year, bed net use, distance to the water drain, and movements outside the settlement during previous year. A p-value <0.05 was considered significant for risk factors to be included in the multivariate adjusted model. Interactions were systematically checked for up to order two. All analyses took into account the survey design characteristics, using settlement as strata and household as primary sampling unit.

A simple reversible catalytic conversion model was used to fit the dichotomized serological results, using maximum likelihood methods as published by Drakeley et al. [22]. Briefly, this model generates age-seroprevalence curves, allowing for the estimation of the force of infection, or seroconversion rate (SCR, λ), and a seroreversion rate (ρ). Upon visual examination, if age-seroprevalence data suggest an obvious step at a certain age (time point), a model allowing for two forces of infection (λ1 and λ2) and related profile likelihood plots are run to determine the most likely time point for change in SCR, as previously described by Stewart et al. [24]. The identified time point is subsequently incorporated into the catalytic model to fit a seroprevalence curve with two forces of infection (before and after time cut-off) [38], which is then compared -using the likelihood ratio (LR) test (p < 0.05)- with a sero-prevalence curve with only one force of infection.

Ethical issues

Permission was received from health and local authorities after explaining the purpose and procedures of the survey. Signed, informed consent was obtained prior to participation by all adults and the parents of all participating children <18 years. In addition to their parent’s consent, children ≥ seven years old provided signed informed assent prior to participating. Ethical clearance was obtained from the Ethics Review Board of the Universidad Peruana Cayetano Heredia, Lima, Peru (SIDISI code: 056736).

Results

A total of 996 households and 4,650 individuals were identified during the census, and were distributed over the three study settlements as follows: PAV (433 houses; 2,163 individuals), JCM (312; 1,358) and NP (251; 1,129). The overall sex ratio was 0.94, and the age distribution showed that half of the population was <20 years old. A total 2,733 individuals (58.8%) living in 871 households (87.4%) were available at the time of the survey and 97.6% (2,667/2,733) of them accepted to participate. Females (61%) slightly outnumbered males, but the age distribution was very similar to the one in the total population. Among adults aged ≥18 years old, 60% had completed secondary education level. Only about 20% of the respondents had a regular income, almost all below the minimum national vital wage. The most commonly reported occupations were housewife (27.1%), labourer (9.0%) and trader (6.4%), while preprofessionals (children, students) and retired represented half of the participants. Very few respondents reported having been working as farmer (2.4%) or moto-taxi driver (2.6%) in the past year. More than half (52.6%) of the participants stated they were regularly sleeping under an untreated net, and 11.5% had experienced at least one confirmed P. vivax episode during the previous year (Table 1).

Table 1 Baseline characteristics of the study population (N = 2,667)

Parasite prevalence determined by microscopy was 0.3% (total eight P. vivax infections) while by PCR it was estimated at 1% including one P. falciparum and 25 P. vivax infections (Table 2). Malaria seroprevalence for P. vivax and P. falciparum was estimated at 13.6 and 9.8%, respectively, with 9.0% of the total seropositive individuals having antibodies against both antigens. A very weak correlation between antibody responses (percent positivity = PP) to the two species were found in individuals older than ten years (r = 0.1, p < 0.001), but not in younger children (p > 0.1). Most of the P. vivax PCR-positive cases were submicroscopic (17/25 = 68.0%) and asymptomatic (22/25 = 88.0%) at the time of the survey (Table 3). PCR positivity to P. vivax was significantly associated with the presence of P. vivax parasites (by microscopy) (p < 0.001) or antibodies (p < 0.001), as well as with symptoms (p < 0.001). Association between PCR and sero-positivity to P. falciparum could not be explored since only one P. falciparum infection was detected by PCR. This infection was asymptomatic and submicroscopic, and was found in a 16-year-old girl who also had antibodies against P. falciparum.

Table 2 Malaria prevalence (by microscopy and PCR) and seroprevalence
Table 3 Association between Plasmodium vivax PCR results and microscopy, serology and symptoms

Given the small number of PCR-positive individuals, a multivariate adjusted risk factor analysis was not carried out, and the univariate analysis showed that distance to water drain was significantly associated with the risk of P. vivax infection (no association could be found with age, gender, income, education, bed net, or previous travelling outside the community). Individuals living at <100 m from the water drain had increased odds of P. vivax infection than those living farther (≥100 m) (OR = 3.4, 95% CI [1.3–9.0]).

Distance to water drain, age, education, income, occupation as farmer in the previous year, and history of P. vivax malaria in the previous year were significantly associated to P. vivax exposure in the univariate analysis (Table 4). The multivariate analysis (excluding history of malaria in the previous year) showed that only age and distance to water drain remained independently associated with P. vivax seropositivity. Individuals older than ten years had increasingly higher odds of P. vivax seropositivity compared to younger children (test for trend p < 0.001), while those living at closer distance to the water drain had increasingly higher odds of exposure to P. vivax compared to those living farther than 250 m. A significant interaction (OR = 5.7; p = 0.014) between age groups > ten years and distance <100 m was found, showing that the effect of age (>ten versus ≤ ten years) was significantly higher in those living closer (<100 m) to the drain (OR = 11.7; 95 CI [3.0; 45.1]; p < 0.001) compared to those living farther (OR = 2.0; 95 CI [1.5; 2.7], p < 0.001). Conversely, the effect of distance to water (<100 m versus ≥100 m) was significant only in the older age group (OR = 2.4, 95 CI [1.6; 3.7], p < 0.001).

Table 4 Multivariate adjusted analysis for the risk of exposure to Plasmodium vivax using survey logistic regression

Significant risk factors for P. falciparum exposure identified in the univariate analysis were the following: settlement, age, education, prior work as farmer or moto-taxi driver, and bed net use (Table 5). The multivariate-adjusted analysis showed that only settlement, age and previous work as moto-taxi driver remained independently associated with exposure to P. falciparum (no interaction was found). Individuals living in JCM (AOR: 1.5, 95% CI [1.02–2.1]) and in NP (AOR: 2.2, 95% CI [1.6–3.2]) were more likely to be exposed to P. falciparum compared to those living in PAV. In addition, individuals older than five years had increasingly higher odds (test for trend p < 0.001) of P. falciparum seropositivity compared to younger children, and those having worked as moto-taxi driver in the previous year were two times more exposed to P. falciparum (AOR: 2.1, 95% CI [1.1–3.8]) compared to those who did not.

Table 5 Multivariate adjusted analysis for the risk of exposure to Plasmodium falciparum using survey logistic regression

Age seroprevalence plots for PvMSP119 and PfGLURP are shown in Figure 2 (A and B), and confirm previous results: increasing P. vivax and P. falciparum seroprevalence with age. Likelihood ratio (LR) tests supported models with two SCR (forces of infection) rather than one SCR for both P. vivax (p = 0.028) and P. falciparum (p = 0.046), indicating significant changes over time in the MTI for both species. For PvMSP119, best estimates indicated a significant four-fold increase in the SCR approximately four years prior to the survey (year 2006): post-2006 λ 1  = 0.024 (95% CI [0.018–0.032]) and pre-2006 λ 2  = 0.006 (95% CI [0.002–0.017]). For PfGLURP, best estimates indicated a 19–fold drop in the SCR approximately eight years prior to the survey (year 2002): post-2002 λ 1  = 0.022 (95% CI [0.014–0.033]), and pre-2002 λ 2  = 0.431 (95% CI [0.041–4.54]).

Figure 2
figure 2

Malaria seroprevalence curves. A: Seroprevalence curve for Plasmodium vivax. B: Seroprevalence curve for Plasmodium falciparum. Points represent observed data points, whilst the blue lines represent the maximum likelihood model and 95% confidence intervals. Estimated force of infection (λ) is plotted on the graphs. Two forces infection are plotted by likelihood ratio tests indicating change at a certain point in calendar time.

The retrospective analysis of 20-year annual malaria incidence and rainfall from 1990 to 2010 in Piura department showed that after the El Niño-Southern Oscillation (ENSO) phenomenon in 1997–1998 (Figure 3), when nearly 50,000 P. falciparum cases were recorded (1998), P. falciparum incidence dropped and stabilized around 4,000–5,000 cases annually in 2000–2001. This was followed by a steady decrease, and since 2006, autochthonous P. falciparum reported cases have become scarce (six and three reported cases in 2006 and 2008, respectively; and no cases in 2007, 2009 and 2010). Similarly to P. falciparum, P. vivax incidence decreased gradually after the ENSO (around 23,000 cases in 1998) reaching very low levels during the four-year period of intense droughts, with only 700, 315, 168, and 606 reported cases, respectively from 2004 to 2007. However, since then, P. vivax cases have increased with 4,185, 2,735 and 2,153 cases in 2008, 2009 and 2010, respectively. During the same period, annual rainfall in Piura dramatically dropped from 1998 (1,687 mm) to minimum values (between 14.3 and 59.4 mm) during the drought period, but subsequently increased since 2008 (193.5 mm in 2008).

Figure 3
figure 3

Evolution of the annual malaria incidence, and rainfall, in Piura department: 1990–2010. Information on annual malaria cases, registered by Regional Health Direction of Piura, was obtained from the National Institute of Statistics and Informatics [27]. Numbers in the timeline point out important events that influenced malaria incidence: 1) moderate ENSO phenomenon (1991–1992), 2) first reports of chloroquine (CQ) failure for Plasmodium falciparum (since 1994), 3) very strong ENSO phenomenon (1997–1998), 4) confirmed CQ resistance for Plasmodium falciparum (1999), 5) ACT implementation (2001–2003), 6) intense droughts (2004–2007).

Discussion

The combination of molecular and serological tools, in addition to standard microscopy, allowed for an in-depth characterization of the current malaria transmission pattern as well as recent changes in species-specific MTI in this peri-urban area of the Peruvian northern coast. Most of the malaria infections were submicroscopic (70%), as well as asymptomatic (89%) despite the low level of transmission. Though P. vivax was predominant, species-specific seroprevalence showed that exposure to P. falciparum still occurs in the study area. Interestingly, over the past ten years, both species experienced significant but opposite changes in MTI: while P. falciparum MTI dropped after 2002, the one of P. vivax significantly increased after 2006.

Despite having been conducted at the end of rainy season, when the health information system usually records the highest malaria incidence [7], few malaria-infected individuals were identified and most of them had not had malaria-related symptoms within the two days prior to the survey. These results are in line with findings from other areas in the northern coast [39] and the Peruvian Amazon region [40, 41] and support the hypothesis that this asymptomatic and submicroscopic reservoir of infections contributes to malaria transmission [42].

In areas of low malaria transmission with seasonal patterns affected by climatic conditions, such as the Peruvian northern coast region, parasitological indicators determined by microscopy or PCR can be insensitive. In these areas, serological measures can be used as a proxy for malaria transmission intensity [20, 23, 25, 36]. Indeed, seroprevalence reflects the cumulative exposure to malaria and, since antibodies persist longer in the blood than parasites, it is more sensitive and less affected by seasonality or unstable transmission [22, 23, 43]. Though it may be limited in detecting discrete seasonal variations in transmission, it is a good indicator of long-term transmission potential [22, 24].

Even though P. falciparum reported cases in Piura department have been extremely rare in the past five years, P. vivax and P. falciparum seroprevalence indicated ongoing exposure to both species. The low PfGLURP seropositivity in young children and the only one P. falciparum case detected by PCR suggest that a residual P. falciparum transmission is still present in the study area. This residual transmission may be due to asymptomatic P. falciparum infections that remain undetected, unless a population-wide survey (such as the present study) is carried out. However, the implementation of mass screening as a public health strategy in low transmission settings remains a matter of debate [18, 40, 41], as the cost-effectiveness of such an intervention remains difficult to establish. The role of asymptomatic infections in maintaining malaria transmission as well as the impact of mass screening and treatment should be further evaluated through modelling techniques [44].

One might argue that an alternative explanation for the observed P. falciparum seropositivity could be the presence of antibodies cross-reacting with P. vivax or other infectious agents’ antigens. Limited information is available about the cross-reactivity between P. falciparum and P. vivax antigens [35, 45], and this has not been reported for PfGLURP. In addition, the lack of association between confirmed P. vivax infections by PCR and PfGLURP seropositivity, and the absence of correlation between antibody responses to the two species suggest that cross-reactivity is probably minimal. A few studies have suggested the cross-reactive potential of PfGLURP with Schistosoma haematobium[46], which is unlikely in the study area since the latter has not been reported in Piura.

Serologic markers can also be used to determine risk factors for malaria. This is particularly important in low endemicity areas as the one reported here, where the low malaria prevalence jeopardizes the risk factor analysis. In the study area, age was the only independent risk factor that was associated to both species. The age-dependent PvMSP119 and PfGLURP seropositivity indicates cumulative P. vivax and P. falciparum exposure with increasing age. As antibody responses will persist for prolonged periods, the rate of acquisition in young age groups can be used to determine current malaria transmission intensity [2225] as well as to identify recent changes in MTI.

The higher seroprevalence in individuals with several P. vivax malaria episodes also confirmed that PvMSP119 antibody detection measures cumulative exposure. However, the history of P. vivax malaria in the past year was not included in the multivariate risk factor analysis for P. vivax exposure, since it is not a risk factor for P. vivax infections per se but rather a consequence of previous exposure to a given risk factor. Plasmodium vivax infections are on the pathway between risk factors and the presence of P. vivax antibodies.

Differences in the risk factors for P. vivax and P. falciparum seropositivity reflect the heterogeneity of malaria transmission intensity between species. Age and distance to the water drain were the only two independent risk factors significantly associated with P. vivax exposure. As mentioned above, the effect of age on seroprevalence usually reflects the cumulative exposure to malaria infections occurring with age rather than a higher risk of exposure in adults as compared to children. However, the significant interaction found between age and house distance to the drain, beside the cumulative effect of age on seroprevalence, indicates a significant lower exposure in children aged < ten years. Indeed, the effect of distance (<100 m versus ≥100 m) on P. vivax seropositivity was only significant in adults, indicating that children living close to the drain were not exposed any more to infectious bites compared to children living farther. Water accumulation in the drain provides breeding habitats for Anopheles malaria vectors after rains [30, 39], resulting in a higher risk of exposure to infectious vectors for people living close to the drain. This is also supported by the results of univariate analysis for the risk of P. vivax infection. However, since adults are more likely to have outdoor evening activities, this could explain why children below ten, were no more at risk of malaria while living close to the drain.

Besides age, settlement and prior work as moto-taxi driver in the previous year, there were two additional independent risk factors for P. falciparum seropositivity. Historically, the three study settlements were important foci of P. falciparum transmission during the epidemic of 1998 and the early 2000s [47, 48]. Therefore, higher seroprevalence in JCM and NP, compared to PAV again suggest differential reduction rates in MTI between villages (heterogeneity). Occupational activities outside settlements (as moto-taxi driver) that were associated with increased P. falciparum exposure support the hypothesis that transmission occurs not only in the immediate house environment as previously described by Guthmann et al. [29], but outside the community as well. Moto-taxi drivers in the study area usually work in evening times, when exposure to An. albimanus bites increases. Occupational risk for malaria has also been found in the Peruvian Amazon Region, where malaria morbidity has been clearly associated with forest-related activities such as farming, land clearing and wood extraction [49, 50].

The catalytic model used to generate PfGLURP seroprevalence curves suggested that a significant decline in P. falciparum transmission occurred in the study area approximately eight years before the current study (around 2002). This supports the idea that the wide scale implementation of ACT since 2001 has significantly contributed to the reduction of P. falciparum MTI. Indeed, following the 1998 epidemic and the subsequent intensified control interventions implemented [9], P. falciparum incidence returned to the pre-epidemic levels (1997) by 2000–2001 (around 5,000 cases), and since 2002 it steadily decreased to reach almost undetected levels from 2007 onwards (Figure 3). In addition, the absence of P. falciparum surge after the drought period in 2007, as observed with P. vivax, advocates for the additional significant effect of the ACT deployment on P falciparum MTI in the northern coast region [8].

Since the end of the drought period and the resuming of the rains, P. vivax incidence substantially increased [7] (Figure 3) which is concordant with the fitted results from the model, i.e., significant increase in P. vivax MTI after 2006. Plasmodium vivax transmission in this area seems to be more sensitive than P. falciparum to changes in climatological and environmental conditions, especially since the implementation of ACT. The recent changes in species specific MTIs are also in line with the results of the multivariate risk factor analysis. While children under-five were significantly at lower risk of P. falciparum exposure compared to older children age 6-10, this was not the case for the P. vivax exposure where the under five were at similar risk of exposure compared to the 6-10 years old.

The number of antigens used in the two serological tests could be a limitation of the study. Due to the degree of sequence variability, it is recommended to use multiple antigens for each species in order to optimize the sensitivity of the antibody detection and to improve the identification of changes in malaria transmission over time in low transmission settings [20, 38]. However, the observation that the antigens used in the study are relatively conserved [51] combined with results from recent studies performed in Cambodia, Vietnam and Peru suggests that PfGLURP and PvMSP119 are highly suitable for the detection of antibodies against P. falciparum and P. vivax, respectively [33, 52]. Multiplexing the serological tests as well as standardizing the antigens used is of crucial importance for monitoring elimination efforts and comparing trends across countries and regions.

Conclusions

Monitoring MTI in areas of low endemicity and seasonal patterns, such as the north-western coast of Peru, poses a major challenge to national malaria control programmes. In this setting, molecular tools confirmed the current malaria transmission pattern characterized by low parasite rates, mainly due to P. vivax with a majority of asymptomatic and sub-microscopic infections. Additionally, serological markers reflected exposure to malaria and allowed for species-specific risk factor analysis, as well as showing recent changes in respective MTIs. In conclusion, the combination of both serological and molecular tools improved detection sensitivity, and provided new insights into recent changes in transmission intensity for both species. This invaluable information can help decision-makers to adjust malaria control strategies in order to maintain current achievements, avoid outbreaks, and possibly move towards the elimination of malaria.

References

  1. WHO Global Malaria Programme: World malaria report 2011. 2011, Geneva: WHO

    Google Scholar 

  2. Roberts DR, Laughlin LL, Hsheih P, Legters LJ: DDT, global strategies, and a malaria control crisis in South America. Emerg Infect Dis. 1997, 3: 295-302. 10.3201/eid0303.970305.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  3. Marquiño W, MacArthur JR, Barat LM, Oblitas FE, Arrunátegui M, Garavito G, Chafloque ML, Pardavé B, Gutierrez S, Arróspide N, Carrillo C, Cabezas C, Ruebush TK: Efficacy of chloroquine, sulfadoxine-pyrimethamine, and mefloquine for the treatment of uncomplicated Plasmodium falciparum malaria on the north coast of Peru. Am J Trop Med Hyg. 2003, 68: 120-123.

    PubMed  Google Scholar 

  4. Marquiño W, Huilca M, Calampa C, Falconí E, Cabezas C, Naupay R, Ruebush TK: Efficacy of mefloquine and a mefloquine-artesunate combination therapy for the treatment of uncomplicated Plasmodium falciparum malaria in the Amazon Basin of Peru. Am J Trop Med Hyg. 2003, 68: 608-612.

    PubMed  Google Scholar 

  5. Aramburu J, Ramal C, Witzig R: Malaria reemergence in the Peruvian Amazon region. Emerg Infect Dis. 2009, 5: 209-215.

    Google Scholar 

  6. Gagnon AS, Smoyer-Tomic KE, Bush ABG: The El Niño southern oscillation and malaria epidemics in South America. Int J Biometeorol. 2002, 46: 81-89. 10.1007/s00484-001-0119-6.

    Article  PubMed  Google Scholar 

  7. Ministerio de Salud del Peru: Tendencia y situación de las enfermedades sujetas a vigilancia epidemiológica: malaria. Bol Epidemiol. 2011, 20: 1108-1111. Available at: http://www.dge.gob.pe/boletines/2011/52.pdf. Last accessed October 6th 2012

    Google Scholar 

  8. Williams HA, Vincent-Mark A, Herrera Y, Chang OJ: A retrospective analysis of the change in anti-malarial treatment policy: Peru. Malar J. 2009, 8: 85-10.1186/1475-2875-8-85.

    Article  PubMed Central  PubMed  Google Scholar 

  9. Flores W, Chang J, Barillas E: Rapid assessment of the performance of malaria control strategies implemented by countries in the Amazon subregion using adequacy criteria: case study. Malar J. 2011, 10: 379-10.1186/1475-2875-10-379.

    Article  PubMed Central  PubMed  Google Scholar 

  10. Rosas-Aguirre A, Guzmán-Guzmán M, Moreno-Gutierrez D, Rodriguez-Ferrucci H, Vargas-Pacherrez D, Acuña-González Y: Long-lasting insecticide - treated bednet ownership, retention and usage one year after their distribution in Loreto, Peru. Rev Peru Med Exp Salud Publica. 2011, 28: 228-236. 10.1590/S1726-46342011000200009.

    Article  PubMed  Google Scholar 

  11. Hay SI, Smith DL, Snow RW: Measuring malaria endemicity from intense to interrupted transmission. Lancet Infect Dis. 2008, 8: 369-378. 10.1016/S1473-3099(08)70069-0.

    Article  PubMed Central  PubMed  Google Scholar 

  12. Greenwood BM: Control to elimination: implications for malaria research. Trends Parasitol. 2008, 24: 449-454. 10.1016/j.pt.2008.07.002.

    Article  PubMed  Google Scholar 

  13. Byass P: Making sense of long-term changes in malaria. Lancet. 2008, 372: 1523-1525. 10.1016/S0140-6736(08)61631-1.

    Article  PubMed  Google Scholar 

  14. Elissa N, Migot-Nabias F, Luty A, Renaut A, Touré F, Vaillant M, Lawoko M, Yangari P, Mayombo J, Lekoulou F, Tshipamba P, Moukagni R, Millet P, Deloron P: Relationship between entomological inoculation rate, Plasmodium falciparum prevalence rate, and incidence of malaria attack in rural Gabon. Acta Trop. 2003, 85: 355-361. 10.1016/S0001-706X(02)00266-8.

    Article  CAS  PubMed  Google Scholar 

  15. Kelly-Hope LA, McKenzie FE: The multiplicity of malaria transmission: a review of entomological inoculation rate measurements and methods across sub-Saharan Africa. Malar J. 2009, 8: 19-10.1186/1475-2875-8-19.

    Article  PubMed Central  PubMed  Google Scholar 

  16. Steenkeste N, Rogers WO, Okell L, Jeanne I, Incardona S, Duval L, Chy S, Hewitt S, Chou M, Socheat D, Babin FX, Ariey F, Rogier C: Sub-microscopic malaria cases and mixed malaria infection in a remote area of high malaria endemicity in Rattanakiri province, Cambodia: implication for malaria elimination. Malar J. 2010, 9: 108-10.1186/1475-2875-9-108.

    Article  PubMed Central  PubMed  Google Scholar 

  17. Coura JR, Suárez-Mutis M, Ladeia-Andrade S: A new challenge for malaria control in Brazil: asymptomatic Plasmodium infection–a review. Mem Inst Oswaldo Cruz. 2006, 101: 229-237.

    PubMed  Google Scholar 

  18. Johnston SP, Pieniazek NJ, Xayavong MV, Slemenda SB, Wilkins PP, Da Silva AJ: PCR as a confirmatory technique for laboratory diagnosis of malaria. J Clin Microbiol. 2006, 44: 1087-1089. 10.1128/JCM.44.3.1087-1089.2006.

    Article  PubMed Central  PubMed  Google Scholar 

  19. Taylor SM, Juliano JJ, Trottman PA, Griffin JB, Landis SH, Kitsa P, Tshefu AK, Meshnick SR: High-throughput pooling and real-time PCR-based strategy for malaria detection. J Clin Microbiol. 2010, 48: 512-519. 10.1128/JCM.01800-09.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  20. Corran P, Coleman P, Riley E, Drakeley C: Serology: a robust indicator of malaria transmission intensity?. Trends Parasitol. 2007, 23: 575-582. 10.1016/j.pt.2007.08.023.

    Article  PubMed  Google Scholar 

  21. Williams GS, Mweya C, Stewart L, Mtove G, Reyburn H, Cook J, Corran PH, Riley EM, Drakeley CJ: Immunophoretic rapid diagnostic tests as a source of immunoglobulins for estimating malaria sero-prevalence and transmission intensity. Malar J. 2009, 8: 168-10.1186/1475-2875-8-168.

    Article  PubMed Central  PubMed  Google Scholar 

  22. Drakeley CJ, Corran PH, Coleman PG, Tongren JE, McDonald SLR, Carneiro I, Malima R, Lusingu J, Manjurano A, Nkya WM, Lemnge MM, Cox J, Reyburn H, Riley EM: Estimating medium- and long-term trends in malaria transmission by using serological markers of malaria exposure. Proc Natl Acad Sci USA. 2005, 102: 5108-5113. 10.1073/pnas.0408725102.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  23. Bousema T, Youssef RM, Cook J, Cox J, Alegana VA, Amran J, Noor AM, Snow RW, Drakeley C: Serologic markers for detecting malaria in areas of low endemicity, Somalia, 2008. Emerg Infect Dis. 2010, 16: 392-399. 10.3201/eid1603.090732.

    Article  PubMed Central  PubMed  Google Scholar 

  24. Stewart L, Gosling R, Griffin J, Gesase S, Campo J, Hashim R, Masika P, Mosha J, Bousema T, Shekalaghe S, Cook J, Corran P, Ghani A, Riley EM, Drakeley C: Rapid assessment of malaria transmission using age-specific sero-conversion rates. PLoS One. 2009, 4: e6083-10.1371/journal.pone.0006083.

    Article  PubMed Central  PubMed  Google Scholar 

  25. Cook J, Kleinschmidt I, Schwabe C, Nseng G, Bousema T, Corran PH, Riley EM, Drakeley CJ: Serological markers suggest heterogeneity of effectiveness of malaria control interventions on Bioko Island, Equatorial Guinea. PLoS One. 2011, 6: e25137-10.1371/journal.pone.0025137.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  26. Ministerio de Salud del Peru - Dirección General de Epidemiología: Análisis de la Situación de Salud del Perú, ASIS 2010. 2010, Lima, Peru: Ministerio de Salud del Peru, Available at: http://www.dge.gob.pe/publicaciones/pub_asis/asis25.pdf. Last accessed October 5th 2012

    Google Scholar 

  27. ESA Earthnet Online: El Nino-Southern Oscillations (ENSO). http://earth.esa.int/applications/data_util/CLIMATE/ENSO.HTM. Last accessed September 5th 2013

  28. Instituto Nacional de Estadística e Informática: Piura – Compendio Estadístico 2011. 2011, Piura, Perú: Instituto Nacional de Estadística e Informática, Available at: http://www.inei.gob.pe/biblioineipub/bancopub/Est/Lib0997/Libro.pdf. Last accessed October 25th 2012

    Google Scholar 

  29. Guthmann JP, Hall AJ, Jaffar S, Palacios A, Lines J, Llanos-Cuentas A: Environmental risk factors for clinical malaria: a case–control study in the Grau region of Peru. Trans R Soc Trop Med Hyg. 2001, 95: 577-583. 10.1016/S0035-9203(01)90084-7.

    Article  CAS  PubMed  Google Scholar 

  30. Ministerio de Salud del Perú: Manual de Procedimientos de Laboratorio para el Diagnóstico de Malaria. Serie de Normas Técnicas 39. 2003, Lima, Perú: Ministerio de Salud del Peru, Available at: http://bvs.minsa.gob.pe/local/INS/163_malaria.pdf. Last accessed October 5th 2012

    Google Scholar 

  31. Plowe CV, Djimde A, Bouare M, Doumbo O, Wellems TE: Pyrimethamine and proguanil resistance-conferring mutations in Plasmodium falciparum dihydrofolate reductase: polymerase chain reaction methods for surveillance in Africa. Am J Trop Med Hyg. 1995, 52: 565-568.

    CAS  PubMed  Google Scholar 

  32. Rubio JM, Post RJ, Van Leeuwen WMD, Henry MC, Lindergard G, Hommel M: Alternative polymerase chain reaction method to identify Plasmodium species in human blood samples: the semi-nested multiplex malaria PCR (SnM-PCR). Trans R Soc Trop Med Hyg. 2002, 96 (Suppl 1): S199-S204.

    Article  PubMed  Google Scholar 

  33. Cook J, Speybroeck N, Sochanta T, Somony H, Sokny M, Claes F, Lemmens K, Theisen M, Soares IS, D’Alessandro U, Coosemans M, Erhart A: Sero-epidemiological evaluation of changes in Plasmodium falciparum and Plasmodium vivax transmission patterns over the rainy season in Cambodia. Malar J. 2012, 11: 86-10.1186/1475-2875-11-86.

    Article  PubMed Central  PubMed  Google Scholar 

  34. Theisen M, Vuust J, Gottschau A, Jepsen S, Høgh B: Antigenicity and immunogenicity of recombinant glutamate-rich protein of Plasmodium falciparum expressed in Escherichia coli. Clin Diagn Lab Immunol. 1995, 2: 30-34.

    PubMed Central  CAS  PubMed  Google Scholar 

  35. Rodrigues MH, Cunha MG, Machado RL, Ferreira OC, Rodrigues MM, Soares IS: Serological detection of Plasmodium vivax malaria using recombinant proteins corresponding to the 19-kDa C-terminal region of the merozoite surface protein-1. Malar J. 2003, 2: 39-10.1186/1475-2875-2-39.

    Article  PubMed Central  PubMed  Google Scholar 

  36. Corran PH, Cook J, Lynch C, Leendertse H, Manjurano A, Griffin J, Cox J, Abeku T, Bousema T, Ghani AC, Drakeley C, Riley E: Dried blood spots as a source of anti-malarial antibodies for epidemiological studies. Malar J. 2008, 7: 195-10.1186/1475-2875-7-195.

    Article  PubMed Central  PubMed  Google Scholar 

  37. Campbell CC, Martinez JM, Collins WE: Seroepidemiological studies of malaria in pregnant women and newborns from coastal El Salvador. Am J Trop Med Hyg. 1980, 29: 151-157.

    CAS  PubMed  Google Scholar 

  38. Cook J, Reid H, Iavro J, Kuwahata M, Taleo G, Clements A, McCarthy J, Vallely A, Drakeley C: Using serological measures to monitor changes in malaria transmission in Vanuatu. Malar J. 2010, 9: 169-10.1186/1475-2875-9-169.

    Article  PubMed Central  PubMed  Google Scholar 

  39. Guthmann JP, Llanos-Cuentas A, Palacios A, Hall AJ: Environmental factors as determinants of malaria risk. A descriptive study on the northern coast of Peru. Trop Med Int Health. 2002, 7: 518-525. 10.1046/j.1365-3156.2002.00883.x.

    Article  CAS  PubMed  Google Scholar 

  40. Vinetz JM, Gilman RH: Asymptomatic Plasmodium parasitemia and the ecology of malaria transmission. Am J Trop Med Hyg. 2002, 66: 639-640.

    PubMed  Google Scholar 

  41. Branch O, Casapia WM, Gamboa DV, Hernandez JN, Alava FF, Roncal N, Alvarez E, Perez EJ, Gotuzzo E: Clustered local transmission and asymptomatic Plasmodium falciparum and Plasmodium vivax malaria infections in a recently emerged, hypoendemic Peruvian Amazon community. Malar J. 2005, 4: 27-10.1186/1475-2875-4-27.

    Article  PubMed Central  PubMed  Google Scholar 

  42. Da Silva-Nunes M, Moreno M, Conn JE, Gamboa D, Abeles S, Vinetz JM, Ferreira MU: Amazonian malaria: asymptomatic human reservoirs, diagnostic challenges, environmentally driven changes in mosquito vector populations, and the mandate for sustainable control strategies. Acta Trop. 2012, 121: 281-291. 10.1016/j.actatropica.2011.10.001.

    Article  PubMed Central  PubMed  Google Scholar 

  43. Bousema T, Drakeley C, Gesase S, Hashim R, Magesa S, Mosha F, Otieno S, Carneiro I, Cox J, Msuya E, Kleinschmidt I, Maxwell C, Greenwood B, Riley E, Sauerwein R, Chandramohan D, Gosling R: Identification of hot spots of malaria transmission for targeted malaria control. J Infect Dis. 2010, 201: 1764-1774. 10.1086/652456.

    Article  PubMed  Google Scholar 

  44. Aguas R, White LJ, Snow RW, Gomes MGM: Prospects for malaria eradication in sub-Saharan Africa. PLoS One. 2008, 3: e1767-10.1371/journal.pone.0001767.

    Article  PubMed Central  PubMed  Google Scholar 

  45. Culleton R, Ndounga M, Zeyrek FY, Coban C, Casimiro PN, Takeo S, Tsuboi T, Yadava A, Carter R, Tanabe K: Evidence for the transmission of Plasmodium vivax in the Republic of the Congo, West Central Africa. J Infect Dis. 2009, 200: 1465-1469. 10.1086/644510.

    Article  CAS  PubMed  Google Scholar 

  46. Mutapi F, Roussilhon C, Mduluza T, Druilhe P: Anti-malaria humoral responses in children exposed to Plasmodium falciparum and Schistosoma haematobium. Mem Inst Oswaldo Cruz. 2007, 102: 405-409. 10.1590/S0074-02762007005000046.

    Article  CAS  PubMed  Google Scholar 

  47. Bellina C, Castillo C, Puel L, Seminario A, Yerén C: Malaria por Plasmodium falciparum en Sullana. Bol Soc Peru Med Interna. 1999, 12: 163-165.

    Google Scholar 

  48. Sub-Región de Salud Luciano Castillo Colonna: Análisis de situación de salud año 2000. 2001, Sullana, Piura: Sub-Región de Salud Luciano Castillo Colonna, Available at: http://bvs.minsa.gob.pe/local/minsa/1994-1.pdf. Last accessed October 30th 2012

    Google Scholar 

  49. Vittor AY, Gilman RH, Tielsch J, Glass G, Shields T, Lozano WS, Pinedo-Cancino V, Patz JA: The effect of deforestation on the human-biting rate of Anopheles darlingi, the primary vector of Falciparum malaria in the Peruvian Amazon. Am J Trop Med Hyg. 2006, 74: 3-11.

    PubMed  Google Scholar 

  50. Chuquiyauri R, Paredes M, Peñataro P, Torres S, Marin S, Tenorio A, Brouwer KC, Abeles S, Llanos-Cuentas A, Gilman RH, Kosek M, Vinetz JM: Socio-demographics and the development of malaria elimination strategies in the low transmission setting. Acta Trop. 2012, 121: 292-302. 10.1016/j.actatropica.2011.11.003.

    Article  PubMed Central  PubMed  Google Scholar 

  51. De Stricker K, Vuust J, Jepsen S, Oeuvray C, Theisen M: Conservation and heterogeneity of the glutamate-rich protein (GLURP) among field isolates and laboratory lines of Plasmodium falciparum. Mol Biochem Parasitol. 2000, 111: 123-130. 10.1016/S0166-6851(00)00304-2.

    Article  CAS  PubMed  Google Scholar 

  52. Speybroeck N, Praet N, Claes F, Van Hong N, Torres K, Mao S, Van den Eede P, Thi Thinh T, Gamboa D, Sochantha T, Thang ND, Coosemans M, Büscher P, D’Alessandro U, Berkvens D, Erhart A: True versus apparent malaria infection prevalence: the contribution of a Bayesian approach. PLoS One. 2011, 6: e16705-10.1371/journal.pone.0016705.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank Socrates Herrera and the Centro Latino Americano de Investigación en Malaria (CLAIM) for their contribution to the fieldwork, and all study participants and the local authorities for their enthusiastic support provided to our study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Angel Rosas-Aguirre.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AR contributed to the study design, analysed the data and wrote the paper; ALL and VS contributed to the study design and paper review; NS and JC contributed to the data analysis and paper review; JCM contributed to the fieldwork supervision and processed the blood samples with ELISA and PCR; EP and OJP carried out and coordinated the fieldwork; DG contributed to the supervision of the sample processing and paper review; MOP, ISS and MT contributed antigen to the project and reviewed the article; UDA contributed to the study design and reviewed the manuscript; AE contributed to the study design, the data analysis and reviewed the paper. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Rosas-Aguirre, A., Llanos-Cuentas, A., Speybroeck, N. et al. Assessing malaria transmission in a low endemicity area of north-western Peru. Malar J 12, 339 (2013). https://doi.org/10.1186/1475-2875-12-339

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1475-2875-12-339

Keywords