Acessibilidade / Reportar erro

Evaluation of a rapid dipstick test, Malar-CheckTM, for the diagnosis of Plasmodium falciparum malaria in Brazil

Avaliação de um teste rápido em fita, Malar-CheckTM, para o diagnóstico de malária por Plasmodium falciparum no Brasil

Abstracts

The present study was carried out to evaluate the Malar-CheckTM Pf test, an immunochromatographic assay that detects Plasmodium falciparum Histidine Rich Protein II, does not require equipment, and is easy and rapid to perform. In dilution assays performed to test sensitivity against known parasite density, Malar-CheckTMwere compared with thick blood smear (TBS), the gold standard for diagnosis. Palo Alto isolate or P. falciparum blood from patients with different parasitemias was used. The average cut-off points for each technique in three independent experiments were 12 and 71 parasites/mm³ (TBS and Malar-CheckTM, respectively). In the field assays, samples were collected from patients with fever who visited endemic regions. Compared to TBS, Malar-CheckTMyielded true-positive results in 38 patients, false-positive results in 3, true-negative results in 23, and false-negative result in 1. Malar-CheckTMperformed with samples from falciparum-infected patients after treatment showed persistence of antigen up to 30 days. Malar-CheckTM should aid the diagnosis of P. falciparum in remote areas and improve routine diagnosis even when microscopy is available. Previous P. falciparum infection, which can determine a false-positive test in cured individuals, should be considered. The prompt results obtained with the Malar-CheckTM for early diagnosis could avoid disease evolution to severe cases.

Malaria diagnosis; Plasmodium falciparum; Rapid dipstick test; Immunocapture assay; Malar-Check; Histidine Rich Protein II


Este trabalho avaliou o Malar-CheckTM Pf test, ensaio imunocromatográfico que detecta a proteína rica em histidina de Plasmodium falciparum, dispensa uso de equipamentos, é rápido e de fácil execução. Ensaios de diluição com o isolado Palo Alto ou sangue de pacientes com P. falciparum, foram realizados para testar a sensibilidade em diferentes densidades do parasita. Malar-CheckTM foi comparado à gota espessa (GE), padrão ouro para diagnóstico de malária. A média do limiar de sensibilidade para cada técnica em três experimentos independentes foi de 12 e 71 parasitas/mm³ (GE e Malar-CheckTM, respectivamente). Em ensaios de campo, amostras foram coletadas de pacientes febris de áreas endêmicas. Comparado à GE, Malar-CheckTM foi verdadeiramente positivo em 38 pacientes, falso positivo em 3, verdadeiramente negativo em 23 e falso negativo em um. Malar-CheckTMrealizado com sangue de pacientes com P. falciparum após tratamento mostrou persistência do antígeno durante 30 dias. Malar-CheckTM pode ser útil no diagnóstico de P. falciparum em áreas remotas e auxiliar a rotina diagnóstica, mesmo quando a microscopia está disponível. Deve ser considerada infecção pregressa por P. falciparum, que pode determinar testes positivos em indivíduos curados. A rapidez do Malar-CheckTM para o diagnóstico precoce pode evitar evolução para casos graves.


EVALUATION OF A RAPID DIPSTICK TEST, MALAR-CHECKÔ, FOR THE DIAGNOSIS OF Plasmodium falciparum MALARIA IN BRAZIL

Priscilla Elisangela AVILA(1 (1 ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil. (2 ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil. ), Karin KIRCHGATTER(1 (1 ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil. (2 ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil. ), Karen Cristina S. BRUNIALTI(1 (1 ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil. (2 ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil. ), Alessandra M. OLIVEIRA(1 (1 ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil. (2 ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil. ), Rinaldo F. SICILIANO(2 (1 ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil. (2 ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil. ) & Silvia Maria DI SANTI(1 (1 ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil. (2 ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil. )

SUMMARY

The present study was carried out to evaluate the Malar-CheckÔ Pf test, an immunochromatographic assay that detects Plasmodium falciparum Histidine Rich Protein II, does not require equipment, and is easy and rapid to perform. In dilution assays performed to test sensitivity against known parasite density, Malar-CheckÔwere compared with thick blood smear (TBS), the gold standard for diagnosis. Palo Alto isolate or P. falciparum blood from patients with different parasitemias was used. The average cut-off points for each technique in three independent experiments were 12 and 71 parasites/mm3 (TBS and Malar-CheckÔ, respectively). In the field assays, samples were collected from patients with fever who visited endemic regions. Compared to TBS, Malar-CheckÔyielded true-positive results in 38 patients, false-positive results in 3, true-negative results in 23, and false-negative result in 1. Malar-CheckÔperformed with samples from falciparum-infected patients after treatment showed persistence of antigen up to 30 days. Malar-CheckÔ should aid the diagnosis of P. falciparum in remote areas and improve routine diagnosis even when microscopy is available. Previous P. falciparum infection, which can determine a false-positive test in cured individuals, should be considered. The prompt results obtained with the Malar-CheckÔ for early diagnosis could avoid disease evolution to severe cases.

KEYWORDS: Malaria diagnosis; Plasmodium falciparum; Rapid dipstick test; Immunocapture assay; Malar-Check; Histidine Rich Protein II.

INTRODUCTION

In the last 2 years, 600 thousand of malaria cases/year were notified in Brazil, where most of the Plasmodium falciparum infections in the Americas occur21. Falciparum malaria is increasing 15% a year, causing an annual increment of 10% in the number of registered deaths (www.funasa.gov.br).

A prompt and accurate diagnosis is essential for a reduction of the morbidity and mortality of the disease. Therefore, there is a constant search for new diagnostic alternatives to the Giemsa-stained thick blood smear (TBS), which continues to be used today17. Considered as the gold standard, TBS is widely employed because of its efficiency and low cost. However, this technique presents low sensitivity, detecting 10 parasites/ml and requires equipment and trained personnel4.

In many places where malaria is endemic, the lack of laboratory infrastructure and appropriate human resources hinders the use of diagnostic techniques based on microscopy. To overcome this problem, some rapid immunochromatographic tests that spare the use of equipment and highly qualified personnel are currently available. The ParaSightÔF test (Becton Dickinson Europe), Malar-CheckÔPf test (Cumberland Diagnostics Ltd.) and others7 use a double sandwich for the detection of the P. falciparum Histidine Rich Protein (PfHRPII) in whole blood samples. PfHRPII is a water-soluble protein produced by asexual blood stages and young gametocytes10 and observed in all P. falciparum isolates16. The principle of the ParaSightÔF test has been described elsewhere18. The Malar-CheckÔPf test uses a monoclonal anti-PfHRPII antibody conjugated with colloidal gold that complexes with PfHRPII in the lysed sample. This complex moves on the nitrocellulose membrane to the region where it is captured by a monoclonal anti-PfHRPII antibody immobilized on the membrane, leading to the formation of a pink coloured band, which confirms a positive test result. The unreacted conjugate and unbound complex, if any, move further on the membrane and are subsequently captured by anti-mouse antibodies fixed on the membrane in the control region, originating a pink band that serves to validate the test performance (Fig. 1). The OptiMALâ Rapid Malaria test (DiaMed SA) is an immunochromatographic test that detects the presence of Plasmodium lactate dehydrogenase (pLDH), an enzyme produced both in the sexual and asexual forms of the parasite. The presence of pLDH is revealed using monoclonal antibodies directed against isoforms of the enzyme and permits to distinguish between Plasmodium falciparum and other Plasmodium species (P. vivax, P. malariae or P. ovale)14.


The objective of the present study was to determine the performance of the Malar-CheckÔPf test in detecting the P. falciparum antigen in the blood of Brazilian patients with malaria. Moreover, we assessed the sensitivity of the Malar-CheckÔPf test compared with Giemsa-stained TBS as the gold standard.

MATERIAL AND METHODS

Dilution assays

Comparison of the Malar-CheckÔPf test and TBS. The P. falciparum Palo Alto isolate was used after culturing by the candle jar method20. Parasitized red blood cells were mixed with culture medium to prepare a 50% hematocrit sample with 81,940 parasites/mm3. By adding a volume of parasitized blood to an equal volume of uninfected donor blood, 14 serial dilutions up to 5 parasites/mm3 were prepared. TBS and Malar-CheckÔPf test were applied to each dilution.

Comparison of the Malar-CheckÔPf test, ParaSightÔF test and TBS. Blood was collected from a patient with 13,400 parasites/mm3 and diluted with uninfected donor blood to prepare dilutions containing 1,340, 134, 77, 33 and 16 parasites/mm3. The Malar-CheckÔPf test, ParaSightÔF test and TBS were performed with each dilution.

Comparison of the Malar-CheckÔPf test, ParaSightÔF test, OptiMALâ Rapid Malaria test and TBS. Blood was collected from a patient with 40,000 parasites/mm3 and diluted with uninfected donor blood to prepare dilutions with 4,000, 400, 200, 100, 50, 25 and 12 parasites/mm3. The Malar-CheckÔPf test, ParaSightÔF test, OptiMALâ Rapid Malaria test and TBS were applied to each dilution.

Field assays

Subjects and sample collection. Blood samples were collected by digital puncture from 65 patients presenting fever (40 collected in São Paulo, São Paulo State, from individuals who were in malaria endemic regions and 25 collected in Santarém, Pará State, Amazon Region). Samples were collected from 7 patients 1, 7, 14 and 30 days after the beginning of treatment to monitor parasitemia clearance. All the blood samples were collected after informed consent from the patients.

Microscopic examination. TBS were prepared for each patient during the blood collection process. After blood films were stained with Giemsa, the species and density of the parasites were determined by two experts in malaria diagnosis. Parasitemia was calculated by the number of parasites per 100 leucocytes based on the assumption of 6,000 leucocytes/mm3 of blood. A total of 100 oil immersion fields were scanned before a slide was considered negative.

Rapid immunocapture assays. The blood samples were also submitted to the ParaSightÔF test, Malar-CheckÔPf test and OptiMALâ Rapid Malaria test. The assays were performed in parallel according to manufacturer instructions and independently examined.

Analysis of field data. The sensitivity and specificity of the Malar-CheckÔPf test were calculated using microscopy as the gold standard.

Cross-reactivity with rheumatoid factor

A total of 18 positive sera for rheumatoid factor (titers > 160) from patients without malaria history were submitted to the Malar-CheckÔPf test. The samples were kindly provided by Laboratório de Investigação em Reumatologia, Faculdade de Medicina, Universidade de São Paulo.

RESULTS

Dilution assays. The dilution experiments were designed to determine the cut-off point for each technique, defined as the highest dilution at which the test was recorded as positive. In a first experiment using the P. falciparum Palo Alto isolate, we compared the Malar-CheckÔPf test and TBS, which detected 80 and 10 parasites/mm3, respectively. Also, we compared the Malar-CheckÔPf test, ParaSightÔF test and TBS using blood from a patient with 13,400 parasites/mm3. TBS, Malar-CheckÔPf test and ParaSightÔF test were positive up to 16, 33 and 77 parasites/mm3, respectively. Additionally, we compared the Malar-CheckÔPf test, ParaSightÔF test, OptiMALâ Rapid Malaria test and TBS using blood from a patient with 40,000 parasites/mm3. TBS, Malar-CheckÔPf test, ParaSightÔF test and OptiMALâ Rapid Malaria test were positive up to 2, 100, 50 and 400 parasites/mm3, respectively.

Field study. A total of 65 blood samples were tested for P. falciparum by the Malar-CheckÔPf test and the results were compared to those obtained from TBS. The test was true-positive in 38 patients, false-positive in 3, true-negative in 23 and false-negative in only 1. Sensitivity was 97.4% (38/39) and specificity 88.5% (23/26). The positive predictive value (PPV) was 92.7% (38/41) and the negative predictive value (NPV) 95.8% (23/24) (Table 1). Of the samples studied, 9 presented P. vivax and 1 presented P. malariae. Only the Malar-CheckÔPf test with P. malariae was positive. In seven P. falciparum patients, blood was collected 1, 7, 14 and 30 days after the beginning of treatment to monitor parasitemia clearance, and the results showed persistence of the antigen up to 30 days.

Cross-reactivity with rheumatoid factor. All sera with rheumatoid factor were negative to the Malar-CheckÔPf test.

DISCUSSION

New methods for malaria diagnosis that complement or even substitute the TBS would be of great usefulness for the control of the disease. Rapid immunocapture assays would be excellent for this purpose, since intensive training and equipment are unnecessary. However, sensitivity is the main requirement for diagnostic application. Therefore, we tested the Malar-CheckÔPf test, a new dipstick assay, using a laboratory isolate with different parasitemias and field samples of P. falciparum from Brazil.

The Malar-CheckÔPf test was able to detect more than 33 parasites/mm3, while the TBS was positive up to 10 parasites/mm3, as described in the literature4. When compared to another dipstick test that detects PfHRPII (ParaSightÔF test), the Malar-CheckÔPf test had a high correlation, although it was more sensitive in one of two experiments. As expected, the Malar-CheckÔPf test was four times more sensitive than the OptiMALâ Rapid Malaria test, possibly because the latter detects only viable parasites, while the Malar-CheckÔPf test detects PfHRPII, that can be present up to 28 days after treatment and parasitemia clearance1.

In the field study, the Malar-CheckÔPf test showed sensitivity up to 240 parasites/mm3. Malar-CheckÔPf test failed to detect P. falciparum in one patient with a mixed infection with P. vivax; however, the TBS showed P. falciparum only in the stage of mature gametocyte. In this slide, all the parasites in the young trophozoite stage presented Schüffner's dots. In this study, three tests showed false-positive results, but we may assume that this probably occurred because of circulating antigen that remained after a recent falciparum infection. In the case of P. malariae, a previous infection with Plasmodium was described by the patient less than one month before, but the species was not identified. In the other two cases the patients were not able to report their last Plasmodium species.

As reported in the literature, the OptiMALâ Rapid Malaria test showed sensitivity ranging from 88.5 to 94%11,19. For the tests based on the detection of PfHRPII, such as the ParaSightÔF test, sensitivity has been reported to range from 84.2 to 96.5%3,15, in agreement with that found in the present study using the Malar-CheckÔPf test (97.4%). Previous studies have revealed that the OptiMALâ Rapid Malaria test presented specificity ranging from 92 to 99.4%5,11. However, the ParaSightÔF test showed values from 72.1 to 97%6,18, similar to the results obtained in the present study using the Malar-CheckÔPf test (88.5%).

Many studies have described false-positive reactions when PfHRPII-based immunocapture diagnostic assays were applied to rheumatoid factor-positive sera2,8,9,12,13. This prompted us to assay the Malar-CheckÔPf test in samples collected from patients with high titers of rheumatoid factor. Using the Malar-CheckÔ Pf test none of these samples showed false-positive results, differently from the other findings.

We conclude that Malar-CheckÔ Pf test should aid the diagnosis of P. falciparum, since the ready execution of the test for early diagnosis in places where TBS cannot be performed could avoid evolution of the disease to severe cases and death. Moreover, the use of rapid dipstick tests could reduce the spread of drug resistance, eliminating the need for presumptive treatments. Some antimalarials are expensive, and therefore using dipsticks instead of treatment based on clinical diagnosis will be more cost effective for malaria control programs. Also, the test could improve the routine diagnosis (TBS), detecting mixed infections when microscopy would not be able to differentiate among young trophozoites of different species. However, when tests that detect PfHRPII are used, previous P. falciparum infection should be considered, since it may cause a false-positive test in cured individuals.

RESUMO

Avaliação de um teste rápido em fita, Malar-CheckÔ, para o diagnóstico de malária por Plasmodium falciparum no Brasil

Este trabalho avaliou o Malar-CheckÔ Pf test, ensaio imunocromatográfico que detecta a proteína rica em histidina de Plasmodium falciparum, dispensa uso de equipamentos, é rápido e de fácil execução. Ensaios de diluição com o isolado Palo Alto ou sangue de pacientes com P. falciparum, foram realizados para testar a sensibilidade em diferentes densidades do parasita. Malar-CheckTM foi comparado à gota espessa (GE), padrão ouro para diagnóstico de malária. A média do limiar de sensibilidade para cada técnica em três experimentos independentes foi de 12 e 71 parasitas/mm3 (GE e Malar-CheckÔ, respectivamente). Em ensaios de campo, amostras foram coletadas de pacientes febris de áreas endêmicas. Comparado à GE, Malar-CheckÔ foi verdadeiramente positivo em 38 pacientes, falso positivo em 3, verdadeiramente negativo em 23 e falso negativo em um. Malar-CheckÔrealizado com sangue de pacientes com P. falciparum após tratamento mostrou persistência do antígeno durante 30 dias. Malar-CheckÔ pode ser útil no diagnóstico de P. falciparum em áreas remotas e auxiliar a rotina diagnóstica, mesmo quando a microscopia está disponível. Deve ser considerada infecção pregressa por P. falciparum, que pode determinar testes positivos em indivíduos curados. A rapidez do Malar-CheckÔ para o diagnóstico precoce pode evitar evolução para casos graves.

ACKNOWLEDGMENTS

We thank RCS – Comércio de Produtos Diagnósticos Ltda, São Paulo – SP, for providing resources and supplies to carry out this work, and Laboratório de Investigação em Reumatologia, Faculdade de Medicina, Universidade de São Paulo for rheumatoid factor sera.

Received: 18 January 2002

Accepted: 12 July 2002

Correspondence to: Silvia Maria Di Santi, Núcleo de Estudos em Malária (SUCEN), Av. Dr. Enéas de Carvalho Aguiar 470, Cerqueira César, 1° andar, sala 22, 05403-000 São Paulo, SP, Brasil. e-mail: santi@usp.br

  • 1. ABUL FAIZ, M.; RASHID, R.; PALIT, R. et al. - ParaSight-F test results in cerebral malaria patients before and after treatment in Chittagong Medical College Hospital, Bangladesh. Trans. roy. Soc. trop. Med. Hyg., 94: 56-57, 2000.
  • 2. BARTOLONI, A.; SABATINELLI G. & BENUCCI, M. - Performance of two rapid tests for Plasmodium falciparum malaria in patients with rheumatoid factors. New Engl. J. Med., 338: 1075, 1998.
  • 3. BOJANG, K.A. - The diagnosis of Plasmodium falciparum infection in Gambian children, by field staff using the rapid, manual, ParaSight-F test. Ann. trop. Med. Parasit., 93: 685-687, 1999.
  • 4. BRUCE-CHWATT, L.J. - Diagnostic methods in malaria. In: BRUCE-CHWATT, L.J., ed. Essential Malariology. 2. ed. London, William Heinemann Medical Books, 1985. p. 103-126.
  • 5. COOKE, A.H.; CHIODINI, P.L.; DOHERTY, T. et al. - Comparison of a parasite lactate dehydrogenase-based immunochromatographic antigen detection assay (OptiMAL) with microscopy for the detection of malaria parasites in human blood samples. Amer. J. trop. Med. Hyg., 60: 173-176, 1999.
  • 6. DIETZE, R.; PERKINS, M.; BOULOS, M. et al. - The diagnosis of Plasmodium falciparum infection using a new antigen detection system. Amer. J. trop. Med. Hyg., 52: 45-49, 1995.
  • 7. GARCIA, M.; KIRIMOAMA, S.; MARLBOROUGH, D.; LEAFASIA, J. & RIECKMANN, K.H. - Immunochromatographic test for malaria diagnosis. Lancet, 347: 1549, 1996.
  • 8. GROBUSH, M.P.; ALPERMANN, U.; SCHWENKE, S.; JELINEK, T. & WARHURST, D.C. - False-positive rapid tests for malaria in patients with rheumatoid factor. Lancet, 353: 297, 1999.
  • 9. IQBAL, J.; SHER, A. & RAB, A. - Plasmodium falciparum histidine-rich protein 2-based immunocapture diagnostic assay for malaria: cross-reactivity with rheumatoid factors. J. clin. Microbiol., 38: 1184-1186, 2000.
  • 10. HOWARD, R.J.; UNI, S.; AIKAWA, M. et al. - Secretion of a malarial histidine-rich protein (Pf HRP II) from Plasmodium falciparum-infected erythrocytes. J. Cell Biol., 103: 1269-1277, 1986.
  • 11. JELINEK, T.; GROBUSH, M.P.; SCHWENKE, S. et al. - Sensitivity and specificity of dipstick tests for rapid diagnosis of malaria in nonimmune travelers. J. clin. Microbiol., 37: 721-723, 1999.
  • 12. LAFERI, H.; KANDEL, K. & PICHLER, H. - False positive dipstick test for malaria. New Engl. J. Med., 337: 1635-1636, 1997.
  • 13. MISHRA, B.; SAMANTARAY, J.C.; KUMAR, A. & MIRDHA, B.R. - Study of false positivity of two rapid antigen detection tests for diagnosis of Plasmodium falciparum malaria. J. clin. Microbiol., 37: 1233, 1999.
  • 14. PALMER, C.J.; LINDO, J.F.; KLASKALA, W.I. et al. - Evaluation of the OptiMAL test for rapid diagnosis of Plasmodium vivax and Plasmodium falciparum malaria. J. clin. Microbiol., 36: 203-206, 1998.
  • 15. PREMIJ, Z.; MINJAS, J.N. & SHIFF, C.J. - Laboratory diagnosis of malaria by village health workers using the rapid manual ParaSight-F test. Trans. roy. Soc. trop. Med. Hyg., 88: 418, 1994.
  • 16. ROCK, E.P.; MARSH, K.; SAUL, A.J. et al. - Comparative analysis of the Plasmodium falciparum histidine-rich proteins HRP-I, HRP-II and HRP-III in malaria parasites of diverse origin. Parasitology, 95: 209-227, 1987.
  • 17. ROSS, R. - An improved method for microscopical diagnosis of intermittent fevers. Lancet, i: 86-87, 1903.
  • 18. SHIFF, C.J.; PREMIJ, Z. & MINJAS, J.N. - The rapid manual ParaSight-F test. A new diagnostic tool for Plasmodium falciparum infection. Trans. roy. Soc. trop. Med. Hyg., 87: 646-648, 1993.
  • 19. TARIMO, D.S.; MINJAS, J.N. & BYGBJERG, I.C. Malaria diagnosis and treatment under the strategy of the integrated management of childhood illness (IMCI): relevance of laboratory support from the rapid immunocromatographic test of ICT Malaria Pf/Pv and OptiMal. Ann. trop. Med. Parasit., 95: 437-444, 2001.
  • 20. TRAGER, W. & JENSEN, J.B. - Human malaria parasites in continuous culture. Science, 193: 673-675, 1976.
  • 21. WHO - World malaria situation in 1994. Part I-III. Wkly. epidem. Rec., 72: 269-290, 1997.
  • (1
    ) Núcleo de Estudos em Malária, Superintendência de Controle de Endemias (SUCEN), São Paulo, SP, Brasil.
    (2
    ) Departamento de Moléstias Infecciosas e Parasitárias, Faculdade de Medicina, Universidade de São Paulo, São Paulo, SP, Brasil.
  • Publication Dates

    • Publication in this collection
      12 Nov 2002
    • Date of issue
      Oct 2002

    History

    • Received
      18 Jan 2002
    • Accepted
      12 July 2002
    Instituto de Medicina Tropical de São Paulo Av. Dr. Enéas de Carvalho Aguiar, 470, 05403-000 - São Paulo - SP - Brazil, Tel. +55 11 3061-7005 - São Paulo - SP - Brazil
    E-mail: revimtsp@usp.br