Acessibilidade / Reportar erro

Cross-cultural adaptation of the Chilean version of the Voice Symptom Scale – VoiSS

ABSTRACT

This research aims to accomplish the cross-cultural equivalence of the Chilean version of the VoiSS protocol through its cultural and linguistic adaptation. After the translation of the VoiSS protocol to Chilean Spanish by two bilingual speech therapists and its back translation to English, we compared the items of the original tool with the previous translated version. The existing discrepancies were modified by a consensus committee of five speech therapists and the translated version was entitled Escala de Sintomas Vocales – ESV, with 30 questions and five answers: “Never”, “Occasionally”, “Sometimes”, “Most of the time”, “Always”. For cross-cultural equivalence, the protocol was applied to 15 individuals with vocal problems. In each question the option of “Not applicable” was added to the answer choices for identification of the questions not comprehended or not appropriate for the target population. Two individuals had difficulty answering two questions, which made it necessary to adapt the translation of only one of them. The modified ESV was applied to three individuals with vocal problems, and there were incomprehensible inappropriate questions for the Chilean culture. The ESV reflects the original English version, both in the number of questions and the limitations of the emotional and physical domains. There is now a cross-cultural equivalence of VoiSS in Chilean Spanish, titled ESV. The validation of the ESV for Chilean Spanish is ongoing.

Keywords:
Voice; Validation Studies; Protocols; Signs and Symptoms; Speech, Language and Hearing Sciences; Surveys and Questionnaires; Evaluation Studies

RESUMEN

Este estudio tuvo como objetivo realizar la equivalencia cultural de la versión Chilena del protocolo Voice Symptom Scale – VoiSS por medio de su adaptación cultural y lingüística. Después de la traducción del VoiSS para el Español Chileno, por dos fonoaudiólogos bilingües, y de la retro traducción para el inglés, se realizó una comparación de los ítems del instrumento original con la versión traducida, surgiendo discrepancias; tales divergencias fueron resueltas por un comité compuesto por cinco fonoaudiólogos, que llegaron a un consenso de donde surgió la denominada Escala de Síntomas Vocales – ESV, compuesta de 30 preguntas y 5 respuestas: “Nunca”, “Casi nunca”, “A veces”, “Casi siempre”, “Siempre”. Con el objetivo de lograr la equivalencia cultural, la ESV fue aplicada a 15 individuos con problemas vocales. A cada pregunta se le agregó la opción “No aplicable” en las elecciones de respuesta, con el fin de identificar preguntas incomprendidas o inapropiadas para la población en cuestión. Dos de los individuos tuvieron dificultades en el momento de contestar dos preguntas, haciéndose necesario adaptar solamente la traducción de una de ellas. La ESV modificada fue aplicada a tres personas más con problemas vocales, no encontrándose preguntas incomprendidas o inapropiadas para la cultura Chilena. La ESV refleja la versión original de inglés, tanto en la cantidad de preguntas como en la limitación de los dominios emocional y físico. Existe una equivalencia cultural del VoiSS para el Español Chileno, que recibe el nombre de ESV. La validación de la ESV para el Español Chileno está en proceso de conclusión.

Descriptores:
Voz; Estudios de Validación; Protocolos; Signos y Síntomas; Fonoaudiología; Encuestas y Cuestionarios; Estudios de Evaluación

INTRODUCTION

The concern for individuals’ quality of life, described in the early 90s(11 WHO: World Health Organization. Measuring quality of life: the World Health Organization Quality of Life Instruments (the WHOQOL-100 and the WHOQOL-BREF). Geneva: WHO; 1997. p. 1-15.), has been highlighted with self-assessment protocols for the impact of a dysphonia(22 Jacobson BH, Johnson A, Grywalski C, Silbergleit A, Jacobson G, Benninger MS, et al. The Voice Handicap Index (VHI): development and validation. Am J Speech Lang Pathol. 1997;6(3):66-70. http://dx.doi.org/10.1044/1058-0360.0603.66.
http://dx.doi.org/10.1044/1058-0360.0603...
,33 Hogikyan ND, Sethuraman G. Validation of an instrument to measure voice-related quality of life (V-RQOL). J Voice. 1999;13(4):557-69. PMid:10622521. http://dx.doi.org/10.1016/S0892-1997(99)80010-1.
http://dx.doi.org/10.1016/S0892-1997(99)...
), used on dysphonic patients during the last two decades. These protocols were created to obtain more data on the development of patients in therapy, and were distributed worldwide in different languages and cultures, with various constructs for their development(44 Branski RC, Cukier-Blaj S, Pusic A, Cano SJ, Klassen A, Mener D, et al. Measuring quality of life in dysphonic patients: a systematic review of content development in patient-reported outcomes measures. J Voice. 2010;24(2):193-8. PMid:19185454. http://dx.doi.org/10.1016/j.jvoice.2008.05.006.
http://dx.doi.org/10.1016/j.jvoice.2008....
).

Vocal self-assessment tools were produced from clinical information with data on specific diseases or resulting data to mix general quality of life aspects with voice symptoms(55 Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5.
http://dx.doi.org/10.1016/S0022-3999(02)...
). The Voice Symptom Scale – VoiSS is a voice self-assessment tool made with a solid construction(44 Branski RC, Cukier-Blaj S, Pusic A, Cano SJ, Klassen A, Mener D, et al. Measuring quality of life in dysphonic patients: a systematic review of content development in patient-reported outcomes measures. J Voice. 2010;24(2):193-8. PMid:19185454. http://dx.doi.org/10.1016/j.jvoice.2008.05.006.
http://dx.doi.org/10.1016/j.jvoice.2008....
), which shows both the voice symptoms and the clinical response to dysphonia treatment(55 Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5.
http://dx.doi.org/10.1016/S0022-3999(02)...
). The VoiSS was developed in the United Kingdom and for its use in other locations it must be translated and culturally adapted, as was done in Brazil(66 Moreti F, Zambon F, Oliveira G, Behlau M. Cross-cultural adaptation of the Brazilian version of the Voice Symptom Scale: VoiSS. J Soc Bras Fonoaudiol. 2011;23(4):398-400. PMid:22231064. http://dx.doi.org/10.1590/S2179-64912011000400018.
http://dx.doi.org/10.1590/S2179-64912011...
), according to international standards set out by the Scientific Advisory Committee of Medical Outcome Trust(77 Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193-205. PMid:12074258. http://dx.doi.org/10.1023/A:1015291021312.
http://dx.doi.org/10.1023/A:101529102131...
).

Therefore, the present study aimed to carry out the cross-cultural equivalence of the Chilean version of the VoiSS protocol, through its cultural and linguistic adaptation.

METHODS

Research was approved by the Research Ethics Committee of the Centro de Especialização em Fonoaudiologia Clínica – CEFAC (CAAE: 39481714.9.0000.5538 and verdict no 897,370). All participants signed the informed consent.

Firstly, two translations of the VoiSS protocol were obtained(55 Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5.
http://dx.doi.org/10.1016/S0022-3999(02)...
) in Chilean Spanish by Chilean bilingual speech therapists working in the voice field (T1 = English-Spanish translator number 1; T2 = English-Spanish translator number 2). Then the two translations were compiled in a single translation (SV = Spanish version of the compilation of translations T1 + T2). A back translation was carried out by a third speech therapist fluent in English, who was unaware of the protocol and did not participate in the earlier stages. The back translation, translation and original version were compared by a committee composed of five speech therapist voice specialists. The discrepancies found were modified by consensus, ultimately resulting in the protocol titled Escala de Síntomas Vocales – ESV.

In the cross-cultural equivalence of the ESV, 15 individuals with different kinds or degrees of dysphonia participated in the study, diagnosed by ENT. The ESV protocol questions could be answered with the following: “Never”, “Occasionally”, “Some of the time”, “Most of the time”, “Always”. In addition, the “not applicable” alternative was added to each question, in order to identify misunderstood or inappropriate phrases for the Chilean population and culture.

Finally, exclusion criteria were applied in cases of illiteracy or protocol misunderstanding, and neurological, cognitive and/or psychiatric disturbances that would prevent proper application of the protocol.

RESULTS

The ESV protocol contains 30 questions, similar to the original version in English. These questions are divided into three domains: 15 questions are concerning limitation (functionality) – e.g., 1- Do you have difficulties to get attention from others using your voice?; 8 questions concerning the emotion domain (psychological) - e.g., 10- Do you feel less valued or depressed due to your voice problem?; and 7 questions belonging to the physical domain (organic symptoms) - e.g., 3- Do you have a sore throat?

At the translation and adaptation stage, 2 individuals from a total of 15 answered the “not applicable” option in various questions (2- Do you have trouble singing? And 24- Do you feel your voice sounds rough and dry?). In the case of question 2, the committee of speech therapists decided not to make modifications since the individual who consigned did not sing, while question 24 itself was modified due to concepts of non-identification of vocabulary, which was as follows: Do you feel that your voice sounds hoarse and dry?. The reformulated ESV was applied to three individuals with impaired speech, in which no cultural and/or conceptual barriers were identified.

The process of adaptation and cultural equivalence of the ESV to Chilean Spanish is abbreviated in Chart 1, and the VoiSS version for Chilean Spanish is listed in Annex A.

Chart 1
Process of translation and cultural adaptation of the Voice Symptom Scale – VoiSS(55 Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5.
http://dx.doi.org/10.1016/S0022-3999(02)...
) for Chilean Spanish

DISCUSSION

The translation and cultural adaptation is a process developed for the population in question, with diverse individuals and types of disorders, in which it is verified whether the translated instrument is applicable to the new culture(77 Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193-205. PMid:12074258. http://dx.doi.org/10.1023/A:1015291021312.
http://dx.doi.org/10.1023/A:101529102131...
). In Chile, Spanish protocols are often used that are not culturally validated, therefore it is necessary to insist on a more rigorous process that consists of a cultural adaptation and equivalence consistent with the Chilean reality.

For the adaptation and validation of the ESV in Chilean Spanish, international standards are considered, provided by the Scientific Advisory Committee of Medical Outcome Trust(77 Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193-205. PMid:12074258. http://dx.doi.org/10.1023/A:1015291021312.
http://dx.doi.org/10.1023/A:101529102131...
), using what was developed in Brazil as a reference, where it was shown that the adaptation and validation of the VoiSS protocol(55 Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5.
http://dx.doi.org/10.1016/S0022-3999(02)...
) for that culture can identify the vocal symptoms that respond to dysphonia treatment(66 Moreti F, Zambon F, Oliveira G, Behlau M. Cross-cultural adaptation of the Brazilian version of the Voice Symptom Scale: VoiSS. J Soc Bras Fonoaudiol. 2011;23(4):398-400. PMid:22231064. http://dx.doi.org/10.1590/S2179-64912011000400018.
http://dx.doi.org/10.1590/S2179-64912011...
,88 Moreti F, Zambon F, Oliveira G, Behlau M. Cross-cultural adaptation, validation, and cutoff values of the Brazilian version of the Voice Symptom Scale-VoiSS. J Voice. 2014;28(4):458-68. PMid:24560004. http://dx.doi.org/10.1016/j.jvoice.2013.11.009.
http://dx.doi.org/10.1016/j.jvoice.2013....
). Validation of assessment tools on the impact of dysphonia generates greater reliability and scientific rigor in clinical practice and research(66 Moreti F, Zambon F, Oliveira G, Behlau M. Cross-cultural adaptation of the Brazilian version of the Voice Symptom Scale: VoiSS. J Soc Bras Fonoaudiol. 2011;23(4):398-400. PMid:22231064. http://dx.doi.org/10.1590/S2179-64912011000400018.
http://dx.doi.org/10.1590/S2179-64912011...
), as is done in other self-assessment tools for the impact of voice problems, which are validated in different languages other than the original(99 Gasparini G, Behlau M. Quality of life: validation of the Brazilian version of the voice-related quality of life (V-RQOL) measure. J Voice. 2009;23(1):76-81. PMid:17628396. http://dx.doi.org/10.1016/j.jvoice.2007.04.005.
http://dx.doi.org/10.1016/j.jvoice.2007....

10 Behlau M, Alves Dos Santos L M, Oliveira G. Cross-cultural adaptation and validation of the voice handicap index into Brazilian Portuguese. J Voice. 2011;25(3):354-9. PMid:20434874. http://dx.doi.org/10.1016/j.jvoice.2009.09.007.
http://dx.doi.org/10.1016/j.jvoice.2009....

11 Paulinelli BR, Gama ACC, Behlau M. Validation of the Vocal Performance Questionnaire in Brazil. Rev Soc Bras Fonoaudiol. 2012;17(1):85-91. http://dx.doi.org/10.1590/S1516-80342012000100016.
http://dx.doi.org/10.1590/S1516-80342012...
-1212 Ricarte A, Oliveira G, Behlau M. Validation of the Voice Activity and Participation Profile protocol in Brazil. CoDAS. 2013;25(3):242-9. PMid:24408335. http://dx.doi.org/10.1590/S2317-17822013000300009.
http://dx.doi.org/10.1590/S2317-17822013...
). This process is being carried out to obtain the VoiSS protocol in Chilean Spanish.

CONCLUSION

The cross-cultural and linguistic equivalence of the Voice Symptom Scale – VoiSS was verified between its original language and the translated version in Chilean Spanish, Escala de Síntomas Vocales – ESV. Validation of the ESV in Chilean Spanish is under development, once this phase is completed.

Annex A. Translated and culturally adapted version of the Chilean Voice Symptom Scale – VoiSS(55 Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5.
http://dx.doi.org/10.1016/S0022-3999(02)...
), called Escala de Síntomas Vocales – ESV

ESCALA DE SÍNTOMAS VOCALES – ESV

Su nombre: _______________________________________________

Fecha de nacimiento: _____/_____/________

Fecha de hoy: _____/_____/________

Por favor, encierre en un círculo una respuesta para cada pregunta.

Por favor, no deje ninguna pregunta sin responder.

1. ¿Tiene dificultades para llamar la atención de los demás usando su voz? Nunca Casi nunca A veces Casi siempre Siempre
2. ¿Tiene problemas al cantar? Nunca Casi nunca A veces Casi siempre Siempre
3. ¿Le duele la garganta? Nunca Casi nunca A veces Casi siempre Siempre
4. ¿Su voz está ronca? Nunca Casi nunca A veces Casi siempre Siempre
5. En conversaciones grupales, ¿Las personas tienen dificultades para escucharlo(a)? Nunca Casi nunca A veces Casi siempre Siempre
6. ¿Suele perder su voz? Nunca Casi nunca A veces Casi siempre Siempre
7. ¿Suele toser o carraspear? Nunca Casi nunca A veces Casi siempre Siempre
8. ¿Considera que tiene una voz débil? Nunca Casi nunca A veces Casi siempre Siempre
9. ¿Tiene problemas al hablar por teléfono? Nunca Casi nunca A veces Casi siempre Siempre
10. ¿Se siente menos valorado o deprimido debido a su problema de la voz? Nunca Casi nunca A veces Casi siempre Siempre
11. ¿Siente como si tuviera algo atascado en su garganta? Nunca Casi nunca A veces Casi siempre Siempre
12. ¿Siente inflamación en la garganta? Nunca Casi nunca A veces Casi siempre Siempre
13. ¿Siente pudor al usar su voz? Nunca Casi nunca A veces Casi siempre Siempre
14. ¿Siente que se cansa al hablar? Nunca Casi nunca A veces Casi siempre Siempre
15. ¿Su problema de la voz lo hace sentir estresado y nervioso? Nunca Casi nunca A veces Casi siempre Siempre
16. ¿Tiene dificultades para hacerse escuchar cuando hay ruido en el ambiente? Nunca Casi nunca A veces Casi siempre Siempre
17. ¿Es incapaz de gritar o alzar la voz? Nunca Casi nunca A veces Casi siempre Siempre
18. ¿Su problema de la voz le genera complicaciones con su familia y amigos? Nunca Casi nunca A veces Casi siempre Siempre
19. ¿Tiene mucha flema o mucosidad en su garganta? Nunca Casi nunca A veces Casi siempre Siempre
20. ¿Siente que la calidad de su voz varía durante el día? Nunca Casi nunca A veces Casi siempre Siempre
21. ¿Siente que a las personas les molesta su voz? Nunca Casi nunca A veces Casi siempre Siempre
22. ¿Tiene la nariz tapada? Nunca Casi nunca A veces Casi siempre Siempre
23. ¿La gente le pregunta qué le pasa a su voz? Nunca Casi nunca A veces Casi siempre Siempre
24. ¿Siente que su voz suena ronca y seca? Nunca Casi nunca A veces Casi siempre Siempre
25. ¿Siente que debe esforzarse para sacar la voz? Nunca Casi nunca A veces Casi siempre Siempre
26. ¿Con cuánta frecuencia presenta infecciones en la garganta? Nunca Casi nunca A veces Casi siempre Siempre
27. ¿Su voz se “agota” mientras está hablando? Nunca Casi nunca A veces Casi siempre Siempre
28. ¿Su voz lo(a) hace sentir incompetente? Nunca Casi nunca A veces Casi siempre Siempre
29. ¿Se siente avergonzado debido a su problema de la voz? Nunca Casi nunca A veces Casi siempre Siempre
30. ¿Se siente aislado por sus problemas con la voz? Nunca Casi nunca A veces Casi siempre Siempre

Gracias por completar este cuestionario

¿Usted respondió todas las preguntas?

Para uso del evaluador:

Cada pregunta tiene un puntaje de 0 a 4 de acuerdo a la frecuencia respuesta: nuca, casi nunca, a veces, casi siempre, siempre.

Puntaje total de ESV: Indica el nivel general de la alteración de voz (máximo 120) = ___________

La subescalas son calculadas por la suma de los ítems, de la siguiente forma:

  • Limitación: 1, 2, 4, 5, 6, 8, 9, 14, 16, 17, 20, 23, 24, 25, 27 (Max 60) = ___________

  • Emocional: 10, 13, 15, 18, 21, 28, 29, 30 (Max 32) = ___________

  • Físico: 3, 7, 11, 12, 19, 22, 26 (Max 28) = ___________

  • Study carried out at the Centro de Estudos da Voz – CEV - São Paulo (SP), Brazil.
  • Financial support: nothing to declare.

REFERENCES

  • 1
    WHO: World Health Organization. Measuring quality of life: the World Health Organization Quality of Life Instruments (the WHOQOL-100 and the WHOQOL-BREF). Geneva: WHO; 1997. p. 1-15.
  • 2
    Jacobson BH, Johnson A, Grywalski C, Silbergleit A, Jacobson G, Benninger MS, et al. The Voice Handicap Index (VHI): development and validation. Am J Speech Lang Pathol. 1997;6(3):66-70. http://dx.doi.org/10.1044/1058-0360.0603.66
    » http://dx.doi.org/10.1044/1058-0360.0603.66
  • 3
    Hogikyan ND, Sethuraman G. Validation of an instrument to measure voice-related quality of life (V-RQOL). J Voice. 1999;13(4):557-69. PMid:10622521. http://dx.doi.org/10.1016/S0892-1997(99)80010-1
    » http://dx.doi.org/10.1016/S0892-1997(99)80010-1
  • 4
    Branski RC, Cukier-Blaj S, Pusic A, Cano SJ, Klassen A, Mener D, et al. Measuring quality of life in dysphonic patients: a systematic review of content development in patient-reported outcomes measures. J Voice. 2010;24(2):193-8. PMid:19185454. http://dx.doi.org/10.1016/j.jvoice.2008.05.006
    » http://dx.doi.org/10.1016/j.jvoice.2008.05.006
  • 5
    Deary IJ, Wilson JA, Carding PN, MacKenzie K. VoiSS: a patient-derived Voice Symptom Scale. J Psychosom Res. 2003;54(5):483-9. PMid:12726906. http://dx.doi.org/10.1016/S0022-3999(02)00469-5
    » http://dx.doi.org/10.1016/S0022-3999(02)00469-5
  • 6
    Moreti F, Zambon F, Oliveira G, Behlau M. Cross-cultural adaptation of the Brazilian version of the Voice Symptom Scale: VoiSS. J Soc Bras Fonoaudiol. 2011;23(4):398-400. PMid:22231064. http://dx.doi.org/10.1590/S2179-64912011000400018
    » http://dx.doi.org/10.1590/S2179-64912011000400018
  • 7
    Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, et al. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193-205. PMid:12074258. http://dx.doi.org/10.1023/A:1015291021312
    » http://dx.doi.org/10.1023/A:1015291021312
  • 8
    Moreti F, Zambon F, Oliveira G, Behlau M. Cross-cultural adaptation, validation, and cutoff values of the Brazilian version of the Voice Symptom Scale-VoiSS. J Voice. 2014;28(4):458-68. PMid:24560004. http://dx.doi.org/10.1016/j.jvoice.2013.11.009
    » http://dx.doi.org/10.1016/j.jvoice.2013.11.009
  • 9
    Gasparini G, Behlau M. Quality of life: validation of the Brazilian version of the voice-related quality of life (V-RQOL) measure. J Voice. 2009;23(1):76-81. PMid:17628396. http://dx.doi.org/10.1016/j.jvoice.2007.04.005
    » http://dx.doi.org/10.1016/j.jvoice.2007.04.005
  • 10
    Behlau M, Alves Dos Santos L M, Oliveira G. Cross-cultural adaptation and validation of the voice handicap index into Brazilian Portuguese. J Voice. 2011;25(3):354-9. PMid:20434874. http://dx.doi.org/10.1016/j.jvoice.2009.09.007
    » http://dx.doi.org/10.1016/j.jvoice.2009.09.007
  • 11
    Paulinelli BR, Gama ACC, Behlau M. Validation of the Vocal Performance Questionnaire in Brazil. Rev Soc Bras Fonoaudiol. 2012;17(1):85-91. http://dx.doi.org/10.1590/S1516-80342012000100016
    » http://dx.doi.org/10.1590/S1516-80342012000100016
  • 12
    Ricarte A, Oliveira G, Behlau M. Validation of the Voice Activity and Participation Profile protocol in Brazil. CoDAS. 2013;25(3):242-9. PMid:24408335. http://dx.doi.org/10.1590/S2317-17822013000300009
    » http://dx.doi.org/10.1590/S2317-17822013000300009

Publication Dates

  • Publication in this collection
    31 Oct 2016
  • Date of issue
    Sep-Oct 2016

History

  • Received
    15 Sept 2015
  • Accepted
    22 Nov 2015
Sociedade Brasileira de Fonoaudiologia Al. Jaú, 684, 7º andar, 01420-002 São Paulo - SP Brasil, Tel./Fax 55 11 - 3873-4211 - São Paulo - SP - Brazil
E-mail: revista@codas.org.br