Abstract
Objective
to develop and assess a Knowledge, Attitude and Practice survey on healthy lifestyle in people with human immunodeficiency virus.
Method
a development study, with the elaboration of survey through of an integrative review and analysis of the guidelines; content and appearance analysis by 22 expert judges; and semantic analysis by 22 outpatients. The proportion of positive assessments of the items was measured, considering a percentage equal to or greater than 85%.
Results
the survey had three domains and seven axes: chronic diseases in people with human immunodeficiency virus; body weight control; healthy eating; physical exercise; avoiding smoking, alcohol and illicit drugs; stress control/reduction; antiretroviral and other medication compliance. Knowledge and attitude domains had 10 questions, and practice domains had 11. In the assessment by expert judges, nurses, doctors and nutritionists participated, with positive agreement of items above 85%. Patients underwent semantic analysis, with 100% positive agreement in the domains.
Conclusion and implications for practice
the survey had adequate evidence of validity, to be used by nurses and other health professionals, to support care, educational strategies and research with people living with the human immunodeficiency virus.
Keywords:
HIV; Lifestyle; Chronic Disease; Surveys and Questionnaires; Nursing
Resumo
Objetivo
desenvolver e avaliar um inquérito de Conhecimento, Atitude e Prática sobre estilo de vida saudável em pessoas com vírus da imunodeficiência humana.
Método
estudo de desenvolvimento, com elaboração do inquérito por meio de revisão integrativa e análise das diretrizes; análise de conteúdo e aparência por 22 juízes especialistas; e análise semântica por 22 pacientes em acompanhamento ambulatorial. Mensurada a proporção de avaliações positivas dos itens, considerando-se percentual igual ou maior a 85%.
Resultados
o inquérito teve três domínios e sete eixos: doenças crônicas em pessoas com vírus da imunodeficiência humana; controle do peso corporal; alimentação saudável; prática de exercício físico; evitar fumo, álcool e drogas ilícitas; controle/redução do estresse; adesão aos antirretrovirais e outros medicamentos. Domínios conhecimento e atitude tiveram 10 perguntas, e o de prática, 11. Na avaliação pelos juízes especialistas, participaram enfermeiros, médicos e nutricionista, com concordância positiva dos itens acima de 85%. Os pacientes fizeram a análise semântica, com concordância positiva nos domínios de 100%.
Conclusão e implicações para a prática
o inquérito teve evidência de validade adequada, para ser utilizado por enfermeiros e outros profissionais de saúde, para subsidiar a assistência, estratégias educativas e pesquisas com pessoas vivendo com o vírus da imunodeficiência humana.
Palavras-chave:
HIV; Estilo de Vida; Doença Crônica; Inquéritos e Questionários; Enfermagem
Resumen
Objetivo
elaborar y evaluar una encuesta de conocimientos, actitudes y prácticas sobre estilo de vida saludable en personas con virus de inmunodeficiencia humana.
Método
estudio de desarrollo, con la elaboración de la encuesta a través de una revisión y análisis integrador de las directrices; análisis de contenido y apariencia por 22 jueces expertos; y análisis semántico por 22 pacientes ambulatorios. Se midió la proporción de valoraciones positivas de los ítems, considerando un porcentaje igual o superior al 85%.
Resultados
la encuesta tuvo tres dominios y siete ejes: enfermedades crónicas en personas portadoras del virus de la inmunodeficiencia humana; control del peso corporal; alimentación saludable; ejercicio físico; evitación del tabaquismo, alcohol y drogas ilícitas; control/reducción del estrés; adherencia a los antirretrovirales y otros medicamentos. Los dominios conocimientos y actitudes tenían 10 preguntas y los dominios práctica tenían 11. En la evaluación de los jueces expertos, participaron enfermeros, médicos y nutricionistas, con concordancia positiva de los ítems superior al 85%. Los pacientes fueron sometidos a análisis semántico, con 100% de concordancia positiva en los dominios.
Conclusión e implicaciones para la práctica
la encuesta tuvo pruebas adecuadas de validez, para ser utilizada por enfermeros y otros profesionales de la salud, para apoyar la asistencia, las estrategias educativas y la investigación con personas que viven con el virus de la inmunodeficiencia humana.
Palabras-clave:
VIH; Estilo de Vida; Enfermedad Crónica; Encuestas y Cuestionarios; Enfermería
INTRODUCTION
With Highly Active Antiretroviral Therapy (HAART), Human Immunodeficiency Virus (HIV) infection has gone from a progressive and fatal disease to a chronic and controllable condition, with a consequent reduction in mortality.11 Boyd MA, Boffito M, Castagna A, Estrada V. Rapid initiation of antiretroviral therapy at HIV diagnosis: definition, process, knowledge gaps. HIV Med. 2019 mar;20(Supl 1):3-11. http://dx.doi.org/10.1111/hiv.12708. PMid:30724450.
http://dx.doi.org/10.1111/hiv.12708...
Concurrent with the increase in life expectancy, people living with HIV (PLHIV) became more susceptible to the onset of other chronic diseases. Rates of myocardial infarction, heart failure, stroke, and other manifestations of cardiovascular disease, such as pulmonary hypertension and sudden cardiac death, are significantly higher in PLHIV than in uninfected control subjects, even in the context of viral suppression and effective HAART.22 Feinstein MJ, Hsue PY, Benjamin LA, Bloomfield GS, Currier JS, Freiberg MS et al. Characteristics, prevention, and management of cardiovascular disease in people living with HIV: a scientific statement from the American Heart Association. Circulation. 2019 jul;140(2):e98-124. http://dx.doi.org/10.1161/CIR.0000000000000695. PMid:31154814.
http://dx.doi.org/10.1161/CIR.0000000000...
These elevated risks persist after sociodemographic and clinical risk factors are accounted for, and may be partially attributed to chronic inflammation and immune dysregulation by HIV.22 Feinstein MJ, Hsue PY, Benjamin LA, Bloomfield GS, Currier JS, Freiberg MS et al. Characteristics, prevention, and management of cardiovascular disease in people living with HIV: a scientific statement from the American Heart Association. Circulation. 2019 jul;140(2):e98-124. http://dx.doi.org/10.1161/CIR.0000000000000695. PMid:31154814.
http://dx.doi.org/10.1161/CIR.0000000000...
Despite the benefits of HAART on HIV suppression and increase in CD4+ T lymphocytes, metabolic alterations, bone demineralization, lipodystrophy and lactic acidosis occur after adaptation to HAART and its long-term use. These events are not specific to a type of antiretroviral drug, but the severity and incidence vary individually, depending on drug classes, which may lead to discontinuation of therapy or switching to regimens with fewer adverse effects.33 Thet D, Siritientong T. Antiretroviral therapy-associated metabolic complications: review of the recent studies. HIV AIDS. 2020 out;12:507-24. http://dx.doi.org/10.2147/HIV.S275314. PMid:33061662.
http://dx.doi.org/10.2147/HIV.S275314...
Studies also show that PLHIV who use alcohol and illicit drugs have reduced HAART compliance and viral suppression, in addition to toxicity, as the drugs interact with antiretrovirals, resulting in risk for liver disease, dysfunctions in drug absorption and metabolism, in addition to reducing the effectiveness of treatment and increasing the chances of virus transmission and co-infections.44 Fuster-RuizdeApodaca MJ, Castro-Granell V, Laguía A, Jaén A, Cenoz S, Galindo MJ. Drug use and antiretroviral therapy (ART) interactions: a qualitative study to explore the knowledge, beliefs, adherence, and quality of life of people living with HIV taking ART and illicit drugs. AIDS Res Ther. 2020 mai;17(1):24. http://dx.doi.org/10.1186/s12981-020-00279-y. PMid:32448214.
http://dx.doi.org/10.1186/s12981-020-002...
,55 Wagman JA, Wynn A, Matsuzaki M, Gnatienko N, Metsch LR, Rio C et al. Hazardous alcohol use, antiretroviral therapy receipt, and viral suppression in people living with HIV who inject drugs in the United States, India, Russia, and Vietnam. AIDS. 2020 dez;34(15):2285-94. http://dx.doi.org/10.1097/QAD.0000000000002716. PMid:33048870.
http://dx.doi.org/10.1097/QAD.0000000000...
Inflammation and smoking are independent predictors of morbidity and mortality in PLHIV, as the burden of smoking exacerbates inflammation, with the hypothesis that greater intensity and duration of smoking is associated with an increase in C-reactive protein, an inflammatory marker. Thus, reducing the intensity and duration of smoking to cessation may be helpful in reducing levels of inflammation and mitigating HIV-related harm.66 Poudel KC, Poudel-Tandukar K, Bertone-Johnson ER, Pekow P, Vidrine DJ. Inflammation in relation to intensity and duration of cigarette smoking among people living with HIV. AIDS Behav. 2021 mar;25(3):856-65. http://dx.doi.org/10.1007/s10461-020-03048-0. PMid:32986190.
http://dx.doi.org/10.1007/s10461-020-030...
A study carried out in South Africa also showed that, among PLHIV, malnutrition, obesity and a sedentary lifestyle are highlighted, with diets of low nutritional diversity, rich in carbohydrates, with few fruits and vegetables, no regular exercise, and limited understanding of the health impact of obesity.77 Hyle EP, Martey EB, Bekker L, Xu A, Parker RA, Walensky RP et al. Diet, physical activity, and obesity among ART-experienced people with HIV in South Africa. AIDS Care. 2021 dez;16:1-7. http://dx.doi.org/10.1080/09540121.2021.2012556. PMid:34913762.
http://dx.doi.org/10.1080/09540121.2021....
Given the above, changes in health behavior are essential so that PLHIV are not affected by other chronic conditions and have a better quality of life. This research arose from the need to analyze Knowledge, Attitude and Practice, when it was found after the development and validity of an educational booklet to promote a healthy lifestyle in PLHIV,88 Fontenele MSM, Cunha GH, Lopes MVO, Siqueira LR, Lima MAC, Moreira LA. Development and evaluation of a booklet to promote ealthy lifestyle in people with HIV. Rev Bras Enferm. 2021 mar;74(Supl 5):e20200113. http://dx.doi.org/10.1590/0034-7167-2020-0113. PMid:33729374.
http://dx.doi.org/10.1590/0034-7167-2020...
which there was no published form capable of assessing whether these patients were aware of, would like to change their habits and practiced the health guidelines.
Thus, this study was designed to develop and assess a Knowledge, Attitude and Practice (KAP) survey, which consists of a set of questions to measure what the population knows, thinks and acts on a given problem, in addition to pointing out possible avenues for interventions.99 Kaliyaperumal K. Guideline for conducting a knowledge, attitude and practice (KAP) study. AECS Illumination. 2004 jan/mar [citado 2022 out 13];4(1):7-9. Disponível em: http://v2020eresource.org/content/files/guideline_kap_Jan_mar04.pdf
http://v2020eresource.org/content/files/...
KAP concepts were established from a similar study: knowledge means remembering specific facts within an individual’s educational system, ability to apply these facts to problem-solving, and emitting concepts with the understanding gained about a given event; attitude is to have opinions, feelings, predispositions and constant beliefs, directed to an objective, person or situation, regarding the affective domain and emotional dimension; practice is decision-making to perform an action, and is related to the psychomotor, affective, cognitive and social dimension domains.1010 Marinho LAB, Costa-Gurgel MS, Cecatti JG, Osis MJD. Knowledge, attitude and practice of breast self-examination in health centers. Rev Saude Publica. 2003 out;37(5):576-82. http://dx.doi.org/10.1590/S0034-89102003000500005. PMid:14569332.
http://dx.doi.org/10.1590/S0034-89102003...
In this context, this study aimed to develop and assess a KAP survey on healthy lifestyle in people with HIV.
METHOD
This is a developmental study to design and assess a KAP survey to verify what PLHIV know, think and act in relation to a healthy lifestyle. The research was developed in 2019, in Fortaleza, Ceará, Brazil, in three stages: 1. KAP survey development; 2. KAP survey assessment by expert judges; 3. KAP survey assessment by PLHIV.
The study population consisted of expert judges and PLHIV. The infinite population formula was used, with statistical criteria in the minimum proportion of 85% agreement, with the relevance of each item assessed, and a difference of 15% in this agreement was admitted. The sample was defined by the formula:1111 Lopes MVO, Silva VM, Araújo TL. Methods for establishing the accuracy of clinical indicators in predicting nursing diagnoses. Int J Nurs Knowl. 2012 out;23(3):134-9. http://dx.doi.org/10.1111/j.2047-3095.2012.01213.x. PMid:23043652.
http://dx.doi.org/10.1111/j.2047-3095.20...
n=Zα2.P.(1-P)/d,22 Feinstein MJ, Hsue PY, Benjamin LA, Bloomfield GS, Currier JS, Freiberg MS et al. Characteristics, prevention, and management of cardiovascular disease in people living with HIV: a scientific statement from the American Heart Association. Circulation. 2019 jul;140(2):e98-124. http://dx.doi.org/10.1161/CIR.0000000000000695. PMid:31154814.
http://dx.doi.org/10.1161/CIR.0000000000...
where Zα is the confidence coefficient (95% - 1.96), referring to the correct decision-making based on the null hypothesis; P is the proportion expected from experts and indicates the adequacy of each item; d: represents the acceptable proportional difference from the expected. The calculation was determined by n=(1.96)22 Feinstein MJ, Hsue PY, Benjamin LA, Bloomfield GS, Currier JS, Freiberg MS et al. Characteristics, prevention, and management of cardiovascular disease in people living with HIV: a scientific statement from the American Heart Association. Circulation. 2019 jul;140(2):e98-124. http://dx.doi.org/10.1161/CIR.0000000000000695. PMid:31154814.
http://dx.doi.org/10.1161/CIR.0000000000...
.(0.85).(0.15)/(0.15),22 Feinstein MJ, Hsue PY, Benjamin LA, Bloomfield GS, Currier JS, Freiberg MS et al. Characteristics, prevention, and management of cardiovascular disease in people living with HIV: a scientific statement from the American Heart Association. Circulation. 2019 jul;140(2):e98-124. http://dx.doi.org/10.1161/CIR.0000000000000695. PMid:31154814.
http://dx.doi.org/10.1161/CIR.0000000000...
the sample being 22 judges with expertise in HIV. In the same way, the sample of 22 PLHIV was calculated.
For the selection of expert judges, intentional non-probabilistic sampling was carried out, based on adapted inclusion criteria: having a master’s degree (1 point) or a doctorate (2 points) in health; dissertation (1 point) or thesis (2 points) on PLHIV; published article on HIV (1 point); having participated in HIV research group/project (1 Score); to be a professor in courses in health involving assistance to PLHIV (2 points); professional experience in HIV hospitals or clinics (2 points).1212 Lira ALBC, Lopes MVO. Nursing diagnosis: educational strategy based on problem-based learning. Rev Lat Am Enfermagem. 2011 jul/ago;19(4):936-43. http://dx.doi.org/10.1590/S0104-11692011000400012. PMid:21876946.
http://dx.doi.org/10.1590/S0104-11692011...
Professionals should have at least six points to be included. The search for the judges took place on the Platforma Lattes of the Brazilian National Council for Scientific and Technological Development (CNPq - Conselho Nacional de Desenvolvimento Científico e Tecnológico), after invitation via e-mail or in person at the workplace.
PLHIV were recruited through convenience sampling at the Hospital Universitário Walter Cantídio Infectious Diseases Outpatient Clinic (HUWC) of the Universidade Federal do Ceará (UFC), while waiting for a medical appointment. Inclusion criteria were age 18 years or older, being on outpatient follow-up, being able to read the KAP survey and understand it, having more than 35 points on the Health Literacy Scale.1313 Suka M, Odajima T, Kasai M, Igarashi A, Ishikawa H, Kusama M et al. The 14-item health literacy scale for Japanese adults (HLS-14). Environ Health Prev Med. 2013 set;18(5):407-15. http://dx.doi.org/10.1007/s12199-013-0340-z. PMid:23689952.
http://dx.doi.org/10.1007/s12199-013-034...
This scale was translated and adapted to Brazilian Portuguese and contains 14 questions that assess health literacy in three dimensions: functional (5 items), communicative (5 items) and critical (4 items) literacy).1414 Batista MJ, Marques ACP, Silva Jr MF, Alencar GP, Sousa MLR. Translation, cross-cultural adaptation and psychometric evaluation of Brazilian Portuguese version of the 14-item Health Literacy Scale. Cien Saude Colet. 2020 jul;25(7):2847-57. http://dx.doi.org/10.1590/1413-81232020257.22282018. PMid:32667566.
http://dx.doi.org/10.1590/1413-812320202...
The answers follow a five-point Likert scale: (1) strongly agree, (2) agree, (3) neither agree nor disagree, (4) disagree, (5) strongly disagree. The score is calculated by the total sum of the items. If above 35 points, health literacy level is considered adequate.1313 Suka M, Odajima T, Kasai M, Igarashi A, Ishikawa H, Kusama M et al. The 14-item health literacy scale for Japanese adults (HLS-14). Environ Health Prev Med. 2013 set;18(5):407-15. http://dx.doi.org/10.1007/s12199-013-0340-z. PMid:23689952.
http://dx.doi.org/10.1007/s12199-013-034...
,1414 Batista MJ, Marques ACP, Silva Jr MF, Alencar GP, Sousa MLR. Translation, cross-cultural adaptation and psychometric evaluation of Brazilian Portuguese version of the 14-item Health Literacy Scale. Cien Saude Colet. 2020 jul;25(7):2847-57. http://dx.doi.org/10.1590/1413-81232020257.22282018. PMid:32667566.
http://dx.doi.org/10.1590/1413-812320202...
The KAP survey was developed based on an integrative review, whose research question was: what are the interventions for a healthy lifestyle in PLHIV?
The research question was supported by the PICo strategy, which represents an acronym for Patient or Population (People Living with HIV), Interest or Intervention (health education strategies) and Context (healthy lifestyle). Full articles available electronically, in Portuguese, English or Spanish, involving the theme, regardless of the year of publication, were included. Letters to the editor were excluded.
The articles were selected from the databases: Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Índice Bibliográfico Español de Ciencias de La Salud (IBECS), Latin American and Caribbean Literature in Health Sciences (LILACS) and Scopus, and an electronic library, the Scientific Electronic Library Online (SciELO).
To survey the articles, the following descriptors were used: HIV; Acquired Immunodeficiency Syndrome; Hypertension; Highly Active Antiretroviral Therapy; Health promotion; Validity Studies; Technology; Health education; Chronic Conditions. All were from the Descriptors of Health Sciences (DeCS), from the Virtual Health Library and Medical Subject Headings (MeSH) from the National Library of Medicine, in Portuguese, English and Spanish, using the Boolean operator AND for crossings. The crosses performed were: [Acquired Immunodeficiency Syndrome AND Antiretroviral Therapy Highly Active AND Hypertension], [Acquired Immunodeficiency Syndrome AND Health Education AND Chronic Disease], [Acquired Immunodeficiency Syndrome AND Technology AND Health Education], [Health Promotion AND Acquired Immunodeficiency Syndrome], [HIV AND Hypertension AND Validity studies].
A total of 2,705 articles were found, 2,696 were excluded for not answering the guiding question, nine being selected for full reading. The issues identified to be addressed in the KAP survey were: interventions aimed at non-drug treatment compliance (body weight control, healthy eating, regular physical exercise, avoiding smoking, alcohol and illicit drugs, stress control/reduction), and interventions aimed at drug treatment compliance. To these findings, information from the guidelines for the treatment of PLHIV1515 Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Protocolo clínico e diretrizes terapêuticas para manejo da infecção pelo HIV em adultos. Brasília: Ministério da Saúde; 2018. and the prevention and control of chronic noncommunicable diseases (CNCD) was added.1616 Ministério da Saúde (BR). Secretaria de Atenção à Saúde. Diretrizes para o cuidado das pessoas com doenças crônicas nas redes de atenção à saúde e nas linhas de cuidado prioritárias. Brasília: Ministério da Saúde; 2018.
The KAP survey built was submitted to expert judges’ assessment, who performed content and appearance analysis. After accepting to participate in the study, they received a kit with the Informed Consent Form (ICF), the KAP survey and the KAP survey assessment instrument. A period of 15 days was stipulated for assessment, for completing the self-applied questionnaire, containing two parts: 1. Identification and training data (name, date of birth, age, sex, profession, training time, degree, research projects, participation in a research group, work area, institution, function/position, time working in the area, scientific production, experience in validating educational instruments/materials); and 2. KAP survey content analysis (three questions about content adequacy in the three domains: Knowledge, Attitude and Practice). The answers to the questions for each domain were presented by dichotomous variables: (1) Yes, I agree with the proposed question; (2) I do not agree with the question proposed. The questionnaire had space for suggestions. If they did not return the questionnaire and the ICF within the deadline, the judges had another 15 days for delivery, being excluded from the study after this period, but, in this study, there were no exclusions.
Next, the KAP survey was assessed by PLHIV, who performed the semantic analysis, to verify if the items were understandable to the population for which it is intended, considering individuals of different socioeconomic levels and schooling. After signing the ICF in a private environment, participants received the printed KAP survey for reading, and then answered the assessment questionnaire. The average time of this procedure was 30 minutes. The self-administered questionnaire contained two parts: 1. Identification data (name, date of birth, age, sex, number of years of study, until which grade studied, category of exposure, time of diagnosis of positive HIV serology); and 2. KAP survey content analysis (three questions about content adequacy in the three domains: Knowledge, Attitude and Practice). The answers to the questions in each domain were based on dichotomous variables: (1) Yes, I agree with the proposed question; (2) I do not agree with the proposed question. The questionnaire had space for suggestions.
After KAP survey assessment by expert judges and PLHIV, the data obtained were analyzed by measuring the proportion of evaluators, who agreed on the positive item assessment.1717 Polit DF, Beck CT. Fundamentos da pesquisa em enfermagem: avaliação de evidências para a prática de enfermagem. 7ª ed. Porto Alegre: Artes Médicas; 2011. Item relevance is reached through a percentage greater than or equal to 85% of agreement among evaluators.1111 Lopes MVO, Silva VM, Araújo TL. Methods for establishing the accuracy of clinical indicators in predicting nursing diagnoses. Int J Nurs Knowl. 2012 out;23(3):134-9. http://dx.doi.org/10.1111/j.2047-3095.2012.01213.x. PMid:23043652.
http://dx.doi.org/10.1111/j.2047-3095.20...
Thus, the item that obtains a total percentage lower than 85%, for any of the assessed criteria, should be modified according to evaluators’ suggestions or excluded. To characterize expert judges and PLHIV, frequency distributions, measures of central tendency and dispersion were performed, normality tests, taking as a reference a confidence interval of 95% for quantitative variables. IBM® SPSS® Statistics for Windows, Version 23.0 was used for statistical analysis.
The project was approved by the UFC Research Ethics Committee, under Opinion 2,481,617, and by the co-participating institution, HUWC, under Opinion 2,513,172. The study followed Resolution 466/2012 and all participants signed the ICF.
RESULTS
After an integrative literature review and analysis of health care guidelines for people with HIV, the KAP survey on a healthy lifestyle in PLHIV was created. The survey had three domains (knowledge, attitude and practice) with questions covering 7 subject axes: 1. Chronic diseases in PLHIV; 2. Body weight control; 3. Healthy eating; 4. Practice of regular physical exercise; 5. Avoid smoking, alcohol and illicit drugs; 6. Stress control/reduction; 7. Compliance with antiretrovirals and other medications.
In the knowledge domain, 10 questions were formulated to measure the understanding of PLHIV about a healthy lifestyle. The answers to the questions occurred by the variables: (1) Yes, (2) No, (3) do not know. In the attitude domain, 10 questions were formulated to measure individuals’ interest in situations or objectives. The answers occurred by the variables: (1) Yes, (2) No. In the practice domain, 11 questions were formulated to measure the execution of actions regarding healthy practices. The answers to the questions occurred by the variables: (1) Yes, (2) No, (3) do not know. The three domains allow assessment separately, obtaining adequate or inadequate knowledge, attitude and practice.
The KAP survey developed was then assessed by 22 expert judges with expertise in the area of HIV, who performed material content and appearance analysis. This group consisted of 15 nurses, a nutritionist, two general practitioners and four infectious disease specialists, which reached a score equal to or greater than six, based on the criteria mentioned in the Method. The affiliations of expert judges were: Ceará (Universidade Federal do Ceará, Universidade Estadual do Ceará, Universidade de Fortaleza), São Paulo (Universidade de São Paulo) and Rio de Janeiro (Universidade Federal do Rio de Janeiro). The mean and standard deviation (mean ± SD) were respectively: age (42.1 ± 10.3), time since graduation (18.2 ± 10.1) and time working in the area were respectively (13.0 ± 9.5). Table 1 shows the characterization of expert judges.
Characterization of expert judges according to sociodemographic data (n=22). Fortaleza/CE, 2019.
Subsequently, the KAP survey was assessed by the target population, composed of 22 PLHIV in outpatient follow-up, which occurred through semantic analysis. The mean and standard deviation (mean ± SD) were respectively age (41.5 ± 11.9), education (10.9 ± 2.9) and time of diagnosis of positive anti-HIV serology (9.0 ± 7 ,5). Table 2 characterizes these individuals.
Characterization of people living with HIV according to sociodemographic data (n=22). Fortaleza/CE, 2019.
All domains of the KAP survey assessed by experts had positive agreement above 85%, so there was no need for reassessment. The attitude domain had 100% agreement, the knowledge and practice domains had, respectively, 90.9% and 95.5% of positive agreement. Two judges who did not agree in the knowledge domain and one judge who did not agree in the practice domain did not leave any suggestions for changes. All PLHIV responded “yes” to the domains assessed. Thus, the domains’ positive agreement was 100%, with no variation in the answers, therefore, a reassessment was not necessary. Table 3 shows KAP survey assessment by expert judges and PLHIV.
Assessment of the Knowledge, Attitude and Practice survey by expert judges and people living with HIV (n=44). Fortaleza/CE, 2019.
Therefore, the KAP survey on healthy lifestyle in PLHIV is validated in terms of content, appearance and semantics. The final instrument setting has 31 items, divided into three domains, with response options ranging from 1 to 3. With this study, we also suggest scoring criteria with a percentage total to classify patient responses in each domain as adequate or inadequate. It was considered as adequate knowledge, attitude and practice, the value equal to or greater than 70% of correct answers in the questions in each domain, in which the answers are correct when a participant answers “yes”, scoring the question. With the exception of the practice domain, where for items 8 and 9, the appropriate answer will be “no”. The answers were considered adequate or inadequate according to an integrative review carried out, in addition to the guidelines for health care for PLHIV. The KAP survey in full and the suggested criteria for assessment are presented, respectively, in Charts 1-2.
Knowledge, Attitude and Practice Survey on healthy lifestyle in people living with HIV. Fortaleza/CE, 2019.
Knowledge, Attitude and Practice Survey on healthy lifestyle in people living with HIV assessment criteria. Fortaleza/CE, 2019.
DISCUSSION
The elaboration of a KAP survey on a healthy lifestyle in PLHIV represents an important technology, as it directs the actions of professionals to promote this target audience’s health, through the identification of knowledge about the disease and lifestyle, the assessment of attitudes and verification of its practice in daily habits, which, if inadequate, can generate risks for other chronic conditions.1818 Filgueiras TF, Silva RA, Pimenta CJL, Filgueiras TF, Oliveira SHS, Castro RCMB. Instrument for nursing consultation to pregnant women with diabetes mellitus. Rev Rene. 2019 mar;20:e40104. http://dx.doi.org/10.15253/2175-6783.20192040104.
http://dx.doi.org/10.15253/2175-6783.201...
The development of quality materials enables educational interventions based on structured knowledge and information aimed at the clientele, contributes to the teaching-learning process and encourages behavioral changes.1919 Silva RA, Ximenes LB, Cruz AG, Serra MAAO, Araújo MFM, Andrade LM et al. Sexual activity of people with spinal cord injury: development and validation of an educational booklet. Acta Paul Enferm. 2018 mai/jun;31(3):255-64. http://dx.doi.org/10.1590/1982-0194201800037.
http://dx.doi.org/10.1590/1982-019420180...
Another study also showed that the application of a KAP survey about the Pap smear in pregnant women had a positive effect to mediate educational interventions, resulting in an improvement in the levels of knowledge about the test.2020 Rosa ARR, Silva TSL, Carvalho ICS, Sousa ASJ, Rodrigues AB, Penha JC. Cervical cytology examination: inquiry into the knowledge, attitude and practice of pregnant women. Cogitare Enferm. 2018 fev;23(2):e52589. http://dx.doi.org/10.5380/ce.v23i2.52589.
http://dx.doi.org/10.5380/ce.v23i2.52589...
For the construction of measurement instruments, it is essential to outline objectives that are connected with the concepts discussed, in addition to defining the target population, as it justifies the relevance of creating a specific instrument. Questionnaire items should not be constructed at random, nor restricted to technical and scientific knowledge, as it can make it difficult for patients to understand.2121 Andrade C, Menon V, Ameen S, Praharaj SK. Designing and conducting knowledge, attitude, and practice surveys in psychiatry: practical guidance. Indian J Psychol Med. 2020 ago;42(5):478-81. http://dx.doi.org/10.1177/0253717620946111. PMid:33414597.
http://dx.doi.org/10.1177/02537176209461...
In this regard, the KAP survey was built from themes intrinsic to PLHIV’s healthy lifestyle, based on a literature review, national and international guidelines, and with simple and direct language.
Among the topics addressed, the need to change eating habits stands out. Assessment of PLHIV’s nutritional status is necessary for the proper institution of treatment and prevention of diseases, because adequate food consumption can reduce the side effects of medications, if they are involved with symptoms of malabsorption, in addition to preserving lean mass and promoting a better quality of life for these patients.2222 Silveira EA, Falco MO. Nutritional diagnosis of people living with HIV/AIDS: a review of national and international protocols. Cien Saude Colet. 2020 dez;25(12):5003-16. http://dx.doi.org/10.1590/1413-812320202512.36262018. PMid:33295518.
http://dx.doi.org/10.1590/1413-812320202...
It is also essential to measure knowledge, attitude and practice about physical exercise appropriate to clinically stable PLHIV’s health conditions. Regular practice of physical exercise stimulates the immune system of these individuals, increases CD4+ T lymphocytes, reduces fat and glycemic index, increases muscle mass, with a reduction in metabolic syndrome and coronary risk factors.2323 Oliveira JA, Aguiar MB, Vasconcelos WKV, Silva HG, Leandro LS. Influence of physical exercise on the TCD4+ cell count in people living with HIV/AIDS: an integrative review. Arq Bras Ed Fís. 2020 dez;3(2):1-6. http://dx.doi.org/10.20873/10.20873/abef.2595-0096.v2n2p5055.2020.
http://dx.doi.org/10.20873/10.20873/abef...
Another topic addressed was the use of alcohol, cigarettes and other drugs. Smoking can stimulate progression to AIDS and mortality in PLHIV, as the substances contained in cigarettes activate the inflammatory state, by association with C-reactive protein levels so that it increases the risk for chronic diseases such as type 2 diabetes mellitus and metabolic syndrome.66 Poudel KC, Poudel-Tandukar K, Bertone-Johnson ER, Pekow P, Vidrine DJ. Inflammation in relation to intensity and duration of cigarette smoking among people living with HIV. AIDS Behav. 2021 mar;25(3):856-65. http://dx.doi.org/10.1007/s10461-020-03048-0. PMid:32986190.
http://dx.doi.org/10.1007/s10461-020-030...
Additionally, high consumption of alcoholic beverages can lead individuals to indirect behaviors, such as reduced HAART compliance, increased sexual risk behaviors, which in turn compromise the clinical management of HIV infection and increase virus transmission.2424 Santos VF, Cunha GH, Galvão MTG, Lima ICV, Gir E, Costa AKB. The effects of alcohol use on people living with HIV/Aids: an integrative review. Rev Eletr Enf. 2018 dez;20:1-11. http://dx.doi.org/10.5216/ree.v20.46712.
http://dx.doi.org/10.5216/ree.v20.46712...
Regarding stress control, a study showed that mental disorders are associated with a higher viral load in PLHIV in clinical follow-up, and emotional stress can manifest itself in the form of pain and sleep disorders, which negatively impact the clinical course, even when individuals have adequate HAART compliace.2525 Nogueira LFR, Pellegrino P, Duarte AS, Inoue SRV, Marqueze EC. Common mental disorders are associated with higher viral load in people living with HIV. Saúde Debate. 2019 abr/jun;43(121):464-76. http://dx.doi.org/10.1590/0103-1104201912114.
http://dx.doi.org/10.1590/0103-110420191...
In this regard, the importance of mental health care for PLHIV is reinforced, as part of a set of non-pharmacological interventions, to encourage a healthy lifestyle and optimize the response to antiretrovirals.
Drug treatment was also included in the KAP survey, as PLHIV need to actively participate in self-care management, with adequate HAAR compliance, as this represents the only treatment currently available for these patients, being essential to keep the infection under control and the viral load undetectable.2626 Gomes MP, Barbosa DJ, Souza FBA, Gomes AMT, Silva ALB, Silva GA. Antiretroviral medication as an expression of care for life: adherence, hope and longevity. R Pró-Uni. 2020 dez;11(2):164-7. http://dx.doi.org/10.21727/rpu.v11i2.2327.
http://dx.doi.org/10.21727/rpu.v11i2.232...
Moreover, professionals involved in the care of PLHIV must offer reception, qualified listening, guidance without moral judgments, to favor the creation of bonds and improve treatment compliance.
For the health technology assessment stage by expert judges, it is relevant to consider these professionals’ expertise, to ensure that the materials do not contain incomplete information or inappropriate language for the target population.2121 Andrade C, Menon V, Ameen S, Praharaj SK. Designing and conducting knowledge, attitude, and practice surveys in psychiatry: practical guidance. Indian J Psychol Med. 2020 ago;42(5):478-81. http://dx.doi.org/10.1177/0253717620946111. PMid:33414597.
http://dx.doi.org/10.1177/02537176209461...
In addition to expertise, the multidisciplinarity of experts who participated in this study, which included nurses, physicians and nutritionists, stands out, being essential for a more complete assessment of the KAP survey built, which addresses a common subject for different areas of knowledge.
Thus, for the KAP survey content analysis by experts, a positive agreement greater than 85% was used, in which the evidence of validity of the instrument in question was verified. In another research for a KAP survey construction and validity, the percentage greater than 80% of positive agreement among judges was considered valid.2727 Jacob LMS, Lopes MHBM, Shimo AKK. Instrument about knowledge, attitudes, and practices of pregnant women about the hypertensive disease of pregnancy. Rev Rene. 2021 jan;22:e60040. http://dx.doi.org/10.15253/2175-6783.20212260040.
http://dx.doi.org/10.15253/2175-6783.202...
It is noteworthy that in addition to reaching the values considered ideal for the internal validity of an instrument, it is also necessary to consider the points for improvement suggested by judges,2828 Pasquali L. Teste validity. Rev Examen. 2017 jul/dez [citado 2022 out 13];1(1):14-48. Disponível em: https://examen.emnuvens.com.br/rev/article/view/19/17
https://examen.emnuvens.com.br/rev/artic...
which did not occur in this study, due to the high positive agreement and absence of suggestions.
Moreover, the instrument semantic analysis by the target audience is necessary, because for a favorable application of the technology, it must be reliable to the target population’s reality.2828 Pasquali L. Teste validity. Rev Examen. 2017 jul/dez [citado 2022 out 13];1(1):14-48. Disponível em: https://examen.emnuvens.com.br/rev/article/view/19/17
https://examen.emnuvens.com.br/rev/artic...
In this study, semantic analysis was considered satisfactory by PLHIV, as there was a reading and good understanding of the questions, and they did not leave suggestions or mention difficulties in answering the KAP survey. This finding corroborates another study that carried out the elaboration and validity evidence of a KAP survey for pregnant women about gestational hypertensive syndrome.2727 Jacob LMS, Lopes MHBM, Shimo AKK. Instrument about knowledge, attitudes, and practices of pregnant women about the hypertensive disease of pregnancy. Rev Rene. 2021 jan;22:e60040. http://dx.doi.org/10.15253/2175-6783.20212260040.
http://dx.doi.org/10.15253/2175-6783.202...
For the developed instrument’s assessment criteria, there is no consensus among the studies regarding the score that should be considered as satisfactory so that the scores can be classified as adequate or inadequate. Considering that the literature considers a variation in the percentage of correct answers between 50%2929 Machado SPC, Samico IC, Braga TDA. Knowledge, attitude and practice about phototherapy among nursing professionals of teaching hospitals. Rev Bras Enferm. 2012 jan/fev;65(1):34-41. http://dx.doi.org/10.1590/S0034-71672012000100005. PMid:22751706.
http://dx.doi.org/10.1590/S0034-71672012...
and 90%,3030 Santos CAPS, Costa RS, Silva JLM, Santos MRF, Gomes BLF. Knowledge, attitude and practice on childhood immunization personnel in Teresina-PI, Brazil, 2015. Epidemiol Serv Saude. 2017 jan/mar;26(1):133-40. http://dx.doi.org/10.5123/S1679-49742017000100014. PMid:28226015.
http://dx.doi.org/10.5123/S1679-49742017...
for this study it was suggested to consider adequate values equal to or greater than 70%.
CONCLUSION AND IMPLICATIONS FOR PRACTICE
A KAP survey-type questionnaire on healthy lifestyle in PLHIV was developed and assessed, which was considered adequate by expert judges and target audience, reaching the percentage of positive agreement greater than 85% in just one round of instrument assessment, reaching the proposed objective. The instrument was built to enable the assessment of PLHIV’s KAP and promote actions focused on healthy habits. Thus, the KAP survey is suitable for use by nurses and other health professionals, to support assistance, educational strategies and research aimed at PLHIV. It is also suggested that studies be carried out for the psychometric analysis of this questionnaire, for a better adequacy of the suggested score in the domain assessment.
One of the limitations of this study was failure to verify the exploratory factor validity, to analyze the instrument’s internal consistency and satisfactory number of questions, to measure what the construct proposes to investigate. Therefore, after the development and assessment of this KAP survey, a study with a larger sample of patients is necessary for this score to be valid. Another possible limitation was the absence of suggestions by judges, who did not agree with some domains assessed, however, they did not leave changes that could be relevant for improving the instrument.
It is noteworthy that the application of this KAP survey may provide subsidies for nursing care, as well as for other areas that provide health care to PLHIV, in order to direct educational interventions to weaknesses in knowledge, attitude and practice about a healthy lifestyle, and thus guide health promotion practices.
REFERÊNCIAS
-
1Boyd MA, Boffito M, Castagna A, Estrada V. Rapid initiation of antiretroviral therapy at HIV diagnosis: definition, process, knowledge gaps. HIV Med. 2019 mar;20(Supl 1):3-11. http://dx.doi.org/10.1111/hiv.12708 PMid:30724450.
» http://dx.doi.org/10.1111/hiv.12708 -
2Feinstein MJ, Hsue PY, Benjamin LA, Bloomfield GS, Currier JS, Freiberg MS et al. Characteristics, prevention, and management of cardiovascular disease in people living with HIV: a scientific statement from the American Heart Association. Circulation. 2019 jul;140(2):e98-124. http://dx.doi.org/10.1161/CIR.0000000000000695 PMid:31154814.
» http://dx.doi.org/10.1161/CIR.0000000000000695 -
3Thet D, Siritientong T. Antiretroviral therapy-associated metabolic complications: review of the recent studies. HIV AIDS. 2020 out;12:507-24. http://dx.doi.org/10.2147/HIV.S275314 PMid:33061662.
» http://dx.doi.org/10.2147/HIV.S275314 -
4Fuster-RuizdeApodaca MJ, Castro-Granell V, Laguía A, Jaén A, Cenoz S, Galindo MJ. Drug use and antiretroviral therapy (ART) interactions: a qualitative study to explore the knowledge, beliefs, adherence, and quality of life of people living with HIV taking ART and illicit drugs. AIDS Res Ther. 2020 mai;17(1):24. http://dx.doi.org/10.1186/s12981-020-00279-y PMid:32448214.
» http://dx.doi.org/10.1186/s12981-020-00279-y -
5Wagman JA, Wynn A, Matsuzaki M, Gnatienko N, Metsch LR, Rio C et al. Hazardous alcohol use, antiretroviral therapy receipt, and viral suppression in people living with HIV who inject drugs in the United States, India, Russia, and Vietnam. AIDS. 2020 dez;34(15):2285-94. http://dx.doi.org/10.1097/QAD.0000000000002716 PMid:33048870.
» http://dx.doi.org/10.1097/QAD.0000000000002716 -
6Poudel KC, Poudel-Tandukar K, Bertone-Johnson ER, Pekow P, Vidrine DJ. Inflammation in relation to intensity and duration of cigarette smoking among people living with HIV. AIDS Behav. 2021 mar;25(3):856-65. http://dx.doi.org/10.1007/s10461-020-03048-0 PMid:32986190.
» http://dx.doi.org/10.1007/s10461-020-03048-0 -
7Hyle EP, Martey EB, Bekker L, Xu A, Parker RA, Walensky RP et al. Diet, physical activity, and obesity among ART-experienced people with HIV in South Africa. AIDS Care. 2021 dez;16:1-7. http://dx.doi.org/10.1080/09540121.2021.2012556 PMid:34913762.
» http://dx.doi.org/10.1080/09540121.2021.2012556 -
8Fontenele MSM, Cunha GH, Lopes MVO, Siqueira LR, Lima MAC, Moreira LA. Development and evaluation of a booklet to promote ealthy lifestyle in people with HIV. Rev Bras Enferm. 2021 mar;74(Supl 5):e20200113. http://dx.doi.org/10.1590/0034-7167-2020-0113 PMid:33729374.
» http://dx.doi.org/10.1590/0034-7167-2020-0113 -
9Kaliyaperumal K. Guideline for conducting a knowledge, attitude and practice (KAP) study. AECS Illumination. 2004 jan/mar [citado 2022 out 13];4(1):7-9. Disponível em: http://v2020eresource.org/content/files/guideline_kap_Jan_mar04.pdf
» http://v2020eresource.org/content/files/guideline_kap_Jan_mar04.pdf -
10Marinho LAB, Costa-Gurgel MS, Cecatti JG, Osis MJD. Knowledge, attitude and practice of breast self-examination in health centers. Rev Saude Publica. 2003 out;37(5):576-82. http://dx.doi.org/10.1590/S0034-89102003000500005 PMid:14569332.
» http://dx.doi.org/10.1590/S0034-89102003000500005 -
11Lopes MVO, Silva VM, Araújo TL. Methods for establishing the accuracy of clinical indicators in predicting nursing diagnoses. Int J Nurs Knowl. 2012 out;23(3):134-9. http://dx.doi.org/10.1111/j.2047-3095.2012.01213.x PMid:23043652.
» http://dx.doi.org/10.1111/j.2047-3095.2012.01213.x -
12Lira ALBC, Lopes MVO. Nursing diagnosis: educational strategy based on problem-based learning. Rev Lat Am Enfermagem. 2011 jul/ago;19(4):936-43. http://dx.doi.org/10.1590/S0104-11692011000400012 PMid:21876946.
» http://dx.doi.org/10.1590/S0104-11692011000400012 -
13Suka M, Odajima T, Kasai M, Igarashi A, Ishikawa H, Kusama M et al. The 14-item health literacy scale for Japanese adults (HLS-14). Environ Health Prev Med. 2013 set;18(5):407-15. http://dx.doi.org/10.1007/s12199-013-0340-z PMid:23689952.
» http://dx.doi.org/10.1007/s12199-013-0340-z -
14Batista MJ, Marques ACP, Silva Jr MF, Alencar GP, Sousa MLR. Translation, cross-cultural adaptation and psychometric evaluation of Brazilian Portuguese version of the 14-item Health Literacy Scale. Cien Saude Colet. 2020 jul;25(7):2847-57. http://dx.doi.org/10.1590/1413-81232020257.22282018 PMid:32667566.
» http://dx.doi.org/10.1590/1413-81232020257.22282018 -
15Ministério da Saúde (BR). Secretaria de Vigilância em Saúde. Protocolo clínico e diretrizes terapêuticas para manejo da infecção pelo HIV em adultos. Brasília: Ministério da Saúde; 2018.
-
16Ministério da Saúde (BR). Secretaria de Atenção à Saúde. Diretrizes para o cuidado das pessoas com doenças crônicas nas redes de atenção à saúde e nas linhas de cuidado prioritárias. Brasília: Ministério da Saúde; 2018.
-
17Polit DF, Beck CT. Fundamentos da pesquisa em enfermagem: avaliação de evidências para a prática de enfermagem. 7ª ed. Porto Alegre: Artes Médicas; 2011.
-
18Filgueiras TF, Silva RA, Pimenta CJL, Filgueiras TF, Oliveira SHS, Castro RCMB. Instrument for nursing consultation to pregnant women with diabetes mellitus. Rev Rene. 2019 mar;20:e40104. http://dx.doi.org/10.15253/2175-6783.20192040104
» http://dx.doi.org/10.15253/2175-6783.20192040104 -
19Silva RA, Ximenes LB, Cruz AG, Serra MAAO, Araújo MFM, Andrade LM et al. Sexual activity of people with spinal cord injury: development and validation of an educational booklet. Acta Paul Enferm. 2018 mai/jun;31(3):255-64. http://dx.doi.org/10.1590/1982-0194201800037
» http://dx.doi.org/10.1590/1982-0194201800037 -
20Rosa ARR, Silva TSL, Carvalho ICS, Sousa ASJ, Rodrigues AB, Penha JC. Cervical cytology examination: inquiry into the knowledge, attitude and practice of pregnant women. Cogitare Enferm. 2018 fev;23(2):e52589. http://dx.doi.org/10.5380/ce.v23i2.52589
» http://dx.doi.org/10.5380/ce.v23i2.52589 -
21Andrade C, Menon V, Ameen S, Praharaj SK. Designing and conducting knowledge, attitude, and practice surveys in psychiatry: practical guidance. Indian J Psychol Med. 2020 ago;42(5):478-81. http://dx.doi.org/10.1177/0253717620946111 PMid:33414597.
» http://dx.doi.org/10.1177/0253717620946111 -
22Silveira EA, Falco MO. Nutritional diagnosis of people living with HIV/AIDS: a review of national and international protocols. Cien Saude Colet. 2020 dez;25(12):5003-16. http://dx.doi.org/10.1590/1413-812320202512.36262018 PMid:33295518.
» http://dx.doi.org/10.1590/1413-812320202512.36262018 -
23Oliveira JA, Aguiar MB, Vasconcelos WKV, Silva HG, Leandro LS. Influence of physical exercise on the TCD4+ cell count in people living with HIV/AIDS: an integrative review. Arq Bras Ed Fís. 2020 dez;3(2):1-6. http://dx.doi.org/10.20873/10.20873/abef.2595-0096.v2n2p5055.2020
» http://dx.doi.org/10.20873/10.20873/abef.2595-0096.v2n2p5055.2020 -
24Santos VF, Cunha GH, Galvão MTG, Lima ICV, Gir E, Costa AKB. The effects of alcohol use on people living with HIV/Aids: an integrative review. Rev Eletr Enf. 2018 dez;20:1-11. http://dx.doi.org/10.5216/ree.v20.46712
» http://dx.doi.org/10.5216/ree.v20.46712 -
25Nogueira LFR, Pellegrino P, Duarte AS, Inoue SRV, Marqueze EC. Common mental disorders are associated with higher viral load in people living with HIV. Saúde Debate. 2019 abr/jun;43(121):464-76. http://dx.doi.org/10.1590/0103-1104201912114
» http://dx.doi.org/10.1590/0103-1104201912114 -
26Gomes MP, Barbosa DJ, Souza FBA, Gomes AMT, Silva ALB, Silva GA. Antiretroviral medication as an expression of care for life: adherence, hope and longevity. R Pró-Uni. 2020 dez;11(2):164-7. http://dx.doi.org/10.21727/rpu.v11i2.2327
» http://dx.doi.org/10.21727/rpu.v11i2.2327 -
27Jacob LMS, Lopes MHBM, Shimo AKK. Instrument about knowledge, attitudes, and practices of pregnant women about the hypertensive disease of pregnancy. Rev Rene. 2021 jan;22:e60040. http://dx.doi.org/10.15253/2175-6783.20212260040
» http://dx.doi.org/10.15253/2175-6783.20212260040 -
28Pasquali L. Teste validity. Rev Examen. 2017 jul/dez [citado 2022 out 13];1(1):14-48. Disponível em: https://examen.emnuvens.com.br/rev/article/view/19/17
» https://examen.emnuvens.com.br/rev/article/view/19/17 -
29Machado SPC, Samico IC, Braga TDA. Knowledge, attitude and practice about phototherapy among nursing professionals of teaching hospitals. Rev Bras Enferm. 2012 jan/fev;65(1):34-41. http://dx.doi.org/10.1590/S0034-71672012000100005 PMid:22751706.
» http://dx.doi.org/10.1590/S0034-71672012000100005 -
30Santos CAPS, Costa RS, Silva JLM, Santos MRF, Gomes BLF. Knowledge, attitude and practice on childhood immunization personnel in Teresina-PI, Brazil, 2015. Epidemiol Serv Saude. 2017 jan/mar;26(1):133-40. http://dx.doi.org/10.5123/S1679-49742017000100014 PMid:28226015.
» http://dx.doi.org/10.5123/S1679-49742017000100014
SCIENTIFIC EDITOR
Publication Dates
-
Publication in this collection
02 Dec 2022 -
Date of issue
2023
History
-
Received
08 Mar 2022 -
Accepted
13 Oct 2022