Abstracts
Despite significant advancements in antiretroviral therapy (ART) for HIV, adherence remains a challenge. While Brazil has validated scales for treatment adherence, few assess treatment adherence barriers. This underscores the necessity for validated questionnaires on adherence barriers to identify patient-specific challenges and enhance strategies for ART adherence. This study aimed to adapt and validate the Adherence Barriers Questionnaire for HIV Patients on Antiretroviral Therapy (ABQ-HIV), a 17-item questionnaire assessing the adherence barriers to ART, for the Brazilian context and to evaluate its psychometric properties in HIV patients. A methodological study on the psychometric properties and factorial structure of ABQ-HIV was conducted. The study followed seven steps: consent of the original authors, two translations, synthesis of the translations, expert committee, back-translation, pre-test, and reliability test. A high content validity index (0.93) was achieved with the expert committee. The study sample consisted of 230 adults with HIV, with 37.0 (29.3-45.0) years as the median age (IQR), and 52.2% were male. The exploratory factor analysis with a three subscales structure of 17 items showed good interpretability (Bartlett’s sphericity (1167.2 [136]; p < 0.001) and Kaiser-Meyer-Olkin = 0.602) and internal consistency (α = 0.76; Ω = 0.76). The fit indicators were satisfactory (χ2 = 89.931; df = 88; p > 0.005; RMSEA = 0.010; RMSR = 0.07; CFI = 0.996; GFI = 0.940; AGFI = 0.907; NNFI = 0.995). The Brazilian version of ABQ-HIV is a potential instrument for identifying specific barriers to adherence to ART in adults living with HIV in Brazil.
Keywords:
Hospital Care; Hospital Information Systems; Benchmarking; Indicators (Statistic); Unified Health System
Apesar dos avanços significativos na terapia antirretroviral (TARV) para o HIV, a adesão continua sendo um desafio. Embora o Brasil tenha escalas validadas para a adesão ao tratamento, poucas avaliam as barreiras de adesão ao tratamento. Isso ressalta a necessidade de questionários validados sobre as barreiras de adesão para identificar os desafios específicos dos pacientes e aprimorar as estratégias de adesão à TARV. Este estudo teve como objetivo adaptar e validar o Adherence Barriers Questionnaire for HIV Patients on Antiretroviral Therapy (ABQ-HIV), um questionário de 17 itens que avalia as barreiras de adesão à TARV, para o contexto brasileiro e avaliar suas propriedades psicométricas em pacientes com HIV. Foi realizado um estudo metodológico sobre as propriedades psicométricas e a estrutura fatorial do ABQ-HIV. O estudo seguiu sete etapas: consentimento dos autores originais, duas traduções, síntese das traduções, comitê de especialistas, retrotradução, pré-teste e teste de confiabilidade. Um comitê de especialistas obteve um alto índice de validade de conteúdo (0,93). A amostra do estudo foi de 230 adultos com HIV, com idade média (IQR) de 37,0 (29,3-45,0) anos, e 52,2% eram homens. A análise fatorial exploratória com uma estrutura de três subescalas de 17 itens mostrou boa interpretabilidade (esfericidade de Bartlett (1167,2 [136]; p < 0,001) e Kaiser-Meyer-Olkin = 0,602) e consistência interna (α = 0,76; Ω = 0,76). Os indicadores de ajuste foram satisfatórios (χ2 = 89,931; df = 88; p > 0,005; RMSEA = 0,010; RMSR = 0,07; CFI = 0,996; GFI = 0,940; AGFI = 0,907; NNFI = 0,995). A versão brasileira do ABQ-HIV é um instrumento em potencial para identificar barreiras específicas à adesão à TARV em adultos vivendo com HIV no Brasil.
Palavras-chave:
Assistência Hospitalar; Sistemas de Informação Hospitalar; Benchmarking; Indicadores (Estatística); Sistema Único de Saúde
A pesar de los avances significativos de la terapia antirretroviral (TARV) para el VIH, la adherencia sigue siendo un desafío. Aunque Brasil ha validado las escalas de adherencia al tratamiento, pocas escalas evalúan las barreras de adherencia al tratamiento. Esto subraya la necesidad de cuestionarios validados sobre las barreras de adherencia para identificar los desafíos específicos de los pacientes y mejorar las estrategias de adherencia a la TARV. Este estudio tuvo como objetivo adaptar y validar el Adherence Barriers Questionnaire for HIV Patients on Antiretroviral Therapy (ABQ-VIH), un cuestionario de 17 ítems que evalúa las barreras para la adherencia a la TARV para el contexto brasileño, y evaluar sus propiedades psicométricas en pacientes con VIH. Se realizó un estudio metodológico sobre las propiedades psicométricas y la estructura factorial del ABQ-VIH. Este estudio consistió en siete etapas: consentimiento de los autores originales, dos traducciones, síntesis de traducciones, comité de expertos, retrotraducción, prueba previa y prueba de confiabilidad. Un comité de expertos obtuvo un alto índice de validez de contenido (0,93). La muestra del estudio estuvo conformada de 230 adultos con VIH, con una edad media (IQR) de 37,0 (29,3-45,0) años, y el 52,2% de ellos son del sexo masculino. El análisis factorial exploratorio con una estructura de tres subescalas de 17 ítems mostró una buena interpretabilidad (esfericidad de Bartlett (1167,2 [136]; p < 0,001) y Kaiser-Meyer-Olkin = 0,602) y consistencia interna (α = 0,76; Ω = 0,76). Los indicadores de ajuste fueron satisfactorios (χ2 = 89,931; df = 88; p > 0,005; RMSEA = 0,010; RMSR = 0,07; CFI = 0,996; GFI = 0,940; AGFI = 0,907; NNFI = 0,995). La versión brasileña de ABQ-VIH es una potencial herramienta para identificar barreras específicas en la adherencia a la TARV en adultos que viven con VIH en Brasil.
Palabras-clave:
Atención Hospitalaria; Sistemas de Información en Hospital; Benchmarking; Indicadores (Estadística); Sistema Único de Salud
Introduction
The human immunodeficiency virus (HIV), the etiological agent responsible for the AIDS, is one of the greatest obstacles to global public health due to its pandemic nature and associated severity 11. Chen J, Zhou T, Zhang Y, Luo S, Chen H, Chen D, et al. The reservoir of latent HIV. Front Cell Infect Microbiol 2022; 12: 945956.. HIV infection compromises the function of CD4+ cells, which are responsible for defending the immune system 22. Zuge SS, Paula CC, Padoin SMM. Efetividade de intervenções para adesão à terapia antirretroviral em adultos com HIV: revisão sistemática. Rev Esc Enferm USP 2020; 54:e03627.. Without treatment, progression to AIDS can lead to significant and potentially lethal clinical complications 22. Zuge SS, Paula CC, Padoin SMM. Efetividade de intervenções para adesão à terapia antirretroviral em adultos com HIV: revisão sistemática. Rev Esc Enferm USP 2020; 54:e03627..
AIDS is recognized as one of the most fatal infectious diseases recorded in history, with approximately 40.4 million global deaths 33. World Health Organization. HIV/AIDS. Global situation and trends. https://www.who.int/data/gho/data/themes/hiv-aids (accessed on 06/Dec/2023).
https://www.who.int/data/gho/data/themes...
. By the end of 2022, around 39 million people were living with HIV/AIDS worldwide 33. World Health Organization. HIV/AIDS. Global situation and trends. https://www.who.int/data/gho/data/themes/hiv-aids (accessed on 06/Dec/2023).
https://www.who.int/data/gho/data/themes...
. In Brazil, the HIV/AIDS Epidemiological Bulletin reports 1,124,063 AIDS cases in 43 years (1980 to June 2023) 44. Secretaria de Vigilância em Saúde, Ministério da Saúde. HIV/AIDS 2023. Boletim Epidemiológico de HIV/Aids 2023; Número Especial.. Between 2007 and June 2023, the country recorded 489,594 cases of HIV infection, 21.3% of which occurred in the Northeast Region, which has the second-highest case detection rate in the country 44. Secretaria de Vigilância em Saúde, Ministério da Saúde. HIV/AIDS 2023. Boletim Epidemiológico de HIV/Aids 2023; Número Especial..
Antiretroviral therapy (ART) transformed HIV infection into a manageable chronic condition, significantly reducing deaths related to the disease globally 11. Chen J, Zhou T, Zhang Y, Luo S, Chen H, Chen D, et al. The reservoir of latent HIV. Front Cell Infect Microbiol 2022; 12: 945956.. According to World Health Organization (WHO) guidelines 55. World Health Organization. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach. https://www.who.int/data/gho/data/themes/hiv-aids (accessed on 23/May/2022).
https://www.who.int/data/gho/data/themes...
, ART is recommended for all people living with HIV (PLHIV), aiming at benefits such as effective immune reconstitution, control of viral replication, reduction of transmission, and AIDS mortality 66. Sakthivel V, Krishnasamy V, Mehalingam V. Level of medication adherence and its associated factors among patients receiving antiretroviral therapy at a tertiary care hospital in South India. J Caring Sci 2020; 9:93-7.. Treatment adherence of less than 85% can increase drug resistance and disease progression 77. Vetrova MV, Aleksandrova V, Paschenko AE, Toropov SE, Rassokhin VV, Abyshev RA, et al. Physician and patient prediction of adherence to antiretroviral therapy in HIV positive people in Saint-Petersburg, Russia. AIDS Care 2021; 33473-7..
Studies have unveiled multiple barriers that significantly impact adherence to ART. These include intrapersonal factors such as age (younger populations), alcohol/drug use, low schooling, anxiety/depression disorders, and forgetfulness 88. Heylen E, Chandy S, Shamsundar R, Nair S, Ravi Kumar BN, Ekstranda ML. Correlates of and barriers to ART adherence among adherence-challenged people living with HIV in southern India. AIDS Care 2021; 33:486-93.; social/environmental factors such as HIV stigma/discrimination and fear of disclosure 99. Chakraborty A, Hershow RC, Qato DM, Stayner L, Dworkin MS. Adherence to antiretroviral therapy among HIV patients in India: a systematic review and meta-analysis. AIDS Behav 2020; 24:2130-48.; drug-related factors such as access, side effects, and complexity of the regimen 1010. Buh A, Deonandan R, Gomes J, Krentel A, Oladimeji O, Yaya S. Adherence barriers and interventions to improve ART adherence in sub-saharan african countries: a systematic review protocol. PLoS One 2022; 17:e0269252.; and health system factors such as the quality of the physician-patient relationship and the level of education/information 1111. Zeng C, Xiaoming L, Qiao S, Yang S, Shen Z, Zhou Y. Anticipated stigma and medication adherence among people living with HIV: the mechanistic roles of medication support and ART self-efficacy. AIDS Care 2020; 32:1014-22..
Understanding the barriers to adherence to treatment by PLHIV is crucial for the efficacy of ART and for targeting effective interventions. Identifying predictive factors to manage unsuppressed viral loads and avoid costly resistance testing 1212. Spinelli MA, Haberer JE, Chai PR, Castillo-Mancilla J, Anderson PL, Gandhi M. Approaches to objectively measure antiretroviral medication adherence and drive adherence interventions. Curr HIV/AIDS Rep 2020; 17:301-14.. Validated self-report questionnaires are valuable for capturing patient perspectives on treatment and are a practical, cost-effective approach that focuses on knowledge of the disease, attitude towards drugs, and management of side effects 1313. Bastán P, Enrique J. Adherencia al tratamiento antirretroviral de personas con VIH/sida en la atención primaria de salud. Rev Habanera Cienc Méd 2020; 19:e2962..
Specific questionnaires tailored to assess adherence among individuals with HIV/AIDS receiving ART are lacking in Brazil 1414. Santos AP, Cordeiro JFC, Fracarolli IFL, Gomide EBG, Andrade D. Instruments to assess adherence to medication in people living with HIV: a scoping review. Rev Saúde Pública 2022; 56:112.,1515. Remor E, Milner-Moskovics J, Preussler G. Adaptação brasileira do "Cuestionario para la Evaluación de la Adhesión al Tratamiento Antirretroviral". Rev Saúde Pública 2007; 41:685-94.,1616. Vale FC, Santa-Helena ET, Santos MA, Carvalho WMES, Menezes PR, Basso CR, et al. Desenvolvimento e validação do Questionário WebAd-Q para monitorar adesão à terapia do HIV. Rev Saúde Pública 2018; 52:62.,1717. Costa LS, Latorre MRDO, Silva MH, Bertolini DV, Machado DM, Pimentel SR, et al. Validity and reliability of a self-efficacy expectancy scale for adherence to antiretroviral therapy for parents and carers of children and adolescents with HIV/AIDS. J Pediatr (Rio J.) 2008; 84:41-6.. A recent scoping review 1414. Santos AP, Cordeiro JFC, Fracarolli IFL, Gomide EBG, Andrade D. Instruments to assess adherence to medication in people living with HIV: a scoping review. Rev Saúde Pública 2022; 56:112. identified only three validated instruments in Brazil to assess adherence to antiretroviral therapy in PLHIV: (a) Questionnaire for Assessment of Adherence to Antiretroviral Treatment1515. Remor E, Milner-Moskovics J, Preussler G. Adaptação brasileira do "Cuestionario para la Evaluación de la Adhesión al Tratamiento Antirretroviral". Rev Saúde Pública 2007; 41:685-94.; (b) WebAd-Q questionnaire 1616. Vale FC, Santa-Helena ET, Santos MA, Carvalho WMES, Menezes PR, Basso CR, et al. Desenvolvimento e validação do Questionário WebAd-Q para monitorar adesão à terapia do HIV. Rev Saúde Pública 2018; 52:62.; and (c) Self-efficacy Scale for Adherence to Antiretroviral Treatment in Children and Adolescents with HIV/AIDS1717. Costa LS, Latorre MRDO, Silva MH, Bertolini DV, Machado DM, Pimentel SR, et al. Validity and reliability of a self-efficacy expectancy scale for adherence to antiretroviral therapy for parents and carers of children and adolescents with HIV/AIDS. J Pediatr (Rio J.) 2008; 84:41-6.. However, existing validated questionnaires primarily focus on treatment adherence per se, focusing on medication intake 1414. Santos AP, Cordeiro JFC, Fracarolli IFL, Gomide EBG, Andrade D. Instruments to assess adherence to medication in people living with HIV: a scoping review. Rev Saúde Pública 2022; 56:112.. A validated questionnaire specifically designed to explore the barriers to adherence among people living with HIV/AIDS in Brazil is unavailable. This gap in assessment tools impedes a comprehensive understanding of the multifaceted challenges individuals face in adhering to ART regimens, thus highlighting the urgent need for the development and validation of such instruments within the Brazilian context.
Given this, we opted for the Adherence Barriers Questionnaire for HIV Patients on Antiretroviral Therapy (ABQ-HIV) 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599., which was adapted from a German study involving 370 participants. The ABQ-HIV comprises 17 items that investigate the barriers to adherence affecting patient behaviour concerning ART. Its effectiveness has already been proven for other chronic conditions 1919. Mueller S, Kohlmann T, Wilke T. Validation of the Adherence Barriers Questionnaire - an instrument for identifying potential risk factors associated with medication-related non-adherence. BMC Health Serv Res 2015; 15:153.,2020. Mueller S, Junker S, Wilke T, Lommatzsch A, Schuster AK, Kaymak H, et al. Questionnaire for the assessment of adherence barriers of intravitreal therapy: the ABQ-IVT. Int J Retina Vitreous 2021; 7:43.. This study aimed to adapt and validate the ABQ-HIV for the Brazilian context and to evaluate its psychometric properties in individuals with HIV. The overarching goal is to provide a practical and easy tool for understanding and improving adherence to ART in Brazil.
Method
Study design
This is a methodological, cross-sectional, and quantitative study carried out to translate and adapt the ABQ-HIV for the Brazilian context. This study was conducted according to the COSMIN methodology (COnsensus-based Standards for the selection of health Measurement INstruments), which is considered a standard guide for assessing the psychometric quality of health measurement questionnaires 2121. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010; 63:737-45.. The study phases were: (a) consent from the authors of the original questionnaire; (b) translation by two independent translators; (c) synthesis of the translations; (d) expert committee; (e) back-translation; (f) pre-test; and (g) assessment of reliability in the target population.
Study setting and participants
The study was conducted with a sample of PLHIV who were being attended at the sexually transmitted infection (STI), HIV, and AIDS Specialized Care Service of the Aracaju Medical Specialties Center. This center is the main point of reference for PLHIV in the state of Sergipe, providing services to approximately 6,185 patients on ART 2222. Governo de Sergipe. Secretaria da Saúde alerta sobre tratamento correto para HIV. https://www.se.gov.br/noticias/saude/secretaria_da_saude_alerta_sobre_tratamento_correto_para_hiv (accessed on 06/Jan/2022).
https://www.se.gov.br/noticias/saude/sec...
.
To be included in the study, PLHIV had to meet the following criteria: (a) positive HIV serology; (b) aged 18 years or older; (c) use of ART for at least one year. Individuals with severe neuropsychological impairment or psychosis were excluded from the study, as were those who were unable to complete the interviews required for the study.
Sample size
Sample sizes were defined for each phase of the study. To guarantee the reliability of the questionnaire, 126 individuals were required, based on a 0.8 minimum item-total correlation, a 0.15 margin of error, an 5% alpha, and 95% power. To structure the questionnaire, the sample size was calculated using the Inverse Square Root 2323. Kock N, Hadaya P. Minimum sample size estimation in PLS-SEM: the inverse square root and gamma-exponential methods. Inf Syst J 2018; 28:227-61. method:
Where, is the sample size, is the normal distribution score associated with the significance level α and z β is the normal distribution score associated with the power of the test β and |β| min is the effect between factors. Assuming 5% significance, 95% power, and a 0.25 minimum effect, 208 participants were needed.
Instruments
Sociodemographic data (such as age, sex, marital status) and clinical data (such as CD4+ count, viral load, ART regimen) were collected using a pre-defined questionnaire designed for the study. Data on clinical profile, time of use and ART regimen were confirmed by retrieving the medical records.
The ABQ-HIV 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599., a German questionnaire, is an instrument with 17 Likert-scaled items divided into three subscales (unintentional barriers, barriers associated with knowledge of the disease/treatment, and intentional barriers) to identify barriers to adherence to treatment in PLHIV. The questionnaire showed good internal consistency (α = 0.708) and convergent validity (-0.422; p < 0.001) when compared to the 8-item Morisky Medication Adherence Scale (MMAS-8). Responses range from 1 to 4 from “strongly agree” to “strongly disagree,” and a total score above 28 indicates a higher risk of significant barriers to adherence. The higher the score, the greater the barrier burden and, thus, the associated risk of non-adherence.
Translation, cross-cultural adaptation, and pre-test stages
For the cross-cultural adaptation 2121. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010; 63:737-45.,2424. Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract 2011; 17:268-74. of the ABQ-HIV, we first obtained authorization from the authors. The original German version was translated into Brazilian Portuguese by two independent and blinded translators. The first translation (T1) was carried out by a translator with expertise in the health field and adopted a technical perspective, whereas the second translation (T2) was performed by a professional translator without expertise in health and adopted an idiomatic approach. Both translations encompassed the title, instructions, response options, and the 17 items of the ABQ-HIV questionnaire. A synthesized version (T1-2) was elaborated, integrating the most relevant aspects of the preceding translations.
Professionals with expertise in HIV were recruited through the Lattes Platform of the Brazilian National Research Council (CNPq) to assess construct validity. Health professionals with clinical experience of 10 years or more in treating HIV patients and carrying out validation studies were selected. A total of 15 judges took part in the study: five infectious disease doctors, four pharmacists, three nurses, one psychologist, one social worker, and one speech-language therapist. All the experts assessed the suitability and relevance of the items using a four-point ordinal scale (1 “not relevant”, 2 “slightly relevant”, 3 “quite relevant”, and 4 “highly relevant”).
The judges evaluated the items, recommending reformulations and additions for Brazilian sociocultural adequacy, aiming for clarity and relevance. The agreement was quantified by the content validity index (CVI), with an acceptable minimum of 0.80 and preferably 0.90. The CVI was calculated as the sum of answers 3 and 4 divided by the total number of answers, reflecting the proportion of agreement on relevance 2525. Yusoff MSB. ABC of content validation and content validity index calculation. Education in Medicine Journal 2019; 11:49-54..
The modified questionnaire underwent a back-translation process, wherein a native German speaker translated it from Portuguese to German. Subsequently, the translated version was forwarded to the original authors for evaluation of semantic equivalence and to obtain their consent. Finally, a pre-test involving 15 individuals from the target population was carried out to identify any uncertainties or challenges. Since no notable issues emerged during the test, the Portuguese version was considered definitive. Figure 1 shows the methodological process.
Flowchart of the adaptation and validation process of the Adherence Barriers Questionnaire for HIV Patients on Antiretroviral Therapy (ABQ-HIV).
Data collection procedures
Participants were selected based on eligibility criteria, and data collection occurred from October 2022 to January 2023. The process included structured interviews and the application of the ABQ-HIV Brazilian version. With their consent, the participants completed supervised questionnaires in individual 15-minute sessions, placing emphasis on the completeness of their answers and ensuring anonymity.
Data analysis
Categorical variables were described using frequencies and percentages. Normality assumptions were assessed using the Shapiro-Wilk test, and homoscedasticity was evaluated using the Levene test. We conducted nonparametric tests to verify the significance of the distributions between the study variables, as most datasets had a skewed distribution.
The adequacy of the ABQ-HIV questionnaire was assessed using the Kaiser-Meyer-Olkin (KMO) test (expected to be > 0.5) 2626. Kaiser HF. An index of factorial simplicity. Psychometrika 1974; 39:31-6. and Bartlett’s test of sphericity (expected to be p < 0.05) 2727. Bartlett MS. The effect of standardization on a chi-square approximation in factor analysis. Biometrika 1951; 38:337-44.. The unidimensionality was assessed using Unidimensional Congruence (UniCo) (expected to be > 0.95), explained common variance (ECV) (expected to be > 0.85), and mean of item residual absolute loadings (Mireal) (expected to be < 0.30) tests 2828. Damásio BF, Dutra DF. Análise fatorial exploratória: um tutorial com o software FACTOR. In: Damásio BF, Borsa JC, editors. Manual de desenvolvimento de instrumentos. São Paulo: Vetor; 2017. p. 241-65.,2929. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2015.. Exploratory factor analysis (EFA) was used to examine the factor structure of the ABQ-HIV questionnaire. The EFA used a polychoric matrix and the robust diagonally weighted least squares (RDWLS) method. The number of retained subscales was determined through the parallel analysis (PA) method 3030. Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods 2011; 16:209-20. employing random permutation of observed data, along with Robust Promin rotation 3131. Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Liberabit 2019; 25:99-106. and empirical LOSEFER correction 3232. Lorenzo-Seva U, Ferrando PJ. A simulation-based scaled test statistic for assessing model-data fit in least-squares unrestricted factor-analysis solutions. Tarragona: Universitat Rovira i Virgili; 2022. (Technical Report)..
The stability of the subscales of the adapted questionnaire was assessed using the Generalized G-H Index, with G-H values ranging from 0 to 1. High G-H values (> 0.80) suggest a well-defined latent variable likely to be stable across studies, whereas low values indicate a poorly defined and likely unstable latent variable across studies 3333. Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas 2018; 78:762-80..
To confirm the fit of the model, indices such as chi-square (χ2), root mean square error of approximation (RMSEA), comparative fit index (CFI), non-normed fit index (NNFI), and Tucker-Lewis index (TLI) were used. We have adopted the following threshold for the adequacy of the model: RMSEA < 0.08, CFI > 0.90, and TLI > 0.90 3434. Marsh HW, Hau KT, Grayson D. Goodness of fit evaluation in structural equation modeling. In: Maydeu-Olivares A, McArdle J, editors. Contemporary psychometrics. Mahwah: Erlbaum; 2005. p. 275-340.. Reliability was evaluated using Cronbach’s alpha (α > 0.70) and McDonald’s omega (Ω > 0.70).
The descriptive analyses were carried out using Stata version 14.0 (https://www.stata.com) and the AFE using Factor Analysis Application (version 14.04.01). Statistical significance was set at p < 0.05.
Ethical aspects
The study was approved by the Human Research Ethics Committee of the Federal University of Sergipe (CAAE: 51176221.5.0000.5546, protocol n. 5.036.636). All investigations were conducted according to the Declaration of Helsinki and Resolution n. 466/2012 of the Brazilian National Health Council. Informed written consent was obtained from the participants.
Results
Translation, committee of expert judges, back-translation, and pre-testing
A comparison between translation 1 and translation 2 revealed minimal stylistic discrepancies, which did not compromise fidelity to the original content.
The content analysis revealed that 15 out of 17 items had a CVI > 0.80, with 10 items achieving a perfect 1.00 CVI. This indicates a high level of agreement regarding the equivalence of the content assessed. However, two items (#5 and #8) fell below the established threshold, with 0.46 and 0.73 CVI values, respectively, requiring adjustments to enhance objectivity and comprehension in the Brazilian context. These results are shown in Table 1.
Agreement values for the content validity index (CVI). Aracaju, Sergipe State, Brazil, 2023.
Item #5 was modified to replace ambiguous terms with clearer expressions, ensuring the original meaning. As for item #8, alternatives were introduced to encompass additional barriers to ART access, such as the economic burden of treatment, given the context of free treatment provided by the Brazilian Unified National Health System (SUS) in Brazil. These adjustments, guided by judges’ recommendations, led to a 0.93 overall CVI for the questionnaire. After back-translation into German and approval by the authors of the original questionnaire, the pre-final Portuguese version was tested by the target audience, who reported no difficulties. The final Portuguese version of the ABQ-HIV questionnaire, adapted for the Brazilian context, is presented in the Supplementary Material (https://cadernos.ensp.fiocruz.br/static//arquivo/suppl-e006324_1322.pdf).
Validation of the ABQ-HIV Brazilian version
Characterization of the sample
In total, 230 adults living with HIV were included and fully completed the ABQ-HIV. Table 2 shows the sociodemographic characteristics of the individuals included. Ages ranged from 19 to 78 years, with a median of 37.0 years (interquartile range, IQR: 29.3-45.0). Most participants were male (120, 52.2%), self-declared as brown ethnicity (112, 48.7%), living in urban areas (163, 70.9%), single (160, 69.6%), earning 1-2 Brazilian minimum wages (108, 47%), with completed secondary education (67, 29.1%).
The median (IQR) time since starting ART was 5.0 (IQR: 2.0-8.0) years. One hundred and twenty-four (53.9%) participants reported using condoms in all sexual relations in the last six months. Most individuals reported previous (104, 45.2%) partners as their exposure to HIV; and 88 (38.3%) were unaware of their main source of exposure to HIV. The rapid test (point-of-care) and routine examinations were the main methods of HIV diagnosis, with 117 (50.9%) and 90 (39.1%), respectively. The most common treatment regimen was the combination of Tenofovir + Lamivudine + Dolutegravir (126, 54.8%) and Lamivudine + Tenofovir + Efavirenz (55, 23.9%), both prescribed as a single-dose regimen. Most participants had a CD4 count of 500cells/mm3 or higher (133, 57.8%). The viral load was 40 copies or less in 128 (55.7%) of participants. (Table 3).
Factor structure and psychometric properties of the ABQ-HIV
The data matrix showed favorable indicators (KMO = 0.602; IC95: 0.194-0.499 and Bartlett's Test of Sphericity = 1167.2 [136]; p < 0.001). The hypothesis of unidimensionality was rejected based on the values obtained for UniCo (0.68) and ECV (0.67), whereas the Mireal criterion (0.28) was the only one to suggest such a possibility.
The PA revealed two subscales for the Brazilian version of the ABQ-HIV questionnaire, with variations of 26.45% for Factor#1 and 12.62% for Factor#2. These results differ from the three subscales structure proposed in the original version of the ABQ-HIV questionnaire 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.. For this reason, testing the number of subscales in the questionnaire followed the theoretical model on which it was built, i.e., with three subscales. The data matrix was interpreted using the weighted Varimax method, which was used to extract orthogonal factors, i.e., not correlated with each other.
The subsequent factor analysis, fixing three factors, revealed a factor structure with subscales that can be identified as unintentional barriers, barriers associated with knowledge of the disease/treatment, and intentional barriers. The variance explained by each extracted subscale was 26.45%, 12.62%, and 8.69%, respectively.
The factor loadings of the items (Table 4) showed saturations above 0.30, ranging from 0.32 to 0.69. The non-intentional factor comprised six items (4, 6, 7, 12, 13, 17), with saturations ranging from 0.33 (Item 7) to 0.62 (Item 13). The knowledge factor added seven items (2, 5, 8, 9, 10, 11, 15), with saturations ranging from 0.32 (Item 8) to 0.69 (Item 11). The intent factor included four items (1, 3, 14, 16), with saturations ranging from 0.41 (Item 1) to 0.51 (Item 16).
The latent G-H indices scores for subscales 1, 2, and 3 were 0.77, 0.81, and 0.66, respectively. For observed G-H, the scores were 0.59, 0.73, and 0.46 in the same sequence. The significant discrepancy between latent and observed G-H levels suggests instability in the model when applied to different population samples, limiting its generalizability.
The factor structure with the 17 items showed fit indices considered adequate (χ2 = 89.931, degrees of freedom (gl) = 88; p > 0.005; RMSEA = 0.010 (95%CI: 0.0000-0.0160); and RMSR = 0.07; CFI = 0.996; GFI = 0.940; AGFI = 0.907; NNFI and TLI = 0.995). The total questionnaire showed internal consistency, with Cronbach’s α and McDonald’s Ω registering 0.762 and 0.761 values, respectively. Table 4 shows the distribution of the variables according to their factor loadings in the three subscales.
Discussion
This study describes the process of adapting and validating the ABQ-HIV to identify barriers to adherence to ART in PLHIV in Brazil. As a result, an adapted version comprising 17 items was obtained. The findings provided adequate evidence of content validity, the tool’s three subscales factorial structure, and its internal consistency, corroborating the questionnaire's reliability for the context in question.
This is the first study to report on the psychometric properties, reliability, and validity of the ABQ-HIV questionnaire in Brazil and internationally, expanding on the findings of the original study. A previous study only reported on the translation and adaptation process in Brazil 3535. Oliveira AWN. Tradução e adaptação transcutural do Adherence Barriers Questionnaire-HIV (ABQ-HIV) para uso no Brasil [Doctoral Dissertation]. Redenção: Universidade da Integração Internacional da Lusofonia Afro-Brasileira; 2021.. Initially, an attempt was made to analyze the factor structure of the questionnaire using an exploratory method. EFA was chosen to make up the set of preliminary analyses of the questionnaire, as it was also used in the original study 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599..
The KMO index and Bartlett’s test of sphericity were adequate, indicating that the EFA was feasible. During the PA, it was decided to implement the EFA following the three subscales factorial structure already defined in the original version of the questionnaire, as established by Mueller et al. 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.. However, it should be noted that several models were tested, and the results showed good psychometric quality, ensuring the generation of reliable psychometric indicators.
In the first PA (data not shown), the model revealed two subscales and recommended excluding two items: Item 2, on knowledge of medication, and Item 7, on adherence to medication at specific times or occasions. The possible association of these items with socially desirable responses may explain the result. However, the exclusion had no impact on the factor analysis indices or the quality of the measurement. Therefore, it was decided to keep all the items since the aim of the study was not to reduce the ABQ-HIV questionnaire.
In the three subscales model, an explained variance of 26.45%, 12.62%, and 8.69% was observed for each subscale extracted. As highlighted by Lorenzo-Seva & Ferrando 3131. Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Liberabit 2019; 25:99-106., a higher explained variance indicates enhanced effectiveness of the subscales in elucidating the relationships among the original variables. Our findings align with the findings of Mueller et al. 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599. in the development of the questionnaire, wherein the three subscales individually accounted for 22.1%, 8.9%, and 8.8% of the variance, respectively.
The fit of the model resulted in indicators aligned with the ideal values, meeting the criteria established in the specialized literature. The RMSEA was satisfactory, while the other indicators, CFI, GFI, and TLI, were above the desirable values (> 0.9) 3434. Marsh HW, Hau KT, Grayson D. Goodness of fit evaluation in structural equation modeling. In: Maydeu-Olivares A, McArdle J, editors. Contemporary psychometrics. Mahwah: Erlbaum; 2005. p. 275-340.. The reliability of the questionnaire was estimated using the internal consistency method, using Cronbach’s α and McDonald’s Ω indices 2929. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2015.. Both coefficients showed acceptable results, higher than 0.70 and exceeding those found in the original study (α = 0.708) 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.. It should be noted that these reliability coefficients would not increase if any items were eliminated.
The EFA then provided three subscales of the ABQ-HIV, which refer to unintentional adherence barriers, knowledge-related adherence barriers, and intentional adherence barriers. Factor loading was used to indicate how each item (variable) contributed to the formation of the factor. The results with three subscales provided satisfactory factor loadings ranging from 0.32 to 0.69, meeting recommended criteria 3636. Furr RM. Scale construction and psychometrics for social and personality psychology. London: Sage Publications; 2011.. This was close to the findings of the original investigation, which ranged from 0.46 to 0.74 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.. However, the factor weights of the items varied between the two versions, which suggests cultural differences between the German and Brazilian contexts.
The “knowledge” subscale showed the best performance in terms of factor loadings, with adequate saturation levels. The factor loadings of items 2, 7, and 8, despite being the lowest in the investigation, remain within the adequate parameters established by Hair et al. 3737. Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL, Gouvêa MA, et al. Análise multivariada de dados. 6th Ed. Porto Alegre: Bookman; 2009.. These authors propose values between 0.30 and 0.40 as adequate and above 0.50 as satisfactorily adequate. Therefore, the exclusion of these items from the model was not considered in this study.
Considering the three subscales proposed by the original questionnaire, the structure of the current construct showed a distribution among the items that differed from the original model 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.. This result adds empirical data to the debate on the conceptual and functional differences of the subscales investigated. Other studies on the validation of questionnaires have also found that the subscales originally designed were not equivalent to the final subscales 3838. Almeida-Brasil CC, Nascimento E, Silveira MR, Bonolo PF, Ceccato MGB. New patient-reported outcome measure to assess perceived barriers to antiretroviral therapy adherence: the PEDIA scale. Cad Saúde Pública 2019; 35:e00184218.,3939. Ping W, Cao W, Tan H, Guo C, Dou Z, Yang J. Health protective behavior scale: development and psychometric evaluation. PLoS One 2018; 13:e0190390.. In this sense, to verify the replicability of the final three subscales solution, it is recommended that future studies test this structure on new samples.
Given that the ABQ-HIV is currently undergoing its first phase of validation within the Brazilian context, the present study opted for EFA. This methodological choice is substantiated by its recommendation in circumstances where a robust empirical or conceptual foundation is lacking to inform the construction of the subscales model 4040. Flora DB, Flake JK. The purpose and practice of exploratory and confirmatory factor analysis in psychological research: decisions for scale development and validation. Can J Behav Sci 2017; 49:78-88.. The utilization of EFA aligns with best practices in psychometric questionnaire validation, particularly in scenarios characterized by a paucity of pre-established theoretical frameworks. This approach ensures a rigorous exploration of the underlying structure of the ABQ-HIV, laying the groundwork for its subsequent psychometric validation within the Brazilian population.
The absence of tailored questionnaires to assess adherence barriers among individuals with HIV/AIDS receiving ART in Brazil underscores a significant gap in understanding the complexities of adherence behaviours in this population. While existing validated instruments primarily focus on medication intake 1414. Santos AP, Cordeiro JFC, Fracarolli IFL, Gomide EBG, Andrade D. Instruments to assess adherence to medication in people living with HIV: a scoping review. Rev Saúde Pública 2022; 56:112.,1515. Remor E, Milner-Moskovics J, Preussler G. Adaptação brasileira do "Cuestionario para la Evaluación de la Adhesión al Tratamiento Antirretroviral". Rev Saúde Pública 2007; 41:685-94.,1616. Vale FC, Santa-Helena ET, Santos MA, Carvalho WMES, Menezes PR, Basso CR, et al. Desenvolvimento e validação do Questionário WebAd-Q para monitorar adesão à terapia do HIV. Rev Saúde Pública 2018; 52:62.,1717. Costa LS, Latorre MRDO, Silva MH, Bertolini DV, Machado DM, Pimentel SR, et al. Validity and reliability of a self-efficacy expectancy scale for adherence to antiretroviral therapy for parents and carers of children and adolescents with HIV/AIDS. J Pediatr (Rio J.) 2008; 84:41-6., they fail to delve into the nuanced barriers that may impede adherence. In this respect, the Brazilian version of the ABQ-HIV questionnaire is a potential tool for the early detection of patients at risk of non-adherence to ART, as it identifies potentially modifiable barriers, thereby facilitating physician-patient communication and identifying specific patient segments. The use of this tool can reduce readmissions, treatment failures, and costs for the healthcare system. Moreover, the results of the study could potentially contribute to more targeted and effective public health intervention policies and projects in the future. Although the socioeconomic and technical-scientific impacts of the study’s results are potential and are yet to be fully evaluated, they will potentially contribute to improving the quality of life of PLHIV and strengthening the health system’s response capacity. Essentially, the ABQ-HIV questionnaire can complement other available questionnaire options and be as effective as more expensive direct methods for measuring adherence.
This study has some limitations. The assessment of convergent and divergent validity for constructs associated with self-reported non-adherence was constrained by the unavailability of other questionnaires adapted to the Brazilian context. While acknowledging the absence of a universally recognized “gold standard” method for confirming medication non-adherence 4141. Castillo-Mancilla JR, Haberer JE. Adherence measurements in HIV: new advancements in pharmacologic methods and real-time monitoring. Curr HIV/AIDS Rep 2018;15:49-59., future investigations could enhance the questionnaire’s validity by employing questionnaires already adapted for use in the Brazilian context 1515. Remor E, Milner-Moskovics J, Preussler G. Adaptação brasileira do "Cuestionario para la Evaluación de la Adhesión al Tratamiento Antirretroviral". Rev Saúde Pública 2007; 41:685-94.,1616. Vale FC, Santa-Helena ET, Santos MA, Carvalho WMES, Menezes PR, Basso CR, et al. Desenvolvimento e validação do Questionário WebAd-Q para monitorar adesão à terapia do HIV. Rev Saúde Pública 2018; 52:62.. Additionally, exploring alternative measures, such as data derived from medication event monitoring systems, may present a more robust approach to validating the tool, albeit with associated resource demands 1818. Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.. Furthermore, a substantial number of respondents comprised individuals with incomplete elementary school education, potentially influencing their comprehension of the questionnaire and its applicability due to their lower educational attainment. Notwithstanding these limitations, the outcomes of this investigation provide empirical support for the reliability and validity of the ABQ-HIV within the linguistic and cultural context of Portuguese as spoken in Brazil. Subsequent cross-cultural validations are needed to ascertain whether the questionnaire maintains its psychometric robustness when applied in varied national (including more cities and regions of Brazil) and/or international contexts.
In conclusion, the Brazilian adaptation of the ABQ-HIV has demonstrated its potential validity and reliability as a questionnaire for evaluating barriers to ART. The psychometric properties of the adapted version closely align with those of the original model, rendering it suitable for both clinical and research applications within the context of HIV infection in Brazil. The adaptation process was meticulous, incorporating qualitative and quantitative methods to ensure the objectivity, clarity, and relevance of the items while preserving their conceptual integrity. The resultant factor structure, comprising 17 items distributed across three subscales, exhibited adequacy by effectively explaining the observed variance and maintaining consistency throughout all validation phases, despite its configuration differing from the original model. This robust validation process underscores the utility of the Brazilian version of ABQ-HIV, providing a valuable tool for advancing our understanding and assessment of barriers to ART within the specific cultural and linguistic nuances of the Brazilian population.
References
-
1Chen J, Zhou T, Zhang Y, Luo S, Chen H, Chen D, et al. The reservoir of latent HIV. Front Cell Infect Microbiol 2022; 12: 945956.
-
2Zuge SS, Paula CC, Padoin SMM. Efetividade de intervenções para adesão à terapia antirretroviral em adultos com HIV: revisão sistemática. Rev Esc Enferm USP 2020; 54:e03627.
-
3World Health Organization. HIV/AIDS. Global situation and trends. https://www.who.int/data/gho/data/themes/hiv-aids (accessed on 06/Dec/2023).
» https://www.who.int/data/gho/data/themes/hiv-aids -
4Secretaria de Vigilância em Saúde, Ministério da Saúde. HIV/AIDS 2023. Boletim Epidemiológico de HIV/Aids 2023; Número Especial.
-
5World Health Organization. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach. https://www.who.int/data/gho/data/themes/hiv-aids (accessed on 23/May/2022).
» https://www.who.int/data/gho/data/themes/hiv-aids -
6Sakthivel V, Krishnasamy V, Mehalingam V. Level of medication adherence and its associated factors among patients receiving antiretroviral therapy at a tertiary care hospital in South India. J Caring Sci 2020; 9:93-7.
-
7Vetrova MV, Aleksandrova V, Paschenko AE, Toropov SE, Rassokhin VV, Abyshev RA, et al. Physician and patient prediction of adherence to antiretroviral therapy in HIV positive people in Saint-Petersburg, Russia. AIDS Care 2021; 33473-7.
-
8Heylen E, Chandy S, Shamsundar R, Nair S, Ravi Kumar BN, Ekstranda ML. Correlates of and barriers to ART adherence among adherence-challenged people living with HIV in southern India. AIDS Care 2021; 33:486-93.
-
9Chakraborty A, Hershow RC, Qato DM, Stayner L, Dworkin MS. Adherence to antiretroviral therapy among HIV patients in India: a systematic review and meta-analysis. AIDS Behav 2020; 24:2130-48.
-
10Buh A, Deonandan R, Gomes J, Krentel A, Oladimeji O, Yaya S. Adherence barriers and interventions to improve ART adherence in sub-saharan african countries: a systematic review protocol. PLoS One 2022; 17:e0269252.
-
11Zeng C, Xiaoming L, Qiao S, Yang S, Shen Z, Zhou Y. Anticipated stigma and medication adherence among people living with HIV: the mechanistic roles of medication support and ART self-efficacy. AIDS Care 2020; 32:1014-22.
-
12Spinelli MA, Haberer JE, Chai PR, Castillo-Mancilla J, Anderson PL, Gandhi M. Approaches to objectively measure antiretroviral medication adherence and drive adherence interventions. Curr HIV/AIDS Rep 2020; 17:301-14.
-
13Bastán P, Enrique J. Adherencia al tratamiento antirretroviral de personas con VIH/sida en la atención primaria de salud. Rev Habanera Cienc Méd 2020; 19:e2962.
-
14Santos AP, Cordeiro JFC, Fracarolli IFL, Gomide EBG, Andrade D. Instruments to assess adherence to medication in people living with HIV: a scoping review. Rev Saúde Pública 2022; 56:112.
-
15Remor E, Milner-Moskovics J, Preussler G. Adaptação brasileira do "Cuestionario para la Evaluación de la Adhesión al Tratamiento Antirretroviral". Rev Saúde Pública 2007; 41:685-94.
-
16Vale FC, Santa-Helena ET, Santos MA, Carvalho WMES, Menezes PR, Basso CR, et al. Desenvolvimento e validação do Questionário WebAd-Q para monitorar adesão à terapia do HIV. Rev Saúde Pública 2018; 52:62.
-
17Costa LS, Latorre MRDO, Silva MH, Bertolini DV, Machado DM, Pimentel SR, et al. Validity and reliability of a self-efficacy expectancy scale for adherence to antiretroviral therapy for parents and carers of children and adolescents with HIV/AIDS. J Pediatr (Rio J.) 2008; 84:41-6.
-
18Mueller S, Wilke T, Gorasso V, Erhart M, Kittner JM. Adaption and validation of the adherence barriers questionnaire for HIV patients on antiretroviral therapy (ABQ-HIV). BMC Infect Dis 2018; 18:599.
-
19Mueller S, Kohlmann T, Wilke T. Validation of the Adherence Barriers Questionnaire - an instrument for identifying potential risk factors associated with medication-related non-adherence. BMC Health Serv Res 2015; 15:153.
-
20Mueller S, Junker S, Wilke T, Lommatzsch A, Schuster AK, Kaymak H, et al. Questionnaire for the assessment of adherence barriers of intravitreal therapy: the ABQ-IVT. Int J Retina Vitreous 2021; 7:43.
-
21Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010; 63:737-45.
-
22Governo de Sergipe. Secretaria da Saúde alerta sobre tratamento correto para HIV. https://www.se.gov.br/noticias/saude/secretaria_da_saude_alerta_sobre_tratamento_correto_para_hiv (accessed on 06/Jan/2022).
» https://www.se.gov.br/noticias/saude/secretaria_da_saude_alerta_sobre_tratamento_correto_para_hiv -
23Kock N, Hadaya P. Minimum sample size estimation in PLS-SEM: the inverse square root and gamma-exponential methods. Inf Syst J 2018; 28:227-61.
-
24Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract 2011; 17:268-74.
-
25Yusoff MSB. ABC of content validation and content validity index calculation. Education in Medicine Journal 2019; 11:49-54.
-
26Kaiser HF. An index of factorial simplicity. Psychometrika 1974; 39:31-6.
-
27Bartlett MS. The effect of standardization on a chi-square approximation in factor analysis. Biometrika 1951; 38:337-44.
-
28Damásio BF, Dutra DF. Análise fatorial exploratória: um tutorial com o software FACTOR. In: Damásio BF, Borsa JC, editors. Manual de desenvolvimento de instrumentos. São Paulo: Vetor; 2017. p. 241-65.
-
29Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2015.
-
30Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods 2011; 16:209-20.
-
31Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Liberabit 2019; 25:99-106.
-
32Lorenzo-Seva U, Ferrando PJ. A simulation-based scaled test statistic for assessing model-data fit in least-squares unrestricted factor-analysis solutions. Tarragona: Universitat Rovira i Virgili; 2022. (Technical Report).
-
33Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas 2018; 78:762-80.
-
34Marsh HW, Hau KT, Grayson D. Goodness of fit evaluation in structural equation modeling. In: Maydeu-Olivares A, McArdle J, editors. Contemporary psychometrics. Mahwah: Erlbaum; 2005. p. 275-340.
-
35Oliveira AWN. Tradução e adaptação transcutural do Adherence Barriers Questionnaire-HIV (ABQ-HIV) para uso no Brasil [Doctoral Dissertation]. Redenção: Universidade da Integração Internacional da Lusofonia Afro-Brasileira; 2021.
-
36Furr RM. Scale construction and psychometrics for social and personality psychology. London: Sage Publications; 2011.
-
37Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL, Gouvêa MA, et al. Análise multivariada de dados. 6th Ed. Porto Alegre: Bookman; 2009.
-
38Almeida-Brasil CC, Nascimento E, Silveira MR, Bonolo PF, Ceccato MGB. New patient-reported outcome measure to assess perceived barriers to antiretroviral therapy adherence: the PEDIA scale. Cad Saúde Pública 2019; 35:e00184218.
-
39Ping W, Cao W, Tan H, Guo C, Dou Z, Yang J. Health protective behavior scale: development and psychometric evaluation. PLoS One 2018; 13:e0190390.
-
40Flora DB, Flake JK. The purpose and practice of exploratory and confirmatory factor analysis in psychological research: decisions for scale development and validation. Can J Behav Sci 2017; 49:78-88.
-
41Castillo-Mancilla JR, Haberer JE. Adherence measurements in HIV: new advancements in pharmacologic methods and real-time monitoring. Curr HIV/AIDS Rep 2018;15:49-59.
Publication Dates
-
Publication in this collection
16 Sept 2024 -
Date of issue
2024
History
-
Received
11 Jan 2024 -
Reviewed
24 May 2024 -
Accepted
19 July 2024