ABSTRACT
Background: The 36-Item Short Form Health Survey questionnaire (SF-36) is a widely used instrument for evaluating health-related quality-of-life (HRQoL). The psychometric validation of the SF-36 version 2.0 (SF-36v2) in HIV-infected patients had not yet conducted in Brazil.
Aim: To test data quality, reliability and validity of the SF-36v2 as a measure of HRQoL among Brazilian individuals living with HIV.
Methods: A cross-sectional study included 393 HIV-infected patients in whom HRQoL was assessed by using the SF-36v2 questionnaire. Demographic characteristics, socioeconomic status and clinical data were also collected. The SF-36 version 1 translated into Brazilian-Portuguese was adapted and introduced version 2 improvements according to the instrument developers. SPSS version 21 was used for data analyses. Confirmatory factor analysis (CFA) and structural equation modelling were performed using AMOS SPSS version 18. T-test for independent samples was used to compare differences between mean levels of HRQoL components in different groups. Linear multiple regression techniques were used to analyze the relationship between Physical Component Summary (PCS), Mental Component Summary (MCS) and independent variables.
Results: We performed the CFA and tested the hypothetical measurement model. We included five parameters to improve the adherence of data to the model. All indicators met the requirement suggested by specialized literature (χ2 (gl): 980.7 (527); CFI: 0.949; GFI: 0.873; TLI: 0.943; RMSEA: 0.047; 90% IC: 0.042-0.051). Multiple regression analyses revealed that depression (p = 0.001), family income (p = 0.007), sex (p = 0.001) and age (p< 0.021) were associated with MCS. Comorbidities (p = 0.001), health self-perception (p = 0.001), age (p = 0.001), and sex (p = 0.025) were associated with PCS.
Conclusions: A consistent validation of the SF-36v2 in Brazilian HIV patients were shown. Further studies with SF-36v2 psychometric analyses would be required in other populations to establish Brazilian normative data.
Keywords: HIV; health-related quality of life; factor analysis; validation studies.
Background
Antiretroviral therapy improves health, increases patients' survival and reduces the risk of HIV transmission.1 Health-related quality of life (HRQoL) has then become an area of interest in HIV treatment and follow-up. Measuring the HRQoL may be helpful not only to evaluate treatment response, effectiveness of treatment, patients' decline or improvement, but also adherence.2
HRQoL is a multidimensional concept related to the impact of health on the individual's self-perception of wellbeing, considering sex, lifestyle, physical, social and mental aspects.3 Measuring HRQoL in HIV should meet a set of standard psychometric properties, produce accurate results, and be sensitive to treatment adverse effects.4
The 36-Item Short Form Health Survey questionnaire (SF-36) is a widely used, standard instrument for evaluating HRQoL.5 The institution that hold all SF-36 copyrights and trademarks have developed licensing programs for academic research and business applications that evaluate internal consistency, accuracy of data punctuation and adequacy of interpretation.5 The SF-36 was originally derived from the most frequent measured concepts included in the Medical Outcomes Study (MOS).5 In 1997, the SF-36 version 1 was translated into Brazilian-Portuguese and cross-culturally adapted.6
Although SF-36 normative data for the population in the south of Brazil have been proposed,7 the SF-36 version 2.0 (SF-36v2) in HIV-infected patients has not yet been validated in Brazil. The SF-36v2 was introduced in 1996 to improve the original instrument on its psychometrics proprieties when considering the two SF-36 role functioning scales.8 The second version was developed to improve the response options for the items concerning role physical and role emotional limitations, reducing the ceiling effects of these scales.8,9 We aimed to assess data quality, reliability and validity of the SF-36v2 as a measure of health-related quality of life among individuals living with HIV, in Brazil.
Method
Sampling
In January 2017, 2500 patients with HIV were regularly enrolled at a University Hospital. Sample size was calculated, using the OpenEpi v-3 tool for descriptive studies. We estimated sample size to be 334 patients, considering the frequency of HRQoL of 50%, the confidence limit of 5% and the design effect of 1. Sample size was inflated by 20% to account for lost data in HRQoL questionnaires. Incomplete questionnaires (less than 80% of the items) were excluded. A cross-sectional study was conducted from January 2017 to November 2018. A total of 392 patients were recruited in the HIV outpatient clinic at a University Hospital. Information on demographic characteristics, socioeconomic status, clinical history, medical diagnosis of depression, and CD4 + /CD8 + T lymphocytes count were collected from each patient during medical examination, using a structured questionnaire. Information about skin color was self-reported and classified as Caucasian, racially mixed ("mulato") or black. Marital status included the options single or married/stable relationship, the latter applied to couples living together without marriage. Comorbidities were defined as medical diagnoses of tuberculosis, syphilis, cardiopathy, arterial hypertension, type-2 diabetes, chronic renal failure, lymphoma, HCV/HBV/HTLV co-infections and fatty liver disease. HRQoL was assessed by using the SF-36v2 questionnaire.
SF-36 instrument version 2
The SF-36 contains 36 items measuring eight dimensions of HRQoL. All but one of the 36 items (item 2) are used to score the SF-36 eight domains that are aggregated in two summary measures, Physical and Mental components. Among the eight domains, three scales (Physical Functioning, Role-Physical, and Bodily Pain) contributes mostly to the Physical Component Summary (PCS) and three (Mental Health, Role-Emotional, and Social Functioning) contributes to the Mental Component Summary (MCS). The domains Vitality, General Health, and Social Functioning present noteworthy correlations with both summary components.8,9 The eight scales scoring and PCS and MCS were performed using the PROCoRE v 1.3 to obtain the norm-based scores.8,9 Normalized scores enabled comparisons between domains, adjusting scores to a mean of 50 and standard deviation of 10. OptumInsight Life Sciences Inc number was QM025905.
We adapted the SF-36v1 translated into Brazilian-Portuguese and cross-culturally adapted in 19976 and introduced the version 2 improvements in the response options according to the developers (Table 1).8,9
The English and Brazilian Portuguese version of the 36-Item Short Form Health Survey version 2 (SF-36v2®).
Improvements in version 2.0 included a change in the questions and answers layout. The SF-36v2 was printed in a left-to-right format with simplification in the boxes formatting checked by respondents. We included the changes from SF36v2, replacing the dichotomous response choices (Yes, No) for items 4a, 4b, 4c, 4d, 5a, 5b and 5c in the two role functioning scales by "All the time", "Most of the time", "Sometimes", "A little of the time", "None of the time". This change in version 2.0 response scales extends the range measured and greatly increased score precision. We eliminated one of the six response choices (A good bit of the time) for question 9a, 9b, 9c, 9d, 9e, 9f, 9 g, 9 h, 9i from the mental health and vitality items, remaining the following options: All of the time, Most of the time, Some of the time, A little of the time, None of the time.8
Statistical analysis and validation
SPSS software version 21 was used for data analyses and structural equation modeling (SEM) was performed using AMOS SPSS version 18. T-test for independent samples was used to compare mean levels of HRQoL components according to sex, comorbidities and depression. Multiple regression analysis was used to analyze the relationship between PCS, MCS and independent variables. Variables (age, sex, educational status, race, family income, marital status, depression, comorbidities, health self-perception, CD4/CD8 T lymphocytes count, and CD4/CD8 ratio) included in multivariate models had a p-value less than 0.2510 in univariate analysis.
Confirmatory factor analysis (CFA) was assessed using structural equation modeling (SEM). We tested the measurement model consisting of the eight theoretically predicted factors. The items parameters were estimated using weighted least square mean and variance (WLSMV). We used the following indexes of adherence of the model: χ2 (to test the difference between the empirical matrix and the theoretical model matrix, the higher the value of χ2, the worse the adjustment); Comparative fit index (CFI), Goodness-of-fit index (GFI) e Tucker-Lewis Index (TLI) (the closer to 1.0 represent a better model quality). The root mean square error of approximation (RMSEA) was calculated. Values below 0.08 were considered acceptable.11
We adopted the modification indexes and the theoretical pertinence as criteria for inclusion of additional parameters in the model. Model adherence was recalculated after insertion of each parameter.12 Following this first step, we tested the structural model, also theoretically predicted, by grouping of factors into two major components: PCS and MCS. We maintained the entered parameters in the measurement model and observed the same adherence indexes.12
Internal consistency or the extent to which items within the same dimension correlated with each other was measured using the Cronbach α statistic and Composite reliability. Values of ≥ 0.7 were considered satisfactory and values of ≥ 0.8 with high reliability.13 The Floor and Ceiling effect were observed as the percentage of respondents with worst possible score and the percentage of respondents with best possible score, respectively.
Ethical approval
The study protocol was approved by Ethical Review Board (protocol number 1.035.826) and is in accordance with the Declaration of Helsinki 2013 and the Brazilian National Health Council Resolution 499/12. All volunteers signed an informed consent form.
Results
The study enrolled 392 HIV-infected patients (219 males; 173 females), mean age of 44.2 ± 11.5 years, CD4 T lymphocytes count of 701.7 ± 1273.6 cells/mm3 and CD8 count of 1100.9 ± 601.0 cells/mm3. Most patients were racially mixed (54.6%) followed by black (31.1%), did not have a stable relationship (70.7%), had a family income (69.4%) higher than the Brazilian Minimal Wage (284.6 USD) and nine or more schooling years (69.4%). One-hundred-sixty patients (40.8%) had one or more comorbidities and one-hundred-three (26.3) diagnosis of depression (Table 2).
Demographic and clinical characteristics of the 392 HIV-infected patients, Salvador, Bahia, 2018.
Confirmatory factor analysis (CFA) was performed to evaluate the factor structure and dimensionality of SF-36v2. The hypothetical measurement model composed of 35 items distributed by eight factors, as theoretically predicted, was tested. The adjustment indexes obtained for this model were: χ2 (gl): 1225.80 (532); CFI: 0.923; GFI: 0.841; TLI: 0.913; RMSEA: 0.058 (90% IC: 0.054-0.062). To improve the adherence of data to the model, five parameters were included (Table 3).
After inclusion of the five new parameters, we obtained the following adjusted indices: χ2 (gl): 980.7 (527); CFI: 0.949; GFI: 0.873; TLI: 0.943; RMSEA: 0.047 (90% IC: 0.042-0.051). Figure 1 showed the measurement model.
The measurement model for CFA combining all eight domains of SF-36v2 with standardized factor loads and correlation coefficients between factors.
Based on the measurement model, a structural model was tested, grouping the eight factors into two components summaries, as described in the method section. The adjustment indexes obtained for this model were: χ2 (gl): 1702.2 (543); CFI: 0.871; GFI: 0.826; TLI: 0.858; RMSEA: 0.074 (90% IC: 0.070-0.078). The final structural model is described in Figure 2.
SF-36v2 final structural model, with standardized factor loads and correlation coefficients between Summaries Components.
Once the factorial structure of the SF-36v2 was confirmed, we calculated the internal reliability indices of each of the eight factors (Table 4). No floor effects were detected in all SF-36v2 domains, while ceiling effects were observed for the PF, RP, SF and RE.
All SF-36 normalized mean scores were systematically lower in female patients. However, only RP (0.030), VT (0.029), RE (0.009), MH (0.001) and PCS (0.002) were statistically significant (Table 5).
SF-36v2 indicators in 392 HIV-infected patients according to sex. Salvador, Bahia, Brazil, 2018.
The association of the predictive variables with the PCS and MCS scores was explored using multiple regression analyses (Table 6). Depression (p = 0.001), family income (p = 0.007), sex (p = 0.001) and age (p < 0.021) were strongly associated with the variation in MCS; Comorbidities (p = 0.001), health self-perception (p = 0.001), age (p = 0.001) and sex (p = 0.025) were good predictors of the PCS.
Final models of a multiple regression analyses having PCS and MCS as the dependent variable for 392 HIV-infected patients. Salvador, Bahia, 2018.
Discussion
The SF-36v2 is a widely used instrument to assess Health-Related Quality Of Life. This is the first paper to report the psychometric qualities, reliability and validity of the SF-36v2 in Brazil. A previous study reported the translation and validation process of the SF-36v16 and a second one suggested normative data in south Brazil.7 We analyzed the psychometric quality of the SF-36v2 instrument and evaluated the HRQOL in patients living with HIV.
We did not test an alternative model, such as analyzing a structural model composed of a single factor, since SF-36 is a bidimensional instrument. We opted for performing the CFA using the previously established theoretical model of the SF-36. 8,9 The SF-36v2 Manual9 provides two additional forms of calculation of the instrument: the first step considers the eight domains (PF, RP, BP, GH, VT, SF, RE and MH) and the second step generates two summary measures, one physical (PCS) and the other mental (PCS). We tested both models and the results evidenced a good psychometric quality indicating that they generate reliable indicators.
The hypothetical measurement model for the eight factors presented satisfactory factorial loads11 ranging from 0.38 to 0.94 and adherence rates close to satisfactory following the recommended criteria.12,14 The modification indexes indicated a high potential for improvement for the model fit. In total, five parameters were included and all of them theoretically justified by the proximity of content. It is important to notice that the entered parameters were related to PF domain items (3 h Walk Several Hundred Yards, 3i Walk One Hundred Yards and 3 g Walk Mile). However, these items have high semantic proximity suggesting overlapping and redundancy. Maybe withdrawing some of them would raise the model parsimony without damaging the measurement quality. However, since it was not the objective of the study to reduce the SF-36v2 instrument, we decided to maintain all of them. After model adjustment, all indicators presented satisfactory values, except GFI, which was slightly below the threshold (0.873, below the 0.9 parameter) but still meeting the requirement suggested by specialized literature.14,15
Scoring the eight scales using the original non-normalized 0 to 100 algorithms (raw scores) is commonly reported in the literature, but normalization allows meaningful comparisons among domains and unbiased identification and quantification of the SF-36 domains.5,9 The normalized scores and the two summary components are performed by specific Scoring Software9 based on norms with a mean of 50 and a standard deviation of 10. Normalized scores below 50 are interpreted as below the US general population t-score and otherwise above.
Considering the CFA indicators, a previous study16 described lower values (RMSEA 0.14, CFI, 0.83 and TLI, 0.75) than the present study. We tested the psychometric characteristics of the two summaries components model. The structural model was tested, which already took into consideration the parameters previously included in the measurement model. The RMSEA was satisfactory and the other indicators (CFI, GFI and TLI) were close to desirable values (>0.9).11 Once the structural model is more complex than the measurement model, it is difficult to achieve a perfect fit.
To estimate the scale scores of reliability, we used the internal consistency method.13 We opted to use both the Cronbach's alpha and composite reliability coefficients. Cronbach's alpha coefficient is the most widely adopted index in literature and therefore enables comparison with a larger number of studies. However, recent reviews have pointed this measure as a faulty indicator as it underestimate scale/factor consistency. Thus, the composite reliability is a more robust and accurate measure.13
Based on the adopted criteria, the factors PF, RP, RE and MH presented high reliability and the others, apart from SF, provided acceptable reliability indicators.11 The SF has only two items, which may affect the internal consistency. As scales presenting many items tend to have greater internal consistency,11 our SF coefficient was higher than those found by other authors.16-19 Although we did not observe floor effects in any SF-36v2 factors, four domains (PF, RP, SF and RE) presented ceiling effects. All these ceiling effects were much lower than those found in general North American population.20 The application of questionnaires was conducted during face-to-face interviews. This fact may have contributed to a lower ceiling effect compared to the US population.
Our results showed systematically lower scores in females for all SF-36 normalized mean scores. Multiple regression analysis evidenced the association of depression, family income, sex and age with Mental Component Summary. Comorbidities, health self-perception, age and sex were associated with the Physical Component Summary. These results are similar to our previous report that observed lower HRQoL scores in females2,21 and the association of comorbities3,21 with lower HRQoL physical components and depression with lower HRQoL mental components.2,3
Our study has some limitations. Among them, the cross-sectional design and lack of cross validation14 with independent samples, since the SF-36 is widely used with acceptable and higher psychometric proprieties.8,9 However, we were able to provide a consistent validation of the tool in Brazilian HIV-infected patients. The lack of information on SF-36 psychometric proprieties in Brazil, including in HIV patients also reinforces the need of studies in this field. To our knowledge, this is the first study to validate the SF-36v2 in Brazil. Further studies with SF-36v2 psychometric analyses would be required in other populations to establish Brazilian normative data.
-
FundingThis research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
References
- 1 Deeks SG, Lewin SR, Havlir DV. The End of AIDS: HIV Infection as a Chronic Disease. Lancet. 2013;382:1525-33.
- 2 Betancur MN, Lins L, Oliveira IR, Brites C. Quality of life, anxiety and depression in patients with HIV/AIDS who present poor adherence to antiretroviral therapy: a cross-sectional study in Salvador, Brazil. Braz J Infect Dis. 2017;21:507-14.
- 3 Lédo AP, Rodriguez-Prieto I, Lins L, Neto MG, Brites C. Association Between Health-Related Quality of Life and Physical Functioning in Antiretroviral-Naive HIV-Infected Patients. Open AIDS J. 2018;12:117-25.
- 4 Clayson DJ, Wild DJ, Quarterman P, Duprat-Lomon I, Kubin M, Coons SJA. A comparative review of health-related quality-of-life measures for use in HIV/AIDS clinical trials. PharmacoEconomics. 2006;24:751-65.
- 5 Lins L, Carvalho FM. SF-36 total score as a single measure of health-related quality of life: Scoping review. SAGE Open Med. 2016;4:1-12.
-
6 Ciconelli, RM. Tradução para o português e validação do questionário genérico de avaliação de qualidade de vida "Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36)". São Paulo, 1997. 148 p. Tese (Doutorado em Medicina) - Escola Paulista de Medicina, Universidade Federal de São Paulo. São Paulo, 1997. Available from: http://repositorio.unifesp.br/handle/11600/15360
» http://repositorio.unifesp.br/handle/11600/15360 - 7 Laguardia J, Campos MR, Travassos C, Najar AL, Anjos LA, Vasconcellos MM. Dados normativos brasileiros do questionário Short Form-36 versão 2. Rev bras epidemiol. 2013;16:889-97.
- 8 Ware JE. SF-36 Health Survey update. Spine. 2000;25:3130-9.
- 9 Optum PROCoRE 1.3 Smart Measurement System. Optum, Inc 1301 Atwood Avenue, Suite 311 N. Johnston, R.I. 02919, U.S.A. October 2018.
- 10 Hosmer DW, Lemeshow S. Applied Logistic Regression. New York: Wiley;. 2000.
- 11 Furr RM. Scale construction and psychometrics for social and personality psychology. London: SAGE Publications; 2011.
- 12 Byrne BM. Structural equation modeling with AMOS. In: Basics concepts, applications, and programming. New Jersey: Lawrence Erlbaum Associates; 2010.
- 13 Peterson RA, Kim Y. On the relationship between coefficient alpha and composite reliability. J. Appl Psychol. 2013;98:194-8.
- 14 Baumgartner H, Homburg C. Applications of Structural Equation Modeling in Marketing and Consumer Research: a review. Int J Res Mark. 1996;13:139-61.
- 15 Doll WJ, Xia W, Torkzadeh G. A confirmatory factor analysis of the end-user computing satisfaction instrument. MIS Quarterly. 1994;18:357-69.
- 16 Castillo-Carandang NT, Sison OT, Grefal ML, et al. A community-based validation study of the short-form 36 version 2 Philippines (Tagalog) in two cities in the Philippines. PLoS One. 2013;8:1-9.
- 17 Thumboo J, Fong KY, Machin D, et al. A community-based study of scaling assumptions and construct validity of the English (UK) and Chinese (HK) SF-36 in Singapore. Qual Life Res. 2001;10:175-88.
- 18 Fukuhara S, Bito S, Green J, Hsiao A, Kurokawa K. Translation, adaptation, and validation of the SF-36 Health Survey for use in Japan. J Clin Epidemiol. 1998;51:1037-44.
- 19 Nakao M, Yamauchi K, Ishihara Y, Solongo B, Ichinnorov D, Breugelmans R. Validation of the Mongolian version of the SF-36v2 questionnaire for health status assessment of Mongolian adults. Springerplus. 2016;5:1-13.
- 20 Ware JE, Kosinski M, Dewey JE. How to score version 2 of the SF-36 health survey. Lincoln, RI: Quality Metric Incorporated; 2000.
- 21 Vieira VC, Lins L, Sarmento VA, Netto EM, Brites C. Oral health and health-related quality of life in HIV patients. BMC Oral Health. 2018;18:1-7.
Publication Dates
-
Publication in this collection
25 Nov 2019 -
Date of issue
Sep-Oct 2019
History
-
Received
16 Jan 2019 -
Accepted
7 Aug 2019 -
Published
3 Sept 2019