Acessibilidade / Reportar erro

Structure internal of the dimension Human Person of the Questionnaire of Health Vulnerability in Heart Failure

Estructura interna de la dimensión Persona Humana del Cuestionario de Vulnerabilidad Sanitaria en la Insuficiencia Cardíaca

ABSTRACT

Objective:

to analyze the evidence of validity of the internal structure of the dimension Human Person of the Questionnaire of Health Vulnerability in Heart Failure.

Method:

psychometric study with 1,008 people with heart failure, in a tertiary healthcare institution located in Northeastern Brazil. The internal structure was assessed by exploratory factor analysis with a polychoric correlation matrix, followed by confirmatory factor analysis to verify the quality of the model fit. Internal consistency was measured by composite reliability (CR) and McDonald’s omega (ω).

Results:

psychometric parameters revealed 22-item model, distributed in five factors, total explained variance of 64.9%, factor loadings (0.38 to 0.97) and adequate communalities (0.20 ≤ h2 ≤ 0.98) and acceptable indicators of precision (0.79 ≤ ORION ≤ 0.98), representativeness (0.89 ≤ FDI ≤ 0.99), sensitivity (1.92 ≤ SR ≤ 7.07), factor expectancy (88.3% ≤ EPTD ≤ 97.9%), replicability (0.82 ≤ H-latent ≤ 0.97; 0.81 ≤ H-observed ≤ 0.87) and reliability (CR = 0.92 and ω = 0.83). Adequate adjustment quality was achieved (TLI = 0.99; CFI = 0.99; GFI = 0.99; RMSEA = 0.04 and RMSR = 0.04).

Conclusion:

We obtained an instrument with good evidence of internal structure validity for construct measurement.

DESCRIPTORS
Heart Failur; Health Vulnerabilit; Validation Stud; Psychometric; Factor Analysis

RESUMEN

Objetivo:

analizar las evidencias de validez de la estructura interna de la dimensión Persona Humana del Cuestionario de Vulnerabilidad Sanitaria en la Insuficiencia Cardíaca.

Material y método:

estudio psicométrico con 1.008 personas con insuficiencia cardíaca, en una institución de salud terciaria ubicada en el Nordeste de Brasil. La estructura interna fue evaluada por análisis factorial exploratorio con matriz de correlación policórica, seguido de análisis factorial confirmatorio para verificar la calidad del ajuste del modelo. La consistencia interna se midió mediante la fiabilidad compuesta (FC) y el omega de McDonald (ω).

Resultados:

los parámetros psicométricos revelaron un modelo de 22 ítems, distribuidos en cinco factores, una varianza total explicada del 64,9%, cargas factoriales (0,38 a 0,97) y comunalidades adecuadas (0,20 ≤ h2 ≤ 0,98) e indicadores de precisión aceptables (0. 79 ≤ ORION ≤ 0,98), representatividad (0,89 ≤ FDI ≤ 0,99), sensibilidad (1,92 ≤ SR ≤ 7,07), expectativa de factor (88,3% ≤ EPTD ≤ 97,9%), replicabilidad (0,82 ≤ H-latente ≤ 0,97; 0,81 ≤ H-observado ≤ 0,87) y fiabilidad (CR = 0,92 y ω = 0,83). Se alcanzó una calidad de ajuste adecuada (TLI = 0,99; CFI = 0,99; GFI = 0,99; RMSEA = 0,04 y RMSR = 0,04).

Conclusión:

Se obtuvo un instrumento con buena evidencia de validez de estructura interna para la medición del constructo.

DESCRIPTORES
Insuficiencia Cardíaca; Vulnerabilidad en Salud; Estudio de Validación; Psicometría; Análisis Factorial

RESUMO

Objetivo:

analisar as evidências de validade de estrutura interna da dimensão Pessoa humana do Questionário de Vulnerabilidade em Saúde na Insuficiência Cardíaca.

Método:

estudo psicométrico com 1.008 pessoas com insuficiência cardíaca, em instituição de saúde terciária situada no Nordeste brasileiro. A estrutura interna foi avaliada por meio de análise fatorial exploratória com matriz de correlação policórica, seguida da confirmatória, para atestar a qualidade do ajuste do modelo. A consistência interna foi medida pela fidedignidade composta (FC) e ômega de McDonald (ω).

Resultados:

os parâmetros psicométricos revelaram modelo de 22 itens, distribuídos em cinco fatores, variância total explicada de 64,9%, cargas fatoriais (0,38 a 0,97) e comunalidades (0,20 ≤ h2 ≤ 0,98) adequadas, e indicadores aceitáveis de precisão (0,79 ≤ ORION ≤ 0,98), representatividade (0,89 ≤ FDI ≤ 0,99), sensibilidade (1,92 ≤ SR ≤ 7,07), espera do fator (88,3% ≤ EPTD ≤ 97,9%), replicabilidade (0,82 ≤ H-latente ≤ 0,97; 0,81 ≤ H-observado ≤ 0,87) e confiabilidade (FC = 0,92 e ω = 0,83). Alcançou-se qualidade de ajustamento adequada (TLI = 0,99; CFI = 0,99; GFI = 0,99; RMSEA = 0,04 e RMSR = 0,04).

Conclusão

obteve-se um instrumento com boas evidências de validade de estrutura interna para mensuração do constructo.

DESCRITORES
Insuficiência Cardíaca; Vulnerabilidade em Saúde; Estudo de Validação; Psicometria; Análise Fatorial

INTRODUCTION

Heart failure (HF) is a syndrome presenting high morbidity and mortality worldwide and with a high incapacitating potential(11. Groenewegen A, Rutten FH, Mosterd A, Hoes AW. Epidemiology of heart failure. Eur J Heart Fail. 2020;22(8):1342-56. doi: http://dx.doi.org/10.1002/ejhf.1858. PubMed PMID: 32483830.
http://dx.doi.org/10.1002/ejhf.1858...
), which is expressed in different contexts. The burden of HF reflects the numerous conditions of health vulnerability (HV) experienced by the person who, to coexist with the disease, is immersed in a series of rules that dictate daily self-care actions for control, monitoring and management of symptoms.

To help and support disease management, patients, their families/caregivers and health professionals use instruments that propose the measurement of several constructs(22. Uchmanowicz B, Szymańska-Chabowska A, Jankowska-Polańska B. Assessment of adherence to medication for cardiovascular diseases: measurement tools. Cardiovasc J S Afr. 2019;30(2):113-9. doi: http://dx.doi.org/10.5830/CVJA-2018-050. PubMed PMID: 30720844.
http://dx.doi.org/10.5830/CVJA-2018-050...
) that intervene in the HV. To study a health issue from the HV perspective is to seek new ways to better understand a health problem, adopting and prioritizing the holistic approach and integral understanding of phenomena, as opposed to the isolated analytical process.

In the context of HF, HV is a phenomenon intrinsic to human existence and involves interdependent dimensions: Human Person, co-presences and Care(33. Cestari VRF, Moreira TMM, Pessoa VLMP, Florêncio RS, Silva MRF, Torres RAM. A essência do cuidado na vulnerabilidade em saúde: uma construção heideggeriana. Rev Bras Enferm. 2017;70(5):1171-6. doi: http://dx.doi.org/10.1590/0034-7167-2016-0570. PubMed PMID: 28977242.
http://dx.doi.org/10.1590/0034-7167-2016...
). It is in the dimension of the human person that the subject understands her/his health condition in order to react to situations that place him in vulnerability(44. Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Vulnerabilidad en salud, educación y libertad: reflexión a la luz de Hannah Arendt. Esc Anna Nery. 2022;26:e20210207. doi: http://dx.doi.org/10.1590/2177-9465-ean-2021-0207
doi: http://dx.doi.org/10.1590/2177-9465...
).

Despite the relevance of understanding the HV in this population, a proper instrument to measure it has not yet been identified. With the intention of filling this gap, two studies are highlighted: the first one identified the constituent elements of the HV of the person with HF(55. Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Validação dos marcadores da vulnerabilidade em saúde da pessoa com insuficiência cardíaca. Rev Eletr Acervo Saúde. 2021;13(5):e7282. doi: http://dx.doi.org/10.25248/reas.e7282.2021
doi: http://dx.doi.org/10.25248/reas.e72...
) and the second one focused on the construction and validation of a bank of items(66. Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Questionário de avaliação da vulnerabilidade em saúde da pessoa com insuficiência cardíaca: construção e validação. Rev Eletr Enferm. 2021;23:67807. doi: http://dx.doi.org/10.5216/ree.v23.67807
http://dx.doi.org/10.5216/ree.v23.67807...
). As a result, 49 theoretical elements guided the elaboration of 110 items, divided into three dimensions and validated by 19 health professionals specialized in HF, with content validity index (CVI) per item ≥0.78, without significant disagreement between experts (p > 0.05) as to the score, attested by the binomial exact test, and total CVI 0.99(66. Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Questionário de avaliação da vulnerabilidade em saúde da pessoa com insuficiência cardíaca: construção e validação. Rev Eletr Enferm. 2021;23:67807. doi: http://dx.doi.org/10.5216/ree.v23.67807
http://dx.doi.org/10.5216/ree.v23.67807...
).

In the items bank developed, the Human Person dimension comprised 66 items related to the subject, organized in the subdimensions: socioeconomic, demographic and clinical profile; learning; mental health and health behaviors(66. Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Questionário de avaliação da vulnerabilidade em saúde da pessoa com insuficiência cardíaca: construção e validação. Rev Eletr Enferm. 2021;23:67807. doi: http://dx.doi.org/10.5216/ree.v23.67807
http://dx.doi.org/10.5216/ree.v23.67807...
). In this research, the evidence of validity of the internal structure of the human person dimension of the questionnaire was analyzed. Nevertheless, even though the evidence of validity related to the content by experts has been satisfactory, it is also necessary to observe the evidence of validity of the internal structure of the instrument, in order to assess the agreement between items and construct(77. American Educational Research Association. Standards for Educational and Psychological Testing. New York: American Educational Research Association; 2014.), and thus obtain a valid and reproducible parameter.

To search for evidence of validity of an instrument that allows measuring aspects related to the dimension of the Human Person of the subject with HF is an opportunity to conceive its plurality and plan the integral and continuous care, in addition to driving policies to improve care, in a much more effective direct contribution to health. Thus, this study aimed to analyze the evidence of validity of the internal structure of the dimension Human Person of the Questionnaire of Health Vulnerability in Heart Failure (QVSIC-Human Person).

METHODS

Study Design

Psychometric study, focused on the analysis of evidence of internal structure(77. American Educational Research Association. Standards for Educational and Psychological Testing. New York: American Educational Research Association; 2014.) of the QVSIC-Human Person.

Setting

The study was developed with patients followed-up in a tertiary healthcare institution of reference in the care of people with cardiopulmonary diseases, located in the city of Fortaleza, Ceará, Brazil.

Sample Definition

The target population of the study consisted of 1,008 people with a medical diagnosis of HF, selected by convenience. HF patients aged ≥ 18 years, followed or admitted to the wards, outpatient clinics, cardiac rehabilitation and emergency of the institution were included, and those who did not communicate verbally were excluded.

In the planning of this research, the instrument was fully applied, considering the 110 items. However, for the present study, validity evidence was analyzed only for the human dimension of the instrument, which contains 66 items.

Considering the extension of the general item bank and with the intention of preserving heterogeneity and getting respondents that covered the whole construct, 1,100 people were invited. However, 92 participants were lost due to incomplete responses to the items. The 1,008 participants guaranteed an average of 9.2 observations for each item of the general instrument; when related to the 66 items of the Human Person dimension, the average of participants was 15.3 per item. The sample size of psychometric studies is estimated based on the number of items, which show ratios of 10:1 or more(88. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.). Therefore, the number of participants was adequate based on literature recommendations.

Data Collection

Data were collected in the period from June 2019 to January 2020, through individual interviews conducted at the healthcare facility. Patients were approached in the transplant and HF unit (UTIC in the Portuguese acronym) and inpatient and cardiac rehabilitation and emergency sectors of the institution. Patients were picked up and the objectives and relevance of the research were explained. Those who agreed to participate in the study signed the Informed Consent Form, provided in two copies. The patients were then referred to a reserved room for privacy assurance.

The research coordinator and a previously trained nursing student, scientific initiation scholarship holder, participated in the collection. Two instruments were used: a questionnaire of sociodemographic data (gender, age, region of residence, color, education, family income, number of people in the same household, whether they have a paid activity and whether they receive benefits related to the disease), clinical (HF etiology, functional class and number of hospitalizations in the last year) and behavioral (smoking, alcohol consumption and whether they engage in physical activity); and a bank consisting of 66 items relating to the peculiarities of the person with HF in a vulnerable situation. Among the 66 items, 14 have a dichotomous response pattern (yes/no) and 52 are polytomous, using a Likert-type scale of five points ranging from 1 to 5 (from never to always).

Data Analysis and Treatment

Data were organized in Microsoft Office Excel® spreadsheets and exported to the statistical programs Factor (version 11.05.01) and R (version 3.6.2). To characterize the sociodemographic, clinical, and behavioral data of the research participants, measures of central tendency and dispersion of quantitative variables and simple frequency and percentage of qualitative variables were calculated. Normality was assessed using the Kolmogorov-Smirnov test.

Exploratory Factor Analysis (EFA) was used to validate the internal structure of the QVSIC-Human Person. The suitability of the data for factor analysis was examined using the Kaiser-Meyer-Olkin value (KMO > 0.60) and Bartlett’s test of sphericity. High KMO values indicate the adequacy of the EFA. If the calculated error probability (p-value) of the sphericity test is below 0.05, it is concluded that the correlation or covariance matrix is not a unitary matrix, so factor analysis can be applied(99. Yucel SC, Ergin E, Orgun F, Gokçen M, Eser I. Estudo de validade e confiabilidade do Moral Distress Questionnaire no idioma turco para enfermeiros. Rev Latino-Am Enfermagem. 2020;28:e3319. doi: http://dx.doi.org/10.1590/1518-8345.2960.3319
http://dx.doi.org/10.1590/1518-8345.2960...
).

The dimensionality of the instrument was tested by applying Parallel Analysis using the Parallel Analysis Optimal Implementation technique(1010. Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods. 2011;16(2):209-20. doi: http://dx.doi.org/10.1037/a0023353. PubMed PMID: 21500916.
http://dx.doi.org/10.1037/a0023353...
). The robustness of the test was determined from the bootstrap association, with extrapolation of the sample to 1000 cases. This data resampling procedure is performed in order to obtain confidence intervals of the evaluated parameters(1111. Zientek LR, Thompson B. Applying the bootstrap to the multivariate case: bootstrap component/factor analysis. Behav Res Methods. 2007;39(2):318-25. doi: http://dx.doi.org/10.3758/BF03193163. PubMed PMID: 17695360.
http://dx.doi.org/10.3758/BF03193163...
).

The factors were extracted by the Robust Unweighted Least Squares (ULS) method with polychoric correlation, suitable for polytomous data, and matrix residual reduction(1212. Auerswald M, Moshagen M. How to determine the number of factors to retain in exploratory factor analysis: a comparison of extraction methods under realistic conditions. Psychol Methods. 2019;24(4):468-91. doi: http://dx.doi.org/10.1037/met0000200. PubMed PMID: 30667242.
http://dx.doi.org/10.1037/met0000200...
), and Robust Promin rotation(1313. Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Liberabit. 2019;25(1):99-106. doi: http://dx.doi.org/10.24265/liberabit.2019.v25n1.08
http://dx.doi.org/10.24265/liberabit.201...
). To complement the testing of the number of factors of the total instrument, unidimensionality/multidimensionality techniques were applied: Unidimensional Congruence (UniCo > 0.95), Explained Common Variance (ECV > 0.85) and Mean of Item Residual Absolute Loadings (MIREAL < 0.30)(1414. Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas. 2018;78(5):762-80. doi: http://dx.doi.org/10.1177/0013164417719308. PubMed PMID: 32655169.
http://dx.doi.org/10.1177/00131644177193...
).

The division of the bank to ensure representativeness was performed by the Solomon method, which optimally divides the sample into two equivalent halves to ensure that all possible sources of variation are included in the two subsamples, as attested by the Ratio Communality Index (RCI): the closer to 1.0, the more equivalent are the subsamples and, consequently, the more representative(1515. Lorenzo-Seva U. SOLOMON: a method for splitting a sample into equivalent subsamples in factor analysis. Behav Res Methods. 2021. No prelo. doi: http://dx.doi.org/10.3758/s13428-021-01750-y. PubMed PMID: 34918226.
http://dx.doi.org/10.3758/s13428-021-017...
).

Maintenance or removal of items from the model was done considering: Polycoric Matrix convergence; percentage of covariance destroyed for each item (PCDi); correlation above 0.2 with two other items (those below were eliminated); kurtosis and asymmetry; communalities (h2 > 0.40) and factor load values – those >0.30 were maintained and heywood cases (negative variance estimates or factor load estimates equal to or above 1.00) and with double saturation were excluded. Communality is an important metric for indicating how much each variable is explained by all the factors. Factorial loadings, on the other hand, indicate how much each factor explains each variable(88. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.). It is reiterated that the estimated factorial solutions were evaluated based on the theoretical reasonableness and interpretation of the factors according to the theoretical assumptions of the HV in the context of HF.

Regarding the quality and effectiveness of factor score estimates, accuracy (Overall Reliability of fully Informative prior Oblique N-EAP scores – ORION > 0.70), representativeness of the latent trait and effectiveness of factor estimation (Factor Determinacy Index – FDI > 0.80(1616. Ferrando PJ, Lorenzo-Seva U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicologica. 2016 [cited 2022 Mar 20];37:235-47. Available from: https://www.uv.es/revispsi/articulos2.16/7Ferrando.pdf
https://www.uv.es/revispsi/articulos2.16...
), sensitivity (Sensitivity Ratio – SR > 2.0), expected percentage of the factor (Expected Percentage of true Differences – EPTD > 90%) and replicability (Generalized G-H Index > 0.80)(1414. Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas. 2018;78(5):762-80. doi: http://dx.doi.org/10.1177/0013164417719308. PubMed PMID: 32655169.
http://dx.doi.org/10.1177/00131644177193...
) were assessed.

To test the adjustment of the data to the five-factor structure, confirmatory factor analysis (CFA) was performed. The following indices were used to evaluate the quality of adjustment of the model and their respective 95% confidence intervals: Tucker Lewis Index (TLI > 0.90); Comparative Fit Index (CFI > 0.94); Goodness of Fit Index (GFI > 0.95); Adjusted Goodness of Fit Index (AGFI > 0.93); Root Mean Square Error of Approximation (RMSEA < 0.07); and Root Mean Square of Residuals (RMSR < 0.08)(1717. Goretzko D, Pham TTH, Bühner M. Exploratory factor analysis: current use, methodological developments and recommendations for good practice. Curr Psychol. 2019;40:3510-21. doi: http://dx.doi.org/10.1007/s12144-019-00300-2
http://dx.doi.org/10.1007/s12144-019-003...
).

Factor reliability was checked by McDonald’s Omega coefficient (ω), to verify the maintenance of the Tau equivalence principle; and composite reliability (CR), calculated by the Composite Reliability Calculator, based on standardized factor loadings and error variances (www.thestatisticalmind.com), whose reference values adopted for these measures were <0.6 low; between 0.6 and 0.7, moderate; and between 0.7 and 0.9 high reliability(88. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.,1818. Kuan G, Kueh YC, Abdullah N, Tai ELM. Psychometric properties of the health-promoting lifestyle profile II: cross-cultural validation of the Malay language version. BMC Public Health. 2019;19(1):751. doi: http://dx.doi.org/10.1186/s12889-019-7109-2. PubMed PMID: 31196195.
http://dx.doi.org/10.1186/s12889-019-710...
1919. Barrientos-Trigo S, Gil-García E, Romero-Sánchez JM, Badanta-Romero B, Porcel-Gálvez AM. Evaluation of psychometric properties of instruments measuring nursing-sensitive outcomes: a systematic review. Int Nurs Rev. 2019;66(2):209-20. doi: http://dx.doi.org/10.1111/inr.12495. PubMed PMID: 30378685.
http://dx.doi.org/10.1111/inr.12495...
). We chose to include the WC to increase the reliability of interpretation, because numerous inconsistencies of reliability using Cronbach’s alpha have been reported(2020. McNeish D. Thanks coefficient alpha, we’ll take it from here. Psychol Methods. 2018;23(3):412-33. doi: http://dx.doi.org/10.1037/met0000144. PubMed PMID: 28557467.
http://dx.doi.org/10.1037/met0000144...
).

Ethical Aspects

The study received clearance from the Research Ethics Committee in the year 2019, with opinion no. 3,563,547, in line with what is recommended by Resolution 466/2012, of the National Health Council, and from those responsible for the institution. All participants signed the Informed Consent Form (ICF).

RESULTS

The items were answered by 1. 008 people with HF, mostly males (634; 62.9%), mixed race (862; 85.5%), with a minimum age of 19 and maximum of 93 years (56 ± 13.9 years), from the Northeast region (993; 98.5%), with varied level of education – predominance of subjects with incomplete elementary school (309; 30.7%), and from social class D (R$ 1,874.01 to 3,748.00) (615; 61%). Most lived with one person (602; 59.7%); 820 (81.3%) still had a paid job, 730 (72.4%) were retired, and 710 (70.4%) received government benefits because of the disease.

Initially, eight items were excluded because they had zero variance. In model 1, the results of the analysis of the 58 items revealed a negative matrix, with a bad percentage of destruction of each item (45.4%) and unacceptable KMO, which made further analysis impossible. In model 2, after exclusion of the 14 dichotomous items, we obtained a positive matrix, mediocre KMO (<0.60), and unsatisfactory quality of fit. The results supported the removal of 22 items for presenting inadequate communalities, factor weights below what is considered adequate and double saturation. With the elimination of these items, we proceeded with a new analysis (model 3), with 22 items and adequate adjustment of the data, being considered the best and most parsimonious model tested.

Model 3 presented good sample adequacy, attested by Bartlett’s tests of sphericity (11499.5; gl = 231 and p < 0.001), KMO (0.65 [95%CI = 0.54–0.85]) and RCI (0.98), which suggested interpretability of the correlation matrix of the items and representativeness of the subsamples. Parallel analysis indicated five representative factors of the items, with their respective explained variances: factor 1 – 19.1%, factor 2 – 14.4%, factor 3 – 12.6%, factor 4 – 10.9%, and factor 5 – 7.9%. The multidimensionality of the instrument was confirmed by the UniCo (0.57 [95%CI = 0.44–0.74]), ECV (0.57 [95%CI = 0.55–0.60]) and MIREAL (0.27 [95%CI = 0.19–0.31]) indices.

Table 1 details the factors and descriptive results of the QVSIC-Human Person. The first factor (06 items – 30, 31, 32, 33, 35, and 36), encompassed aspects related to fluid control and diet, qualified as fluid and food intake. The second factor (04 items – 22, 23, 25, and 26) involved items related to sleep difficulty and its consequences and daily activities, designated as Sleep and daily activities. The third (03 items – 56, 57, and 58) was composed of items regarding psychoemotional issues, termed Mental health. The fourth (05 items – 05, 08, 11, 12, and 13), with items related to education and knowledge about the disease and treatment, named Functional health literacy. And finally, the fifth factor (04 items – 14, 15, 16, and 17) comprised items related to difficulty breathing, concentration, memory problems, and fatigue, named Signs and symptoms (Table 2).

Table 1.
Factorial loads, communalities, shortness and reliability of the final model with five factors – Fortaleza, CE, Brazil, 2021.
Table 2.
Model fit indices.

It was considered that the values of the communalities of the items represented the variability explained by the factors and the kurtosis did not indicate severe deviations from the normal distribution of responses and, consequently, psychometric sensitivity. Also, the factors presented adequate values of reliability, and a reliability of 0.92, which ratified their internal consistency. The model presented ω = 0.83.

Table 2 shows the fit indices of the tested models and reveals the quality of model 3 over the others, expressed by the values found in the exploratory and confirmatory factor analyses.

Table 3 specifies the quality and effectiveness of the factor score estimates of the QVSIC-Human Person. The questionnaire proved adequate with regard to accuracy (0.79 ≤ ORION ≤ 0.98), representativeness (0.89 ≤ FDI ≤ 0.99), sensitivity (1.92 ≤ SR ≤ 7.07), factor expectancy (88.3% ≤ EPTD ≤ 97.9%), and replicability (0.82 ≤ H-latent ≤ 0.97; 0.81 ≤ H-observed ≤ 0.87). It should be remarked that although the factors Education and functional health literacy and Water and food intake present SR and EPTD below the reference value, the model shows several indicators that attest to its quality.

Table 3.
Quality and effectiveness of factor score estimates – Fortaleza, CE, Brazil, 2021.

In view of the results obtained, Chart 1 shows the dimensions and corresponding items of the QVSIC-Human Being.

The evaluated indicators pointed to a five-dimensional model with evidence of consistent internal structure for measuring the construct human vulnerability in the context of HF.

Chart 1.
Questionnaire of Health Vulnerability in Heart Failure, human dimension – Fortaleza, CE, Brazil, 2021.

DISCUSSION

Validity based on internal structure represents the degree to which the structure of correlations among items corresponds to the structure of the construct that the test proposes to measure. Therefore, assessing evidence of the internal structure of measurement instruments is a complex procedure, which requires a series of requirements, such as the factorial structure of the instrument and reliability, which are crucial for it to be effective(77. American Educational Research Association. Standards for Educational and Psychological Testing. New York: American Educational Research Association; 2014.,2121. Costa TF, Pimenta CJL, Silva CRR, Bezerra TA, Viana LRC, Ferreira GRS, et al. Cross-cultural adaptation of the Bakas Caregiving Outcome Scale to Brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE01861. doi: http://dx.doi.org/10.37689/actaape/2021AO01861
http://dx.doi.org/10.37689/actaape/2021A...
).

In this study, the sample proved to be adequate and representative for further factor analysis, as evidenced by Bartlett’s tests of sphericity, KMO, and RCI. The EFA is performed to explore the underlying dimensionality of a set of variables(88. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.,1212. Auerswald M, Moshagen M. How to determine the number of factors to retain in exploratory factor analysis: a comparison of extraction methods under realistic conditions. Psychol Methods. 2019;24(4):468-91. doi: http://dx.doi.org/10.1037/met0000200. PubMed PMID: 30667242.
http://dx.doi.org/10.1037/met0000200...
) and can be performed in several statistical softwares. However, Factor stands out by enabling the use of parallel analysis and other dimensionality indicators. The advantage of parallel analysis lies in the fact that the technique is based on samples and not on the population; it allows the random construction of a hypothetical set of correlation matrices of variables, using the same dimensionality of the real data set as a basis, and consequently it decreases the probability of erroneous retention of items, as it considers sampling error and minimizes the influence of sample size and factorial loads of the items(2222. Nogueira GS, Seidl EMF, Tróccoli BT. Análise fatorial exploratória do Questionário de Percepção de Doenças Versão Breve (Brief IPQ). Psicol Teor Pract. 2016;32(1):161-8. doi: http://dx.doi.org/10.1590/0102-37722016011871161168
http://dx.doi.org/10.1590/0102-377220160...
).

To obtain a valid model, it was necessary to review the instrument regarding the irregularity of the items (dichotomous and polytomous). Problems with factor analysis of dichotomous variables have already been recognized in the literature. Although dichotomous items can be submitted to factor analysis using standard techniques, the results may be biased, such as overestimated values of explained variance and instrument quality(2323. Antino M, Alvarado JM, Asún RA, Bliese P. Rethinking the exploration of dichotomous data: Mokken Scale Analysis versus Factorial Analysis. Sociol Methods Res. 2020;49(4):839-67. doi: http://dx.doi.org/10.1177/0049124118769090
http://dx.doi.org/10.1177/00491241187690...
). In this sense, alternative approaches have been suggested for factor analysis of dichotomous data.

Factor analysis showed that the HV construct in the human person with HF is organized into the factors Education and functional health literacy, Signs and symptoms, Sleep and daily activities, Water and food intake and Mental health. The five factors evidenced by the factor analysis correlation matrix were congruent with the concept of HV in the person with HF and its constituent elements(66. Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Questionário de avaliação da vulnerabilidade em saúde da pessoa com insuficiência cardíaca: construção e validação. Rev Eletr Enferm. 2021;23:67807. doi: http://dx.doi.org/10.5216/ree.v23.67807
http://dx.doi.org/10.5216/ree.v23.67807...
): in the dimension of the Human Person, the HV is multifactorial and incorporates social, educational, physiological, clinical, psychological and behavioral attributes. These findings demonstrate the importance of breaking with the merely technical care, focused only on the pathological process, and to adopt preventive and health-promoting measures that allow the understanding of the multiple facets of the subject in his vulnerable condition.

The link between the theoretical and empirical structure of the instrument is confirmed by reference authors(2424. Florêncio RS, Moreira TM. Modelo de vulnerabilidade em saúde: esclarecimento conceitual na perspectiva do sujeito-social. Acta Paul Enferm. 2021;34:eAPE00353. doi: http://dx.doi.org/10.37689/acta-ape/2021AO00353
http://dx.doi.org/10.37689/acta-ape/2021...
) who highlight the subject as one of the central nuclei in the interpretation of the HV, for understanding that this is a product of power relations, and can obtain means for awareness and resist the HV through agencying. This way, there is the possibility of movement towards a better condition of health and life, that is, less vulnerability.

The multidimensionality of the model demonstrates the various peculiarities of the HV of the person with HF, so a deep analysis of the factors is necessary. It is essential for professionals to have means to help identify and assess situations of vulnerability and thus contribute to the direction and planning of care. Therefore, the instrument developed stands out for allowing the professional to obtain from the subjects their perceptions about their health conditions by containing items that address the understanding of the disease and how it impacts their quality of life.

The indicators that were anchored in the first factor are related to eating habits and water intake, with items related to the control of fluid intake, correct diet, decreased consumption of salt and sugar, and difficulties in maintaining a healthy diet. Sodium restriction, supplementation of dietary fats, fatty acids, proteins, amino acids and vitamin and mineral micronutrients, as well as strategies such as nitrates in beet juice have shown promising results in the outcomes of HF, being therefore pointed out as sustainable therapies(2525. Billingsley HE, Hummel SL, Carbone S. The role of diet and nutrition in heart failure: a state-of-the-art narrative review. Prog Cardiovasc Dis. 2020;63(5):538-51. doi: http://dx.doi.org/10.1016/j.pcad.2020.08.004. PubMed PMID: 32798501.
http://dx.doi.org/10.1016/j.pcad.2020.08...
). In this sense, the items enabled the developing of eating habits that can influence a higher or lower level of vulnerability.

The second factor supported items on sleep and daily activities, including sexual intercourse. Common HF symptoms such as dyspnea, fatigue, low exercise tolerance and fluid retention strongly affect sleep quality, contributing to chronic insomnia(2626. Rebora P, Spedale V, Occhino G, Luciani M, Alvaro R, Vellone E, et al. Effectiveness of motivational interviewing on anxiety, depression, sleep quality and quality of life in heart failure patients: secondary analysis of the MOTIVATE-HF randomized controlled trial. Qual Life Res. 2021;30(7):1939-49. doi: http://dx.doi.org/10.1007/s11136-021-02788-3. PubMed PMID: 33616815.
http://dx.doi.org/10.1007/s11136-021-027...
). However, an experimental study revealed that sexual interactions improve diastolic function, reduce HF-associated edema, alter the transcription of heart contractile protein genes, and decrease plasma levels of testosterone, which leads to prolonged survival(2727. Tripathi R, Sullivan RD, Fan TM, Mehta RM, Gladysheva IP, Reed GL. In experimental dilated cardiomyopathy heart failure and survival are adversely affected by a lack of sexual interactions. Int J Mol Sci. 2020;21(15):5450. doi: http://dx.doi.org/10.3390/ijms21155450. PubMed PMID: 32751757.
http://dx.doi.org/10.3390/ijms21155450...
).

The third factor brought items related to mental health, which identifies the subjects’ perception about their feelings and signs of anxiety or depression, frequent conditions that exacerbate vulnerability by interfering in the physical and psychological state, associated with poor quality of life(2828. Alemoush RA, Al-Dweik G, AbuRuz ME. The effect of persistent anxiety and depressive symptoms on quality of life among patients with heart failure. Appl Nurs Res. 2021;62:151503. doi: http://dx.doi.org/10.1016/j.apnr.2021.151503. PubMed PMID: 34814999.
http://dx.doi.org/10.1016/j.apnr.2021.15...
). The fourth factor covered items on education, subject’s understanding of the disease, and knowledge of the therapeutics. Knowledge and active participation of the patient in his treatment is essential to optimize self- management(2929. Morley CM, Levin SA. Health literacy, health confidence, and simulation: a novel approach to patient education to reduce readmissions. Prof Case Manag. 2021;26(1):138-49. doi: http://dx.doi.org/10.1097/NCM.0000000000000456. PubMed PMID: 33784721.
http://dx.doi.org/10.1097/NCM.0000000000...
) and, consequently, lower levels of vulnerability.

The fifth and last factor involves items on the presentation of signs and symptoms of HF, such as decreased concentration, memory problems and physical signs, the main ones being fatigue and dyspnea. The gradual or sudden worsening of the disease symptoms causes frequent decompensations that lead to progressive deterioration of cardiac function(3030. Huang T, Moser DK, Hwang S. Identification, associated factors, and prognosis of symptom clusters in Taiwanese patients with heart failure. J Nurs Res. 2018;26(1):60-7. doi: http://dx.doi.org/10.1097/JNR.0000000000000199. PubMed PMID: 28221187.
http://dx.doi.org/10.1097/JNR.0000000000...
), impacting negatively on the subject’s life contexts.

All factors presented items with satisfactory factor loadings (there was no violation of the limits) and saturating in a single factor as well as kurtosis considered statistically acceptable. Factor loadings indicate how much a factor explains a variable, while communality is the proportion of each variable’s variability that is explained by the values: the closer to 1, the better the variable is explained by the factors. Kurtosis is a shape measure that characterizes the flattening of the probability distribution function curve(88. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.).

Communality was also used as an item permanence criterion. Defined as the proportion of common variance present in a given variable, the communality, analyzed together with the factorial load, helps to identify problematic items(88. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.). Although some items presented communality below the cutoff point, factor loadings were adequate and the other tests performed attested to the quality of the model, which supports keeping these items in the instrument.

The factors showed strong internal consistency, according to the CR value. The use of CR instead of Cronbach’s alpha is justified by evidence in the literature that demonstrates its weakness as an indicator of reliability of scores from multidimensional models, due to tau-equivalence:€α considers that all items have equivalent loadings; and suggest new tests, such as CR, a technique that takes into account the factorial load of the items, thus allowing better assessment of the quality of the structural model of psychometric instruments(2020. McNeish D. Thanks coefficient alpha, we’ll take it from here. Psychol Methods. 2018;23(3):412-33. doi: http://dx.doi.org/10.1037/met0000144. PubMed PMID: 28557467.
http://dx.doi.org/10.1037/met0000144...
).

Different statistical criteria ensured the adequacy of the internal structure estimates, considering their potentials and weaknesses. By using various criteria and indicators, associated with theoretical interpretation, it was possible to eliminate risks and biases and find an adequate factorial solution that was consistent with the original proposal of the instrument. In this sense, we chose to use current and robust techniques, which would only be possible in confirmatory factor analysis: precision, representativeness, sensitivity, replicability, expected factor percentage and model adequacy indexes.

However, some limitations were found, such as the homogeneity of the sociodemographic, economic, and clinical profile of the subjects, who were treated at the same healthcare institution. Although the institution is a reference and treats patients from the North and Northeast regions, the profile was similar among the participants. Such limitation contributed to the exclusion of relevant items for the context of HV, being important to conduct future research involving people with HF of different profiles. Moreover, we should mention the lack of similar instruments in the scientific literature, not allowing for comparisons.

The statistical tests improved the interpretation and reliability of the model and showed that the QVSIC-Human Person showed psychometric parameters of quality and theoretical consistency. The use of the instrument will allow new interpretative horizons on the HV of the person with HF and its results may support care actions by nurses and more effective strategies to reduce the levels of vulnerability.

Additionally, this research brings robust techniques, with methodological rigor and, above all, based on contemporary psychometric recommendations.

CONCLUSIONS

The QVSIC-Human person, composed of 22 items distributed in 5 dimensions (Water and food intake, Sleep and daily activities, Mental health, Functional health literacy, and Signs and symptoms) showed satisfactory psychometric properties, evidencing a model with good validity and reliability evidences.

REFERENCES

  • 1
    Groenewegen A, Rutten FH, Mosterd A, Hoes AW. Epidemiology of heart failure. Eur J Heart Fail. 2020;22(8):1342-56. doi: http://dx.doi.org/10.1002/ejhf.1858 PubMed PMID: 32483830.
    » http://dx.doi.org/10.1002/ejhf.1858
  • 2
    Uchmanowicz B, Szymańska-Chabowska A, Jankowska-Polańska B. Assessment of adherence to medication for cardiovascular diseases: measurement tools. Cardiovasc J S Afr. 2019;30(2):113-9. doi: http://dx.doi.org/10.5830/CVJA-2018-050 PubMed PMID: 30720844.
    » http://dx.doi.org/10.5830/CVJA-2018-050
  • 3
    Cestari VRF, Moreira TMM, Pessoa VLMP, Florêncio RS, Silva MRF, Torres RAM. A essência do cuidado na vulnerabilidade em saúde: uma construção heideggeriana. Rev Bras Enferm. 2017;70(5):1171-6. doi: http://dx.doi.org/10.1590/0034-7167-2016-0570 PubMed PMID: 28977242.
    » http://dx.doi.org/10.1590/0034-7167-2016-0570
  • 4
    Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Vulnerabilidad en salud, educación y libertad: reflexión a la luz de Hannah Arendt. Esc Anna Nery. 2022;26:e20210207. doi: http://dx.doi.org/10.1590/2177-9465-ean-2021-0207
    » doi: http://dx.doi.org/10.1590/2177-9465-ean-2021-0207
  • 5
    Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Validação dos marcadores da vulnerabilidade em saúde da pessoa com insuficiência cardíaca. Rev Eletr Acervo Saúde. 2021;13(5):e7282. doi: http://dx.doi.org/10.25248/reas.e7282.2021
    » doi: http://dx.doi.org/10.25248/reas.e7282.2021
  • 6
    Cestari VRF, Florêncio RS, Pessoa VLMP, Moreira TMM. Questionário de avaliação da vulnerabilidade em saúde da pessoa com insuficiência cardíaca: construção e validação. Rev Eletr Enferm. 2021;23:67807. doi: http://dx.doi.org/10.5216/ree.v23.67807
    » http://dx.doi.org/10.5216/ree.v23.67807
  • 7
    American Educational Research Association. Standards for Educational and Psychological Testing. New York: American Educational Research Association; 2014.
  • 8
    Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2013.
  • 9
    Yucel SC, Ergin E, Orgun F, Gokçen M, Eser I. Estudo de validade e confiabilidade do Moral Distress Questionnaire no idioma turco para enfermeiros. Rev Latino-Am Enfermagem. 2020;28:e3319. doi: http://dx.doi.org/10.1590/1518-8345.2960.3319
    » http://dx.doi.org/10.1590/1518-8345.2960.3319
  • 10
    Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods. 2011;16(2):209-20. doi: http://dx.doi.org/10.1037/a0023353 PubMed PMID: 21500916.
    » http://dx.doi.org/10.1037/a0023353
  • 11
    Zientek LR, Thompson B. Applying the bootstrap to the multivariate case: bootstrap component/factor analysis. Behav Res Methods. 2007;39(2):318-25. doi: http://dx.doi.org/10.3758/BF03193163 PubMed PMID: 17695360.
    » http://dx.doi.org/10.3758/BF03193163
  • 12
    Auerswald M, Moshagen M. How to determine the number of factors to retain in exploratory factor analysis: a comparison of extraction methods under realistic conditions. Psychol Methods. 2019;24(4):468-91. doi: http://dx.doi.org/10.1037/met0000200 PubMed PMID: 30667242.
    » http://dx.doi.org/10.1037/met0000200
  • 13
    Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Liberabit. 2019;25(1):99-106. doi: http://dx.doi.org/10.24265/liberabit.2019.v25n1.08
    » http://dx.doi.org/10.24265/liberabit.2019.v25n1.08
  • 14
    Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas. 2018;78(5):762-80. doi: http://dx.doi.org/10.1177/0013164417719308 PubMed PMID: 32655169.
    » http://dx.doi.org/10.1177/0013164417719308
  • 15
    Lorenzo-Seva U. SOLOMON: a method for splitting a sample into equivalent subsamples in factor analysis. Behav Res Methods. 2021. No prelo. doi: http://dx.doi.org/10.3758/s13428-021-01750-y PubMed PMID: 34918226.
    » http://dx.doi.org/10.3758/s13428-021-01750-y
  • 16
    Ferrando PJ, Lorenzo-Seva U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicologica. 2016 [cited 2022 Mar 20];37:235-47. Available from: https://www.uv.es/revispsi/articulos2.16/7Ferrando.pdf
    » https://www.uv.es/revispsi/articulos2.16/7Ferrando.pdf
  • 17
    Goretzko D, Pham TTH, Bühner M. Exploratory factor analysis: current use, methodological developments and recommendations for good practice. Curr Psychol. 2019;40:3510-21. doi: http://dx.doi.org/10.1007/s12144-019-00300-2
    » http://dx.doi.org/10.1007/s12144-019-00300-2
  • 18
    Kuan G, Kueh YC, Abdullah N, Tai ELM. Psychometric properties of the health-promoting lifestyle profile II: cross-cultural validation of the Malay language version. BMC Public Health. 2019;19(1):751. doi: http://dx.doi.org/10.1186/s12889-019-7109-2 PubMed PMID: 31196195.
    » http://dx.doi.org/10.1186/s12889-019-7109-2
  • 19
    Barrientos-Trigo S, Gil-García E, Romero-Sánchez JM, Badanta-Romero B, Porcel-Gálvez AM. Evaluation of psychometric properties of instruments measuring nursing-sensitive outcomes: a systematic review. Int Nurs Rev. 2019;66(2):209-20. doi: http://dx.doi.org/10.1111/inr.12495 PubMed PMID: 30378685.
    » http://dx.doi.org/10.1111/inr.12495
  • 20
    McNeish D. Thanks coefficient alpha, we’ll take it from here. Psychol Methods. 2018;23(3):412-33. doi: http://dx.doi.org/10.1037/met0000144 PubMed PMID: 28557467.
    » http://dx.doi.org/10.1037/met0000144
  • 21
    Costa TF, Pimenta CJL, Silva CRR, Bezerra TA, Viana LRC, Ferreira GRS, et al. Cross-cultural adaptation of the Bakas Caregiving Outcome Scale to Brazilian portuguese. Acta Paul Enferm. 2021;34:eAPE01861. doi: http://dx.doi.org/10.37689/actaape/2021AO01861
    » http://dx.doi.org/10.37689/actaape/2021AO01861
  • 22
    Nogueira GS, Seidl EMF, Tróccoli BT. Análise fatorial exploratória do Questionário de Percepção de Doenças Versão Breve (Brief IPQ). Psicol Teor Pract. 2016;32(1):161-8. doi: http://dx.doi.org/10.1590/0102-37722016011871161168
    » http://dx.doi.org/10.1590/0102-37722016011871161168
  • 23
    Antino M, Alvarado JM, Asún RA, Bliese P. Rethinking the exploration of dichotomous data: Mokken Scale Analysis versus Factorial Analysis. Sociol Methods Res. 2020;49(4):839-67. doi: http://dx.doi.org/10.1177/0049124118769090
    » http://dx.doi.org/10.1177/0049124118769090
  • 24
    Florêncio RS, Moreira TM. Modelo de vulnerabilidade em saúde: esclarecimento conceitual na perspectiva do sujeito-social. Acta Paul Enferm. 2021;34:eAPE00353. doi: http://dx.doi.org/10.37689/acta-ape/2021AO00353
    » http://dx.doi.org/10.37689/acta-ape/2021AO00353
  • 25
    Billingsley HE, Hummel SL, Carbone S. The role of diet and nutrition in heart failure: a state-of-the-art narrative review. Prog Cardiovasc Dis. 2020;63(5):538-51. doi: http://dx.doi.org/10.1016/j.pcad.2020.08.004 PubMed PMID: 32798501.
    » http://dx.doi.org/10.1016/j.pcad.2020.08.004
  • 26
    Rebora P, Spedale V, Occhino G, Luciani M, Alvaro R, Vellone E, et al. Effectiveness of motivational interviewing on anxiety, depression, sleep quality and quality of life in heart failure patients: secondary analysis of the MOTIVATE-HF randomized controlled trial. Qual Life Res. 2021;30(7):1939-49. doi: http://dx.doi.org/10.1007/s11136-021-02788-3 PubMed PMID: 33616815.
    » http://dx.doi.org/10.1007/s11136-021-02788-3
  • 27
    Tripathi R, Sullivan RD, Fan TM, Mehta RM, Gladysheva IP, Reed GL. In experimental dilated cardiomyopathy heart failure and survival are adversely affected by a lack of sexual interactions. Int J Mol Sci. 2020;21(15):5450. doi: http://dx.doi.org/10.3390/ijms21155450 PubMed PMID: 32751757.
    » http://dx.doi.org/10.3390/ijms21155450
  • 28
    Alemoush RA, Al-Dweik G, AbuRuz ME. The effect of persistent anxiety and depressive symptoms on quality of life among patients with heart failure. Appl Nurs Res. 2021;62:151503. doi: http://dx.doi.org/10.1016/j.apnr.2021.151503 PubMed PMID: 34814999.
    » http://dx.doi.org/10.1016/j.apnr.2021.151503
  • 29
    Morley CM, Levin SA. Health literacy, health confidence, and simulation: a novel approach to patient education to reduce readmissions. Prof Case Manag. 2021;26(1):138-49. doi: http://dx.doi.org/10.1097/NCM.0000000000000456 PubMed PMID: 33784721.
    » http://dx.doi.org/10.1097/NCM.0000000000000456
  • 30
    Huang T, Moser DK, Hwang S. Identification, associated factors, and prognosis of symptom clusters in Taiwanese patients with heart failure. J Nurs Res. 2018;26(1):60-7. doi: http://dx.doi.org/10.1097/JNR.0000000000000199 PubMed PMID: 28221187.
    » http://dx.doi.org/10.1097/JNR.0000000000000199

Edited by

ASSOCIATE EDITOR

Renata Eloah de Lucena Ferretti-Rebustini

Publication Dates

  • Publication in this collection
    16 Dec 2022
  • Date of issue
    2022

History

  • Received
    20 Mar 2022
  • Accepted
    20 Oct 2022
Universidade de São Paulo, Escola de Enfermagem Av. Dr. Enéas de Carvalho Aguiar, 419 , 05403-000 São Paulo - SP/ Brasil, Tel./Fax: (55 11) 3061-7553, - São Paulo - SP - Brazil
E-mail: reeusp@usp.br