Acessibilidade / Reportar erro

Psychometric evaluation of the Brazilian-Portuguese version of the Functional Outcome of Sleep Questionnaire 10 (FOSQ-10) in patients with obstructive apnea

Abstract

Objective

Perform the validation and psychometric evaluation of the Brazilian-Portuguese translation of the Functional Outcome of Sleep Questionnaire 10 (FOSQ10).

Materials and methods

182 patients (65 females 48.3 ± 14.4 years and 117 males 46.9 ± 12.4 years), were evaluated by sleep physicians suspected of having Obstructive Sleep Apnea, underwent polysomnography and completed the FOSQ-10 and the Epworth Sleepiness Scale. APA & NCME, 2014 was used to validate the data as the American Educational Research Association recommended.

Results

Quality indicators such as Bartlett's test of sphericity (χ2 = 1108.2; gL = 45; p = 0.000010) and KMO (0.83), and adherence measures, attest to the quality of the model. The indicators TLI (0.97), CFI (0.98), and RMSEA (0.04) fall within the expected values. Using the Eigenvalue > 1 technique, two factors explain 53% and 13.3% of the variances. In the Parallel Analysis technique, a single factor explained 59.4653% of the random variance, and the Unidimensionality indicators UniCo = 0.921, ECV = 0.822, and MIREAL = 0.253, were supported. Construct Validity: reliability coefficients Cronbach’s α = 0.87, McDonald’s ordinal Omega index 0.9, and the Composite Reliability 0.891 were satisfactory.

Convergent validity

There was a significant Spearman correlation between FOSQ-10 and the Epworth Sleepiness Scale (r = 0.364 [−0.487; −0.226]).

Criterion validity

Was not possible to differentiate the groups based on the severity of AHI using FOSQ-10P.

Conclusions

The Brazilian translation of FOSQ-10 is valid and reliable for identifying significant effects of excessive daytime sleepiness in patients with Obstructive Sleep Apnea.

Level of evidence 2.

Keywords
Functional outcomes of sleep questionnaire; FOSQ-10; Quality of life; Reliability and validity; Obstructive sleep apnea

Highlights

  • The translation and cultural adaptation of the FOSQ-10 into Portuguese is valid and reliable.

  • The study methodology was grounded in the APA & NCME, 2014 guidelines proposed by the AERA.

  • The missing values are non-random, associated with individuals not performing tasks (questions 3, 4, and 10).

  • The total scores of FOSQ-10P exhibited a significant negative correlation with the total scores of the ESE.

Highlights

  • The translation and cultural adaptation of the FOSQ-10 into Portuguese is valid and reliable.

  • The study methodology was grounded in the APA & NCME, 2014 guidelines proposed by the AERA.

  • The missing values are non-random, associated with individuals not performing tasks (questions 3, 4, and 10).

  • The total scores of FOSQ-10P exhibited a significant negative correlation with the total scores of the ESE.

Introduction

Excessive Daytime Sleepiness (EDS) impairs daily functioning,11 Pagel JF. Excessive daytime sleepiness. Am Fam Physician. 2009;79:391-6. reducing the ability to perform basic tasks, affecting cognitive efficiency, increasing the risk of accidents in various contexts, and significantly impacting public health.22 Tufik S, Santos-Silva R, Taddei JA, Bittencourt LRA. Obstructive Sleep Apnea Syndrome in the Sao Paulo Epidemiologic Sleep Study. Sleep Med. 2010;11:441-6. Additionally, drowsiness decreases engagement in social interactions and physical activities.

Health-Related Quality of Life (HRQoL)33 Moyer CA, Sonnad SS, Garetz SL, Helman JI, Chervin RD. Quality of life in obstructive sleep apnea: A systematic review of the literature. Sleep Med. 2001;2:477-91. is a multidimensional concept that evaluates the long-term impact of diseases, disabilities, or disorders on an individual's life. It considers various sleep disturbances, such as excessive daytime sleepiness,44 Billings ME, Rosen CL, Auckley D, Benca R, Foldvary-Schaefer N, Iber C, et al. Psychometric performance and responsiveness of the functional outcomes of sleep questionnaire and sleep apnea quality of life index in a randomized trial: The Home PAP study. Sleep. 2014;37:2017-2 as assessed by tools like the Epworth Sleepiness Scale (ESS)55 Johns MW. A New Method for Measuring Daytime Sleepiness: The Epworth Sleepiness Scale. Sleep. 1991;14:540-5. ‒ translated and validated for Brazilian Portuguese66 Bertolazi AN, Fagondes SC, Hoff LS, Dallagasperina Pedro V, Barreto SSM, Johns MW. Portuguese-Language Version of the Epworth Sleepiness Scale: Validation for Use in Brazil. J Bras Pneumol. 2009;35:877-83. ‒ and Functional Outcome of Sleep Questionnaire (FOSQ-30).77 Weaver E, Laizner AM, Evans LK, Maislin G, Chugh DK, Lyon K, et al. An Instrument to Measure Functional Status Outcomes for Disorders of Excessive Sleepiness. Sleep. 1997;20:835-43. The FOSQ-10,88 Chasens ER, Ratcliffe SJ, Weaver TE. Development of the FOSQ-10: A Short Version of the Functional Outcomes of Sleep Questionnaire. Sleep. 2009;32:915-9. a shorter version, is widely used in large-scale studies and clinical practice, measuring the impact of sleep-related dysfunction on daily activities efficiently. This study focuses on establishing the psychometric properties of a Portuguese version of the FOSQ-10 in a clinical population of Brazilian-Portuguese-speakers patients diagnosed with Obstructive Sleep Apnea (OSA).

Methods

This research was conducted at the Sleep Division of the Department of Otorhinolaryngology, Faculty of Medical Sciences, State University of Campinas (Unicamp) in São Paulo, Brazil, from February 2022 to March 2023, with approval from the Institutional Research Ethics Committee (protocol CAAE: 35036620.4.0000.5404) and adhered to both International and National Guidelines. Professor Terri E. Weaver, Ph.D., RN, from the University of Illinois Chicago, 845 South Damen Avenue, MC 802, Chicago, IL 60612, granted permission to use and translate the scale. Contact e-mail: teweaver@uic.edu.

Translation and cross-cultural adaptation

It was a prospective study, where participants diagnosed with OSA through Polysomnography (PSG), recruited from the Sleep Division of the Department of Otorhinolaryngology, including 17 women (57%) and 13 men (43%), with a mean age of 65 ± 11 years, fulfilled the FOSQ-10.

The process adhered to the guidelines proposed by Guillemin.99 Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clio Epidemiol. 1993;46:1417-32. We made two modifications to the questionnaire based on the English version: the unit of distance was changed from miles to kilometers in Questions 3 and 4, and the phrase “nod off” was culturally adapted to “pescar” (meaning “to doze” in Portuguese). The structures were evaluated, achieving a satisfactory agreement percentage (≥80%).1010 Oliveira ERR. Elisabete Raca Romero de Oliveira - A. 2018. Accessed November 29, 2023. https://repositorio.unifesp.br/handle/11600/52423.
https://repositorio.unifesp.br/handle/11...

The second part was a prospective study evaluating the reliability and validity of the Functional Outcomes of Sleep Questionnaire - Portuguese ‒ Short Version (FOSQ-10P) among Brazilian patients with OSA.

Sample size calculation

  • Cronbach's consistency,1111 Sánchez R, Echeverry J. Validación de escalas de medición en salud. Revista de Salud Pública. 2004;6:302-18. suggests indices between 0.7 and 0.9 (70%-90%). Using alpha = 0.05, Power = 90%, k = 10, H0 = 0.5, and Ha = 0.7, a sample size of n ≥ 92 was recommended.

  • Correlation Coefficient (CO) according to G*Power 3.11,1212 Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41:1149-60. alpha = 0.05; Power = 95%; r0 = 0 (testing if r0 is significant); r1 = 0.3, suggesting a sample size of n = 112.

  • Multiple Linear Regression according to G*Power 3.111212 Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41:1149-60. with effect size f ≥ 0.15; alpha = 0.05; Power = 95%, suggesting a sample size of n = 129.

  • ANOVVA according to G*Power 3.11 with an effect size f ≥ 1; alpha = 0.05; Power = 95%, suggesting a sample size of n = 22 per group.

The larger sample size, exceeding n ≥ 182, was chosen to ensure it accommodates all the analyses.

Validation

The enrolled patients (n = 205) were referred from a Sleep Laboratory (n = 82), a sleep dentistry clinic (n = 72), and a CPAP distributor (n = 51) to the researchers. All participants suspected of OSA underwent Type I or Type II Polysomnography (PSG) based on ICSD-3/2018 Diagnostic Criteria.1313 American Academy of Sleep Medicine. ICSD-3-TR: International Classification of Sleep Disorders: Summary of Diagnostic Criteria Changes. 3rd ed. AASM; 2018. Accessed July 2, 2023. https://aasm.org/wp-content/uploads/2023/05/ICSD-3-Text-Revision-Supplemental-Material.pdf.
https://aasm.org/wp-content/uploads/2023...
The PSG recording included channels of electroencephalogram, electrooculogram, chin electromyography, airflow sensors, snore microphone, respiratory effort monitoring, pulse oximetry, electrocardiogram, surface electromyography, and body position sensor. Sleep stages and respiratory events (Apnea-Hypopnea Index ‒ AHI) were scored according to the American Academy of Sleep Medicine (AASM).1414 American Academy of Sleep Medicine. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications - Version 2.5. AASM; 2018. Accessed July 2, 2023. https://aasm.org/clinical-resources/scoring-manual/.
https://aasm.org/clinical-resources/scor...

Inclusion criteria

Patients over 18 years suspected of OSA1414 American Academy of Sleep Medicine. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications - Version 2.5. AASM; 2018. Accessed July 2, 2023. https://aasm.org/clinical-resources/scoring-manual/.
https://aasm.org/clinical-resources/scor...
and referred for polysomnography were invited to complete both scales, FOSQ-10P and ESS.

Exclusion criteria

Participants with severe comorbidities or cognitive impairment from any cause, incomplete questionnaires (n = 4), chronic sleep deprivation, night shift workers (n = 3), and Type III cardiorespiratory monitoring (n = 5), previous treatment with Continuous Positive Airway Pressure (CPAP) and Mandibular Advancement Appliances (MAA) (n = 2) were excluded.

Statistical analysis

We started imputing the Missing Values (MV) using the MICE package1515 Buuren S van, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45:1-67. for Multivariate Imputation (MI) and employing multinomial logistic regression, suitable for our ordinal categorical data with four categories.1616 Jia F, Wu W. Evaluating methods for handling missing ordinal data in structural equation modeling. Behav Res Methods. 2019;51:2337-55. We highlight that a response of “0” (zero value) ‒ MV ‒ in FOSQ-10P doesn't indicate greater functional impairment; instead, it means that the individual doesn’t endorse specific statements in Questions 3, 4, and 10. Therefore, caution is necessary when interpreting a response of 0.

We did an Exploratory Factor Analysis (EFA) using the Unrestricted Factor Analysis program,1717 Lorenzo-Seva U, Ferrando PJ. Factor Analysis. (Release 12.03.01 64bits) [Computer Software]. Terragona (Spain): Rovira i Virgili University; 2022 July [cited 2023 May 10]. Available from: psico.fcep.urv.cat/utilitats/factor. the Psych R package,1818 Revelle W. Package “psych” Title Procedures for Psychological, Psychometric, and Personality Research.; 2023. https://personality-project.org/r/psych/.
https://personality-project.org/r/psych/...
,1919 Peterson RA. A Meta-Analysis of Variance Accounted for and Factor Loadings in Exploratory Factor Analysis. Mark Lett. 2000;11:261-75. and The Jamovi project (Computer Software)2020 The Jamovi project. Jamovi. (Version 2.3) [Computer Software]; 2022 [cited 2023 July 31]. Retrieved from: https://www.jamovi.org.
https://www.jamovi.org...
for ANOVA, Linear Regression, and Spearman's Correlation.

The EFA aimed to assess the factorial structure of the FOSQ-10P, utilizing a polychoric matrix and the Robust Diagonally Weighted Least Squares (RDWLS).2121 Asparouhov T, Muthén B. Simple Second Order Chi-Square Correction. In: 2010. Accessed July 9, 2023. https://api.semanticscholar.org/CorpusID:3962271
https://api.semanticscholar.org/CorpusID...
extracting the number of factors to retain relied on Eigenvalue >1,2222 Cattell RB. The Scree Test For The Number Of Factors. Multivariate Behav Res. 1966;1:245-76. aligning with other validation studies in different languages. The Parallel Analysis (PA) technique2323 Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods. 2011;16:209-20. with randomly permuted observed data was employed, and the rotation used was Robust Promin.2424 Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Published online April 12, 2019. doi:10.24265/liberabit.2019.v25n1.08.
https://doi.org/10.24265/liberabit.2019....

Model fit was evaluated using the Root Mean Square Error of Approximation (RMSEA), Comparative Fit Index (CFI), and Tucker-Lewis Index (TLI) as fit indices. According to literature guidelines,2525 Brown TA. Confirmatory Factor Analysis for Applied Research. Vol 2nd edition; 2015. Accessed June 29, 2023. http://people.bu.edu/tabrown/.
http://people.bu.edu/tabrown/...
RMSEA values should be below 0.08, and CFI and TLI values should be above 0.90‒0.95.

For Factor stability, we used the H index (0-1).2626 Ferrando PJ, Lorenzo-Seva U. Assessing the Quality and Appropriateness of Factor Solutions and Factor Score Estimates in Exploratory Item Factor Analysis. Educ Psychol Meas. 2018;78:762-80. Values (>0.80) suggest a well-defined latent variable.

A Unidimensional Congruence (UniCo) exceeding 0.95, Explained Common Variance (ECV) surpassing 0.85, and a Mean of Item Residual Absolute Loadings (MIREAL) value below 0.300 indicates that the data can be considered essentially unidimensional.2626 Ferrando PJ, Lorenzo-Seva U. Assessing the Quality and Appropriateness of Factor Solutions and Factor Score Estimates in Exploratory Item Factor Analysis. Educ Psychol Meas. 2018;78:762-80.

Statistics

We employed the model advocated by the American Educational Research Association2727 American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. American Educational Research Association; 2014. Accessed July 30, 2023. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf.
https://www.testingstandards.net/uploads...
‒ “APA & NCME, 2014”, for all validation processes:

Internal Consistency (Reliability):

Content validity: EFA and Confirmatory Factor Analysis (CFA) of the FOSQ-10P, reporting quality indices ‒ Bartlett's test (H0 < 0.05) and Kaiser-Meyer-Olkin test (KMO ‒ H0 > 0.5); Adherence measures: Tucker & Lewis Fit Index (TLI > 0.9), Comparative Fit Index (CFI > 0.9), and Root Mean Square Error of Approximation (RMSEA ‒ H0 < 0.05);

Construct validity: Standardized Cronbach's Alpha (0.7‒0.9),2828 Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297-334. McDonald's Omega ordinal index (0.7‒0.9),2929 McDonald RP. Test Theory: A Unified Treatment. Vol 1. 2nd ed. Routlege Taylor & Francis Group; 2011. Accessed July 9, 2023. https://books.google.com.br/books?id=2-V5tOsa_DoC&pg=PR4&lpg=PR4&dq=ISBN++0-8058-3075-8&source=bl&ots=hXhA1z-ZG_&sig=ACfU3U3flp-J9YsYn4hNsPP7LGt7fnpHOw&hl=pt-BR&sa=X&ved=2ahUKEwi45-baiKGBAxVID7kGHc55AYEQ6AF6BAgNEAM#v=onepage&q=ISBN%20%200-8058-3075-8&f=false.
https://books.google.com.br/books?id=2-V...
and Composite Reliability (>0.7).3030 Valentini F, Damásio BF. Average Variance Extracted and Composite Reliability: Reliability Coefficients. Psicologia: Teoria e Pesquisa. 2016;32:1-7.

Validity based on relationships with external parameters:

Convergent validity: Spearman's correlation was computed to validate the FOSQ-10P against ESS scores ‒ <10, excessive daytime sleepiness ≥10 ESS scores (r ≥ 0.3).

Criterion validity: The extent to which FOSQ-10P differentiates between different AHI groups was tested (control: AHI < 5; mild: 5 ≤ AHI < 15; moderate: 15 ≤ AHI < 30; severe: AHI ≥ 30).

The sample was analyzed using ANOVA procedures to assess means across 2 or more groups. Assumptions were verified through Levene's test (p > 0.05), Shapiro-Wilk test (p > 0.05), and post hoc Tukey analysis. A p-value < 0.05 was considered statistically significant for the analysis, and descriptive statistics were applied to all the data.

Results

The Translation and Cross-Cultural Adaptation of the FOSQ-10 into Brazilian Portuguese were successfully conducted, maintaining an equivalent meaning to the original English version, suitable for individuals ≥18 years old and who completed elementary education.

The population descriptive analysis of the validation process is presented in Table 1.

Table 1
Demographic characteristics of respondents (n = 182).

Factor analysis

Content validity

The Bartlett's sphericity test (χ² = 1108.2; df = 45; p = 0.000010), KMO (0.83), TLI (0.97), and CFI (0.98) indicators, as well as RMSEA (0.04), are suitable and within the expected values.

Factor extraction ‒ Eigenvalue technique

Based on the Eigenvalue > 1 criterion, two factors were extracted with values of 5.30850 and 1.33073, while the remaining factors had Eigenvalues < 1. Both factors explain variances of 53% and 13.3%, respectively.

The items exhibited appropriate factor loadings on their respective factors. No cross-loading pattern was observed (i.e., items with factor loadings above 0.30 on more than one factor) (Table 2).

Table 2
Factor loadings for each item in the FOSQ10-P.

Indices estimate the replicability of the factor scores using the H-index suggesting that both factors could be replicable in future studies (H > 0.80).

The PA considers that only one factor extracted from the actual data will have a higher explained variance (59.4653) than random data (256.196) with indicators such as UniCo = 0.921 (0.873‒0.959), ECV = 0.822 (0.785‒0.871), and MIREAL = 0.253 (0.211‒0.282).

The missing values are non-random (linked to individuals' not performing tasks, i.e., Questions 3, 4, and 10).

In Question 3, 24.62%, and Question 4, 27.69% of female subjects responded “0” (do not perform this task), while only 1.71% of male subjects did so.

Concerning Question 10, an EFA suggested a link between MV and gender and age. A binary logistic regression confirmed the significance of both variables. We found that with each additional year of life, there is a 9% chance of not marking Question 10 compared to the previous year, and females have an 8.35% higher chance of marking “0” than males.

Construct validity

Cronbach's alpha 0.87 (0.84‒0.9) (Table 3), and McDonald's ordinal Omega index 0.9, are satisfactory and Composite Reliability* 0.891 is suitable for a unidimensional structure.

Table 3
Results of internal consistency measured by Cronbach’s alpha coefficients.

Convergent validity

Categorizing respondents assessed the FOSQ-10P according to their ESS scores were negatively correlated, (r = 0.364 [−0.487; −0.226]). Table 4 shows the means in the five subscales of the FOSQ-10P and the total scores for those who scored low (0 < 10) and high (≥10) on the ESS scale.

Table 4
Convergent validity according to ESS groups.

Criterion validity

The Spearman correlation between the AHI and FOSQ-10P was not significant (r = 0.026 [−0.120; 0.170]).

The ANOVA to determine whether the FOSQ-10P could discriminate subjects based on the severity of AHI was not significant (p = 0.144) (Table 5).

Table 5
Analysis of variance between the different OSA severity groups.

The Regression including variables from Polysomnography (AHI, Arousal Index [ArI], Wake After Sleep Onset [WASO], Oxygen Desaturation Index [ODI], Time under 90% O2 [T90], Body Mass Index [BMI], age, and gender) as predictors (Table 6).

Table 6
Regression FOSQ-10P versus PSG parameters.

Discussion

Our findings indicate that three out of the four selected parameters for validating FOSQ-10P ‒ content validity, construct validity, and convergent validity ‒ were thoroughly addressed.

An EFA is a specific type of Structural Equation Model (SEM) with latent variables that identify the pattern of item correlations, and the factorial structure is derived from the response to those items. Scores obtained using scales should demonstrate various indicators of validity and precision indicators3030 Valentini F, Damásio BF. Average Variance Extracted and Composite Reliability: Reliability Coefficients. Psicologia: Teoria e Pesquisa. 2016;32:1-7. that ensure their utility across different samples, populations, and over time.3131 Sireci SG. On Validity Theory and Test Validation. Educational Researcher. 2007;36:477-81.

A widely accepted model for validity criteria, AERA, APA, & NCME, 2014,2727 American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. American Educational Research Association; 2014. Accessed July 30, 2023. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf.
https://www.testingstandards.net/uploads...
defines validity as arising from five sources of evidence: (a) Based on test content; (b) Based on response processes; (c) Based on internal structure; (d) Based on relationships with other variables (convergent, discriminant, criterion, and generalization validity); and (e) Based on consequences of testing. Therefore, our validations aimed to align with the evidence suitable for FOSQ-10P.

Validity based on Internal Consistency or reliability is a form of evidence that pertains to the empirical and theoretical structure of the instrument, revealing the latent variable through the relationships among observed variables, aiming to investigate the accuracy of the response pattern to item.3232 Rios J, Wells C. Evidencia de validez basada en la estructura interna. Psicothema. 2014;26:108-16.

Content Validity assesses how accurately a test measures the construct of interest. We found quality indices such as Bartlett's sphericity test and the Kaiser-Meyer-Olkin (KMO) and data fit indices like TLI, CFI, and RMSEA,2525 Brown TA. Confirmatory Factor Analysis for Applied Research. Vol 2nd edition; 2015. Accessed June 29, 2023. http://people.bu.edu/tabrown/.
http://people.bu.edu/tabrown/...
appropriated for the use and interpretability of the scale for Brazilian-Portuguese speakers.

The Eigenvalue technique revealed two factors, consistent with a previous study.3333 De Castro JR, Rosales-Mayor E, Weaver TE. Reliability and validity of the functional outcomes of sleep questionnaire ‒ Spanish short version (FOSQ-10SV) in Peruvian patients with obstructive sleep apnea. J Clin Sleep Med. 2018;14:615-21. However, the emergence of the second factor was primarily due to a significant prevalence of MV - response “0” ‒ I do not perform this task ‒ in Questions 3 and 4 (short and long-distance driving), especially among female participants. Therefore, as seen in the Peruvian validation,3333 De Castro JR, Rosales-Mayor E, Weaver TE. Reliability and validity of the functional outcomes of sleep questionnaire ‒ Spanish short version (FOSQ-10SV) in Peruvian patients with obstructive sleep apnea. J Clin Sleep Med. 2018;14:615-21. we cannot associate this factor with Sleep-Related Impairment (SRI). But, for Question 10, analyzing MV, suggests that as years go by, both sexual desire and intimacy are affected, more among women. This may be attributed to the emphasis older men place on sexual potency, while older women see a decrease in sexual activity as a natural aspect of aging, and elderly individuals might feel uneasy discussing sexuality.3434 Soares KG, Meneghel SN. The silenced sexuality in dependent older adults. Cien Saude Colet. 2021;26(1):129-36.

The PA, where the decision on dimensionality is based on the percentage of explained common variance. Pearson's correlation was computed for linear factor analysis, and polychoric matrix was used for nonlinear factor analyses, along with the correlation of matrices. Considered the most recommended method,3535 Fabrigar LR, Wegener DT, Maccallum RC, Strahan EJ. Evaluating the Use of Exploratory Factor Analysis in Psychological Research. Psychological Methods. 1999;4:272-99.

36 Hayton JC, Allen DG, Scarpello V. Factor Retention Decisions in Exploratory Factor Analysis: A Tutorial on Parallel Analysis. Organ Res Methods. 2004;7:191-205.
-3737 Thompson B. Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications.; 2004. supported by its performance in comparative simulation3838 Humphreys LG, Montanelli RG. An investigation of the parallel analysis criterion for determining the number of common factors. Multivariate Behav Res. 1975;10:193-205. studies and empirical applications.2323 Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods. 2011;16:209-20.

Thus, PA supported the single-factor structure with appropriate factor loadings, indicating that the FOSQ-10P is a unidimensional measure, as intended and confirmed by the Composite Reliability index (0.891) and the factor stability assessed through the H index (0.92).2626 Ferrando PJ, Lorenzo-Seva U. Assessing the Quality and Appropriateness of Factor Solutions and Factor Score Estimates in Exploratory Item Factor Analysis. Educ Psychol Meas. 2018;78:762-80. The H index assesses how well a set of items represents a common factor. Higher H values (>0.80) suggest a well-defined latent variable, likely to remain stable across different studies. Additionally, indicators such as UniCo = 0.921, ECV = 0.822, and MIREAL = 0.253 ‒ supported the unidimensionality of the scale. This aligns with Weaver's (2009)88 Chasens ER, Ratcliffe SJ, Weaver TE. Development of the FOSQ-10: A Short Version of the Functional Outcomes of Sleep Questionnaire. Sleep. 2009;32:915-9. recommendation when developing the shortened version of the scale, stating that “only the total score would be used in interpreting the degree of impairment associated with daytime sleepiness”.

Construct validity is based on estimation methods that consider the importance of items through factor loadings,2525 Brown TA. Confirmatory Factor Analysis for Applied Research. Vol 2nd edition; 2015. Accessed June 29, 2023. http://people.bu.edu/tabrown/.
http://people.bu.edu/tabrown/...
,3030 Valentini F, Damásio BF. Average Variance Extracted and Composite Reliability: Reliability Coefficients. Psicologia: Teoria e Pesquisa. 2016;32:1-7. indicated psychometric properties of the FOSQ-10P, such as Cronbach's α of 0.87, similar to those found in the original FOSQ-1088 Chasens ER, Ratcliffe SJ, Weaver TE. Development of the FOSQ-10: A Short Version of the Functional Outcomes of Sleep Questionnaire. Sleep. 2009;32:915-9. and other validation studies.3333 De Castro JR, Rosales-Mayor E, Weaver TE. Reliability and validity of the functional outcomes of sleep questionnaire ‒ Spanish short version (FOSQ-10SV) in Peruvian patients with obstructive sleep apnea. J Clin Sleep Med. 2018;14:615-21.,3939 Rahavi-Ezabadi S, Amali A, Sadeghniiat-Haghighi K, Montazeri A. Adaptation of the 10-Item Functional Outcomes of Sleep Questionnaire to Iranian Patients with Obstructive Sleep Apnea. Qual Life Res. 2016;25:337-41. The scale demonstrated stability even when item removal was simulated, as shown in Table 4. Additionally, indices like the McDonald's ordinal Omega index (0.9) and the Composite Reliability (0.891) support the appropriateness of interpretations and actions based on the test scores.

Validity based on the relationship to external parameters is crucial as it assesses how test scores are associated with external measures in a theoretically expected manner, examining how the construct relates to other constructs.4040 Preckel F, Brunner M. Nomological Nets. In: Encyclopedia of Personality and Individual Differences. Springer International Publishing; 2017:1-4. doi:10.1007/978-3-319-28099-8_1334-1.
https://doi.org/10.1007/978-3-319-28099-...

Convergent validity demonstrates the two extents to which instruments measure similar constructs and associate them as expected. The negative correlation between FOSQ-10P and ESS, considering the inverse scoring of the scales, fell within the expected range (r = 0.364). The effect of FOSQ-10P results in the two groups ‒ low scores (0 < 10) and high scores (≥10) on the ESS scale, were significant (p < 0.05) in all five domains, as well as the total score of FOSQ-10P, with a strong effect size (Cohen's d 0.719), supporting convergent validity.

Criterion validity seeks validity through external criteria. For OSAS, polysomnography was the gold standard, and there was no correlation between FOSQ-10P and AHI indices. Was not possible to differentiate the groups based on the severity of AHI using FOSQ-10P. However, the impact of OSAS on quality of life may be attributed to the presence of daytime sleepiness, not just the severity of AHI, as observed in a recent study4141 Tasbakan MS, Gunduz C, Pirildar S, Basoglu OK. Quality of life in obstructive sleep apnea is related to female gender and comorbid insomnia. Sleep Breath. 2018;22(4):1013-20. and also in ours.

We also found that younger individuals had lower FOSQ-10P scores (p = 0.004), suggesting that the perception of daytime sleepiness in young adults prompts them to seek investigation into sleep quality4242 Rubin A, Mangal R, Stead TS, Walker J, Ganti L. The extent of sleep deprivation and daytime sleepiness in young adults. Health Psychol Res. 2023;11:74555. and men had a mean score of 1.616 higher on the FOSQ-10P, indicating a lower impact on daily activities than women. Possible explanations include gender differences in sensitivity to voluntary sleep deprivation4343 Forest G, Gaudreault P, Michaud F, Green-Demers I. Gender differences in the interference of sleep difficulties and daytime sleepiness on school and social activities in adolescents. Sleep Med. 2022;100:79-84. and the presence of comorbid insomnia with OSA in women,4141 Tasbakan MS, Gunduz C, Pirildar S, Basoglu OK. Quality of life in obstructive sleep apnea is related to female gender and comorbid insomnia. Sleep Breath. 2018;22(4):1013-20. along with the burden of dual responsibilities and tasks.4444 Doi Y, Minowa M. Gender differences in excessive daytime sleepiness among Japanese workers. Soc Sci Med. 2003;56:883-94.

This study's limitations are tied to administering the questionnaire exclusively before the recommended treatment, given the diverse sources of the database. The next phase of the project will involve evaluating the perception of sleepiness and functional impairment before and after different types of treatments recommended for OSA.

Conclusion

The FOSQ-10P is a reliable and valid instrument for assessing functional status, effectively identifying significant impacts of sleep-related impairment in individuals with sleep-disordered breathing who speak Brazilian Portuguese.

  • Financing
    This research did not receive specific funding from public, commercial, or non-profit funding agencies.

Acknowledgments

Prof. Dr. Monica Levi Andersen; Prof. Dr. Altay Alves Lino de Souza.

References

  • 1
    Pagel JF. Excessive daytime sleepiness. Am Fam Physician. 2009;79:391-6.
  • 2
    Tufik S, Santos-Silva R, Taddei JA, Bittencourt LRA. Obstructive Sleep Apnea Syndrome in the Sao Paulo Epidemiologic Sleep Study. Sleep Med. 2010;11:441-6.
  • 3
    Moyer CA, Sonnad SS, Garetz SL, Helman JI, Chervin RD. Quality of life in obstructive sleep apnea: A systematic review of the literature. Sleep Med. 2001;2:477-91.
  • 4
    Billings ME, Rosen CL, Auckley D, Benca R, Foldvary-Schaefer N, Iber C, et al. Psychometric performance and responsiveness of the functional outcomes of sleep questionnaire and sleep apnea quality of life index in a randomized trial: The Home PAP study. Sleep. 2014;37:2017-2
  • 5
    Johns MW. A New Method for Measuring Daytime Sleepiness: The Epworth Sleepiness Scale. Sleep. 1991;14:540-5.
  • 6
    Bertolazi AN, Fagondes SC, Hoff LS, Dallagasperina Pedro V, Barreto SSM, Johns MW. Portuguese-Language Version of the Epworth Sleepiness Scale: Validation for Use in Brazil. J Bras Pneumol. 2009;35:877-83.
  • 7
    Weaver E, Laizner AM, Evans LK, Maislin G, Chugh DK, Lyon K, et al. An Instrument to Measure Functional Status Outcomes for Disorders of Excessive Sleepiness. Sleep. 1997;20:835-43.
  • 8
    Chasens ER, Ratcliffe SJ, Weaver TE. Development of the FOSQ-10: A Short Version of the Functional Outcomes of Sleep Questionnaire. Sleep. 2009;32:915-9.
  • 9
    Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clio Epidemiol. 1993;46:1417-32.
  • 10
    Oliveira ERR. Elisabete Raca Romero de Oliveira - A. 2018. Accessed November 29, 2023. https://repositorio.unifesp.br/handle/11600/52423
    » https://repositorio.unifesp.br/handle/11600/52423
  • 11
    Sánchez R, Echeverry J. Validación de escalas de medición en salud. Revista de Salud Pública. 2004;6:302-18.
  • 12
    Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41:1149-60.
  • 13
    American Academy of Sleep Medicine. ICSD-3-TR: International Classification of Sleep Disorders: Summary of Diagnostic Criteria Changes. 3rd ed. AASM; 2018. Accessed July 2, 2023. https://aasm.org/wp-content/uploads/2023/05/ICSD-3-Text-Revision-Supplemental-Material.pdf
    » https://aasm.org/wp-content/uploads/2023/05/ICSD-3-Text-Revision-Supplemental-Material.pdf
  • 14
    American Academy of Sleep Medicine. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications - Version 2.5. AASM; 2018. Accessed July 2, 2023. https://aasm.org/clinical-resources/scoring-manual/
    » https://aasm.org/clinical-resources/scoring-manual/
  • 15
    Buuren S van, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45:1-67.
  • 16
    Jia F, Wu W. Evaluating methods for handling missing ordinal data in structural equation modeling. Behav Res Methods. 2019;51:2337-55.
  • 17
    Lorenzo-Seva U, Ferrando PJ. Factor Analysis. (Release 12.03.01 64bits) [Computer Software]. Terragona (Spain): Rovira i Virgili University; 2022 July [cited 2023 May 10]. Available from: psico.fcep.urv.cat/utilitats/factor.
  • 18
    Revelle W. Package “psych” Title Procedures for Psychological, Psychometric, and Personality Research.; 2023. https://personality-project.org/r/psych/
    » https://personality-project.org/r/psych/
  • 19
    Peterson RA. A Meta-Analysis of Variance Accounted for and Factor Loadings in Exploratory Factor Analysis. Mark Lett. 2000;11:261-75.
  • 20
    The Jamovi project. Jamovi. (Version 2.3) [Computer Software]; 2022 [cited 2023 July 31]. Retrieved from: https://www.jamovi.org
    » https://www.jamovi.org
  • 21
    Asparouhov T, Muthén B. Simple Second Order Chi-Square Correction. In: 2010. Accessed July 9, 2023. https://api.semanticscholar.org/CorpusID:3962271
    » https://api.semanticscholar.org/CorpusID:3962271
  • 22
    Cattell RB. The Scree Test For The Number Of Factors. Multivariate Behav Res. 1966;1:245-76.
  • 23
    Timmerman ME, Lorenzo-Seva U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol Methods. 2011;16:209-20.
  • 24
    Lorenzo-Seva U, Ferrando PJ. Robust Promin: a method for diagonally weighted factor rotation. Published online April 12, 2019. doi:10.24265/liberabit.2019.v25n1.08.
    » https://doi.org/10.24265/liberabit.2019.v25n1.08.
  • 25
    Brown TA. Confirmatory Factor Analysis for Applied Research. Vol 2nd edition; 2015. Accessed June 29, 2023. http://people.bu.edu/tabrown/
    » http://people.bu.edu/tabrown/
  • 26
    Ferrando PJ, Lorenzo-Seva U. Assessing the Quality and Appropriateness of Factor Solutions and Factor Score Estimates in Exploratory Item Factor Analysis. Educ Psychol Meas. 2018;78:762-80.
  • 27
    American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. American Educational Research Association; 2014. Accessed July 30, 2023. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf
    » https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf
  • 28
    Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297-334.
  • 29
    McDonald RP. Test Theory: A Unified Treatment. Vol 1. 2nd ed. Routlege Taylor & Francis Group; 2011. Accessed July 9, 2023. https://books.google.com.br/books?id=2-V5tOsa_DoC&pg=PR4&lpg=PR4&dq=ISBN++0-8058-3075-8&source=bl&ots=hXhA1z-ZG_&sig=ACfU3U3flp-J9YsYn4hNsPP7LGt7fnpHOw&hl=pt-BR&sa=X&ved=2ahUKEwi45-baiKGBAxVID7kGHc55AYEQ6AF6BAgNEAM#v=onepage&q=ISBN%20%200-8058-3075-8&f=false
    » https://books.google.com.br/books?id=2-V5tOsa_DoC&pg=PR4&lpg=PR4&dq=ISBN++0-8058-3075-8&source=bl&ots=hXhA1z-ZG_&sig=ACfU3U3flp-J9YsYn4hNsPP7LGt7fnpHOw&hl=pt-BR&sa=X&ved=2ahUKEwi45-baiKGBAxVID7kGHc55AYEQ6AF6BAgNEAM#v=onepage&q=ISBN%20%200-8058-3075-8&f=false
  • 30
    Valentini F, Damásio BF. Average Variance Extracted and Composite Reliability: Reliability Coefficients. Psicologia: Teoria e Pesquisa. 2016;32:1-7.
  • 31
    Sireci SG. On Validity Theory and Test Validation. Educational Researcher. 2007;36:477-81.
  • 32
    Rios J, Wells C. Evidencia de validez basada en la estructura interna. Psicothema. 2014;26:108-16.
  • 33
    De Castro JR, Rosales-Mayor E, Weaver TE. Reliability and validity of the functional outcomes of sleep questionnaire ‒ Spanish short version (FOSQ-10SV) in Peruvian patients with obstructive sleep apnea. J Clin Sleep Med. 2018;14:615-21.
  • 34
    Soares KG, Meneghel SN. The silenced sexuality in dependent older adults. Cien Saude Colet. 2021;26(1):129-36.
  • 35
    Fabrigar LR, Wegener DT, Maccallum RC, Strahan EJ. Evaluating the Use of Exploratory Factor Analysis in Psychological Research. Psychological Methods. 1999;4:272-99.
  • 36
    Hayton JC, Allen DG, Scarpello V. Factor Retention Decisions in Exploratory Factor Analysis: A Tutorial on Parallel Analysis. Organ Res Methods. 2004;7:191-205.
  • 37
    Thompson B. Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications.; 2004.
  • 38
    Humphreys LG, Montanelli RG. An investigation of the parallel analysis criterion for determining the number of common factors. Multivariate Behav Res. 1975;10:193-205.
  • 39
    Rahavi-Ezabadi S, Amali A, Sadeghniiat-Haghighi K, Montazeri A. Adaptation of the 10-Item Functional Outcomes of Sleep Questionnaire to Iranian Patients with Obstructive Sleep Apnea. Qual Life Res. 2016;25:337-41.
  • 40
    Preckel F, Brunner M. Nomological Nets. In: Encyclopedia of Personality and Individual Differences. Springer International Publishing; 2017:1-4. doi:10.1007/978-3-319-28099-8_1334-1.
    » https://doi.org/10.1007/978-3-319-28099-8_1334-1.
  • 41
    Tasbakan MS, Gunduz C, Pirildar S, Basoglu OK. Quality of life in obstructive sleep apnea is related to female gender and comorbid insomnia. Sleep Breath. 2018;22(4):1013-20.
  • 42
    Rubin A, Mangal R, Stead TS, Walker J, Ganti L. The extent of sleep deprivation and daytime sleepiness in young adults. Health Psychol Res. 2023;11:74555.
  • 43
    Forest G, Gaudreault P, Michaud F, Green-Demers I. Gender differences in the interference of sleep difficulties and daytime sleepiness on school and social activities in adolescents. Sleep Med. 2022;100:79-84.
  • 44
    Doi Y, Minowa M. Gender differences in excessive daytime sleepiness among Japanese workers. Soc Sci Med. 2003;56:883-94.

Publication Dates

  • Publication in this collection
    30 Sept 2024
  • Date of issue
    2024

History

  • Received
    7 Jan 2024
  • Accepted
    9 May 2024
  • Published
    04 June 2024
Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Sede da Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico Facial, Av. Indianópolia, 1287, 04063-002 São Paulo/SP Brasil, Tel.: (0xx11) 5053-7500, Fax: (0xx11) 5053-7512 - São Paulo - SP - Brazil
E-mail: revista@aborlccf.org.br