Acessibilidade / Reportar erro

Evaluation of the psychometric properties of the Brazilian version of the Short Portable Mental Status Questionnaire (SPMSQ) by Pfeiffer

Abstract

Objective

To evaluate the psychometric properties, including validity, reliability, sensitivity, and specificity of the SPMSQ-BR.

Method

The analysis was conducted on 93 older adults, assessed with the Brazilian version of the SPMSQ, Mini-Mental State Examination (MMSE), Clock Drawing Test (CDT), and Verbal Fluency Test (VFT). Internal consistency was estimated using Cronbach's alpha coefficient. In order to assess intra-rater stability and inter-rater reproducibility, the intraclass correlation coefficient (ICC) with a 95% confidence interval was employed. For concurrent and convergent validity, Spearman's correlation coefficient was utilized. Accuracy in establishing the cutoff point for the SPMSQ-BR to screen sensitivity and specificity was assessed through ROC curve analysis.

Result

The SPMSQ-BR demonstrated excellent internal consistency (α=0.803), high intra-rater and inter-rater reliability (ICC=0.977 and ICC=0.973), respectively. In terms of concurrent validity, it showed a strong negative linear correlation with the MMSE (-0.799, p<0.001), while moderate correlations were found with the CDT (-0.584, p<0.01) and VFT (-0.569, p<0.01). The SPMSQ-BR proved capable of discriminating cognitive impairment with a cutoff point of 3 errors, following the original scale. The area under the curve (AUC) considering education level was 0.905 (sensitivity=81.3%, specificity=76.9%), and without considering education level, the AUC was 0.927 (sensitivity=87.5%, specificity=80.8%), indicating good sensitivity and specificity in both cases.

Conclusion

The study demonstrated that the Brazilian version of the SPMSQ, established as a Brief Cognitive Capacity Scale, proved to be stable, reproducible, valid, and reliable for assessing the cognitive capacity of older adults. Furthermore, it showed sensitivity in identifying cognitive impairment.

Keywords
Validation Study; Elderly Health; Mental Status and Dementia Tests; Cognitive Aging; Sensitivity and Specificity

Resumo

Objetivo

Avaliar as propriedades psicométricas, contemplando validade, confiabilidade, sensibilidade e especificidade do SPMSQ-BR.

Método

A análise foi realizada em 93 idosos, avaliados com a versão brasileira do SPMSQ, Mini-Exame do Estado Mental (MEEM), Teste do Desenho do Relógio (TDR) e Teste de Fluência Verbal (TFV). A consistência interna foi estimada pelo coeficiente alfa de Cronbach. Para avaliar a estabilidade intra-avaliador e a reprodutibilidade inter-avaliador, utilizou-se o coeficiente de correlação intraclasse (CCI) com intervalo de confiança de 95%. Para a validade concorrente e convergente, utilizou-se o coeficiente de correlação de Spearman. A acurácia para estabelecer o ponto de corte do SPMSQ-BR para rastreamento da sensibilidade e especificidade realizou-se através da curva ROC. Resultado: O SPMSQ-BR demonstrou excelente consistência interna (α=0,803), alta confiabilidade intra e inter-avaliador (CCI-0,977) e (CCI-0,973) respectivamente. Na validade concorrente apresentou forte correlação linear com o MEEM (-0,799 p<0,001), já com TDR (-0,584 p<0,01) e TFV (-0,569 p<0,01) foram encontradas correlações moderadas. O SPMSQ-BR mostrou-se capaz de discriminar o comprometimento cognitivo com ponto de corte a partir de 3 erros, conforme a escala original. A área sob a curva considerando a escolaridade foi de AUC=0,905 (S=81,3% e E=76,9%) e sem considerar a escolaridade AUC=0,927 (S=87,5% e E=80,8%) apresentando uma boa sensibilidade e especificidade em ambos os casos.

Conclusão

O estudo demonstrou que a versão brasileira do SPMSQ estabelecida como Breve Escala de Capacidade Cognitiva apresentou-se estável, reprodutível, válida e confiável para avaliar a capacidade cognitiva de idosos, além de ser sensível na identificação de comprometimento cognitivo.

Palavras-Chave:
Estudo de Validação; Saúde do Idoso; Testes de Estado Mental e Demência; Envelhecimento Cognitivo; Sensibilidade e Especificidade

INTRODUCTION

The extension of life expectancy is a process that implies changes in the organization of societies. Amid discussions about the most appropriate measures to adapt to new population configurations, the projection of a longer lifespan has effects, particularly on the health of this population11 Rougemont F. Redefining the passage of time: lifestyle and longevity. Rev bras geriatr gerontol [Internet]. 2018 Nov;21(6):645–6. Disponível em: https://doi.org/10.1590/1981-22562018021.180218.
https://doi.org/10.1590/1981-22562018021...
. The aging process is characterized by impairment in the functioning of the body's systems. These progressive limitations can be exacerbated by non-communicable chronic diseases, leading to changes in functional capacity11 Rougemont F. Redefining the passage of time: lifestyle and longevity. Rev bras geriatr gerontol [Internet]. 2018 Nov;21(6):645–6. Disponível em: https://doi.org/10.1590/1981-22562018021.180218.
https://doi.org/10.1590/1981-22562018021...
,22 Souza GA de, Giacomin KC, Firmo JOA. A necessidade de cuidado na percepção de pessoas idosas em processo de fragilização. Cad saúde colet [Internet]. 2022 Oct;30(4):486–95. Disponível em: https://doi.org/10.1590/1414-462X202230040506.
https://doi.org/10.1590/1414-462X2022300...
.

Functional capacity refers to the ability to perform activities of daily living (ADLs) and instrumental activities of daily living (IADLs), which encompass, in one of their aspects, cognitive impairment. In aging, the central nervous system is one of the most affected with the development of alterations in the neurotransmitter system and cerebral hypotrophy22 Souza GA de, Giacomin KC, Firmo JOA. A necessidade de cuidado na percepção de pessoas idosas em processo de fragilização. Cad saúde colet [Internet]. 2022 Oct;30(4):486–95. Disponível em: https://doi.org/10.1590/1414-462X202230040506.
https://doi.org/10.1590/1414-462X2022300...
,33 Sánchez CZ, Sanabria MOC, Sánchez MZ, López PAC, Sanabria MS, Hernández SH, et al. Prevalencia de demencia en adultos mayores de América Latina: revisión sistemática. Rev Esp Geriatr Gerontol. 2019;54(6):346–55. Disponível em: https://doi.org/10.1016/j.regg.2018.12.007.
https://doi.org/10.1016/j.regg.2018.12.0...
. These modifications typically occur in regions responsible for cognitive functions, and it is common to observe both minor and significant impairments in this function among older individuals33 Sánchez CZ, Sanabria MOC, Sánchez MZ, López PAC, Sanabria MS, Hernández SH, et al. Prevalencia de demencia en adultos mayores de América Latina: revisión sistemática. Rev Esp Geriatr Gerontol. 2019;54(6):346–55. Disponível em: https://doi.org/10.1016/j.regg.2018.12.007.
https://doi.org/10.1016/j.regg.2018.12.0...
. Early diagnosis is crucial for implementing measures that preserve the autonomy and independence of older adults33 Sánchez CZ, Sanabria MOC, Sánchez MZ, López PAC, Sanabria MS, Hernández SH, et al. Prevalencia de demencia en adultos mayores de América Latina: revisión sistemática. Rev Esp Geriatr Gerontol. 2019;54(6):346–55. Disponível em: https://doi.org/10.1016/j.regg.2018.12.007.
https://doi.org/10.1016/j.regg.2018.12.0...
,44 Duran-Badillo T, Salazar-González BC, Cruz-Quevedo JE, Sánchez-Alej EJ, Gutierrez-Sanchez G, Hernández-Cortés PL. Função sensorial, cognitiva, capacidade de caminhar e funcionalidade de idosos. Rev Latino-Am Enferm. 2020;28. Disponível em:https://doi.org/10.1590/1518-8345.3499.3282.
https://doi.org/10.1590/1518-8345.3499.3...
.

Dementia conditions are indicated as major contributors to the development of functional dependence and are related to this decline. Dementia syndromes, although not inherent characteristics of aging, are more prevalent in this age group. It is estimated that between 2% and 10% of all dementia cases begin before the age of 65. After this age, the prevalence of cases tends to double every five years of life44 Duran-Badillo T, Salazar-González BC, Cruz-Quevedo JE, Sánchez-Alej EJ, Gutierrez-Sanchez G, Hernández-Cortés PL. Função sensorial, cognitiva, capacidade de caminhar e funcionalidade de idosos. Rev Latino-Am Enferm. 2020;28. Disponível em:https://doi.org/10.1590/1518-8345.3499.3282.
https://doi.org/10.1590/1518-8345.3499.3...
,55 Dias, L. B., Castiglioni, L., Tognola, W. A., & Bianchin, M. A. (2018). Sobrecarga no cuidado de paciente idoso com demência. Revista Kairós-Gerontologia, 2018; 21(1), 169–190. https://doi.org/10.23925/2176-901X.2018v21i1p169-190.
https://doi.org/10.23925/2176-901X.2018v...
.

Studies show that the prevalence of dementia in the Brazilian population is very similar to that of foreign studies66 Balsinha, C., Gonçalves-Pereira, M., Iliffe, S., Freitas, J.A., Grave, J. Health-Care Delivery for Older People with Dementia in Primary Care. In: de Mendonça Lima, C., Ivbijaro, G. (eds) Primary Care Mental Health in Older People 2019;311–29. Disponível em: https://doi.org/10.1007/978-3-030-10814-4_23.
https://doi.org/10.1007/978-3-030-10814-...
, demonstrating significant impairments in functionality and consequently in the quality of life of older adults and those around them44 Duran-Badillo T, Salazar-González BC, Cruz-Quevedo JE, Sánchez-Alej EJ, Gutierrez-Sanchez G, Hernández-Cortés PL. Função sensorial, cognitiva, capacidade de caminhar e funcionalidade de idosos. Rev Latino-Am Enferm. 2020;28. Disponível em:https://doi.org/10.1590/1518-8345.3499.3282.
https://doi.org/10.1590/1518-8345.3499.3...
,66 Balsinha, C., Gonçalves-Pereira, M., Iliffe, S., Freitas, J.A., Grave, J. Health-Care Delivery for Older People with Dementia in Primary Care. In: de Mendonça Lima, C., Ivbijaro, G. (eds) Primary Care Mental Health in Older People 2019;311–29. Disponível em: https://doi.org/10.1007/978-3-030-10814-4_23.
https://doi.org/10.1007/978-3-030-10814-...
. This necessitates specific intervention programs to adapt routine activities, to equip caregiving, and to manage behavioral changes55 Dias, L. B., Castiglioni, L., Tognola, W. A., & Bianchin, M. A. (2018). Sobrecarga no cuidado de paciente idoso com demência. Revista Kairós-Gerontologia, 2018; 21(1), 169–190. https://doi.org/10.23925/2176-901X.2018v21i1p169-190.
https://doi.org/10.23925/2176-901X.2018v...
.

In this sense, it becomes imperative to conduct an assessment that takes into account these aspects inherent in the aging process. Identifying risk factors and screening individuals who may have dementia is essential for early treatment, as well as for delaying the effects of the disease33 Sánchez CZ, Sanabria MOC, Sánchez MZ, López PAC, Sanabria MS, Hernández SH, et al. Prevalencia de demencia en adultos mayores de América Latina: revisión sistemática. Rev Esp Geriatr Gerontol. 2019;54(6):346–55. Disponível em: https://doi.org/10.1016/j.regg.2018.12.007.
https://doi.org/10.1016/j.regg.2018.12.0...
,66 Balsinha, C., Gonçalves-Pereira, M., Iliffe, S., Freitas, J.A., Grave, J. Health-Care Delivery for Older People with Dementia in Primary Care. In: de Mendonça Lima, C., Ivbijaro, G. (eds) Primary Care Mental Health in Older People 2019;311–29. Disponível em: https://doi.org/10.1007/978-3-030-10814-4_23.
https://doi.org/10.1007/978-3-030-10814-...
,77 Martins NIM, Caldas PR, Cabral ED, Lins CCSA, Coriolano MGWS. Cognitive assessment instruments used in elderly Brazilians in the last five years. Ciênc Saúde Coletiva. 2019;24(7):2513-30. https://doi.org/10.1590/1413-81232018247.20862017.
https://doi.org/10.1590/1413-81232018247...
. Therefore, it is essential to have practical, accessible, and reliable tools that allow for the detection of cognitive impairment. It is emphasized the importance of verifying whether the instrument has been validated77 Martins NIM, Caldas PR, Cabral ED, Lins CCSA, Coriolano MGWS. Cognitive assessment instruments used in elderly Brazilians in the last five years. Ciênc Saúde Coletiva. 2019;24(7):2513-30. https://doi.org/10.1590/1413-81232018247.20862017.
https://doi.org/10.1590/1413-81232018247...
.

The Short Portable Mental Status Questionnaire (SPMSQ) by Eric Pfeiffer88 Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41. is a cognitive screening and diagnostic support instrument for dementia, specifically designed for older adults. A readily administered test comprising only 10 questions, it can be applied by any healthcare professional and exhibits good sensitivity (S=86%) and specificity (E=99%) in its original English version88 Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41.. It is utilized to monitor therapeutic measures and the progression of cognitive deficits, evaluating memory, temporal orientation, spatial orientation, mathematical ability, and information regarding daily facts and skills. This instrument allows for the classification of the older adult into preserved cognitive capacity, mild cognitive impairment, moderate, or severe impairment, taking into account the individual's level of education88 Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41.,99 Martínez De La Iglesia J, Herrero RD, Vilches MCO, Taberné CA, Colomer CA, Luque RL. Adaptación y validación al castellano del cuestionario de Pfeiffer (SPMSQ) para detectar la existencia de deterioro cognitivo en personas mayores de 65 años. Med Clin (Barc). 2001;117(4):129–34. pp. 129-134, 10.1016/s0025-7753(01)72040-4.. It has already been translated and culturally adapted for Brazil by Teigão et al1010 Teigão, F. C. M., Moser, A. D. de L., & Jerez-Roig, J. (2020). Tradução e adaptação transcultural do Short Portable Mental Status Questionnaire (SPMSQ) de Pfeiffer para pessoas idosas brasileiras. Revista Brasileira de Geriatria e Gerontologia, 2020;23(4). Disponível em: https://doi.org/10.1590/1981-22562020023.200128.
https://doi.org/10.1590/1981-22562020023...
.

Following the process of cross-cultural adaptation of the instrument, it is necessary to analyze its psychometric properties to ensure that the characteristics of the original instrument have been maintained. The most considered measurement properties are validity, reliability, and accuracy, which are fundamental aspects for assessing the quality of an instrument1111 Guillemin, F. Cross-cultural Adaptation and Validation of Heatth Status Measures. Scandinavian Journal of Rheumatology,1995;24(2), 61–63. https://doi.org/10.3109/03009749509099285.
https://doi.org/10.3109/0300974950909928...
,1212 Lino CR de M, Brüggemann OM, Souza M de L de, Barbosa S de FF, Santos EKA dos. Adaptação Transcultural de Instrumentos de Pesquisa Conduzida pela Enfermagem do Brasil: Uma Revisão Integrativa. Texto contexto - enferm [Internet]. 2017;26(4). Disponível em: https://doi.org/10.1590/0104-07072017001730017.
https://doi.org/10.1590/0104-07072017001...
.

Validity refers to the quality of an instrument, whether it assesses exactly what it aims to measure1313 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde [Internet]. 2017Jul;26(3):649–59. Disponível em: https://doi.org/10.5123/S1679-49742017000300022.
https://doi.org/10.5123/S1679-4974201700...
, while reliability concerns the degree to which an instrument allows for the reproduction and consistency of results when applied on different occasions1414 Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades Psicométricas de Instrumentos de Medidas: Bases Conceituais e Métodos de Avaliação - PARTE I. Texto contexto - enferm [Internet]. 2017;26(4). Disponível em: https://doi.org/10.1590/0104-07072017001600017.
https://doi.org/10.1590/0104-07072017001...
, referring to the stability and reproducibility of assessment results to verify if the results are accurate and consistent1515 Moser AD de L, Knaut LAM, Zotz TG, Scharan KO. Validade e confiabilidade da versão em português do American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form. Rev Bras Reumatol [Internet]. 2012May;52(3):352–6. Disponível em: https://www.scielo.br/j/rbr/a/qCTJyPWDBSJTR9pDGt3HSXK/,1616 Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use (5 ed.). 2015. Oxford.. The accuracy, which addresses sensitivity and specificity, lies in the instrument's ability to discriminate between diseased and non-diseased individuals and to detect the highest possible number of correct classifications (true positives) while minimizing errors (false positives)1313 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde [Internet]. 2017Jul;26(3):649–59. Disponível em: https://doi.org/10.5123/S1679-49742017000300022.
https://doi.org/10.5123/S1679-4974201700...
,1616 Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use (5 ed.). 2015. Oxford..

Given this need, the aim of the present study was to evaluate the psychometric properties, including validity, reliability, stability, reproducibility, sensitivity, and specificity, of the Brazilian version of the Short Portable Mental Status Questionnaire (SPMSQ-BR) by Pfeiffer.

METHOD

A methodological validation study was conducted in the city of Curitiba (PR), Brazil. The investigation involved a non-probabilistic or convenience sample. Following international recommendations for investigating the psychometric properties of health questionnaires, the sample consisted of 93 individuals aged <60 years. Efforts were made to standardize the groups according to level of education, sex, and place of residence (institutionalized and non-institutionalized), enabling the SPMSQ-BR to be tested in groups with distinct realities and across different aspects, following its original version.

The approach and recruitment process of the older adults were conducted in two stages. Firstly, there was a presentation of the project to the board of directors of the Homes for the Aged (ILPI) to obtain access to the institutionalized older adults. After obtaining authorization and providing clarifications regarding the project, the older adults were invited to sign the Informed Consent Form (ICF). Data collection took place in the location within the institution where they felt most comfortable, respecting their privacy. The same procedure was carried out for participants from Day Centers (non-institutionalized modality, where older adults spend the day with medical and multiprofessional assistance) and for older adults residents who were registered and attended a Community Center in a metropolitan area of Curitiba.

The research participants selected were aged >60 years and had Portuguese as their native language. Individuals with severe uncorrected hearing impairment and severe psychiatric impairment were excluded.

Sociodemographic information was collected using a structured questionnaire to characterize the sample prior to the questionnaire application.

Concurrent and convergent validity were tested using the Spearman-Rank correlation coefficient, which occurs when there is a correlation between the translated instrument compared to the scale of another similar, already constructed and validated measure, considered the gold standard1111 Guillemin, F. Cross-cultural Adaptation and Validation of Heatth Status Measures. Scandinavian Journal of Rheumatology,1995;24(2), 61–63. https://doi.org/10.3109/03009749509099285.
https://doi.org/10.3109/0300974950909928...
,1515 Moser AD de L, Knaut LAM, Zotz TG, Scharan KO. Validade e confiabilidade da versão em português do American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form. Rev Bras Reumatol [Internet]. 2012May;52(3):352–6. Disponível em: https://www.scielo.br/j/rbr/a/qCTJyPWDBSJTR9pDGt3HSXK/.

To test concurrent and convergent validity, the scores obtained with the SPMSQ-BR were correlated with tests considered gold standards. For concurrent validity, the scores from the Brazilian version of the Mini-Mental State Examination (MMSE) were used1717 Brucki SMD, Nitrini R, Caramelli P, Bertolucci PHF, Okamoto IH. Sugestões para o uso do mini-exame do estado mental no Brasil. Arq Neuro-Psiquiatr [Internet]. 2003Sep;61(3B):777–81. Disponível em: https://doi.org/10.1590/S0004-282X2003000500014.
https://doi.org/10.1590/S0004-282X200300...
. For convergent validity, it was correlated with the scores of the Clock Drawing Test (CDT)1818 Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
https://doi.org/10.1590/S0034-8910200800...
and the Verbal Fluency Test (VFT)1919 Teldeschi ALG, Perez M, Sanchez MA, Lourenço RA. O uso de testes de fluência verbal como ferramenta de rastreio cognitivo em idosos. Rev Hosp Univ Pedro Ernesto. 2018;16(1). Disponível em:https://doi.org/10.12957/rhupe.2017.33289.
https://doi.org/10.12957/rhupe.2017.3328...
, whose validity and reliability have already been demonstrated1717 Brucki SMD, Nitrini R, Caramelli P, Bertolucci PHF, Okamoto IH. Sugestões para o uso do mini-exame do estado mental no Brasil. Arq Neuro-Psiquiatr [Internet]. 2003Sep;61(3B):777–81. Disponível em: https://doi.org/10.1590/S0004-282X2003000500014.
https://doi.org/10.1590/S0004-282X200300...
,1818 Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
https://doi.org/10.1590/S0034-8910200800...
,1919 Teldeschi ALG, Perez M, Sanchez MA, Lourenço RA. O uso de testes de fluência verbal como ferramenta de rastreio cognitivo em idosos. Rev Hosp Univ Pedro Ernesto. 2018;16(1). Disponível em:https://doi.org/10.12957/rhupe.2017.33289.
https://doi.org/10.12957/rhupe.2017.3328...
.

The SPMSQ-BR99 Martínez De La Iglesia J, Herrero RD, Vilches MCO, Taberné CA, Colomer CA, Luque RL. Adaptación y validación al castellano del cuestionario de Pfeiffer (SPMSQ) para detectar la existencia de deterioro cognitivo en personas mayores de 65 años. Med Clin (Barc). 2001;117(4):129–34. pp. 129-134, 10.1016/s0025-7753(01)72040-4. comprises ten questions that assess memory, temporal orientation, mathematical ability, and everyday information. Its score ranges from 0 to 10, considering the sum of the errors made by the evaluated individual; the lower the score, the better the cognitive capacity. It allows the classification of the individual into preserved cognitive capacity (0-2 errors), mild cognitive impairment (3-4 errors), moderate impairment (5-7 errors), or severe impairment (8-10 errors), taking into account the individual's level of education.

The MMSE is a cognitive screening test, considered the gold standard. Its composition consists of thirty items, and in the present study, the Brazilian version adapted by Brucki and colleagues1717 Brucki SMD, Nitrini R, Caramelli P, Bertolucci PHF, Okamoto IH. Sugestões para o uso do mini-exame do estado mental no Brasil. Arq Neuro-Psiquiatr [Internet]. 2003Sep;61(3B):777–81. Disponível em: https://doi.org/10.1590/S0004-282X2003000500014.
https://doi.org/10.1590/S0004-282X200300...
was employed. The score ranges from 0 to 30, with higher scores indicating better cognitive capacity in individuals. Cut-off points are also defined based on education level.

In the CDT1818 Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
https://doi.org/10.1590/S0034-8910200800...
, the subject was asked to draw a clock with hands indicating the time as 11:10. The score ranged from 0 (worst) to 5 (best).

In the VFT1919 Teldeschi ALG, Perez M, Sanchez MA, Lourenço RA. O uso de testes de fluência verbal como ferramenta de rastreio cognitivo em idosos. Rev Hosp Univ Pedro Ernesto. 2018;16(1). Disponível em:https://doi.org/10.12957/rhupe.2017.33289.
https://doi.org/10.12957/rhupe.2017.3328...
, participants were required to name as many animals as they could remember in 1 minute without repeating any of them. The test score varies according to the participants' level of education, with a higher number of words indicating better performance on the test.

Validity was examined through the Spearman-Rank correlation coefficient (ρ). To obtain the reliability of the instrument, measures of internal consistency, test-retest reliability, and intra- and inter-rater reproducibility were utilized.

Internal consistency was assessed using Cronbach's α, while intra-rater test-retest stability was analyzed through the Intraclass Correlation Coefficient (ICC). Test-retest inter-rater reproducibility was tested using the Intraclass Correlation Coefficient with a 95% confidence interval (CI95%).

The Receiver Operating Characteristic Curve (ROC Curve) analysis was performed to evaluate the sensitivity and specificity of the Brazilian version of the SPMSQ. This analysis provides the Area Under the Curve (AUC), which establishes a cut-off point on the scale, aiding in the probability of the questionnaire correctly identifying patients with cognitive impairment (true positives) compared to those without cognitive impairment (true negatives) with the estimation of the standard error (SE).

According to the criteria established in the International Classification of Diseases, Tenth Revision (ICD-10) and the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV), geriatricians diagnosed institutionalized older adults with or without dementia based on cognitive screening tests and imaging examinations such as computed tomography and/or magnetic resonance imaging, considered as the reference standard.

The test was run with data from older adults whose access to medical records was obtained (n=51), and through the information, it was verified whether they presented dementia, without detailing the severity (mild, moderate, or severe) or the type (Alzheimer's disease, Lewy bodies, vascular dementia, etc.). The analysis was limited to the presence or absence of cognitive impairment.

The study was conducted after obtaining authorization for the use of the instrument from the Duke University Center for the Study of Aging and Human Development, which holds the copyright for this questionnaire. It was reviewed and approved by the Research Ethics Committee of Pontifícia Universidade Católica do Paraná (PUC-PR) under number 17222319.9.0000.0020 and is in accordance with Resolutions number 466/2012 and number 510/2016 regarding research involving human subjects.

All participants were informed about the study's objectives and signed the Informed Consent Form.

RESULTS

The sample consisted of 93 older adults, with 66.7% being women and 33.3% men, with a mean age of 75.1 years, confidence interval ranging from 73.3 to 76.9, and a standard deviation of 8.83. In terms of educational level, 11.8% were illiterate, 46.2% had completed up to 4 years of schooling, 15.1% had completed 5 to 9 years, 15.1% had completed 9 to 11 years, and 11.8% had completed higher education.

Regarding housing, 51.6% were institutionalized and 48.4% were from the community. As for marital status, singles represented 37.6% of the sample, followed by 24.7% widowed, 21.5% divorced, and 16.1% married.

The validity assessment was conducted by correlating the Brazilian version of the SPMSQ with other questionnaires assessing cognitive function. Concurrent validity was verified by correlating the SPMSQ-BR with the MMSE considered as the 'gold standard', and for convergent validity, the scale was correlated with the CDT and VFT. Table 1 demonstrates the correlations.

Table 1
Concurrent and convergent validity indices of the SPMSQ-BR. Curitiba, PR, 2020.

The correlations conducted with the tests (SPMSQ-BR, MMSE, CDT and VFT) revealed a strong linear relationship. This relationship is negative because the tests are inversely proportional; that is, the lower the value of SPMSQ-BR, the better the cognitive function, whereas the higher the value of the other tests, the better the individual's cognitive performance.

There was a strong linear correlation between SPMSQ-BR and the MMSE (gold standard) at 0.799. However, with the CDT and VFT, moderate linear correlations were observed at 0.584 and 0.569, respectively.

The SPMSQ-BR scale demonstrated good internal consistency, with a Cronbach's Alpha value of 0.803. This indicates that the items of the scale are well-cohesive and consistently measure the same construct.

The importance of each item was verified through the analysis of their individual significance. All items were found to be relevant, as the exclusion of any of them would decrease the Cronbach's Alpha value, indicating that the scale would lose consistency (Table 2).

Table 2
Analysis of Internal Consistency if Item is excluded Curitiba, PR, 2020.

Temporal stability was assessed by comparing the scores obtained between two administrations (test-retest) conducted by the same evaluator (intra-rater), with a seven-day interval, showing excellent correlation (0.977), indicating that the scale is stable, as shown in Table 3.

Table 3
Stability and reproducibility analysis. Curitiba, PR, 2020.

Reproducibility was assessed by comparing the scores obtained from two administrations conducted on the same day by two different evaluators (inter-rater).

Performed through the intraclass correlation coefficient, with a 95% confidence interval, the scale demonstrated reproducibility, showing excellent correlation (0.973), as observed in Table 3.

Accuracy, assessed through the ROC Curve analysis, followed Pfeiffer's proposal, the author of the original questionnaire, which takes into account the level of education. For illiterate older adults, an additional error was allowed, while for those with higher education, one less error was allowed. As a result, the area under the curve was AUC=0.905 (SE=0.04; p<0.01; 95% CI=0.817–0.993). In the analysis disregarding educational level, the curve exhibited an AUC=0.927 (SE=0.03; p<0.01; 95% CI=0.852–1.000). These findings demonstrate that, if chosen randomly, 90 to 92% of clinical cases will present higher scores than non-clinical cases on the SPMSQ-BR. The results revealed statistically significant curves in both cases, which can be observed in Figure 1 and Table 4.

Figure 1
Areas under the ROC curve. Curitiba, PR, 2020.
Table 4
Sensitivity and specificity of the SPMSQ-BR according to the cutoff point. Curitiba, PR, 2020.

The curves in Figure 1 demonstrate that the closer the results are to the upper left corner of the graph, the higher the sensitivity and the lower the proportion of false positives, indicating that the test is accurate in both scenarios.

The best parameters of sensitivity and specificity are achieved with a cutoff point of 3 or more errors, as seen in Table 4.

DISCUSSION

Recent experiences with the SPMSQ demonstrate its efficacy as a screening tool and for monitoring clinical outcomes1919 Teldeschi ALG, Perez M, Sanchez MA, Lourenço RA. O uso de testes de fluência verbal como ferramenta de rastreio cognitivo em idosos. Rev Hosp Univ Pedro Ernesto. 2018;16(1). Disponível em:https://doi.org/10.12957/rhupe.2017.33289.
https://doi.org/10.12957/rhupe.2017.3328...
,2020 Liu C-L, Chuang C-J, Chou C-M. A Pilot Fuzzy System with Virtual Reality for Mild Cognitive Impairment (MCI) Assessment. Healthcare [Internet]. 2023;11(18):1–27. Disponível em: https://www.mdpi.com/2227-9032/11/18/2503.,2121 Yang, TI., Kuo, YJ., Huang, SW. et al. Minimal short-term decline in functional performance and quality of life predicts better long-term outcomes for both in older Taiwanese adults after hip fracture surgery: a prospective study. J Orthop Surg Res 18, 791 (2023). https://doi.org/10.1186/s13018-023-04278-3.
https://doi.org/10.1186/s13018-023-04278...
. A study conducted in Israel analyzed the impact of sedative medications on the cognition of hospitalized older adults who were cognitively intact upon admission2222 Smichenko J, Gil E, Zisberg A. Relationship between Changes in Sedative Hypnotic Medications Burden and Cognitive Outcomes in Hospitalized Older Adults. The Journals of Gerontology. Journals Gerontol. 2020;A(015). Disponível em: https://doi.org/10.1093/gerona/glaa015.
https://doi.org/10.1093/gerona/glaa015...
, using the SPMSQ. The study concluded that sedative burden is an important risk factor for acquired cognitive decline in the hospital. This identification will also help in Brazil to monitor older adults with a potential increase in sedative burden and assist in the design of interventions to reduce the risk of cognitive decline during hospitalization.

In another study conducted in Germany by Schönstein et al.2323 Schönstein A, Wahl HW, Katus HA, Bahrmann A. SPMSQ for risk stratification of older patients in the emergency department : An exploratory prospective cohort study. Z Gerontol Geriatr. 2019 Nov;52(Suppl 4):222-228. doi: 10.1007/s00391-019-01626-z., the SPMSQ was used for risk stratification in older adult patients in the emergency department. The results showed that it alone is not a precise tool for stratification, however, the findings demonstrated that the SPMSQ is a significant predictor of long-term adverse outcomes. Despite its limitations, it is worth noting that the SPMSQ is used in various studies as a screening instrument for inclusion and exclusion criteria in research, such as the study by Sri-on et al.2424 Sri-on, J., Vanichkulbodee, A., Sinsuwan, N. et al. Disaster preparedness among Thai elderly emergency department patients: a survey of patients’ perspective. BMC Emerg Med 19, 58 (2019). https://doi.org/10.1186/s12873-019-0269-7
https://doi.org/10.1186/s12873-019-0269-...
conducted in Thailand.

Recently, the SPMSQ was validated in Iran2525 kojaie-Bidgoli, A., Fadayevatan, R., Sharifi, F., Alizadeh-Khoei, M., Vahabi, Z., & Aminalroaya, R. Applicability of SPMSQ in illiterate outpatients in clinics: The validity and reliability of the Short Portable Mental Status Questionnaire. Applied Neuropsychology: Adult, 2022;29(4), 591–597. https://doi.org/10.1080/23279095.2020.1792909
https://doi.org/10.1080/23279095.2020.17...
. The SPMSQ is used in various countries; however, some do not mention whether the scale has been adapted or validated for the specific country. An example is the study by Ferruci et al.2626 Ferrucci L, Guralnik JM, Corti MC, Pahor M, Havlik D. Cognitive impairment and risk of stroke in the older population-Reply. J Am Geriatr Soc. 1996;44(11):1411–7., conducted in Italy, prospectively involving 5,024 individuals who were followed for three years to assess the association between cognitive impairment (using the SPMSQ) and the risk of cerebrovascular accident (CVA), independently of other risk factors. The study concluded that the incidence of CVA was lower in those with normal scores and higher in those with severe impairment.

Despite its relevance, the authors of the mentioned study conducted in Italy relied on the original scale and its validation for the American population. However, they made significant alterations, such as excluding question 3 and adapting the final scoring, without providing adequate justification, which may have compromised the reliability of the results.

For the aforementioned reasons, proper cross-cultural adaptation and validation are essential to demonstrate the evidence-based power of the instrument and determine whether it is suitable for use in the adapted cultural context, as well as whether it meets its proposed objectives1313 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde [Internet]. 2017Jul;26(3):649–59. Disponível em: https://doi.org/10.5123/S1679-49742017000300022.
https://doi.org/10.5123/S1679-4974201700...
. Validation requires the demonstration of robust psychometric characteristics for the acceptance and application of a new cognitive test1414 Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades Psicométricas de Instrumentos de Medidas: Bases Conceituais e Métodos de Avaliação - PARTE I. Texto contexto - enferm [Internet]. 2017;26(4). Disponível em: https://doi.org/10.1590/0104-07072017001600017.
https://doi.org/10.1590/0104-07072017001...
.

With the scale already translated and adapted for Brazil99 Martínez De La Iglesia J, Herrero RD, Vilches MCO, Taberné CA, Colomer CA, Luque RL. Adaptación y validación al castellano del cuestionario de Pfeiffer (SPMSQ) para detectar la existencia de deterioro cognitivo en personas mayores de 65 años. Med Clin (Barc). 2001;117(4):129–34. pp. 129-134, 10.1016/s0025-7753(01)72040-4., the same criteria used in the creation of the instrument by Pfeiffer88 Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41. were employed for validation, following rigorous methodological standards.

In the validation sample, there was a predominance of women, a phenomenon that may be related to the phenomenon known as the feminization of aging, where there is a higher proportion of women than men in the older population, especially at older ages2727 Cepellos VM. Feminization of Aging: a Multifaceted Phenomenon Beyond the Numbers. RAE Rev Adm Empres. 2021;61(2):1–7. e20190861. Disponível em: https://doi.org/10.1590/S0034-759020210208.
https://doi.org/10.1590/S0034-7590202102...
, and the majority had low formal education.

For the concurrent validity analysis, the correlation with the MMSE, considered the gold standard, was calculated. A strong significant and inversely proportional linear correlation was observed (r=-0.799, p<0.001), a finding that corroborated with the validation of the SPMSQ in Singapore (r=-0.814, p<0.001) and in Spain (r=-0.738, p<0.001), which also correlated it with the MMSE and showed results similar to the findings of the present study1010 Teigão, F. C. M., Moser, A. D. de L., & Jerez-Roig, J. (2020). Tradução e adaptação transcultural do Short Portable Mental Status Questionnaire (SPMSQ) de Pfeiffer para pessoas idosas brasileiras. Revista Brasileira de Geriatria e Gerontologia, 2020;23(4). Disponível em: https://doi.org/10.1590/1981-22562020023.200128.
https://doi.org/10.1590/1981-22562020023...
,2828 Malhotra C, Chan A, Matchar D, Seow D, Chuo A, Do YK. Diagnostic performance of Short Portable Mental Status Questionnaire for screening dementia among patients attending cognitive assessment clinics in Singapore. Ann Acad Med Singapore. 2013;42(7):315–9. Disponível em: https://hdl.handle.net/10161/22889..

Convergent validity was analyzed through the correlation between SPMSQ-BR scores and the CDT and VFT tests, which also measure cognitive issues but in other dimensions. The obtained results showed significant moderately inversely proportional relationships (-0.584, p<0.001) and (-0.569, p<0.001) respectively.

In the validation study of the CDT for the Brazilian context, it was also correlated with the MMSE, obtaining a moderate relationship of 0.464 when compared1818 Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
https://doi.org/10.1590/S0034-8910200800...
. In a study conducted in Japan on the validity and reliability of the Japanese version of the Dementia Behavior Disturbance Scale (DBD Scale), the SPMSQ was used for convergent validity, with the obtained correlation data also showing moderate correlation of 0.54 (p<0.001)2929 Mizoguchi T, Iijima S, Eto F, Ishizuka A, Orimo H. Reliability and validity of a Japanese version of the Dementia Behavior Disturbance Scale]. Nihon Ronen Igakkai zasshi. Japanese Journal of Geriatrics. 1993 Oct;30(10):835-840. DOI: 10.3143/geriatrics.30.835. PMID: 8301854.. A moderate correlation was also found in the SPMSQ-SV (Spanish version) when compared to the Informant Questionnaire on Cognitive Decline in the Elderly (S-IQCODE) with 0.578 (p<0.001)1010 Teigão, F. C. M., Moser, A. D. de L., & Jerez-Roig, J. (2020). Tradução e adaptação transcultural do Short Portable Mental Status Questionnaire (SPMSQ) de Pfeiffer para pessoas idosas brasileiras. Revista Brasileira de Geriatria e Gerontologia, 2020;23(4). Disponível em: https://doi.org/10.1590/1981-22562020023.200128.
https://doi.org/10.1590/1981-22562020023...
.

The internal consistency of the scale was highly satisfactory (α= 0.803), such that if any item were excluded, its value would decrease. According to Streiner et al.1616 Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use (5 ed.). 2015. Oxford., alpha values above 0.90 indicate item content duplication, which points more towards redundancy rather than homogeneity. Similarly, the Iranian and Spanish versions of the SPMSQ demonstrated good internal consistency (α=0.880) and (α=0.824) respectively, a value similar to that found in the present study. This means that all items of the construct correspond to its measure.

In intra-rater stability, a coefficient of r=0.977 was obtained, indicating that the rating in the first application was very close to that in the second application. Kanter and Mosquera3030 Flores Kanter PE, Mosquera M. Aportes para la Promoción de mayor Transparencia en los Estudios Psicométricos. PSIQUEMAG/ Rev Científica Digit Psicol. 2022;11(2):14–21. Disponível em: https://doi.org/10.18050/psiquemag.v11i2.2064.
https://doi.org/10.18050/psiquemag.v11i2...
state that the correlation coefficient expresses the level of relationship between two events; the closer it is to a positive 1, the higher the correspondence. These values were similar to those found in the Spanish version (0.925)1010 Teigão, F. C. M., Moser, A. D. de L., & Jerez-Roig, J. (2020). Tradução e adaptação transcultural do Short Portable Mental Status Questionnaire (SPMSQ) de Pfeiffer para pessoas idosas brasileiras. Revista Brasileira de Geriatria e Gerontologia, 2020;23(4). Disponível em: https://doi.org/10.1590/1981-22562020023.200128.
https://doi.org/10.1590/1981-22562020023...
.

The literature recommends that the stability of a test be verified between 7 and 14 days after its first application1313 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde [Internet]. 2017Jul;26(3):649–59. Disponível em: https://doi.org/10.5123/S1679-49742017000300022.
https://doi.org/10.5123/S1679-4974201700...
. The original version tested stability after 4 weeks and obtained a good result (0.83)88 Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41., with similar results in China after 5 weeks (0.70). However, these values are lower than those found in the present study (0.97). This difference can be explained by changes in the participants' mood, which can be influenced by events occurring between the two applications, as well as the fact that participants may acquire new knowledge during this period, which can affect their results. The longer the period between applications, the higher the likelihood of these occurrences1414 Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades Psicométricas de Instrumentos de Medidas: Bases Conceituais e Métodos de Avaliação - PARTE I. Texto contexto - enferm [Internet]. 2017;26(4). Disponível em: https://doi.org/10.1590/0104-07072017001600017.
https://doi.org/10.1590/0104-07072017001...
.

Inter-rater reproducibility demonstrated excellent reproducibility (r=0.973), higher than that found in the Spanish version (0.734)1010 Teigão, F. C. M., Moser, A. D. de L., & Jerez-Roig, J. (2020). Tradução e adaptação transcultural do Short Portable Mental Status Questionnaire (SPMSQ) de Pfeiffer para pessoas idosas brasileiras. Revista Brasileira de Geriatria e Gerontologia, 2020;23(4). Disponível em: https://doi.org/10.1590/1981-22562020023.200128.
https://doi.org/10.1590/1981-22562020023...
.

The ROC curve analyses of the SPMSQ-BR indicated that the test has good ability to discriminate between older adults with and without cognitive impairment, revealing good sensitivity and specificity. The best parameters were obtained for a cut-off point of 3 or more errors (S=81.3%-87.5%) and (E=76.9%-80.8%), values similar to those observed in Pfeiffer's original validation88 Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41. (S=87.5%-92.3%) and (E=72.2%-81.9%) and in the validation conducted in Finland3131 Erkinjuntti T et al. Short Portable Mental Status Questionnaire as a screening test for dementia and delirium among the elderly. J Am Geriatr Soc. 1987;35(5):412–6. Disponível em:https://doi.org/10.1111/j.1532-5415.1987.tb04662.x.
https://doi.org/10.1111/j.1532-5415.1987...
(S=66.7%-86.2%) and (E=99.0%-100%).

The aforementioned study conducted in Finland3131 Erkinjuntti T et al. Short Portable Mental Status Questionnaire as a screening test for dementia and delirium among the elderly. J Am Geriatr Soc. 1987;35(5):412–6. Disponível em:https://doi.org/10.1111/j.1532-5415.1987.tb04662.x.
https://doi.org/10.1111/j.1532-5415.1987...
aimed to assess the SPMSQ's ability to differentiate between patients with dementia and delirium. The test showed good sensitivity and specificity in identifying dementia with a cut-off point of 3 errors, proving to be sensitive in both community-dwelling individuals and hospitalized older adults, consistent with the findings of the present study. In the same study, the validity of the SPMSQ for delirium was lower than for dementia, due to the variable nature of the clinical picture of delirium. The optimal cut-off point was found to be 2 errors.

In the Singapore study2828 Malhotra C, Chan A, Matchar D, Seow D, Chuo A, Do YK. Diagnostic performance of Short Portable Mental Status Questionnaire for screening dementia among patients attending cognitive assessment clinics in Singapore. Ann Acad Med Singapore. 2013;42(7):315–9. Disponível em: https://hdl.handle.net/10161/22889., the cut-off point was 5 or more errors (S=78%, E=75%). Meanwhile, in the Iranian validation2525 kojaie-Bidgoli, A., Fadayevatan, R., Sharifi, F., Alizadeh-Khoei, M., Vahabi, Z., & Aminalroaya, R. Applicability of SPMSQ in illiterate outpatients in clinics: The validity and reliability of the Short Portable Mental Status Questionnaire. Applied Neuropsychology: Adult, 2022;29(4), 591–597. https://doi.org/10.1080/23279095.2020.1792909
https://doi.org/10.1080/23279095.2020.17...
, the cut-off point was determined based on educational level, with 4 errors for illiterate older adults (S=86%, E=88%) and 3 errors for literate older adults (S=83%, E=93.7%).

These studies demonstrate that education level is an important factor, and the ideal cut-off point may vary according to the population and the study's objectives. Therefore, appropriate selection is necessary to avoid errors in obtaining false positive and false negative results.

The association between low education level and dementia processes has been the focus of research since the 1970s. During this time, a study conducted at the St. Luke Medical Center in Chicago (United States of America), with 642 older adults, revealed that each year of formal education could reduce the risk of developing Alzheimer's disease by up to 17%3232 Marx J. Neuroscience. Preventing Alzheimer’s: a lifelong commitment? Science (80- ). 2005;309(5736):864–6. Disponível em: DOI: 10.1126/ciência.309.5736.864., a topic that has been the subject of much current research.

A prospective cohort study with 2,458 participants from various states in the United States demonstrated that low education level is directly related to a higher incidence of dementia3333 Kaup AR, Simonsick EM, Harris TB, Satterfield S, Metti AL, Ayonayon HN, et al. Older adults with limited literacy are at increased risk for likely dementia. Journals Gerontol - Ser A Biol Sci Med Sci. 2014;69(7):900–6.Disponível em: https://doi.org/10.1093/gerona/glt176
https://doi.org/10.1093/gerona/glt176...
.

The MMSE itself is influenced by education level, as higher educational attainment is associated with better scores on the test1818 Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
https://doi.org/10.1590/S0034-8910200800...
. For this reason, some authors also suggest differentiating scores for educated and illiterate older adults, establishing distinct cut-off points1818 Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
https://doi.org/10.1590/S0034-8910200800...
,3434 Scarabelot LF, Monteiro M de M, Rubert MC da S, Zetola V de HF. Is the Mini-Mental State Examination the best cognitive screening test for less educated people?. Arq Neuro-Psiquiatr [Internet]. 2019May;77(5):330–4. Disponível em: https://doi.org/10.1590/0004-282X20190043.
https://doi.org/10.1590/0004-282X2019004...
.

Within the clinical practice, it is proposed to conduct an initial assessment of the older adult. This assessment should provide a baseline measure for monitoring cognitive function and, when necessary, alert to the need for further investigation. The SPMSQ-BR emerges as a valuable tool that meets this need.

The scale can be accessed through your article on translation and cross-cultural adaptation99 Martínez De La Iglesia J, Herrero RD, Vilches MCO, Taberné CA, Colomer CA, Luque RL. Adaptación y validación al castellano del cuestionario de Pfeiffer (SPMSQ) para detectar la existencia de deterioro cognitivo en personas mayores de 65 años. Med Clin (Barc). 2001;117(4):129–34. pp. 129-134, 10.1016/s0025-7753(01)72040-4..

A limitation to be mentioned, also found in the study by Ferreira et al3535 Ferreira M de FAP, Pinto M do RP. Tradução, adaptação e validação para a língua portuguesa da escala Chelsea Crítical Care Physical Assessment. Rev Port Enf Reab [Internet]. 5 de Fevereiro de 2024 de 2024];7(1):e363. Disponível em: https://rper.aper.pt/index.php/rper/article/view/363, is that the sample was collected in the southern region. Considering the dimensions of Brazil, it would be important to analyze the influence of different cultures on the performance of the Brief Cognitive Capacity Scale (SPMSQ-BR), compare the results from different regions, and consider variables such as education level, type of dementia, and its severity. This information could confirm the instrument's unidimensionality.

The SPMSQ-BR is not a tool for the definitive diagnosis of dementia. Its primary function is to serve as an indicator of possible cognitive impairments, requiring further assessment to confirm a diagnosis.

CONCLUSION

The process of evaluation and analysis of the psychometric properties of the Brazilian version of the Short Portable Mental Status Questionnaire (SPMSQ-BR) demonstrated that the scale is consistent, stable, reproducible, valid, and reliable in assessing cognitive impairment in older adults.

The SPMSQ-BR will contribute to healthcare professionals and the scientific community as another valid and reliable assessment tool. It can be utilized in clinical trials, international comparisons, and support screening, planning, and monitoring of cognitive function treatment in older adults.

  • Funding: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) - Brasil
  • DATA AVAILABILITY

    The entire dataset supporting the results of this study has been made available on Figshare and can be accessed at 10.6084/m9.figshare.25669545.

REFERÊNCIAS

  • 1
    Rougemont F. Redefining the passage of time: lifestyle and longevity. Rev bras geriatr gerontol [Internet]. 2018 Nov;21(6):645–6. Disponível em: https://doi.org/10.1590/1981-22562018021.180218.
    » https://doi.org/10.1590/1981-22562018021.180218
  • 2
    Souza GA de, Giacomin KC, Firmo JOA. A necessidade de cuidado na percepção de pessoas idosas em processo de fragilização. Cad saúde colet [Internet]. 2022 Oct;30(4):486–95. Disponível em: https://doi.org/10.1590/1414-462X202230040506.
    » https://doi.org/10.1590/1414-462X202230040506
  • 3
    Sánchez CZ, Sanabria MOC, Sánchez MZ, López PAC, Sanabria MS, Hernández SH, et al. Prevalencia de demencia en adultos mayores de América Latina: revisión sistemática. Rev Esp Geriatr Gerontol. 2019;54(6):346–55. Disponível em: https://doi.org/10.1016/j.regg.2018.12.007.
    » https://doi.org/10.1016/j.regg.2018.12.007
  • 4
    Duran-Badillo T, Salazar-González BC, Cruz-Quevedo JE, Sánchez-Alej EJ, Gutierrez-Sanchez G, Hernández-Cortés PL. Função sensorial, cognitiva, capacidade de caminhar e funcionalidade de idosos. Rev Latino-Am Enferm. 2020;28. Disponível em:https://doi.org/10.1590/1518-8345.3499.3282.
    » https://doi.org/10.1590/1518-8345.3499.3282
  • 5
    Dias, L. B., Castiglioni, L., Tognola, W. A., & Bianchin, M. A. (2018). Sobrecarga no cuidado de paciente idoso com demência. Revista Kairós-Gerontologia, 2018; 21(1), 169–190. https://doi.org/10.23925/2176-901X.2018v21i1p169-190.
    » https://doi.org/10.23925/2176-901X.2018v21i1p169-190
  • 6
    Balsinha, C., Gonçalves-Pereira, M., Iliffe, S., Freitas, J.A., Grave, J. Health-Care Delivery for Older People with Dementia in Primary Care. In: de Mendonça Lima, C., Ivbijaro, G. (eds) Primary Care Mental Health in Older People 2019;311–29. Disponível em: https://doi.org/10.1007/978-3-030-10814-4_23.
    » https://doi.org/10.1007/978-3-030-10814-4_23
  • 7
    Martins NIM, Caldas PR, Cabral ED, Lins CCSA, Coriolano MGWS. Cognitive assessment instruments used in elderly Brazilians in the last five years. Ciênc Saúde Coletiva. 2019;24(7):2513-30. https://doi.org/10.1590/1413-81232018247.20862017.
    » https://doi.org/10.1590/1413-81232018247.20862017
  • 8
    Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433–41.
  • 9
    Martínez De La Iglesia J, Herrero RD, Vilches MCO, Taberné CA, Colomer CA, Luque RL. Adaptación y validación al castellano del cuestionario de Pfeiffer (SPMSQ) para detectar la existencia de deterioro cognitivo en personas mayores de 65 años. Med Clin (Barc). 2001;117(4):129–34. pp. 129-134, 10.1016/s0025-7753(01)72040-4.
  • 10
    Teigão, F. C. M., Moser, A. D. de L., & Jerez-Roig, J. (2020). Tradução e adaptação transcultural do Short Portable Mental Status Questionnaire (SPMSQ) de Pfeiffer para pessoas idosas brasileiras. Revista Brasileira de Geriatria e Gerontologia, 2020;23(4). Disponível em: https://doi.org/10.1590/1981-22562020023.200128.
    » https://doi.org/10.1590/1981-22562020023.200128
  • 11
    Guillemin, F. Cross-cultural Adaptation and Validation of Heatth Status Measures. Scandinavian Journal of Rheumatology,1995;24(2), 61–63. https://doi.org/10.3109/03009749509099285.
    » https://doi.org/10.3109/03009749509099285
  • 12
    Lino CR de M, Brüggemann OM, Souza M de L de, Barbosa S de FF, Santos EKA dos. Adaptação Transcultural de Instrumentos de Pesquisa Conduzida pela Enfermagem do Brasil: Uma Revisão Integrativa. Texto contexto - enferm [Internet]. 2017;26(4). Disponível em: https://doi.org/10.1590/0104-07072017001730017.
    » https://doi.org/10.1590/0104-07072017001730017
  • 13
    Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol Serv Saúde [Internet]. 2017Jul;26(3):649–59. Disponível em: https://doi.org/10.5123/S1679-49742017000300022.
    » https://doi.org/10.5123/S1679-49742017000300022
  • 14
    Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades Psicométricas de Instrumentos de Medidas: Bases Conceituais e Métodos de Avaliação - PARTE I. Texto contexto - enferm [Internet]. 2017;26(4). Disponível em: https://doi.org/10.1590/0104-07072017001600017.
    » https://doi.org/10.1590/0104-07072017001600017
  • 15
    Moser AD de L, Knaut LAM, Zotz TG, Scharan KO. Validade e confiabilidade da versão em português do American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form. Rev Bras Reumatol [Internet]. 2012May;52(3):352–6. Disponível em: https://www.scielo.br/j/rbr/a/qCTJyPWDBSJTR9pDGt3HSXK/
  • 16
    Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use (5 ed.). 2015. Oxford.
  • 17
    Brucki SMD, Nitrini R, Caramelli P, Bertolucci PHF, Okamoto IH. Sugestões para o uso do mini-exame do estado mental no Brasil. Arq Neuro-Psiquiatr [Internet]. 2003Sep;61(3B):777–81. Disponível em: https://doi.org/10.1590/S0004-282X2003000500014.
    » https://doi.org/10.1590/S0004-282X2003000500014
  • 18
    Atalaia-Silva KC, Lourenço RA. Tradução, adaptação e validação de construto do Teste do Relógio aplicado entre idosos no Brasil. Rev Saúde Pública [Internet]. 2008Oct;42(5):930–7. Disponível em: https://doi.org/10.1590/S0034-89102008000500020.
    » https://doi.org/10.1590/S0034-89102008000500020
  • 19
    Teldeschi ALG, Perez M, Sanchez MA, Lourenço RA. O uso de testes de fluência verbal como ferramenta de rastreio cognitivo em idosos. Rev Hosp Univ Pedro Ernesto. 2018;16(1). Disponível em:https://doi.org/10.12957/rhupe.2017.33289.
    » https://doi.org/10.12957/rhupe.2017.33289
  • 20
    Liu C-L, Chuang C-J, Chou C-M. A Pilot Fuzzy System with Virtual Reality for Mild Cognitive Impairment (MCI) Assessment. Healthcare [Internet]. 2023;11(18):1–27. Disponível em: https://www.mdpi.com/2227-9032/11/18/2503.
  • 21
    Yang, TI., Kuo, YJ., Huang, SW. et al. Minimal short-term decline in functional performance and quality of life predicts better long-term outcomes for both in older Taiwanese adults after hip fracture surgery: a prospective study. J Orthop Surg Res 18, 791 (2023). https://doi.org/10.1186/s13018-023-04278-3.
    » https://doi.org/10.1186/s13018-023-04278-3
  • 22
    Smichenko J, Gil E, Zisberg A. Relationship between Changes in Sedative Hypnotic Medications Burden and Cognitive Outcomes in Hospitalized Older Adults. The Journals of Gerontology. Journals Gerontol. 2020;A(015). Disponível em: https://doi.org/10.1093/gerona/glaa015.
    » https://doi.org/10.1093/gerona/glaa015
  • 23
    Schönstein A, Wahl HW, Katus HA, Bahrmann A. SPMSQ for risk stratification of older patients in the emergency department : An exploratory prospective cohort study. Z Gerontol Geriatr. 2019 Nov;52(Suppl 4):222-228. doi: 10.1007/s00391-019-01626-z.
  • 24
    Sri-on, J., Vanichkulbodee, A., Sinsuwan, N. et al. Disaster preparedness among Thai elderly emergency department patients: a survey of patients’ perspective. BMC Emerg Med 19, 58 (2019). https://doi.org/10.1186/s12873-019-0269-7
    » https://doi.org/10.1186/s12873-019-0269-7
  • 25
    kojaie-Bidgoli, A., Fadayevatan, R., Sharifi, F., Alizadeh-Khoei, M., Vahabi, Z., & Aminalroaya, R. Applicability of SPMSQ in illiterate outpatients in clinics: The validity and reliability of the Short Portable Mental Status Questionnaire. Applied Neuropsychology: Adult, 2022;29(4), 591–597. https://doi.org/10.1080/23279095.2020.1792909
    » https://doi.org/10.1080/23279095.2020.1792909
  • 26
    Ferrucci L, Guralnik JM, Corti MC, Pahor M, Havlik D. Cognitive impairment and risk of stroke in the older population-Reply. J Am Geriatr Soc. 1996;44(11):1411–7.
  • 27
    Cepellos VM. Feminization of Aging: a Multifaceted Phenomenon Beyond the Numbers. RAE Rev Adm Empres. 2021;61(2):1–7. e20190861. Disponível em: https://doi.org/10.1590/S0034-759020210208.
    » https://doi.org/10.1590/S0034-759020210208
  • 28
    Malhotra C, Chan A, Matchar D, Seow D, Chuo A, Do YK. Diagnostic performance of Short Portable Mental Status Questionnaire for screening dementia among patients attending cognitive assessment clinics in Singapore. Ann Acad Med Singapore. 2013;42(7):315–9. Disponível em: https://hdl.handle.net/10161/22889.
  • 29
    Mizoguchi T, Iijima S, Eto F, Ishizuka A, Orimo H. Reliability and validity of a Japanese version of the Dementia Behavior Disturbance Scale]. Nihon Ronen Igakkai zasshi. Japanese Journal of Geriatrics. 1993 Oct;30(10):835-840. DOI: 10.3143/geriatrics.30.835. PMID: 8301854.
  • 30
    Flores Kanter PE, Mosquera M. Aportes para la Promoción de mayor Transparencia en los Estudios Psicométricos. PSIQUEMAG/ Rev Científica Digit Psicol. 2022;11(2):14–21. Disponível em: https://doi.org/10.18050/psiquemag.v11i2.2064.
    » https://doi.org/10.18050/psiquemag.v11i2.2064
  • 31
    Erkinjuntti T et al. Short Portable Mental Status Questionnaire as a screening test for dementia and delirium among the elderly. J Am Geriatr Soc. 1987;35(5):412–6. Disponível em:https://doi.org/10.1111/j.1532-5415.1987.tb04662.x.
    » https://doi.org/10.1111/j.1532-5415.1987.tb04662.x
  • 32
    Marx J. Neuroscience. Preventing Alzheimer’s: a lifelong commitment? Science (80- ). 2005;309(5736):864–6. Disponível em: DOI: 10.1126/ciência.309.5736.864.
  • 33
    Kaup AR, Simonsick EM, Harris TB, Satterfield S, Metti AL, Ayonayon HN, et al. Older adults with limited literacy are at increased risk for likely dementia. Journals Gerontol - Ser A Biol Sci Med Sci. 2014;69(7):900–6.Disponível em: https://doi.org/10.1093/gerona/glt176
    » https://doi.org/10.1093/gerona/glt176
  • 34
    Scarabelot LF, Monteiro M de M, Rubert MC da S, Zetola V de HF. Is the Mini-Mental State Examination the best cognitive screening test for less educated people?. Arq Neuro-Psiquiatr [Internet]. 2019May;77(5):330–4. Disponível em: https://doi.org/10.1590/0004-282X20190043.
    » https://doi.org/10.1590/0004-282X20190043
  • 35
    Ferreira M de FAP, Pinto M do RP. Tradução, adaptação e validação para a língua portuguesa da escala Chelsea Crítical Care Physical Assessment. Rev Port Enf Reab [Internet]. 5 de Fevereiro de 2024 de 2024];7(1):e363. Disponível em: https://rper.aper.pt/index.php/rper/article/view/363

Edited by

Edited by: Camila Alves dos Santos

Data availability

The entire dataset supporting the results of this study has been made available on Figshare and can be accessed at 10.6084/m9.figshare.25669545.

Publication Dates

  • Publication in this collection
    08 July 2024
  • Date of issue
    2024

History

  • Received
    05 Dec 2023
  • Accepted
    30 Apr 2024
Universidade do Estado do Rio Janeiro Rua São Francisco Xavier, 524 - Bloco F, 20559-900 Rio de Janeiro - RJ Brasil, Tel.: (55 21) 2334-0168 - Rio de Janeiro - RJ - Brazil
E-mail: revistabgg@gmail.com