ABSTRACT
Objective
To assess the test-retest reliability of the Memorial Symptom Assessment Scale translated and culturally adapted into Brazilian Portuguese.
Methods
The scale was applied in an interview format for 190 patients with various cancers type hospitalized in clinical and surgical sectors of the Instituto Nacional de Câncer José de Alencar Gomes da Silva and reapplied in 58 patients. Data from the test-retest were double typed into a Microsoft Excel spreadsheet and analyzed by the weighted Kappa.
Results
The reliability of the scale was satisfactory in test-retest. The weighted Kappa values obtained for each scale item had to be adequate, the largest item was 0.96 and the lowest was 0.69. The Kappa subscale was also evaluated and values were 0.84 for high frequency physic symptoms, 0.81 for low frequency physical symptoms, 0.81 for psychological symptoms, and 0.78 for Global Distress Index.
Conclusion
High level of reliability estimated suggests that the process of measurement of Memorial Symptom Assessment Scale aspects was adequate.
Neoplasms; Symptom assessment; Validation studies; Reproducibility of results; Scales
RESUMO
Objetivo
Avaliar a confiabilidade teste-reteste da versão traduzida e adaptada culturalmente para o português do Brasil do Memorial Symptom Assessment Scale.
Métodos
A escala foi aplicada em forma de entrevista em 190 pacientes com diversos tipos de câncer internados nos setores clínicos e cirúrgicos do Instituto Nacional de Câncer José de Alencar Gomes da Silva e reaplicada em 58 pacientes. Os dados dos testes-retestes foram inseridos num banco de dados por dupla digitação independente em Excel e analisados pelo Kappa ponderado.
Resultados
A confiabilidade da escala mostrou-se satisfatória nos testes-retestes. Os valores do Kappa ponderado obtidos para cada item da escala apresentaram-se adequados, sendo o maior item de 0,96 e o menor de 0,69. Também se avaliou o Kappa das subescalas, sendo de 0,84 para sintomas físicos de alta frequência, de 0,81 para sintomas físicos de baixa frequência, de 0,81 também para sintomas psicológicos, e de 0,78 para Índice Geral de Sofrimento.
Conclusão
Altos níveis de confiabilidade estimados permitem concluir que o processo de aferição dos itens do Memorial Symptom Assessment Scale foi adequado.
Neoplasias; Avaliação de sintomas; Estudos de validação; Reprodutibilidade dos testes; Escalas
INTRODUCTION
Symptoms are multidimensional experiences that include perception of frequency, intensity, distress and meaning of its occurrence and expression. A symptom can influence in the occurrence and meaning of other symptoms.11. Armstrong TS, Cohen MZ, Eriksen LR, Hickey JV. Symptom clusters in oncology patients and implications for symptom research in people with primary brain tumors. J Nurs Scholarsh. 2004;36(3):197-206. Review.
When three or more symptoms occur concomitantly (e.g., pain, fatigue, sleeping disorders, nausea, vomiting, and loss of appetite) they are associated and called a (cluster symptoms). These symptoms can be an side effect in development of the patient and they may cause a synergic effect, such as predictor of patient’s morbidity.22. Dodd MJ, Miaskowski C, Lee KA. Occurrence of symptom clusters. J Natl Cancer Inst Monogr. 2004(32):76-8. Review.
Cancer is not a single disease, but a set of more than a hundred of different diseases.33. Brasil. Ministério da Saúde. Instituto Nacional de Câncer José Alencar Gomes da Silva (INCA). ABC do câncer: abordagens básicas para o controle do câncer. 2a ed. rev. e atual. Rio de Janeiro: INCA; 2012. When the concept of group of diseases is established, the cancer becomes responsible to produce a variety of symptoms because of its complexity.
Malignant neoplasms is the second cause of death in the world and, according to perspectives, they should be considered the first cause of death in Brazil by 2020.44. Chammas R. Biologia do câncer. In: Hoff P, editor. Tratado de oncologia. São Paulo: Atheneu; 2013. p. 3-8. Based on statistics of the Brazilian National Cancer Institute (INCA - Instituto Nacional de Câncer José de Alencar Gomes da Silva), approximately 596,000 cancer cases were expected in 2016 among Brazilian population.55. Brasil. Ministério da Saúde. Instituto Nacional de Câncer José Alencar Gomes da Silva (INCA). Estimativa 2016: incidência de câncer no Brasil [Internet]. Rio de Janeiro: INCA; 2015 [citado 2016 Fev 7]. Disponível em: http://www.inca.gov.br/estimativa/2016/estimativa-2016-v11.pdf
http://www.inca.gov.br/estimativa/2016/e...
Malignant neoplasms are able to generate important physical and psychosocial changes, mainly because of appearance of symptoms that can be intensified along with development process of the disease. Inpatients with cancer have symptoms that vary in terms of severity, frequency and duration.66. Pelaez Dóro M, Pasquini R, Medeiros CR, Bitencourt MA, Moura GL. The cancer and its symbolic representation. Psicol Ciênc Prof. 2004;24(2):120-34. Factors such as prevalence, intensity, and perception of symptoms impact life activities and they also present high variability among patients and are strongly influence by the disease itself and toxicity from the treatment.77. Ferreira KA, William Jr WN, Mendonza TR, Kimura M, Kowalski LP, Rosenthal DI, et al. Translation of the M.D. Anderson Symptom Inventory - head and neck module (MDASI-H&N) to Brazilian Portuguese. Rev Bras Cir Cabeça Pescoço. 2008;37(2):109-13. Symptoms evaluation constitutes, therefore, a challenge, because of evolution pathway and complex relation between the disease and symptoms.88. Kirkova J, Walsh D, Aktas A, Davis MP. Cancer symptom clusters: old concept but new data. Am J Hosp Palliat Care. 2010;27(4):282-8.
Each symptoms in oncology constitutes a dynamic phenomenon and, for this reason, symptoms should be always reevaluated in order to control intercurrences, and to provide relief and comfort to the patient.99. Brasil. Ministério da Saúde. Instituto Nacional de Câncer José Alencar Gomes da Silva (INCA). Controle de sintomas do câncer avançado em adultos. Rev Bras Cancerol. 2000;46(3):243-56. Considering the frequent occurrence of multiple symptoms in patients with cancer, there is the need of made available new validate instruments for assessment of prevalent symptoms, mainly for scarcity of tools in Brazil.
The Memorial Symptom Assessment Scale (MSAS) is an instrument develop in 1994 to provide multidimensional information about a diversified cluster of physical and psychological symptoms that are common in patients with cancer. This scale evaluates 32 physical and psychological symptoms, and its frequent dimensions, severity and distress by a Likert-type scale. In addition it provides an broadly assessment method for symptoms and can be useful when information about symptoms are desirable, such as in clinical trials or epidemiological studies.1010. Portenoy RK, Thaler HT, Kornblith AB, Lepore JM, Friedlander-Klar H, Kiyasu E, et al. The Memorial Symptom Assessment Scale: an instrument for the evaluation of symptom prevalence, characteristics and distress. Eur J Cancer. 1994;30A(9):1326-36.
The validation of MSAS scale for Brazilian culture context is justified for the need of instruments to evaluate more broadly multiple symptoms in patients with cancer. This scale enables health professional to better understand the complexity of cluster of symptoms presented in a specific patients, or more frequently, in a specific type of cancer, therefore, this scale may guide health professionals and helps in development of interventions for management of such symptoms. This instrument can be also useful to be applied in epidemiological studies about cluster symptoms in oncology and quality of life.
The MSAS scale has been translated into Brazilian Portuguese and tested in terms of semantic equivalence. To establish psychometric properties of an instrument is important after its semantic adaptation.
Adapting process of an instrument is more than simple translation of words. It involves combination of translation from an idiom to another and standardized process that considers cultural context and life style of the target-population.1111. Behling O, Law KS. Translating questionnaires and other research instruments: problems and solutions. Thousand Oaks: Sage Publications; 2000. 156p. [Series Quantitative Applications in the Social Sciences, number 07-133]. Reichenheim et al.,1212. Reichenheim ME, Moraes CL. [Operationalizing the cross-cultural adaptation of epidemological measurement instruments]. Rev Saude Publica. 2007; 41(4):665-73. Portuguese. suggest transcultural adaptation to be done in six phases: (1) concept equivalence; (2) equivalence of items; (3) semantic equivalence; (4) operational equivalence; (5) measurement equivalence; (6) functional equivalence.
Findings of this study indicated whether translated and adapted version was adequate to be used with oncology patients in Brazil.
OBJECTIVE
To evaluate test-retest reliability of the Memorial Symptom Assessment Scale translated and culturally adapted into Brazilian Portuguese.
METHODS
This study is the fifth stage of transcultural adaption of MSAS-BR scale that correspondent to the reliability assessment. As the first time we performed equivalence tests on concept, items, semantic, operational followed by the first four steps required in the process.1313. Rocha LF. Equivalência semântica da versão em português do instrumento Memorial Symptom Assessmet Scale (MSAS) para avaliar sintomas em pacientes oncológicos [tese]. Rio de Janeiro: Instituto Nacional de Câncer José Alencar Gomes da Silva; 2015.
Characterization of the instrument
The MSAS scale was created in 1994 in the United States. It was constructed to detect and monitor symptoms of patients with cancer. This instrument was developed by oncology specialist and the scale combines physical and psychological symptoms with their degrees of severity, frequency and discomfort caused by symptoms.
The original version of the scale is composed by Likert-type scale including 32 symptoms. It is a self-reported instrument in which patients attribute a number from 1 to 4 for frequency and intensity of symptoms, from 0 to 4 for the degree of discomfort experienced during the last week at interview time. The responses order indicates a higher score meaning a worse clinical feature.
The stimulus is divided in subscales that evaluated psychological symptoms (PSYCH), with 6 items, physical symptoms of high frequency (PHYS H), with 12 items; and physical symptoms of relatively low frequency (PHYS L), with 14 items. Still there is a fourth subscale that contains four psychological symptoms and six physical symptoms in which global distress index (GDI) is evaluated, which may vary when applied, for example, ambulatory and hospitalized patients, and they can be considered more useful in a clinical point of view. Finally, there is final index that comprises the mean between three domains and all items (TMSAS). The internal consistence of these groups was evaluated in the original version by the Cronbach’s a coefficient, attributing the following values 0.835 to PSYCH, 0.882 to PHYS H and 0.580 to PHYS L.1010. Portenoy RK, Thaler HT, Kornblith AB, Lepore JM, Friedlander-Klar H, Kiyasu E, et al. The Memorial Symptom Assessment Scale: an instrument for the evaluation of symptom prevalence, characteristics and distress. Eur J Cancer. 1994;30A(9):1326-36.
The MSAS version used in Brazil was translated and adapted by a group of specialists in Oncology and Epidemiology. The principal author of the original versions authorized by e-mail the translation and adaptation to Brazilian Portuguese. The semantic equivalence process of the MSAS-BR scale for Brazilian culture had satisfactory results and good acceptability by target-population during pre-tests. We observed high limitation for self-application of the instrument by target-population specially because educational deficit is still an issue in Brazil. For this reason, instrument was applied by interviewing. The 32 symptoms cited in the original instrument scale were maintained and their classification followed the same original score.1313. Rocha LF. Equivalência semântica da versão em português do instrumento Memorial Symptom Assessmet Scale (MSAS) para avaliar sintomas em pacientes oncológicos [tese]. Rio de Janeiro: Instituto Nacional de Câncer José Alencar Gomes da Silva; 2015.
Data collection and analysis
Data were collected from March to December 2015. The MSAS-BR scale was applied to 190 patients at private interview after previous explanation about the objective of the study. We include those who agreed to participate and signed the consent form. The study population was composed by men and women patients, aged ran18 years or older, with multiple neoplasia and who hospitalized in clinical and surgical areas at Hospital do Câncer I (HCI/INCA). We excluded patients with cognitive disorders (neoplasia or metastasis of the center nervous system) that status could compromise the reliability of answers.
For additional data collection, we used our own sociodemographic and clinical data form including age, sex, marital status, level of education, race, primary diagnosis and metastasis.
A second interview was carried out and the scale was reapplied in 58 patients who remained hospitalized or were re-hospitalized in an interval between 5 to 15 days, from the first interview, and who had the same clinical condition and/or agreed to answer to re-test to check the scale reliability.
Answers of tests-retests were included in double typed spreadsheet from in Excel program, with posterior correction of inconsistences. Statistical data were analyzed. In assessment of individual variables, the stability analysis of test-retest of items and dimensions score was applied to Kappa statistics, in case of ordinal variables, we used weighted Kappa with quadratic weight.1414. Fleiss JL, Cohen J. The equivalence of weighted Kappa and the intraclass correlation coefficient as measures reliability. Educ Psychol Meas. 1973; 33(3):613-9. Discordant answers were weighted by squares of exact concordance deviations. To all statistics, we estimated a 95% confidence intervals.
We used the cut-off points suggested by Byrt et al., to classify level of stability of the answer: weak if 0 to 0.20, mild if 0.21 to 0.40, fair if 0.41 to 0.60, good if 0.61 to 0.80, very good if 0.81 to 0.92, and excellent if 0.93 to 1.00.1515. Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993; 46(5):423-9.However, it is important to highlight that, in general, we recommended higher emphasis to numerical value because such scales can vary among authors.1616. Campos MR, Leal Mdo C, Souza PR Jr, Cunha CB. [Consistency between data sources and inter-observer reliability in the Study on Neonatal and Perinatal Morbidity and Mortality and Care in the City of Rio de Janeiro]. Cad Saude Publica. 2004;20:Sup 1:S34-43. Portuguese.
Ethical and legal aspects of the study
Our study followed all ethical and legal requirements of the resolution 466/12 from the National Health Council/Brazilian Ministry of Health for research involving humans. This study was approved by INCA Ethics and Research Committee, protocol number 863,339 and CAAE: 33237314.2.0000.5274 - November 2014. The authors have no conflict of interests to disclose.
RESULTS
Of 190 interviewed patients, 61.34% were men. Patients’ age ranged from 20 to 89 years, and mean age was 55 years (standard deviation - SD: 14.64); 61.86% of respondents declared to be white, 48.97% had complete or incomplete primary school, 57.73% were married or were in a consensual union, 74.21% were hospitalized for clinical treatment, and 73.70% were not diagnosed with distant metastasis at the time of the interview (Table 1).
The five most common symptoms were dry mouth (60.31%), fatigue (58.5%), pain (56.19%), drowsiness (51.55%) and change in taste of food (48.97%). Five less frequent symptoms were problems with sexual desire or sexual activity (12.37%), problems to urinate (16.49%), itching (18.04%), difficult to swallow (18.56%), and diarrhea (21.13%) (Table 2).
In analysis or symptoms prevalence, most of items were within cluster symptoms more and less frequent found in PHYS H and PHYS L subscales. Differences were seen only in symptoms: cough was low prevalence in the subscale, and in our study, it was in the 8th position with 45.36% prevalence; and vomiting that belonged to subscale of symptoms with higher prevalence and, in our study, it appeared in the 26th position with only 21.56% prevalence.
We observed in degrees presented in three Likert-type scales that measured frequency, intensity, and discomfort for each item, the degree 2 was the most seen. The five items that most presented the degree 4 in the frequency scale were numbness or tingling (31.25%), loss of appetite (30.12%), problems to urinate (25.00%), problems with sexual desire and sexual activity (25.00%), and pain (23.85%), the five itens that most presented the degree 1 in the frequency scale were vomiting (38.10%), diarrhea (21.95%), nausea (21.05%), cough (19.32%) and itching (17.14%). The five items most presented degree 4 in intensity scale were problems with sexual desire and sexual activity (25.00%), difficult to swallow (18.92%), “I feel like I am not myself anymore” (20.78%), hair loss (18.92%) and irritation (13.64%). Items that most seen in the degree 1 were wounds in the mouth (57.78%), cough (55.68%), numbness or tingling in hands/feet (50.00%), difficult to concentrate (45.83%) and vomiting (42.86%). The five items most presented degree 4 in discomfort scale were pain (17.01%), constipation (6.70%), “I feel like I am not myself anymore” (5.67%), nervousness (5.15%) and loss of appetite (5.15%), those presenting more percentage in degree 0 were problems related to sexual desire and sexual activity (87.63%), problems to urinate (82.99%), itching (81.96%), difficult to swallow (81.44%) and hair loss (80.93%).
Therefore as an original instrument, MSAS-BR symptoms scale assess frequency, intensity and discomfort in 24 of 32 items and, in other 8 items, only intensity and discomfort were seen, because it was understood that symptoms such as hair loss, loss of appetite and wounds in the mouth were not considered relevant in terms of frequency because it was a continuous long-term situation.
Reliability of scale showed satisfactory results in tests-retest. Weighted Kappa values obtained for each item in the scale were high and varied from good to excellent, according to cut-off point adopted; the largest item was 0.96 and smaller was 0.69 (Table 3).
We also obtained mean scores, standard deviations, weighted Kappa and 95% confidence intervals in test-retest for each subscale of PHYS H, PHYS L, PHYCH and GDI and mean among three domains, and all items. Weighted Kappa applied to these subscales also indicated good reliability related to cluster symptoms included. The subscale of PHYS domain had higher level of reliability (K=0.84) and domain of global distress index has lower level (K=0.78) (Table 4).
DISCUSSION
The MSAS scale was developed as measurer for prevalence and characteristics of each group that include physical and psychological symptoms experienced by a number of oncology patients. This scale was validate in other countries such as China, Turkey, Sweden and Israel,1717. Cheng KK, Wong EM, Ling WM, Chan CW, Thompson DR. Measuring the symptom experience of Chinese cancer patients: a validation of the Chinese version of the memorial symptom assessment scale. J Pain Symptom Manage. 2009;37(1):44-57.
18. Yildirim Y, Tokem Y, Bozkurt N, Fadiloglu C, Uyar M, Uslu R. Reliability and validity of the Turkish version of the Memorial Symptom Assessment Scale in cancer patients. Asian Pac J Cancer Prev. 2011;12(12):3389-96.
19. Browall M, Kenne Sarenmalm E, Nasic S, Wengström Y, Gaston-Johansson F. Validity and reliability of the Swedish version of the Memorial Symptom Assessment Scale (MSAS): an instrument for the evaluation of symptom prevalence, characteristics and distress. J Pain Symptom Manage. 2013; 46(1):131-41.-2020. Pud D. The psychometric properties of the Hebrew version of the Memorial Symptom Assessment Scale (MSAS-Heb) in patients with breast cancer. J Pain Symptom Manage. 2015;49(4):790-5. and a high variability were seen in the most frequent symptoms. In analysis of symptoms prevalence observed in tests, similarities were seen in relation to high and less frequent symptoms seen in the validation study of the original instrument and its respective subscales PHYS H (most prevalent symptoms) and PHYS L (symptoms of relatively low prevalence). Different items, considered high, was cough, belonging to PHYS L with prevalence of 45.36%, and vomiting that belonged to PHYS H, considered relatively, and had prevalence of 21.65%. The most prevalence item was dry mouth (60.31%) and less prevalence was problems with sexual desire and sexual activity (12.37%). Other studies on MSAS scale test-retest reliability were not found in Brazil because of the recent semantic equivalence of the scale to Brazilian Portuguese, therefore, an comparisons of test-retest reliability and items prevalence are impossible in a national level.
In test-retest analysis (n=58), answers to items were stable, and concordance measured by weighted Kappa with quadratic weight ranged from good to excellent. We also observed similarities in values obtained in mean score between test-retests and weighted Kappa in analysis of subscales PHYS H, PHYS L, PSYCH, and GDI and total TMSAS. Such results show that MSAS-BR version was stable and presented significant results in weighted Kappa indexes, therefore showing high concordance between values and, therefore, adequate stability.
Zwart et al., revealed the time interval between tests that can be influence in test-retest reliability, in case of tests repletion in short time interval. Participants’ memory can influence results in second application and, therefore, falsely expand test-retest reliability, as well as changes in health status occurring during tests can also influence interviewees’ answers and reduce reliability of test-rest.2121. de Zwart BC, Frings-Dresen MH, van Duivenbooden JC. Test-retest reliability of the Work Ability Index Questionnaire. Occup Med (Lond). 2002;52(4):177-81.
CONCLUSION
The present study, along with other investigations as to semantic validity, suggest a high stability of information collected by the instrument. In this sense, results achieved allow the use of instrument for the next stages of validation. Therefore, additional studies on validity will complete Memorial Symptom Assessment Scale psychometric assessment.
REFERENCES
-
1Armstrong TS, Cohen MZ, Eriksen LR, Hickey JV. Symptom clusters in oncology patients and implications for symptom research in people with primary brain tumors. J Nurs Scholarsh. 2004;36(3):197-206. Review.
-
2Dodd MJ, Miaskowski C, Lee KA. Occurrence of symptom clusters. J Natl Cancer Inst Monogr. 2004(32):76-8. Review.
-
3Brasil. Ministério da Saúde. Instituto Nacional de Câncer José Alencar Gomes da Silva (INCA). ABC do câncer: abordagens básicas para o controle do câncer. 2a ed. rev. e atual. Rio de Janeiro: INCA; 2012.
-
4Chammas R. Biologia do câncer. In: Hoff P, editor. Tratado de oncologia. São Paulo: Atheneu; 2013. p. 3-8.
-
5Brasil. Ministério da Saúde. Instituto Nacional de Câncer José Alencar Gomes da Silva (INCA). Estimativa 2016: incidência de câncer no Brasil [Internet]. Rio de Janeiro: INCA; 2015 [citado 2016 Fev 7]. Disponível em: http://www.inca.gov.br/estimativa/2016/estimativa-2016-v11.pdf
» http://www.inca.gov.br/estimativa/2016/estimativa-2016-v11.pdf -
6Pelaez Dóro M, Pasquini R, Medeiros CR, Bitencourt MA, Moura GL. The cancer and its symbolic representation. Psicol Ciênc Prof. 2004;24(2):120-34.
-
7Ferreira KA, William Jr WN, Mendonza TR, Kimura M, Kowalski LP, Rosenthal DI, et al. Translation of the M.D. Anderson Symptom Inventory - head and neck module (MDASI-H&N) to Brazilian Portuguese. Rev Bras Cir Cabeça Pescoço. 2008;37(2):109-13.
-
8Kirkova J, Walsh D, Aktas A, Davis MP. Cancer symptom clusters: old concept but new data. Am J Hosp Palliat Care. 2010;27(4):282-8.
-
9Brasil. Ministério da Saúde. Instituto Nacional de Câncer José Alencar Gomes da Silva (INCA). Controle de sintomas do câncer avançado em adultos. Rev Bras Cancerol. 2000;46(3):243-56.
-
10Portenoy RK, Thaler HT, Kornblith AB, Lepore JM, Friedlander-Klar H, Kiyasu E, et al. The Memorial Symptom Assessment Scale: an instrument for the evaluation of symptom prevalence, characteristics and distress. Eur J Cancer. 1994;30A(9):1326-36.
-
11Behling O, Law KS. Translating questionnaires and other research instruments: problems and solutions. Thousand Oaks: Sage Publications; 2000. 156p. [Series Quantitative Applications in the Social Sciences, number 07-133].
-
12Reichenheim ME, Moraes CL. [Operationalizing the cross-cultural adaptation of epidemological measurement instruments]. Rev Saude Publica. 2007; 41(4):665-73. Portuguese.
-
13Rocha LF. Equivalência semântica da versão em português do instrumento Memorial Symptom Assessmet Scale (MSAS) para avaliar sintomas em pacientes oncológicos [tese]. Rio de Janeiro: Instituto Nacional de Câncer José Alencar Gomes da Silva; 2015.
-
14Fleiss JL, Cohen J. The equivalence of weighted Kappa and the intraclass correlation coefficient as measures reliability. Educ Psychol Meas. 1973; 33(3):613-9.
-
15Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993; 46(5):423-9.
-
16Campos MR, Leal Mdo C, Souza PR Jr, Cunha CB. [Consistency between data sources and inter-observer reliability in the Study on Neonatal and Perinatal Morbidity and Mortality and Care in the City of Rio de Janeiro]. Cad Saude Publica. 2004;20:Sup 1:S34-43. Portuguese.
-
17Cheng KK, Wong EM, Ling WM, Chan CW, Thompson DR. Measuring the symptom experience of Chinese cancer patients: a validation of the Chinese version of the memorial symptom assessment scale. J Pain Symptom Manage. 2009;37(1):44-57.
-
18Yildirim Y, Tokem Y, Bozkurt N, Fadiloglu C, Uyar M, Uslu R. Reliability and validity of the Turkish version of the Memorial Symptom Assessment Scale in cancer patients. Asian Pac J Cancer Prev. 2011;12(12):3389-96.
-
19Browall M, Kenne Sarenmalm E, Nasic S, Wengström Y, Gaston-Johansson F. Validity and reliability of the Swedish version of the Memorial Symptom Assessment Scale (MSAS): an instrument for the evaluation of symptom prevalence, characteristics and distress. J Pain Symptom Manage. 2013; 46(1):131-41.
-
20Pud D. The psychometric properties of the Hebrew version of the Memorial Symptom Assessment Scale (MSAS-Heb) in patients with breast cancer. J Pain Symptom Manage. 2015;49(4):790-5.
-
21de Zwart BC, Frings-Dresen MH, van Duivenbooden JC. Test-retest reliability of the Work Ability Index Questionnaire. Occup Med (Lond). 2002;52(4):177-81.
Publication Dates
-
Publication in this collection
Apr-Jun 2017
History
-
Received
8 Feb 2016 -
Accepted
10 Jan 2017