Brazilian cross-cultural adaptation of “Return-to-work self-efficacy” questionnaireABSTRACT
OBJECTIVE To describe the translation and early stages of cross-cultural adaptation of the questionnaire Verwachtingen over werken (or “Return-to-work self-efficacy”) for workers in sick leave due to mental disorders, from the original in Dutch to the Brazilian Portuguese language.
METHODS A panel gathering experts was formed to determine the questionnaire conceptual and item equivalence. For semantic equivalence, the Dutch-Portuguese Brazilian translations were consolidated and consensus meetings were held to structure versions of the instrument. Each version was back-translated from Brazilian Portuguese to Dutch and evaluated by one of the authors of the original version. The final version was submitted to two pre-tests for operational equivalence.
RESULTS The original questionnaire in Dutch was translated twice to Brazilian Portuguese. During the process, four consensus meetings of the experts’ panel were performed to create the versions. Each version was back-translated to Dutch. One of the authors of the original questionnaire performed an evaluation on the first three versions until the definition of the final one, which was titled Expectativas sobre o trabalho (Expectations about work). Pre-tests’ participants did not reported problems to fill the questionnaire.
CONCLUSIONS Results indicate that the Brazilian Portuguese cross-culturally adapted version maintains the original meaning of the questionnaire, while including characteristics peculiar to the Brazilian reality. Measurement and functional equivalence of this version must still be evaluated before its application can be recommended for workers who have been absent from work due to mental disorders.
Occupational Health; Mental Disorders; Sick Leave; Return to Work; Occupational Medicine; Surveys and Questionnaires; Translations
INTRODUCTION
Impact of sick leaves on social security expenditures is a global problem13. Within this context, sick leaves due to mental disorders are known to have the longest duration5and are a source of significant social security expenditures4. In Brazil, mental diseases are the third main cause for social security sickness benefits, which are paid to ensured workers from the 16th day of sick leave14.
Identification and characterization of groups at high risk for long term sick leave are necessary to develop indicators for programs to facilitate return to work. Professionals involved in these programs should approach workers in sick leave as early as possible to maximize the reintegration to workplace likelihood12. Unfortunately, there is not official guideline to support professionals about return-to-work or validated questionnaire that assesses if workers are at risk for long term sick leave in Brazilian reality.
Among the many determinants involved in the return to work process, the self-efficacy is one of the relevant individual parameters studied in cases of disability due to mental disorders8-10,16. Self-efficacy refers to an individuals’ belief in his or her capacity to execute tasks and behaviors in a satisfactory manner1,2. This concept guided the construction of two instruments to assess the workers’ perception of their ability to perform their usual tasks upon returning to work after sick leaves due to musculoskeletal3 and mental disorders9. Although both instruments were named “Return-to-work self-efficacy” (RTW-SE), only the former was validated for English-speaking populations. The latter was elaborated in Dutch (Verwachtingen over werken) and validated in three groups of workers in the Netherlands.
In the Dutch questionnaire, workers with mental disorders are requested to imagine themselves going to work the following day and to describe their expectations (as a function of their ongoing emotional state and state of mind). The questionnaire includes 11 statements, and respondents are requested to manifest their degree of agreement or disagreement with them on a six-point Likert scale. The sum of the points attributed to each item provides an individual score; the average score of the studied group is considered the cutoff point to dichotomize the perceived return-to-work self-efficacy as low or high. The construct validity of the RTW-SE version validated for workers with mental disorders was considered satisfactory as a function of its good correlation with the dimensions included in the theoretical model: perceived general self-efficacy, locus of control, coping, physical workload, and mental health problems. The questionnaire exhibited excellent internal consistency and adequate test-retest reliability, proved to be sensitive to changes over time, and behaved as a robust predictor of return to work within three months9.
In studies conducted in the Netherlands, RTW-SE demonstrated ability to predict the time for8,10,16 and success in actual return to work9. Thus, application of RTW-SE to Brazilian workers in sick leave due to mental disorders might be useful to detect situations in which having low self-efficacy is an indicator of difficulties to return to work.
The aim of the present study was to perform the translation and early stages of cross-cultural adaptation of RTW-SE questionnaire for workers in sick leave due to mental disorders from the original Dutch to the Brazilian Portuguese language.
METHODS
The translation and cross-cultural adaptation of RTW-SE were performed according to the methods indicated in the scientific literature6,7,11. Efforts were made to maintain the concepts present in the Dutch version, while adapting them to Brazilian cultural equivalents. Conceptual, item, semantic, and operational equivalence were determined. The evaluation of the measurement and functional equivalence will be described in future studies, since they are currently being tested in a multicenter study.
Conceptual equivalence is achieved when the concepts included in the original and adapted questionnaires have similar meaning and equally affect respondents from both cultures7. To test conceptual equivalence between the Dutch and Brazilian versions of RTW-SE we performed a review of the literature on the subject “return to work after sick leave due to mental disorders”. In that stage of the study, our aim was to establish the relevance of the core subject of the questionnaire for the Brazilian reality. For this purpose, a panel of experts with large experience in the conduction of studies on absenteeism by disease was formed, which included one full professor in public health (FMF), one occupational epidemiologist (RHG), and one specialist in occupational medicine and social security legislation (JSSJ). Item equivalence was analyzed in one of the panel meetings to establish the adequacy and clarity of the statements and response options.
Semantic equivalence is concerned with the transfer of the meaning of concepts by words and sentences of different languages to equally affect respondents of different cultures7. This aspect presented some difficulty, since the questionnaire was presented in English in the article describing the validation study9, while the version actually applied in that study was the original Dutch one. To overcome that problem, we performed the following steps, which are schematically described in Figure:
Flowchart representing the process of cross-cultural adaptation of the questionnaire “Return-to-work self-efficacy” (RTW-SE) for workers with mental disorders.
-
Translation: the Dutch version of the questionnaire was split into 22 sentences, as follows: name (one sentence), questionnaire introductory remarks (three sentences), orienting sentence (one sentence), statements (11 sentences), and Likert scale (six sentences). An international certified translation service was hired to independently perform two translations from Dutch to the Brazilian Portuguese language (T1 and T2);
-
First consensus meeting: panel members assessed the clarity of both translations, the use of colloquial language, and the semantic equivalence between items. On those grounds, changes were made, resulting in the first Brazilian Portuguese version (V1);
-
Back-translation: the Brazilian Portuguese version was back-translated to Dutch (B1). Next, one of the original authors of the questionnaire (SEL) was requested to grade the concordance between the original Dutch and back-translated versions from zero to 10. Whenever a sentence scored less than 10, the Dutch reviewer should describe in detail the divergences between versions;
-
Second and third consensus meetings: a second consensus meeting was held after the evaluation of B1 to discuss the need for changes and to elaborate a new Brazilian Portuguese version (V2). This new version was back-translated to Dutch (B2). The procedure was repeated one further time (third consensus meeting → V3 → B3) until the final Brazilian Portuguese version was achieved. We had previously established that the final version was to be the one in which no sentence was graded below 8.5 (eight and a half) by the back-translation reviewer.
Two pretests were performed with individuals in sick leave due to mental disorders to assess the operational equivalence between the questionnaire versions. The aim of the first pretest was to establish whether words and expressions were adequate to the Brazilian reality and verbal constructions clear enough and appropriate for Brazilian Portuguese speakers. In the second pretest, the final version was applied to 17 individuals to investigate whether they had any difficulty in understanding the questionnaire content and responding it. Experts then held the fourth consensus meeting, in which they decided that the version used in the second pretest represented the cross-cultural adaptation of RTW-SE for workers with mental disorders to the Brazilian Portuguese language.
The present study was approved by the human research ethics committee of Faculdade de Saúde Pública, Universidade de São Paulo, Brazil (Certificate of Presentation for Ethical Appraisal – CAAE 23492013.5.0000.5421).
RESULTS
The experts panel considered that domains described in the scale validation study9 could be of interest for the Brazilian reality and that they agreed with the local occupational and social security conditions. The first topic discussed by the panel of experts was the questionnaire name. While the literal translation of the Dutch name is “Expectations about work”, in the validation study the questionnaire was named “Return-to-work self-efficacy” in English. The experts agreed that terms “efficacy” or “self-efficacy” misrepresented the original name, in addition to the fact that word “expectations” is much more widely used in Brazil than “self-efficacy”. Moreover, it is worth to notice that the English version of the questionnaire has not yet been validated.
The questionnaire name changed from V1 to V2. The name initially suggested was “Expectations about return to work”; however, as a function of comments made to the back-translation, the experts observed that the questionnaire can be usefully applied not only to workers in sick leave, but also to the ones who already returned to work. In the latter case, the aim of the questionnaire application is to monitor changes in the expectations of workers in process of returning to work. Therefore, the selected name was “Expectations about work”.
In Brazil, public and private organizations are entitled to reduce the working hours and workload, but a proportional reduction in the salary is illegal. However, the ongoing trend is for employers allow employees returning to work after a sick leave to shift to part-time employment. The contradiction between labor law and the perception of the panel of experts about what really happens in practice resulted in the need to discuss the questionnaire’s introductory remarks. The original Dutch version comprises three options: if the worker is currently not working, or partially returned to work, or fully returned to work. Considering the possibility of part-time work, especially in companies that allow for gradual return to work, we chose not to make any changes in the original introductory remarks.
Still in this regard, the back-translation reviewer observed that V1 overemphasized the mandatory aspect of return to work (“Imagine that you have to return to work tomorrow…”). Therefore, the final version states: “Imagine that you’re returning to work tomorrow (in your present state of health)”.
Also, the orienting sentence had to be rephrased following the evaluation of the first back-translation. For the same reasons mentioned above, it was changed to emphasize the possibility aspect (“If I were to return to work tomorrow…”).
Concerning the end of the orienting sentence, the experts discussed whether to keep the active verb “to expect” as in the original Dutch version (“If I were to return to work tomorrow I expect…”) or use the noun “expectations” as in the questionnaire name. In Portuguese, the latter formula (“… my expectations are…”) is more akin to the structure of the questionnaire statements, which begin by a verb in infinitive form (“to be able to”, “not to be able to”, “not to have” etc.) and provides a more accurate perspective of the immediate future.
As concerns statement 1, the two initial translations included words seldom used in colloquial Brazilian Portuguese (“contratempos/adversidades”: setbacks). The panel of experts suggested using “difficulties” or “problems” instead; the evaluation of the first back-translation indicated that the word “difficulties” better matched the statement’s intention.
Statements 2, 4, 5, and 6 did not pose any problems requiring special attention along the process of cross-cultural adaptation of the questionnaire, since the translations successfully represented the concepts meant in the original Dutch version, according to the back-translation reviewer.
Statement 3 (“I will be able to set my personal boundaries at work”) was a subject of much discussion at the first consensus meeting, because its essential meaning was not clear. In one of the translations, the corresponding expectation was described as of being able to control work tasks, while in the other, as of being able to set boundaries to work pressure. Following consultation to the authors of the original questionnaire, the experts understood that statement 3 concerns the workers’ awareness of their individual boundaries to the performance of work tasks and their expectation of being able to avoid overstepping them.
Regarding statement 7, the problem was the best word to qualify the workers’ ability to concentrate on their work. Although the adverb “well” (“bem”) is commonly used in Brazil, the back-translation with the highest score was the one that used the word “enough” (“suficiente”) instead. The back-translation reviewer considered the latter was less emphatic and thus closer to the original meaning.
As in the case of statement 3, the focus of the discussion regarding statement 8 was also the essential meaning of the corresponding expectation. According to one translation, it concerned the ability to cope with the pressure exerted by interpersonal relationships at work (with colleagues, supervisors, customers), while the other translation is about the discomfort caused by the organization of the work environment (hustle and bustle). The panel of experts agreed that the latter was the most adequate.
Concerning statement 9, the discussion centered on the choice of the most adequate verb; the options were “to handle” (“lidar”) or “to solve” (“resolver”) possible problems at work. The back-translation reviewer considered the latter to be the closest to the original Dutch version.
As for statement 10, the experts understood that the best manner to assess the motivation to work is by motivating behavior rather than based on transient motivational states or being motivated by extrinsic influences.
In statement 11, the verb “to meet” (“cumprir”) was considered more adequate than “to deal” (“lidar/gerir/gerenciar”) with the physical demands of work.
The adaptation of the six-point Likert scale did not pose any problem.
In the evaluation of the first back-translation, the average score attributed by one of the authors of the original Dutch questionnaire to the first Brazilian Portuguese version (V1) was 7.89 (total score corresponding to the sum of 22 items = 173.5). At the second consensus meeting, the panel of experts made changes in all items, except for the Likert scale (which had been attributed the maximum score), resulting in the second Brazilian Portuguese version (V2). The average score attributed by the Dutch reviewer to the second back-translation (B2) was 9.34 (total score for 22 items = 205.5).
During the third consensus meeting, experts revised four out of the 22 items and established the third Brazilian Portuguese version (V3). The average score attributed by the Dutch reviewer to the corresponding back-translation (B3) was 9.66 (total score for 22 items = 212.5).
This version (V3) was used in the first pretest. With the follow-up, the experts discussed in the fourth consensus meeting chose to add the expression “at/of/in work” (“no trabalho”, “do trabalho”, “durante o trabalho”) in statements 2, 4, 5 and 6 to reinforce the fact that the questionnaire focuses on the respondents’ expectations regarding work situations upon returning to it after a sick leave. This change might be considered as a cross-cultural adaptation performed after a pretest with the target population.
Following these modifications in V3, the new version (V4) was considered to be adequate as the final one by all the authors (Table).
The individuals invited to respond the final version of the questionnaire did not report any difficulty in understanding or filling in it. Most of the second pretest participants were female (66.7%), education equal or over 11 years (80.0%), and diagnosis of depressive disorder (60.0%). Their mean age was 36 years (SD ± 7.08 years).
DISCUSSION
Comparison between the original questionnaire and the back-translation of the third Brazilian Portuguese version (V3) showed that the referential meaning of the questionnaire name, introductory remarks, orienting sentence, and Likert scale was similar between both. Inclusion of expression “at/of/in work” at a few statements in the final Brazilian Portuguese version (V4) might be considered a small change concerning the original questionnaire. Thus, the cross-adaptation of the instrument succeeded in maintaining its original meaning, while including characteristics peculiar to the Brazilian reality.
Since workers’ self-efficacy might be a predictor of the time for and success of return to work8-10,16, knowledge of the workers’ expectations might allow detecting difficulties in this regard. Compared with simple and short questions about expectations, the RTW-SE scale seems better suited to predict the actual return-to-work process9. As the original version of the questionnaire exhibited satisfactory internal consistency and sensitivity over time9, its application might be useful to health care professionals, occupational support team, and social security services by providing ideas to improve workers’ self-efficacy for return to work.
The social exclusion of ill workers might interfere with individual, economic, and psychosomatic aspects of their lives. Long sick leaves perpetuate the workers’ suffering, which certainly does not help to improve their physical and mental wellbeing15. Application of questionnaire “Expectations about work” to Brazilian workers might contribute to the planning of return-to-work procedures for individuals with disabling mental disorders.
Knowledge on the workers’ limitations about returning to work provided by the questionnaire might further contribute to the formulation of public (e.g., vocational rehabilitation improvement) and private policies (e.g., guidelines to improve the return-to-work process). It might also be useful for occupational health professionals to achieve an adaptation point between work demands and employees’ ability, whereas they are returning from sick leave due to mental disorders. Thus, the use of the questionnaire by professionals might exert positive influence on the social reinsertion of workers and contribute to monitoring the efficiency of the whole process.
In conclusion, the present article describes the initial steps in the cross-cultural adaptation of the questionnaire “Return-to-work self-efficacy” after sick leave due to mental disorders to the Brazilian Portuguese language. Measurement and functional equivalence of the adapted version must still be assessed before its application can be recommended. Future studies ought to assess the scientific validity of the Brazilian Portuguese version in such a way to be used in research as well in private and public occupational health services.
REFERENCES
-
1 Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev 1977;84(2):191-215. https://doi.org/10.1016/0146-6402(78)90002-4
» https://doi.org/10.1016/0146-6402(78)90002-4 -
2 Bandura A. The explanatory and predictive scope of self-efficacy theory. J Soc Clin Psychol 1986;4(3):359-73. https://doi.org/10.1521/jscp.1986.4.3.359
» https://doi.org/10.1521/jscp.1986.4.3.359 -
3 Brouwer S, Franche R, Hogg-Johnson S, Lee H, Krause N, Shaw WS. Return-to-work self-efficacy: development and validation of a scale in claimants with musculoskeletal disorders. J Occup Rehabil 2011;21(2):244-58. https://doi.org/10.1007/s10926-010-9262-4
» https://doi.org/10.1007/s10926-010-9262-4 -
4 Catalina-Romero C, Martínez-Muñoz P, Quevedo-Aguado L, Ruiz-Moraga M, Fernández-Labandera C, Calvo-Bonacho E. Predictores de la duración de la incapacidad temporal por contingencias comunes en los trastornos de ansiedad. Gac Sanit 2013;27(1):40-6. https://doi.org/10.1016/j.gaceta.2011.12.008
» https://doi.org/10.1016/j.gaceta.2011.12.008 -
5 Hensing G, Spak F. Psychiatric disorders as a factor in sick-leave due to other diagnoses: a general population-based study. Br J Psychiatry 1998;172(3):250-6. https://doi.org/10.1192/bjp.172.3.250
» https://doi.org/10.1192/bjp.172.3.250 -
6 Herdman M, Fox-Rushby J, Badia X. ‘Equivalence’ and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res 1997;6(3):237-47. https://doi.org/10.1023/A:1026410721664
» https://doi.org/10.1023/A:1026410721664 -
7 Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res 1998;7(4):323-35. https://doi.org/10.1023/A:1024985930536
» https://doi.org/10.1023/A:1024985930536 -
8 Huijs JJ, Koppes LL, Taris TW, Blonk RW. Differences in predictors of return to work among long-term sick-listed employees with different self-reported reasons for sick leave. J Occup Rehabil 2012;22(3):301-11. https://doi.org/10.1007/s10926-011-9351-z
» https://doi.org/10.1007/s10926-011-9351-z -
9 Lagerveld SE, Blonk RW, Brenninkmeijer V, Schaufeli WB. Return to work among employees with mental health problems: development and validation of a self-efficacy questionnaire. Work Stress. 2010;24(4):359-75. https://doi.org/10.1080/02678373.2010.532644
» https://doi.org/10.1080/02678373.2010.532644 -
10 Nieuwenhuijsen K, Noordik E, Dijk FJ, Klink JJ. Return to work perceptions and actual return to work in workers with common mental disorders. J Occup Rehabil 2013;23(2):290-9. https://doi.org/10.1007/s10926-012-9389-6
» https://doi.org/10.1007/s10926-012-9389-6 -
11 Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemological measurement instruments. Rev Saude Publica 2007;41(4):665-73. https://doi.org/10.1590/S0034-89102006005000035
» https://doi.org/10.1590/S0034-89102006005000035 -
12 Roelen CA, Nordeer G, Koopmans PC, Rhenen W, Klink JJ, Bültmann U. Employees sick-listed with mental disorders: who returns to work and when? J Occup Rehabil 2012;22(3):409-17. https://doi.org/10.1007/s10926-012-9363-3
» https://doi.org/10.1007/s10926-012-9363-3 - 13 Scheil-Adlung X, Sandner L. Paid sick leave: incidence, patterns and expenditure in times of crisis. Geneva: International Labour Office; 2010. (ESS Paper Series, n. 27).
-
14 Silva Junior JS, Fischer FM. Disability due to mental illness: social security benefits in Brazil 2008-2011. Rev Saude Publica 2014;48(1):186-90. https://doi.org/10.1590/S0034-8910.2014048004802
» https://doi.org/10.1590/S0034-8910.2014048004802 -
15 Toldrá RC, Daldon MTB, Santos MC, Lancman S. Facilitadores e barreiras para o retorno ao trabalho: a experiência de trabalhadores atendidos em um centro de referência em saúde do trabalhador - SP, Brasil. Rev Bras Saude Ocup 2010;35(121):10-22. https://doi.org/10.1590/S0303-76572010000100003
» https://doi.org/10.1590/S0303-76572010000100003 -
16 Volker D, Zijlstra-Vlasveld MC, Brouwers EPM, Lomwel AGC, Feltz-Cornelis CM. Return-to-work self-efficacy and actual return to work among long-term sick-listed employees. J Occup Rehabil. 2015;25(2):423-31. https://doi.org/10.1007/s10926-014-9552-3
» https://doi.org/10.1007/s10926-014-9552-3
-
Funding: Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq – Grant 442051/2014-0). Instituto Nacional do Seguro Social (INSS – Brazilian National Social Security Institute provided institutional support for one author [JSSJ]). The Public Health Graduate Program, Faculdade de Saúde Pública, Universidade de São Paulo, Brazil, provided funding for publication.
Publication Dates
-
Publication in this collection
2017
History
-
Received
20 Oct 2015 -
Accepted
2 Feb 2016
