Acessibilidade / Reportar erro

Cultural competence of undergraduate student nurses: a multicenter study * * Supported by European Program Erasmus+, Key Action 203 Strategic Partnerships for Higher Education (Line KA203), Grant #2018-1-ES01-KA203-050800.

Objective:

to evaluate the level of cultural competence of an undergraduate nursing students’ population from four European higher education institutions.

Method:

a total of 168 nursing students from four different countries were included in our study. The study methodology involved a cross-sectional assessment of cultural competence among undergraduate nursing students from four European universities. Data collection included sociodemographic variables, as well as the following validated tools: the Intercultural Sensitivity Scale, the Cultural Competence Assessment Tool (student version) and the Cultural Awareness Scale.

Results:

our results indicated that students demonstrated a high level of intercultural sensitivity but a moderate level of cultural competence and cultural awareness. Variations existed among students from different countries, suggesting potential differences in educational approaches. Despite expectations that higher-level students would exhibit greater cultural competence, no significant differences were found by year of study, indicating a lack of effective integration of cultural competence into nursing curricula.

Conclusion:

nurse educators should consider the students’ cultural competence before designing related study programmes. Training programmes related to cultural competence should include elements which have been associated with enhanced cultural competence, including language skills, cultural encounter, and opportunities for internationalisation.

Descriptors:
Transcultural Nursing; Cultural Competency; Culturally Competent Care; Nursing Education; Nursing Students; Cross-Sectional Studies


Objetivo:

evaluar el nivel de competencia cultural de una población de estudiantes de pregrado en enfermería de cuatro instituciones europeas de educación superior.

Método:

en nuestro estudio se incluyeron en total 168 estudiantes de enfermería de cuatro países diferentes. La metodología de estudio implicó una evaluación transversal de la competencia cultural de los estudiantes de pregrado en enfermería de cuatro universidades europeas. La recolección de datos incluyó variables sociodemográficas y las siguientes herramientas validadas: la Escala de Sensibilidad Intercultural, la Herramienta de Evaluación de la Competencia Cultural (versión para estudiantes) y la Escala de Conciencia Cultural.

Resultados:

los estudiantes demostraron un alto nivel de sensibilidad intercultural pero un nivel moderado de competencia y conciencia cultural. Hubo variaciones entre los estudiantes de diferentes países, lo que sugiere posibles diferencias en los enfoques educativos. A pesar de que se esperaba que los estudiantes de educación superior tuvieran mayor competencia cultural, no se encontraron diferencias significativas por año de estudio, lo que indica que la competencia cultural no se incluye de forma efectiva en los planes de estudio de las carreras de pregrado en enfermería.

Conclusión:

los educadores de enfermería deben considerar la competencia cultural de los estudiantes antes de diseñar programas de estudio relacionados con la misma. Los programas de formación relacionados con la competencia cultural deben incluir elementos que se hayan asociado con una mayor competencia cultural, eso incluye habilidades lingüísticas, encuentros culturales y oportunidades de internacionalización.

Descriptores:
Enfermería Transcultural; Competencia Cultural; Asistencia Sanitaria Culturalmente Competente; Educación en Enfermería; Estudiantes de Enfermería; Estudios Transversales


Objetivo:

avaliar o nível de competência cultural de uma população de estudantes de graduação em enfermagem de quatro instituições europeias de ensino superior.

Método:

um total de 168 estudantes de enfermagem de quatro países diferentes foram incluídos em nosso estudo. A metodologia do estudo envolveu uma avaliação transversal da competência cultural entre estudantes de graduação em enfermagem de quatro universidades europeias. A coleta de dados incluiu variáveis sociodemográficas, bem como as seguintes ferramentas validadas: Escala de Sensibilidade Intercultural, Ferramenta de Avaliação de Competência Cultural (versão do aluno) e Escala de Consciência Cultural.

Resultados:

nossos resultados indicaram que os alunos demonstraram um alto nível de sensibilidade intercultural, mas um nível moderado de competência e consciência cultural. Houve variações entre os alunos de diferentes países, o que sugere possíveis diferenças nas abordagens educacionais. Apesar das expectativas de que os alunos de nível superior apresentariam maior competência cultural, não foram encontradas diferenças significativas por ano de estudo, indicando uma falta de integração eficaz da competência cultural nos currículos de enfermagem.

Conclusão:

os educadores de enfermagem devem considerar a competência cultural dos alunos antes de elaborar programas de estudo relacionados. Os programas de treinamento relacionados à competência cultural devem incluir elementos que tenham sido associados a uma maior competência cultural, incluindo habilidades linguísticas, encontros culturais e oportunidades de internacionalização.

Descritores:
Enfermagem Transcultural; Competência Cultural; Assistência à Saúde Culturalmente Competente; Educação em Enfermagem; Estudantes de Enfermagem; Estudos Transversais


Highlights:

(1) Culturally competent nurses can improve patient outcomes and reduce health inequity.

(2) Undergraduate programs should train nurses to become culturally competent nurses.

(3) Language skills and cultural encounter are related with greater cultural competence.

Introduction

Cultural factors can critically influence the nurse-patient relationship. While it is important that nurses be clinically and technically competent, cultural competence (CC) allows healthcare professionals to engage with culturally diverse patients in a way that respects their cultural identity, thus permitting safe practice and high-quality care. It requires nurses to develop an awareness of their own cultural reality, as well as the attitudes and behaviors that they bring to nursing care; to develop a profound respect and acceptance of the patient’s differences; and to prevent one’s personal beliefs from exerting an undue influence on those whose worldview is non-identical from one’s own ( 11. Tosun B; BENEFITS Group. Addressing the effects of transcultural nursing education on nursing students’ cultural competence: A systematic review. Nurse Educ Pract. 2021;55:103171. https://doi.org/10.1016/j.nepr.2021.103171
https://doi.org/10.1016/j.nepr.2021.1031...
) .

Caring for patients who are culturally diverse is part of most European nurses’ daily routine. Nursing professionals are expected to provide appropriate care to all patients, families and communities, ensuring that their rights are respected regardless of sociocultural identifiers such as race, ethnicity, gender, age and nationality, among others ( 22. Lawati MHA, Dennis S, Short SD, Abdulhadi NN. Patient safety and safety culture in primary health care: a systematic review. BMC Fam Pract. 2018;19(1):104. https://doi.org/10.1186/s12875-018-0793-7
https://doi.org/10.1186/s12875-018-0793-...
- 33. Broom A, Parker RB, Kirby E, Kokanovic R, Woodland L, Lwin Z, et al. A qualitative study of cancer care professionals’ experiences of working with migrant patients from diverse cultural backgrounds. BMJ Open. 2019;9(3):e025956. https://doi.org/10.1136/bmjopen-2018-025956
https://doi.org/10.1136/bmjopen-2018-025...
) . CC has been recognized as a bridge that enables nurses to connect to other cultures and understand the skills that are necessary to provide safe patient and family-centered cultural care ( 11. Tosun B; BENEFITS Group. Addressing the effects of transcultural nursing education on nursing students’ cultural competence: A systematic review. Nurse Educ Pract. 2021;55:103171. https://doi.org/10.1016/j.nepr.2021.103171
https://doi.org/10.1016/j.nepr.2021.1031...
) .

In order to ensure health equity for all, nurses must avoid ethnocentric attitudes and cultural bias, become sensitive to every patient’s needs, pay attention to verbal and non-verbal communication, build rapport, engage in cultural negotiation and make efforts to promote patient empowerment, thus creating a sense of safety within the healthcare environment ( 44. Soleimani M, Yarahmadi S. Cultural competence in critical care nurses and its relationships with empathy, job conflict, and work engagement: a cross-sectional descriptive study. BMC Nurs. 2023;22(1):113. https://doi.org/10.1186/s12912-023-01285-x
https://doi.org/10.1186/s12912-023-01285...
) . However, caring for a culturally diverse patient population can be challenging and requires appropriate preparation and training ( 55. Kreines FM, Quinn GP, Cardamone S, Pi GE, Cook T, Salas-Humara C, et al. Training clinicians in culturally relevant care: a curriculum to improve knowledge and comfort with the transgender and gender diverse population. J Assist Reprod Genet. 2022;39(12):2755-66. https://doi.org/10.1007/s10815-022-02655-1
https://doi.org/10.1007/s10815-022-02655...
) .

It is imperative that CC is integrated into nursing education in order to help students develop a culturally mindful and safe practice ( 66. Pacquiao DF, Maxwell JB, Ludwig-Beymer P, Stievano A, Sagar PL, Purnell L, et al. Integration of Population Health, Social Determinants, and Social Justice in Transcultural Nursing and Culturally Competent Care: White Paper by the Scholars Education Interest Group. J Transcult Nurs. 2023;34(3):175-7. https://doi.org/10.1177/10436596231163878
https://doi.org/10.1177/1043659623116387...
- 77. Isakov T, Kamau S, Koskenranta M, Kuivila H, Oikarainen A, Ropponen P, et al. Culturally and linguistically diverse nurses’ experiences of how competence facilitates integration into the working environment: A qualitative study. Nurse Educ Pract. 2023;67:103553. https://doi.org/10.1016/j.nepr.2023.103553
https://doi.org/10.1016/j.nepr.2023.1035...
) . In fact, previous educational interventions seeking to integrate CC in the nursing curriculum have been effective to improve CC in nursing students ( 88. Durant MA. Innovative activities with edible creations to enhance interdisciplinary health profession students’ levels of perceived self-efficacy and cultural competence: An experimental study. Nurse Educ Today. 2022;108:105188. https://doi.org/10.1016/j.nedt.2021.105188
https://doi.org/10.1016/j.nedt.2021.1051...
- 99. Paris DM, Slaymaker RR, Guest HA, Kalb AC. Interprofessional Simulation as an Educational Tool to Assess Cultural Competence Among Health Professions Students. Simul Healthc. 2023;18(3):163-71. https://doi.org/10.1097/SIH.0000000000000655
https://doi.org/10.1097/SIH.000000000000...
) . In a systematic review ( 1010. Govere L, Govere EM. How Effective is Cultural Competence Training of Healthcare Providers on Improving Patient Satisfaction of Minority Groups? A Systematic Review of Literature. Worldviews Evid Based Nurs. 2016;13(6):402-10. https://doi.org/10.1111/wvn.12176
https://doi.org/10.1111/wvn.12176...
) , authors evidenced that CC training had a positive impact on CC of healthcare professionals and was associated with increased patient satisfaction. Thus, it is important to design and implement creative, evidence-based educational activities that promote CC learning outcomes as part of undergraduate nursing programs ( 1111. Shin M, Na H, Kim S. Enhancing cultural competency and empathy toward foreign patients for Korean nursing students through a simulation: A quasi-experimental study. Nurse Educ Pract. 2023;69:103615. https://doi.org/10.1016/j.nepr.2023.103615
https://doi.org/10.1016/j.nepr.2023.1036...
- 1212. Ličen S, Prosen M. The development of cultural competences in nursing students and their significance in shaping the future work environment: a pilot study. BMC Med Educ. 2023;23(1):819. https://doi.org/10.1186/s12909-023-04800-5 .
https://doi.org/10.1186/s12909-023-04800...
) .

In the European context, higher education institutions (HEIs) are becoming increasingly aware of the need to respond to diverse patient populations. Specifically, it has been established that nursing curricula must provide a foundation for the development of CC that allows the acquisition of knowledge, skills and attitudes ( 1313. Mbango C. Incorporating global and cultural competencies in nursing education. Nursing. 2023;53(2):15-7. https://doi.org/10.1097/01.NURSE.0000902952.48970.b9
https://doi.org/10.1097/01.NURSE.0000902...
) . However, the integration of CC into the curriculum of European nursing undergraduate programs is still uneven ( 1414. Smith LS. Cultural competence: A nurse educator’s guide. Nursing. 2017;47(9):18-21. https://doi.org/10.1097/01.NURSE.0000522019.07806.83
https://doi.org/10.1097/01.NURSE.0000522...
- 1515. Rowan MS, Rukholm E, Bourque-Bearskin L, Baker C, Voyageur E, Robitaille A. Cultural competence and cultural safety in Canadian schools of nursing: a mixed methods study. Int J Nurs Educ Scholarsh. 2013;10:/j/ijnes.2013.10.issue-1/ijnes-2012-0043/ijnes-2012-0043.xml. https://doi.org/10.1515/ijnes-2012-0043
https://doi.org/10.1515/ijnes-2012-0043...
) . A scoping review of nursing curricula in Spain, Belgium, Portugal, and Turkey revealed a fragmented, non-consistent approach to the concept. For example, in Spain, only 4 out of 94 undergraduate nursing study programs delivered in the academic year 2018-2019 integrated CC as part of their curricula ( 1616. Universia España [Homepage]. Madrid; c2024 [cited 2023 Mar 16]. Available from: http://www.universia.es/
http://www.universia.es/...
) . This is in agreement with the generalized opinion that European nursing curricula lack detailed CC content ( 11. Tosun B; BENEFITS Group. Addressing the effects of transcultural nursing education on nursing students’ cultural competence: A systematic review. Nurse Educ Pract. 2021;55:103171. https://doi.org/10.1016/j.nepr.2021.103171
https://doi.org/10.1016/j.nepr.2021.1031...
) . However, before implementing any new strategies to address this issue, it is important to measure and analyze European undergraduate student nurses’ current level of CC. Hence, the main purpose of this study was to evaluate the level of CC of an undergraduate nursing students’ population from four European HEIs.

Method

Study design and participants

This study is part of a larger EU-funded project entitled “Transcultural Nursing: A European Priority, a Professional Responsibility for Higher Education” (TC-NURSE), which focuses on cultural, linguistic, and religious diversity, and promotes ownership of shared values, equality, non-discrimination and social inclusion through education and training at higher education level.

A cross-sectional study of CC was performed on a sample of first to fourth year undergraduate nursing students from four European Universities ( Universidad San Jorge , Spain; Istanbul Aydin University, Turkey; Artis Plantin Hogeschool Antwerpen , Belgium; Instituto Politécnico de Portalegre , Portugal). All the universities included in the study implemented student internationalization programs to promote global awareness, cross-cultural understanding, and international collaboration. As a result, all of them were connected to international student mobility and benefited from several internationalization initiatives, including the ERASMUS program.

A universal sampling technique was used; that is, all undergraduate student nurses registered in one of the participating universities were invited to participate in the study. The study sample included 168 nursing students from four undergraduate nursing programmes.

The following were inclusion criteria for participant selection: a) undergraduate nursing students registered in one of the participating HEIs; b) be able to read written English. We excluded from our sample any participants who could not communicate in the official language of each country or in English, and those who refused to give informed consent.

An introductory email containing the link to a confidential electronic survey was sent to all the student nurses via university email, explaining the objective of the study, ensuring anonymity and confidentiality of the responses and inviting them to participate. A reminder was sent 2 weeks later. The invitation and data collection were carried out by some of the researchers of the study.

Data collection

Data were collected between October and November 2021 at the four participating universities.

Sociodemographic variables

The first, self-constructed questionnaire contained 18 items and was designed to describe the participants’ sociodemographic characteristics and cultural background. We collected information about the student nurses’ age, gender, occupation, race/ethnicity, religion, socioeconomic level, year of study, clinical work experience, previous CC training and experience working with clients from diverse cultural backgrounds, among other characteristics.

Intercultural Sensitivity

The Intercultural Sensitivity Scale (ISS) contains 24 items ( 1717. Chen GM, Starosta WJ. The development and validation of the intercultural sensitivity scale. Hum Commun. 2000;3:1-15. https://doi.org/10.1037/t61546-000
https://doi.org/10.1037/t61546-000...
) . This tool was designed to assess intercultural communication competence and integrates both cross-cultural attitude and behavioural skills. It is based on a 5-point Likert scale (5= strongly agree, 4= agree, 3= uncertain, 2= disagree and 1= strongly disagree). It consists of five factors or constructs on which the statements are based: interaction engagement (7 items), respect for cultural differences (6 items), interaction confidence (5 items), interaction enjoyment (3 items) and interaction attentiveness (3 items). The overall score of the ISS ranges between 24 and 120 with higher scores indicating greater intercultural competency. This scale has demonstrated high internal consistency with .86 reliability coefficient.

Cultural Competence

The Cultural Competence Assessment Tool (CCATool) in its Student version was used to measure CC in our sample ( 1818. Papadopoulos I. The RCTSH Cultural Competence Assessment Tool (CCATool). London: Research Centre for Transcultural Studies in Health; 2001. ) . This instrument is based on the model of development of cultural competence ( 1919. Papadopoulos I. Culturally Competent Compassion: A guide for healthcare students and practitioners. New York, NY: Routledge; 2018. ) . It includes four sections measuring cultural awareness, cultural knowledge, cultural sensitivity and cultural practice, and a final section of sociodemographic data. This final section was removed from the electronic survey as we measured the sociodemographic and cultural characteristics of our participants through a self-constructed questionnaire. Each of the four sections contains 10 statements measured on a 4-point Likert scale which respondents must agree or disagree with (1= completely disagree, 2= disagree, 3= agree, 4= completely agree) . In addition, visual analogue scales (VAS) were included to allow the participants to self-rate their cultural awareness, knowledge, sensitivity, and practice. Validity was confirmed using expert panels; Cronbach alpha reliability coefficient was .70 or higher ( 2020. Papadopoulos I, Tilki M, Lees S. Promoting cultural competence in healthcare through a research-based intervention in the UK. Div Health Soc Care [Internet]. 2004 [cited 2023 Mar 16];1:107-16. Available from: https://diversityhealthcare.imedpub.com/abstract/promoting-cultural-competence-in-healthcare-through-a-research-based-intervention-in-the-uk-5809.html
https://diversityhealthcare.imedpub.com/...

21. Repo H, Vahlberg T, Salminen L, Papadopoulos I, Leino-Kilpi H. The Cultural Competence of Graduating Nursing Students. J Transcult Nurs. 2017;28(1):98-107. https://doi.org/10.1177/1043659616632046
https://doi.org/10.1177/1043659616632046...
- 2222. Papadopoulos I, Lees S. Developing culturally competent researchers. J Adv Nurs. 2002;37(3):258-64. https://doi.org/10.1046/j.1365-2648.2002.02092.x
https://doi.org/10.1046/j.1365-2648.2002...
) .

Cultural Awareness

Developed in 2003 and reviewed in 2014 ( 2323. Rew L, Becker H, Cookston J, Khosropour S, Martinez S. Measuring cultural awareness in nursing students. J Nurs Educ. 2003;42(6):249-57. https://doi.org/10.3928/0148-4834-20030601-07
https://doi.org/10.3928/0148-4834-200306...
- 2424. Osmancevic S, Grossschadl F, Lohrmann C. Cultural competence among nursing students and nurses working in acute care settings: a cross-sectional study. BMC Health Serv Res. 2023;23(1):105. https://doi.org/10.1186/s12913-023-09103-5
https://doi.org/10.1186/s12913-023-09103...
) , the Cultural Awareness Scale (CAS) is a 36-item scale measured on a 7-point Likert scale, and includes five constructs or categories of cultural awareness, namely general educational experience, cognitive awareness, research issues, behavior/comfort with interactions and patient care/clinical issues. The internal consistence reliability of the CAS has previously been demonstrated in nursing students ( 99. Paris DM, Slaymaker RR, Guest HA, Kalb AC. Interprofessional Simulation as an Educational Tool to Assess Cultural Competence Among Health Professions Students. Simul Healthc. 2023;18(3):163-71. https://doi.org/10.1097/SIH.0000000000000655
https://doi.org/10.1097/SIH.000000000000...
, 2323. Rew L, Becker H, Cookston J, Khosropour S, Martinez S. Measuring cultural awareness in nursing students. J Nurs Educ. 2003;42(6):249-57. https://doi.org/10.3928/0148-4834-20030601-07
https://doi.org/10.3928/0148-4834-200306...
) .

Data analysis

Descriptive statistics (mean, standard deviation, and percentage) were calculated to describe the characteristics of the sample. Homogeneity and distribution of the results were examined. When a scale showed a normal distribution, independent sample student t- test or ANOVA were used in comparisons; non-parametric tests (Mann-Whitney U test or Kruskal-Wallis) were used when a scale did not show a normal distribution. All statistical analyses were performed using the software Statistical Package for the Social Sciences (version 21.0, SPSS Institute Inc., Chicago, IL, USA). The significance level was set at α = 0.05.

Ethical considerations

Eligible participants were informed about the project aims and purpose, and participation in the study was voluntary. Informed consent to participate in the study was assumed when participants completed and sent the electronic survey. Permission to use the measuring tools applied in this study was sought and granted by the authors. The present study was approved by the Research Ethics Committee of Universidad of San Jorge (16-2019) and was carried out in accordance with the principles of the Declaration of Helsinki.

Results

Participants’ characteristics

The participants’ sociodemographic and cultural characteristics are shown in Table 1 . A total of 168 undergraduate nursing students from the study sites responded to the electronic survey. Specifically, 63 students participated from Spain (37.5%), 56 from Turkey (33.5%), 32 from Belgium (19%) and 17 from Portugal (10%). Most of the participants were female (82%), single (86.3%) and mean age was 21.6±3.93 years. 41% of our participants were on their first or second year of study, whereas 59% were on their third or final year. regarding relation to their cultural characteristics, the vast majority of our students described themselves as being from a white background (92.3%); only 3.6% of our students described themselves as being black, 3% as being Asian and 1.2% as being Arab. In terms of their socioeconomic status, our results show that most of our participants were from a middle-class background (85.1%) and resided in an urban area (84.5%). Half of our participants did not have previous clinical work experience and most of them had never attended a CC training course (80.45%). In addition, only 14.3% of the nursing students had lived abroad for at least 3 months. Interestingly, approximately sixty percent of the students described themselves as belonging to a culturally diverse family or group of friends and half of our sample said that they had looked after patients from a diverse cultural background during their practice placements (51.8%).

Table 1
- Socio demographic and cultural characteristics (n = 168). Zaragoza, Spain; Portalegre, Portugal; Istanbul, Turkey; Antwerp, Belgium, 2021

Intercultural Sensitivity

The results from the ISS are displayed in Table 2 . The overall mean score was 95.80±10.86. Taking into account the number of items in the ISS subscales, mean scores were slightly higher for the subscales interaction engagement (27.85±3.51), respect for cultural differences (25.27±4.08) and interaction enjoyment (12.47±2.69); comparatively lower mean scores were observed in the subscales interaction confidence (18.75±2.92) and interaction attentiveness (11.61±1.88).

No significant differences were found in the scores from the subscales interaction confidence, interaction enjoyment and interaction attentiveness between the students by country of study. The Portuguese students showed higher scores across the subscales interaction engagement (29.70±2.84; p=0.029) and respect for cultural differences (p=0.000); the Belgian students also obtained higher scores from the respect for cultural differences subscale compared with the Spanish and Turkish students.

Table 2
- Results from Intercultural Sensitivity Scale classified by country of study (n = 168). Zaragoza, Spain; Portalegre, Portugal; Istanbul, Turkey; Antwerp, Belgium, 2021

Cultural Competence

The results from the CCATool have been presented in Table 3 . The participants scored higher in the cultural awareness (4.06) and cultural practice (4.01) dimensions, and slightly lower in cultural competence (3.81), cultural knowledge (3.69) and cultural sensitivity (3.46).

The scores obtained by the students from the different European universities were similar. No significant differences were found between the student nurses by country of study, with the exception of the first dimension, cultural awareness. The results indicate that a statistically significant difference exists in the scores obtained by the students on cultural awareness (Spain-Turkey; p=0.023).

Table 3
- Cultural Competence Assessment Tool results classified by the students’ country (n = 168). Zaragoza, Spain; Portalegre, Portugal; Istanbul, Turkey; Antwerp, Belgium, 2021

Cultural Awareness

Table 4 shows the results from the CAS, overall and by categories, by country of study. Mean score for this scale was 188.07±21.45. The Portuguese students presented the highest scores overall and in all the categories, with a statistically significant difference between them and the rest of the student nurses on the CAS score (p=0.006). The Belgian students scored the lowest in general education experience, although no significant differences were found in this category. There was a statistically significant difference between Spanish and Turkish student nurses in cognitive awareness (p=0.005), and between Spanish and Belgian students in research issues (p=0.004). No difference was observed in behaviors/comfort between the four groups of student nurses. Finally, a statistically significant difference was observed in the patient care/clinical issues category (Portugal 31.0±2.03; Spain 28.26±3.15; p=0.009).

Table 4
- Cultural Awareness Scale results by country of study (n = 168). Zaragoza, Spain; Portalegre, Portugal; Istanbul, Turkey; Antwerp, Belgium, 2021

A bivariate analysis of the relationship between the students’ level of intercultural sensitivity, CC and cultural awareness, and their year of study was carried out. Students were divided into two groups: 1) First and second year students (41%), and 2) Third and fourth year students (59%). No significant differences were found between both groups for the CAS (p=0.133), ISS (p=0.570) and CCATool (p=0.624) (data not on the tables).

Discussion

The sociodemographic characteristics of our participants reflected those of the majority of undergraduate student nurses registered at the four participating universities. In relation to the students’ cultural features, we found it interesting that the majority described themselves as belonging to a culturally diverse family or group of friends. This is probably a reflection of society in the four countries of this study, but it may also be due to the students adopting a broader understanding of cultural difference as involving not only race and ethnicity but also other characteristics such as age, religion, sexual orientation and geographical area ( 2424. Osmancevic S, Grossschadl F, Lohrmann C. Cultural competence among nursing students and nurses working in acute care settings: a cross-sectional study. BMC Health Serv Res. 2023;23(1):105. https://doi.org/10.1186/s12913-023-09103-5
https://doi.org/10.1186/s12913-023-09103...
) .

As a whole, our students achieved a high level of intercultural sensitivity. Similar results were obtained by other authors in three samples of health professions students in Turkey ( 2525. Meydanlioglu A, Arikan F, Gozum S. Cultural sensitivity levels of university students receiving education in health disciplines. Adv Health Sci Educ Theory Pract. 2015;20(5):1195-204. https://doi.org/10.1007/s10459-015-9595-z
https://doi.org/10.1007/s10459-015-9595-...
- 2626. Kılıç SP, Sevinç S. The Relationship Between Cultural Sensitivity and Assertiveness in Nursing Students from Turkey. J Transcult Nurs. 2018;29(4):379-86. https://doi.org/10.1177/1043659617716518
https://doi.org/10.1177/1043659617716518...
) and Australia ( 2727. Malau-Aduli BS, Ross S, Adu MD. Perceptions of intercultural competence and institutional intercultural inclusiveness among first year medical students: a 4-year study. BMC Med Educ. 2019;19(1):346. https://doi.org/10.1186/s12909-019-1780-y
https://doi.org/10.1186/s12909-019-1780-...
) . Specifically, it was observed that both medical and nursing students who interacted with people from different cultures and spoke a second language presented higher levels of intercultural sensitivity ( 2525. Meydanlioglu A, Arikan F, Gozum S. Cultural sensitivity levels of university students receiving education in health disciplines. Adv Health Sci Educ Theory Pract. 2015;20(5):1195-204. https://doi.org/10.1007/s10459-015-9595-z
https://doi.org/10.1007/s10459-015-9595-...
) . Interestingly, all the students in our sample spoke at least one more language (English), and over half of them belonged to a culturally diverse group of friends and/or family and had experience looking after patients from minority cultures through their clinical placements.

The level of cultural competence of our participants as measured by the CCATool was moderate. In a study of 295 graduating students in Finland ( 2121. Repo H, Vahlberg T, Salminen L, Papadopoulos I, Leino-Kilpi H. The Cultural Competence of Graduating Nursing Students. J Transcult Nurs. 2017;28(1):98-107. https://doi.org/10.1177/1043659616632046
https://doi.org/10.1177/1043659616632046...
) were obtained similar results, with the difference that our students obtained higher levels of cultural knowledge, whereas theirs displayed better levels of cultural competence. It was interesting to observe that whilst over 80% of these participants had had some form of formal CC training, only 20% of our sample had previously attended a CC course. However, an association was stablished in both cases between frequency of cultural encounters and linguistic skills, and higher levels of cultural competence.

Our students achieved a moderate level of cultural awareness. In a recent cross-sectional study ( 2727. Malau-Aduli BS, Ross S, Adu MD. Perceptions of intercultural competence and institutional intercultural inclusiveness among first year medical students: a 4-year study. BMC Med Educ. 2019;19(1):346. https://doi.org/10.1186/s12909-019-1780-y
https://doi.org/10.1186/s12909-019-1780-...
) involving a sample of nurses and nursing students, they observed high levels of cultural awareness among the sample (mean = 4.42; SD = 0.45). This would support our initial observation that CC is not integrated in the curricula, or at least it is not made explicit to the students when cultural issues are addressed in the classroom.

We analysed the students’ scores from the three scales separately by country of study. Overall, the Portuguese and the Belgian students achieved higher scores than the Spanish and the Turkish in all the scales. It is possible that these results truly reflect a difference between the four groups of student nurses. However, the fact that fewer undergraduate student nurses from Belgium and Portugal participated in this study may have resulted in a sample of students with a particular interest or inclination for CC and, therefore, potentially presenting a higher level of cultural sensitivity awareness and competence. The fact that health professions students in general, and nursing students in particular, achieve high levels on intercultural sensitive is not surprising. The items comprised in the ISS refer to attitudes and/or qualities that are expected of a nurse, such as “I am open-minded to people from different cultures” and “I respect the ways people from different cultures behave”. It is of course possible that the mean score obtained by our student nurses in the ISS is a true reflection of their level of intercultural sensitivity. However, it is also possible that their responses are partially influenced by their projected image of what a qualified nurse should be or behave like. After all, qualities such as respect, open-mindedness and tolerance are frequently associated with the nursing profession, and all of those would be required to demonstrate a high level of cultural sensitivity ( 2828. Gradellini C, Gómez-Cantarino S, Dominguez-Isabel P, Molina-Gallego B, Mecugni D, Ugarte-Gurrutxaga MI. Cultural Competence and Cultural Sensitivity Education in University Nursing Courses. A Scoping Review. Front Psychol. 2021;12:682920. https://doi.org/10.3389/fpsyg.2021.682920
https://doi.org/10.3389/fpsyg.2021.68292...
) .

Regardless of the motivation behind the students’ responses, this is a highly important finding and one that should be considered when designing materials and teaching and learning activities relating to CC. Based on our findings, it could be argued that undergraduate nursing students are a fertile ground on which to continue growing the knowledge, skills, and attitudes that are necessary to become a culturally competent professional. Appraising the students’ initial competence level is key to the design of learning outcomes which are achievable yet challenging for a group of students; to the preparation of teaching and learning materials and activities which enable the students to acquire new, and continue developing existing, knowledge, skills, and attitudes; and to the fair and adequate evaluation of student learning. Thus, we recommend that university lecturers and clinical tutors take the students’ initial level of intercultural sensitivity into account when planning their teaching sessions.

Factors such as language competence and cultural encounter are frequently associated with higher levels of cultural competence ( 2929. Majda A, Zalewska-Puchała J, Bodys-Cupak I, Kurowska A, Barzykowski K. Evaluating the Effectiveness of Cultural Education Training: Cultural Competence and Cultural Intelligence Development among Nursing Students. Int J Environ Res Public Health. 2021;18(8):4002. https://doi.org/10.3390/ijerph18084002
https://doi.org/10.3390/ijerph18084002...
- 3030. Lin MH, Hsu HC. Effects of a cultural competence education programme on clinical nurses: A randomised controlled trial. Nurse Educ Today. 2020;88:104385. https://doi.org/10.1016/j.nedt.2020.104385
https://doi.org/10.1016/j.nedt.2020.1043...
) . All our students were able to speak English and at least half of them were able to interact with people from diverse cultural backgrounds either during clinical placements or as part of a diverse group of friends or family. These characteristics may have resulted in an overestimation of the intercultural sensitivity, CC, and cultural awareness of our participants. Having said this, it seems clear that promoting our students’ language skills and allowing them to experience cultural encounter, both as part of their study programmes and as complementary activities such as summer schools and elective courses with a focus on internationalisation, could be useful to increase their level of CC. Therefore, we argue opportunities should be provided for nursing students to interact with people from diverse cultural backgrounds, develop language skills, and provide possibilities for internationalization ( 3131. Arruzza E, Chau M. The effectiveness of cultural competence education in enhancing knowledge acquisition, performance, attitudes, and student satisfaction among undergraduate health science students: a scoping review. J Educ Eval Health Prof. 2021;18:3. https://doi.org/10.3352/jeehp.2021.18.3
https://doi.org/10.3352/jeehp.2021.18.3...
) .

It was highly interesting to observe that no significant differences existed in the results from the ISS; the CCATool and the CAS by the students’ year of study. We expected our third and final year students to achieve a higher level of CC than that of the first and second years. This was based on the assumption that students on their third and fourth year of study are exposed to a larger and wider range of learning opportunities, including international mobility programmes, internationalization at home, clinical placements, etc. This finding supports our view that CC is not sufficiently integrated into European undergraduate nursing programmes; it would also suggest that current compulsory and elective learning opportunities are either not effective or are not taken advantage of by the students. Previous studies have demonstrated that the integration of CC modules and training courses in the curriculum is effective in promoting CC among undergraduate student nurses ( 3232. Farber JE. Cultural Competence of Baccalaureate Nurse Faculty: Relationship to Cultural Experiences. J Prof Nurs. 2019;35(2):81-8. https://doi.org/10.1016/j.profnurs.2018.09.005
https://doi.org/10.1016/j.profnurs.2018....
- 3333. Ho TT, Oh J. Development and Evaluation of Cultural Competence Course on Undergraduate Nursing Students in Vietnam. Int J Environ Res Public Health. 2022;19(2):888. https://doi.org/10.3390/ijerph19020888
https://doi.org/10.3390/ijerph19020888...
) . We suggest that such activities are designed carefully, based on the students’ initial level of CC, and include elements which have been strongly associated with higher CC, including language skills, cultural encounter and opportunities for internationalisation.

There was a statistically significant difference between Spanish and Turkish student nurses in cognitive awareness. There are several factors that may contribute to the variation in levels of cognitive awareness of cultural competence among student nurses, including students’ personal background and experiences, educational preparation, clinical placements, the effectiveness of teaching methods and instructional materials used to impart CC concepts, the attitudes, beliefs, and teaching practices of nursing faculty, the students’ ability and capacity for self-reflection and critical thinking and, last but not least, exposure to CC training.

Overall, the interplay of personal factors, educational experiences, faculty influence, clinical exposure, and self-directed learning contributes to the variation in levels of cognitive awareness of cultural competence among student nurses. Efforts to enhance cultural competence education and create supportive learning environments can help bridge these disparities and ensure that all students develop the necessary awareness and skills to provide culturally sensitive care.

The core findings of this study showed that nursing students from different European Universities have a high grade of intercultural sensitivity, suggesting that nursing school training programs are attempting to promote some areas of cultural competence, such as to understand, appreciate and respect people from other cultures. However, successful integration of CC into nursing curricula requires a comprehensive approach that may encompass various strategies and considerations, including: 1) Clearly defining specific learning objectives related to cultural competence within the nursing curriculum; 2) Infusing CC content throughout the nursing curriculum rather than confining it to a single course or module; 3) Providing opportunities for students to engage in real-world experiences that expose them to diverse cultures and communities, for example as part of clinical placements in culturally diverse settings; 4) Offering cultural immersion experiences, such as international clinical rotations or community-based projects in multicultural neighborhoods; 5) Collaborating with other healthcare disciplines to incorporate interprofessional education focused on cultural competence; 6) Providing faculty with training and resources to effectively teach cultural competence concepts and facilitate meaningful discussions on cultural diversity in the classroom; 7) Integrating assessment tools and methods to evaluate students’ CC throughout the nursing program; 8) Establishing partnerships with community organizations, cultural centers, and healthcare agencies serving diverse populations, and collaborating with stakeholders who can provide valuable opportunities for students to interact with and learn from individuals from different cultural backgrounds; 9) Providing students with access to resources and support services, such as cultural competence workshops, online training modules, and cultural sensitivity training materials, and 10) Regularly assessing the effectiveness of CC initiatives within the nursing curriculum and solicit feedback from students, faculty, and community partners.

Overall, this research can contribute to the advancement of scientific knowledge by enhancing our understanding of cultural competence development, educational interventions, cross-cultural variations, barriers and facilitators, and assessment methods within nursing education and practice.

There are some limitations in this study that should be noted. First, the length of the electronic survey was a concern (163 items); some students might have found it onerous to complete, resulting in some degree of response bias. However, we were interested in measuring the students’ intercultural sensitivity as well as their perceived level of cultural competence; the CAS tool allowed us to also evaluate the students’ perception or awareness of cultural competence education and training received at their respective universities. Second, considering the total universe of student nurses registered in the study sites, our sample size was limited. This is particularly true in the case of Artis Plantin Hogeschool Antwerpen and Instituto Politécnico de Portalegre and may explain the Belgian and Portuguese students’ higher scores in some of the questionnaires to some extent. This may have been prevented by adapting and translating the tools into the four languages of the study, but this option was discarded due to time and budget constraints. Finally, the fact that all our students were able to speak English, and speaking a second language has been associated with higher levels of CC, makes it difficult to generalize our results to the whole population of undergraduate student nurses in the four countries of the study.

Conclusion

Undergraduate nursing students from four European Universities achieved a high level of intercultural sensitivity and a moderate level of CC and cultural awareness. Thus, it is highly necessary that nursing educators take into consideration the students’ level of CC prior to designing and implementing any related study programmes.

Nursing students are not a white canvas but a fertile ground on which to continue growing the knowledge, skills and attitudes needed to become culturally competent professionals. Accordingly, future teaching and learning programmes and activities related to CC should be carefully designed and include elements which have been associated with enhanced CC, including language skills, cultural encounter, and opportunities for internationalization.

References

  • 1.
    Tosun B; BENEFITS Group. Addressing the effects of transcultural nursing education on nursing students’ cultural competence: A systematic review. Nurse Educ Pract. 2021;55:103171. https://doi.org/10.1016/j.nepr.2021.103171
    » https://doi.org/10.1016/j.nepr.2021.103171
  • 2.
    Lawati MHA, Dennis S, Short SD, Abdulhadi NN. Patient safety and safety culture in primary health care: a systematic review. BMC Fam Pract. 2018;19(1):104. https://doi.org/10.1186/s12875-018-0793-7
    » https://doi.org/10.1186/s12875-018-0793-7
  • 3.
    Broom A, Parker RB, Kirby E, Kokanovic R, Woodland L, Lwin Z, et al. A qualitative study of cancer care professionals’ experiences of working with migrant patients from diverse cultural backgrounds. BMJ Open. 2019;9(3):e025956. https://doi.org/10.1136/bmjopen-2018-025956
    » https://doi.org/10.1136/bmjopen-2018-025956
  • 4.
    Soleimani M, Yarahmadi S. Cultural competence in critical care nurses and its relationships with empathy, job conflict, and work engagement: a cross-sectional descriptive study. BMC Nurs. 2023;22(1):113. https://doi.org/10.1186/s12912-023-01285-x
    » https://doi.org/10.1186/s12912-023-01285-x
  • 5.
    Kreines FM, Quinn GP, Cardamone S, Pi GE, Cook T, Salas-Humara C, et al. Training clinicians in culturally relevant care: a curriculum to improve knowledge and comfort with the transgender and gender diverse population. J Assist Reprod Genet. 2022;39(12):2755-66. https://doi.org/10.1007/s10815-022-02655-1
    » https://doi.org/10.1007/s10815-022-02655-1
  • 6.
    Pacquiao DF, Maxwell JB, Ludwig-Beymer P, Stievano A, Sagar PL, Purnell L, et al. Integration of Population Health, Social Determinants, and Social Justice in Transcultural Nursing and Culturally Competent Care: White Paper by the Scholars Education Interest Group. J Transcult Nurs. 2023;34(3):175-7. https://doi.org/10.1177/10436596231163878
    » https://doi.org/10.1177/10436596231163878
  • 7.
    Isakov T, Kamau S, Koskenranta M, Kuivila H, Oikarainen A, Ropponen P, et al. Culturally and linguistically diverse nurses’ experiences of how competence facilitates integration into the working environment: A qualitative study. Nurse Educ Pract. 2023;67:103553. https://doi.org/10.1016/j.nepr.2023.103553
    » https://doi.org/10.1016/j.nepr.2023.103553
  • 8.
    Durant MA. Innovative activities with edible creations to enhance interdisciplinary health profession students’ levels of perceived self-efficacy and cultural competence: An experimental study. Nurse Educ Today. 2022;108:105188. https://doi.org/10.1016/j.nedt.2021.105188
    » https://doi.org/10.1016/j.nedt.2021.105188
  • 9.
    Paris DM, Slaymaker RR, Guest HA, Kalb AC. Interprofessional Simulation as an Educational Tool to Assess Cultural Competence Among Health Professions Students. Simul Healthc. 2023;18(3):163-71. https://doi.org/10.1097/SIH.0000000000000655
    » https://doi.org/10.1097/SIH.0000000000000655
  • 10.
    Govere L, Govere EM. How Effective is Cultural Competence Training of Healthcare Providers on Improving Patient Satisfaction of Minority Groups? A Systematic Review of Literature. Worldviews Evid Based Nurs. 2016;13(6):402-10. https://doi.org/10.1111/wvn.12176
    » https://doi.org/10.1111/wvn.12176
  • 11.
    Shin M, Na H, Kim S. Enhancing cultural competency and empathy toward foreign patients for Korean nursing students through a simulation: A quasi-experimental study. Nurse Educ Pract. 2023;69:103615. https://doi.org/10.1016/j.nepr.2023.103615
    » https://doi.org/10.1016/j.nepr.2023.103615
  • 12.
    Ličen S, Prosen M. The development of cultural competences in nursing students and their significance in shaping the future work environment: a pilot study. BMC Med Educ. 2023;23(1):819. https://doi.org/10.1186/s12909-023-04800-5 .
    » https://doi.org/10.1186/s12909-023-04800-5.
  • 13.
    Mbango C. Incorporating global and cultural competencies in nursing education. Nursing. 2023;53(2):15-7. https://doi.org/10.1097/01.NURSE.0000902952.48970.b9
    » https://doi.org/10.1097/01.NURSE.0000902952.48970.b9
  • 14.
    Smith LS. Cultural competence: A nurse educator’s guide. Nursing. 2017;47(9):18-21. https://doi.org/10.1097/01.NURSE.0000522019.07806.83
    » https://doi.org/10.1097/01.NURSE.0000522019.07806.83
  • 15.
    Rowan MS, Rukholm E, Bourque-Bearskin L, Baker C, Voyageur E, Robitaille A. Cultural competence and cultural safety in Canadian schools of nursing: a mixed methods study. Int J Nurs Educ Scholarsh. 2013;10:/j/ijnes.2013.10.issue-1/ijnes-2012-0043/ijnes-2012-0043.xml. https://doi.org/10.1515/ijnes-2012-0043
    » https://doi.org/10.1515/ijnes-2012-0043
  • 16.
    Universia España [Homepage]. Madrid; c2024 [cited 2023 Mar 16]. Available from: http://www.universia.es/
    » http://www.universia.es/
  • 17.
    Chen GM, Starosta WJ. The development and validation of the intercultural sensitivity scale. Hum Commun. 2000;3:1-15. https://doi.org/10.1037/t61546-000
    » https://doi.org/10.1037/t61546-000
  • 18.
    Papadopoulos I. The RCTSH Cultural Competence Assessment Tool (CCATool). London: Research Centre for Transcultural Studies in Health; 2001.
  • 19.
    Papadopoulos I. Culturally Competent Compassion: A guide for healthcare students and practitioners. New York, NY: Routledge; 2018.
  • 20.
    Papadopoulos I, Tilki M, Lees S. Promoting cultural competence in healthcare through a research-based intervention in the UK. Div Health Soc Care [Internet]. 2004 [cited 2023 Mar 16];1:107-16. Available from: https://diversityhealthcare.imedpub.com/abstract/promoting-cultural-competence-in-healthcare-through-a-research-based-intervention-in-the-uk-5809.html
    » https://diversityhealthcare.imedpub.com/abstract/promoting-cultural-competence-in-healthcare-through-a-research-based-intervention-in-the-uk-5809.html
  • 21.
    Repo H, Vahlberg T, Salminen L, Papadopoulos I, Leino-Kilpi H. The Cultural Competence of Graduating Nursing Students. J Transcult Nurs. 2017;28(1):98-107. https://doi.org/10.1177/1043659616632046
    » https://doi.org/10.1177/1043659616632046
  • 22.
    Papadopoulos I, Lees S. Developing culturally competent researchers. J Adv Nurs. 2002;37(3):258-64. https://doi.org/10.1046/j.1365-2648.2002.02092.x
    » https://doi.org/10.1046/j.1365-2648.2002.02092.x
  • 23.
    Rew L, Becker H, Cookston J, Khosropour S, Martinez S. Measuring cultural awareness in nursing students. J Nurs Educ. 2003;42(6):249-57. https://doi.org/10.3928/0148-4834-20030601-07
    » https://doi.org/10.3928/0148-4834-20030601-07
  • 24.
    Osmancevic S, Grossschadl F, Lohrmann C. Cultural competence among nursing students and nurses working in acute care settings: a cross-sectional study. BMC Health Serv Res. 2023;23(1):105. https://doi.org/10.1186/s12913-023-09103-5
    » https://doi.org/10.1186/s12913-023-09103-5
  • 25.
    Meydanlioglu A, Arikan F, Gozum S. Cultural sensitivity levels of university students receiving education in health disciplines. Adv Health Sci Educ Theory Pract. 2015;20(5):1195-204. https://doi.org/10.1007/s10459-015-9595-z
    » https://doi.org/10.1007/s10459-015-9595-z
  • 26.
    Kılıç SP, Sevinç S. The Relationship Between Cultural Sensitivity and Assertiveness in Nursing Students from Turkey. J Transcult Nurs. 2018;29(4):379-86. https://doi.org/10.1177/1043659617716518
    » https://doi.org/10.1177/1043659617716518
  • 27.
    Malau-Aduli BS, Ross S, Adu MD. Perceptions of intercultural competence and institutional intercultural inclusiveness among first year medical students: a 4-year study. BMC Med Educ. 2019;19(1):346. https://doi.org/10.1186/s12909-019-1780-y
    » https://doi.org/10.1186/s12909-019-1780-y
  • 28.
    Gradellini C, Gómez-Cantarino S, Dominguez-Isabel P, Molina-Gallego B, Mecugni D, Ugarte-Gurrutxaga MI. Cultural Competence and Cultural Sensitivity Education in University Nursing Courses. A Scoping Review. Front Psychol. 2021;12:682920. https://doi.org/10.3389/fpsyg.2021.682920
    » https://doi.org/10.3389/fpsyg.2021.682920
  • 29.
    Majda A, Zalewska-Puchała J, Bodys-Cupak I, Kurowska A, Barzykowski K. Evaluating the Effectiveness of Cultural Education Training: Cultural Competence and Cultural Intelligence Development among Nursing Students. Int J Environ Res Public Health. 2021;18(8):4002. https://doi.org/10.3390/ijerph18084002
    » https://doi.org/10.3390/ijerph18084002
  • 30.
    Lin MH, Hsu HC. Effects of a cultural competence education programme on clinical nurses: A randomised controlled trial. Nurse Educ Today. 2020;88:104385. https://doi.org/10.1016/j.nedt.2020.104385
    » https://doi.org/10.1016/j.nedt.2020.104385
  • 31.
    Arruzza E, Chau M. The effectiveness of cultural competence education in enhancing knowledge acquisition, performance, attitudes, and student satisfaction among undergraduate health science students: a scoping review. J Educ Eval Health Prof. 2021;18:3. https://doi.org/10.3352/jeehp.2021.18.3
    » https://doi.org/10.3352/jeehp.2021.18.3
  • 32.
    Farber JE. Cultural Competence of Baccalaureate Nurse Faculty: Relationship to Cultural Experiences. J Prof Nurs. 2019;35(2):81-8. https://doi.org/10.1016/j.profnurs.2018.09.005
    » https://doi.org/10.1016/j.profnurs.2018.09.005
  • 33.
    Ho TT, Oh J. Development and Evaluation of Cultural Competence Course on Undergraduate Nursing Students in Vietnam. Int J Environ Res Public Health. 2022;19(2):888. https://doi.org/10.3390/ijerph19020888
    » https://doi.org/10.3390/ijerph19020888
  • *
    Supported by European Program Erasmus+, Key Action 203 Strategic Partnerships for Higher Education (Line KA203), Grant #2018-1-ES01-KA203-050800.
  • All authors approved the final version of the text.
  • How to cite this article
    Sagarra-Romero L, Ramón-Arbués E, Huércanos-Esparza I, Kalkan I, Kömürcü N, Vanceulebroeck V, et al. Cultural competence of undergraduate student nurses: a multicenter study. Rev. Latino-Am. Enfermagem. 2024;32:e4230 [cited year month day]. Available from: URL . https://doi.org/10.1590/1518-8345.7070.4230

Edited by

Associate Editor:
Rosalina Aparecida Partezani Rodrigues

Publication Dates

  • Publication in this collection
    05 July 2024
  • Date of issue
    2024

History

  • Received
    20 Sept 2023
  • Accepted
    12 Mar 2024
Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br