Effectiveness of teaching strategies on the development of critical thinking in undergraduate nursing students: a meta-analysis ^*

Efectividad de las estrategias de enseñanza en el desarrollo del pensamiento crítico de estudiantes de pregrado de enfermería: un metaanálisis

Abstract

OBJECTIVE

To evaluate the effectiveness of teaching strategies used for development of critical thinking (CT) in undergraduate nursing students.

METHOD

Systematic review with meta-analysis based on the recommendations of the Joanna Briggs Institute . Searches were conducted in the following databases: PubMed, CINAHL, EMBASE, Web of Science, SCOPUS, LILACS, Cochrane CENTRAL, PsycINFO, ERIC, and a database of theses from four continents. The initial selection and evaluation of studies and assessment of methodological quality was performed by two reviewers independently.

RESULTS

Twelve randomized clinical trials were included in the study. In the meta-analysis of the four studies included that evaluated the strategy of problem-based learning (PBL), compared to lectures, the effectiveness of PBL was demonstrated with statistical significance (SMD = 0.21 and 95% CI = 0.01 to 0.42; p = 0.0434) for the development of CT in undergraduate nursing students, and the studies were homogeneous (chi-square = 6.10, p = 0.106).

CONCLUSION

The effectiveness of PBL was demonstrated in the increase of overall CT scores. Further studies need to be conducted in order to develop, implement and evaluate teaching strategies that are guided in high methodological rigor, and supported in theoretical models of teaching and learning.

Descriptors
Thinking; Students, Nursing; Education, Nursing; Randomized Controlled Trial; Review

Resumen

OBJETIVO

Evaluar la efectividad de las estrategias de enseñanza utilizadas para el desarrollo del pensamiento crítico (PC) de estudiantes de pregrado de Enfermería.

MÉTODO

Revisión sistemática con metaanálisis basado en las recomendaciones del Joanna Briggs Institute. La búsqueda fue realizada en las bases de datos PubMed, CINAHL, EMBASE, Web of Science, SCOPUS, LILACS, Cochrane CENTRAL, PsycINFO y ERIC, y de banco de tesis de los cuatro continentes. La selección y evaluación inicial de los estudios y la evaluación de la calidad metodológica las llevó a cabo dos revisores de modo independiente.

RESULTADOS

Incluidos 12 ensayos clínicos randomizados. En el metaanálisis, de los cuatro estudios incluidos que evaluaron la estrategia del Problem Based Learning (PBL), comparada con conferencias, fue demostrada la efectividad del PBL, estadísticamente significativa (SMD=0,21 y el 95% IC=0,01-0,42; p=0,0434) para el desarrollo del PC en estudiantes de pregrado en Enfermería, y los estudios eran homogéneos (Chi cuadrado=6,10, p=0,106).

CONCLUSIÓN

Fue demostrada la efectividad del PBL en el incremento de los puntajes de PC global. Se necesitan hacer nuevos estudios con el fin de desarrollar, implantar y evaluar estrategias de enseñanza que se pauten en un alto rigor metodológico y se amparen en modelos teóricos de enseñanza-aprendizaje.

Descriptores
Pensamiento; Estudiantes de Enfermería; Educación en Enfermería; Ensayo Clínico Controlado Aleatório; Revisión

Resumo

OBJETIVO

Avaliar a efetividade das estratégias de ensino utilizadas para o desenvolvimento do pensamento crítico (PC) em estudantes de graduação em Enfermagem.

MÉTODO

Revisão sistemática com metanálise baseada nas recomendações do Joanna Briggs Institute. A busca foi realizada nas bases de dados PubMed, CINAHL, EMBASE, Web of Science, SCOPUS, LILACS, Cochrane CENTRAL, PsycINFO e ERIC e de banco de teses dos quatro continentes. A seleção e avaliação inicial dos estudos e a avaliação da qualidade metodológica foi realizada por dois revisores de forma independente.

RESULTADOS

Incluídos 12 ensaios clínico randomizados. Na metanálise, dos quatro estudos incluídos que avaliaram a estratégia do Problem Based Learning (PBL), comparada a palestras, foi demonstrada a efetividade do PBL, estatisticamente significativa (SMD=0,21 e 95% IC=0,01-0,42; p=0,0434) para o desenvolvimento do PC em estudantes de graduação em Enfermagem e os estudos eram homogêneos (Qui-quadrado=6,10, p=0,106).

CONCLUSÃO

Foi demonstrada a efetividade do PBL no aumento dos escores de PC global. Novos estudos precisam ser feitos com o objetivo de desenvolver, implementar e avaliar estratégias de ensino, que sejam pautadas em alto rigor metodológico e amparadas em modelos teóricos de ensino-aprendizagem.

Descritores
Pensamento; Estudantes de Enfermagem; Educação em Enfermagem; Ensaio Clínico Controlado Aleatório; Revisão

Introduction

It is increasingly important to train professionals that are critical, reflective, and able to make complex decisions based on knowledge of scientific evidence ¹ . In this context, development of critical thinking (CT) skills has become a prerequisite for safe and effective clinical practice ² , given the demonstrated positive and significant correlation between CT and problem solving ³ .

Critical thinking is an essential tool for nursing education, and its acquisition is one of the most desired results of higher education today ⁷ . CT should not be confused with intelligence; instead, it should be understood as a skill that can be taught ⁴ by developing logical and consistent thinking ⁵⁾ that involves both cognitive and behavioral components ⁶ .

Critical thinking has been much discussed in nursing literature ^8-9,4 , and is considered one of the most important concepts in education ¹⁰ . Several studies ^3,7,10-11) have emphasized the importance of preparing educators to teach CT skills through implementing active and innovative teaching strategies. Failure to teach CT at the university level can produce health care professionals devoid of this skill, which carries drastic consequences for the safety and proper treatment of patients in health care settings ¹¹ .

Experimental studies have shown favorable results from strategies for Problem-Based Learning (PBL) ^12-14 and the concept map ^15-16) in developing CT in nursing students. However, no systematic reviews (SR) of quantitative studies that sought to evaluate the effectiveness of these strategies were identified in the literature; thus, the need was indicated for an SR on qualitative studies of CT ⁹ . The authors of the present study identified SR on specific teaching strategies such as PBL ^17-18 and simulation ¹⁹ , which considered CT one of the outcomes assessed. In addition, only one SR ¹⁷ was identified that assessed the effectiveness of a teaching strategy for development of CT according to the variables and effect size in a meta-analysis.

Therefore, given the importance of training nurses capable of thinking critically, the Latin American Network for Research in Nursing Education ( Red Iberoamericana de Investigación en Educación en Enfermería - RIIEE) has addressed this issue in a multicenter research project carried out in 16 countries in Latin America, and the present study is part of this project. Investigation of CT in an international research network enabled the authors to identify the need to synthesize evidence available in the literature on effective teaching strategies for development of CT. Thus, this study aimed to evaluate the effectiveness of teaching strategies for the development of CT in undergraduate nursing students. The following research questions were considered: What teaching strategies have been used and tested by randomized clinical trials to promote CT in undergraduate nursing education ? and What is the effectiveness of teaching strategies to develop CT in undergraduate nursing students ?

Method

Systematic review and meta-analysis guided by recommendations of the Joanna Briggs Institute ²⁰ and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) ²¹ . The SR protocol was published in the JBI Library ²² , and registered in the database International Prospective Register of Systematic Reviews (PROSPERO) ²³ .

Database searches and selection of studies

A preliminary search in the databases Cochrane Database of Systematic Reviews, Joanna Briggs Institute Library of Systematic Reviews, JBI COnNECT+, Database of Abstracts of Reviews of Effects (DARE), PubMed and PROSPERO yielded two SR ^14,19 and one SR protocol ²⁴⁾ on the effectiveness of teaching strategies for the development of CT in nursing students. However, none of these studies was designed based on the aims of the present study.

Inclusion criteria for the present SR were: studies of randomized clinical trials (RCT); published in full in Portuguese, Spanish or English; and, having the aim of researching the effectiveness of teaching strategies on development of CT. Studies that did not show the abstract in full online in the databases searched, and those for which the full text was not obtained online or in the bibliographic archive, or after direct contact with the authors of the manuscript were excluded. No time limit was set for the search.

The PICOS strategy ( P - population; I - intervention; C - comparison; O - outcomes and S - study) guided the development of the leading question of the SR, and was the basis for development of search strategies, so that the synonyms of each PICO component were combined using the Boolean operator "OR" and the components of the acronym were combined with the Boolean operator "AND". Undergraduate nursing students in any stage in the course were considered the study population. Teaching strategies used to develop CT were considered the study intervention. Studies that used a specific teaching strategy or traditional teaching or no specific intervention on the control group were considered the comparison. CT was considered the outcome, which was analyzed through skills and dispositions, and evaluated by means of CT measurement scales ²⁵ . RCTs were considered for inclusion in the study.

Preliminary searches in the PubMed portal and CINAHL database were conducted to identify controlled and uncontrolled terms contained in the titles and abstracts of the studies. The searches were carried out by two reviewers independently, and the terms and search strategies developed by the primary reviewer were validated by the secondary reviewer and a librarian.

The search was conducted from September to December 2014. The databases used were PubMed, CINAHL, EMBASE, Web of Science, SCOPUS, LILACS, Cochrane CENTRAL, PsycINFO and ERIC. Thesis and dissertation databases from four continents (Africa, America, Europe and Australia) were used to search the gray literature: ProQuest Dissertations and Theses, Cybertesis, Digital Library of Theses and Dissertations of the University of São Paulo ( Biblioteca Digital de Teses e Dissertações da Universidade de São Paulo - Brazil), Australian Digital Theses (ADT), Open Access Scientific Repository of Portugal ( Repositório Científico de Acesso Aberto de Portugal - RCAAP), Academic Archive On-Line (DiVA), Theses Canada, Electronic Theses Online Service (EThOS), DART-Europe E-Theses Portal and the National ETD Portal. The terms used for the search included: P - "nursing student", "undergraduate", "baccalaureate"; I and C - "teaching methods", "learning, problem-based", "simulation", "case study", "concept maps", "lectures"; O - "thinking", "critical thinking"; S - "randomized controlled trial", "experimental", "evaluation study".

Selection of studies by title, abstracts and full reading was performed by the primary and secondary reviewers independently. The studies that generated some disagreement between the reviewers for inclusion were discussed with a third reviewer.

Assessment of methodological quality and data extraction

CREMS version 5.02C and JBI-MAStARI were used to analyze the methodological rigor of the studies included, which was performed by two reviewers independently. The studies were evaluated using the Critical Appraisal Tools Randomized Control Trial/Pseudo-randomized Trial (MAStARI), the instrument for critical evaluation of randomized and controlled clinical trials. The instrument assessed whether the study participants were randomized; if the researcher who allocated the subjects and what was evaluated was blinded, as well as the study participants; analysis by intention to treat; if the subjects of the intervention and control groups at baseline were compared; if the groups were identically treated, except for the intervention group; if measurement of results in the control and intervention groups was identical and reliable; and finally, whether statistical analysis was appropriate. Studies that obtained a score of seven or higher of ten items evaluated were included, since the JBI leaves definition of this cut-off point for inclusion of studies to the researcher's criteria ²⁰ .

After assessment of methodological quality, data extraction of studies selected for the SR was performed by two reviewers using the MAStARI data extraction instrument, in order to ensure the accuracy of the findings. The extracted data included details of the study population, intervention, inclusion and exclusion criteria and study results. Data that were not identified in the studies were obtained through contact with authors.

Summary of data and statistical analysis

The results were presented descriptively, and studies evaluating the same teaching strategies and that presented homogeneity in their design were combined to carry out the statistical meta-analysis using the MIX 2.0 Pro software.

The standardized mean difference (SMD) is the difference between two means, divided by an estimate of the standard deviation between the groups, and is used when the outcome is assessed by different scales ^20,26 . In the analysis of continuous variables with outcomes considered desirable, an SMD>0 indicates that the intervention was favorable (statistically significant), and that the results appear to the right of the forest plot ^20,26 .

The effect size (Overall Z) is a generic term for estimating the effect of a study, so that researchers can say that the effect of the intervention is significant when it has a value of p less than 0.05 ^20,26 . In contrast, the heterogeneity of the studies was assessed using the standard Chi-square, which is estimated by the method of inverse variance. Thus, studies are considered homogeneous when the value of p is greater than 0.05 ²⁰ .

Since the studies included evaluated CT through different scales and were considered homogeneous, the effect size was assessed by the fixed effects model, standardized mean difference (SMD), and 95% confidence intervals were calculated for analysis.

Results

A total of 2,949 studies were found in the selected databases and by means of cross-reference strategy. 557 duplicates were excluded, and 78 studies were completely evaluated. After assessment of the methodological quality, 12 RCT were selected that comprised the final sample of this SR, as noted in the flowchart in Figure 1 .

Figure 1
Flowchart of inclusion of studies - São Paulo, Brazil, 2015.

Characteristics of studies

All studies were published in English and had a level of evidence II, according to the JBI classification of quantitative studies ²⁰ ; 50% were carried out in the United States and 33% in China; 75% were published in article format; 83% had grade 7 according to the JBI-MAStARI instrument; and, 66% of the studies were developed in the last five years. The complete characterization of the studies included is described in Table 1 .

Table 1
Characterization of the studies included - São Paulo, Brazil, 2015.

Author (Year) (country)	Sample size	Intervention	Comparison	Duration of intervention	Measurement tools	Results
Tiwari et al. (2006) (China) 27	79 first-year students	Problem-based learning (PBL)	Lectures	2 semesters	California Critical Thinking Disposition Inventory (CCTDI)	The PBL group had overall CT scores measured by the CCTDI that were significantly higher than the lectures group (p=0.005)
Ferguson (2012) (USA) 28	57 first-year students	Two groups were used: 1 - Traditional lectures + microsimulation + Human Patient Simulation (HPS) 2 - Traditional lectures + Microsimulation + HPS, and after one week a new HPS session without the mentor was performed	Used lectures and micro-simulation	2 weeks	Watson Glaser Critical Thinking Appraisal (WGCTA)	There was no statistically significant difference in overall CT score on the pre-test and post-test examination for all groups
Atay & Karabacak (2011) (Turkey) 15	80 first- and second- year students	Concept map in the development of nursing care plans	Traditional method using column format	1 semester	CCTDI	There was no statistically significant difference between the groups. In the experimental group, the difference on the pre- and post-test was statistically significant (p=0.000)
Jun et al. (2013) (South Korea) 29)	161 second-year students	5E learning model combined with PBL	Lectures and discussion groups	5 weeks	Critical Thinking Disposition Scale for Nursing Students	Significant increase in capacity for CT (p=0.005) in the experimental group
Naber & Wyatt (2014) (USA) 30)	70 first-year students	Reflective writing based on Richard Paul's CT Model	There was no intervention, the traditional method already used in the discipline was used	8 weeks	California Critical Thinking Skills Test (CCTST) and CCTDI	No significant differences were observed in CT scores measured by the CCTDI (p=0.690) and CCTST (p=0.260)
Ousley (2012) (USA) 31)	132 second-year students	Two groups were used: 1 - Lecture (4 hours) + Simulation (8 hours) + 32 hours of clinical practice 2 - Lecture (4 hours) + Online Case Studies (8 hours) + 32 hours of clinical practice	Only lectures (12 hours) + 32 hours of practice.	4 weeks	CCTST	All groups showed significant changes on the pre- and post-test for overall CT (p<0.010)
Wheeler and Collins (2003) (USA) 16)	76 second-year students	Concept maps	Traditional method	7.5 weeks	CCTST	There was no significant statistical difference. In the experimental group significant difference of overall CT was found between the pre- and post-test (p=0.020)
Yuan et al. (2008) (China) 14	46 second-year students	PBL	Lectures	18 weeks	CCTST	There was a statistically significant difference between the PBL and lecture groups for overall CT (p=0.040) after intervention
Morey (2012) (USA) 32)	50 students in their last semester	Animated Pedagogical Agents (APA). Using an online tool, students performed three case studies, which they received in writing and that were narrated by APA.	Online case studies		Critical Thinking Process Test (CTPT)	There was no statistically significant difference between the overall CT scores in the groups after the intervention (p=0.561)
Yu et al. (2013) (China) 33	76 second-year students	PBL. Because it was an experimental crossover study , both groups received the interventions PBL and lecture-based learning (LBL) at different times	LBL	One semester	CCTDI-CV (Chinese version)	The group that learned first with PBL showed a statistically significant increase of overall CT (p=0.032), as well as the second group (p=0.048)
Chen et al. (2011) (China) 34	95 second-year students	Concept map + Lectures	Lectures	15 weeks	Critical Thinking Scale (CTS)	No statistically significant differences were found between the groups
Brown (2008) (USA) 35)	67 final- year students	High-fidelity simulation with the use of HPS + Debriefing + Role Modeling	High-fidelity simulation with the use of the HPS + Debriefing.	4 days	Professional Judgment Rating Form (PJRF)	No statistically significant differences were found between the groups

The teaching strategies used and tested in the RCTs included: PBL, concept map, simulation, reflective writing, Role Modeling and Animated Pedagogical Agents. In the control group, lectures were used in 58.3% of the studies. The "traditional" strategy already used in the discipline appeared as a resource used in the control group in 25% of studies. In the remaining 16.7%, the control group's strategy was the same as that used in the intervention group, except for the model that the researcher wanted to test, which were the APA ³²⁾ and Role Modeling ³⁵ .

It is notable that in only three studies was the intervention proposed based on a conceptual model, such as the 5E Learning Model ²⁹ , Richard Paul's CT Instructional Model ³⁰ and the theoretical model of Role Modeling ³⁵ . It is also notable that in only three studies ^14,28,31) was it mentioned that the people who implemented the intervention were trained or had experience with the strategy applied.

Bias risk

Bias risks were identified in the studies based on JBI criteria ²⁰ and the Cochrane Collaboration tool ( Figure 2 ) to assess bias risk in RCTs ^36-37 .

With regard to selection bias, this was uncertain in 50% of studies, due to the paucity of data regarding generation of the random sequence, and in only four studies did the authors explicitly state that they maintained the randomization sequence hidden throughout the study period ^27-28,31,35 .

In regard to performance bias, in none of the studies was it possible to blind the participants, because educational interventions were being investigated. Regarding blinding of the professionals who applied the intervention, in only one study ²⁹⁾ was this described. Blinding of the researcher who analyzed the data was reported in only two studies ^31,35 .

In regard to attrition bias, 33.4% of the studies did not perform analysis by intention to treat, and most had no losses in adherence. In reporting bias, most studies showed a low risk of bias.

Figure 2
Summary of the assessment of risk of bias - São Paulo, Brazil, 2015.

Meta-analysis

Four RCTs were included using PBL as the intervention and lectures on the control group ^14,27,29,33 . The combination of these studies in a meta-analysis, including 362 participants, demonstrated the effectiveness of PBL (SMD=0.32, 95% CI=0.08 to 0.56; Overall Z=2.67, p=0.0078) when compared to lectures for the development of overall CT in undergraduate nursing students ( Figure 3 ), with homogeneity being demonstrated (Chi-square=6.1, p=0.1068) between the studies.

Figure 3
Meta-analysis of overall CT scores of studies that evaluated the strategy of PBL compared to lectures - São Paulo, SP, Brazil, 2015.

Three RCTs were also included that used the concept map as intervention and traditional teaching on the control group ^15-16,34 . The combination of these studies in one meta-analysis, including 251 participants, did not demonstrate effectiveness of the concept map (SMD=-0.53, CI 95% -0.79--0.28; Overall Z=4.07, p<0.0001) when compared to traditional education for development of overall CT in undergraduate nursing students ( Figure 4 ). It is noteworthy that statistical heterogeneity was identified between the studies (Chi-square=10.82, p=0.0044).

Figure 4
Meta-analysis of overall CT scores of studies that evaluated the strategy of the concept map compared to traditional teaching - São Paulo, SP, Brazil, 2015.

Discussion

To the best of the authors' knowledge, this is the first SR that sought to identify the most effective teaching strategies for development of CT in undergraduate nursing students. Other SR ​​have been developed on this topic, however they sought to: evaluate one strategy in isolation, such as PBL ^17-18 and simulation ¹⁹ ; to identify, in two recent SR, the relationship between learning styles and CT ³⁸ ; and, one sought to explore how CT is perceived by teachers and nursing students through a SR of qualitative studies ⁹ .

From the results of studies that evaluated teaching of PBL and the meta-analysis performed of the RCT that used this teaching strategy, it can be said that PBL demonstrated effectiveness in increasing overall CT scores. This finding corroborates the results of the other two SR conducted that evaluated PBL ^17-18 . However, the SR for the present study advances knowledge with respect to the previous ones, since it included only the RCT; identified a statistically significant increase in CT skills using PBL, and not only abilities, as suggested in one SR that evaluated the effectiveness of PBL in development of CT ¹⁷ . In addition, the meta-analysis for the present study demonstrated greater homogeneity between the studies included in relation to this ¹⁷ .

The concept map is a widely used teaching strategy and discussed in nursing education ^39-40 as a promising tool for development of CT skills, however, there are few experimental studies testing its effectiveness. Meta-analysis of the three studies included that used the strategy of concept map compared to the usual teaching method did not demonstrate its benefit, although the studies were identified as heterogeneous, corroborating the findings of another study ⁴¹ which performed an uncontrolled trial with the same goal.

In addition to the PBL developed as an isolated teaching strategy, studies have been conducted evaluating the use of PBL associated with concept maps ^42-43 and even in web-based learning environments ⁴⁴ . Both demonstrate the benefit of this association for the development of CT in students. Therefore, further studies need to be developed with the combination of different teaching strategies, since, although in this SR the strategy of concept map did not demonstrate effectiveness in the development of CT, studies have shown promising results of its association with PBL ^42-43 .

As regards other teaching strategies used (simulation, Role Modeling, reflective writing and APA), none of them proved to be effective to develop CT in undergraduate nursing students. However, isolated studies have been conducted with small samples, and the authors of the present study encourage future research on these strategies that is supported in theoretical models of teaching and learning.

It is no longer acceptable for a nursing instructor to tell their students to think critically, without first providing a detailed explanation of the process and its assumptions ⁴⁵ , since in order to improve CT skills among university students, CT should be taught in the classroom ⁴⁶ . Explicit teaching of CT has been studied in-depth by means of instructional models, in which the teacher teaches the theoretical concepts related to the development of CT capacities and skills, in addition to stimulating the development of these skills. Although the only study included in this SR ³⁰⁾ that used an instructional model for teaching CT did not show a significant increase in CT scores, studies have shown the effectiveness of this model in the development of CT abilities and skills in college students ^46-47 . Thus, the authors of the present study encourage research on the effectiveness of the instructional model combined with other teaching strategies, and highlight the need for a theoretical model of CT that better instructs teachers on instruction of CT for undergraduate nursing students.

Regarding instruments to evaluate CT, although all of those which were used in this SR have proven their validity and reliability according to statistical tests, only two studies used specific instruments for nursing students ^29,32 , given the shortage of scales available in the literature. Therefore, there is a pressing need to develop tools to evaluate CT for undergraduate nursing students, and to consider the aspects inherent to the science and profession of nursing.

Another important issue discussed is the influence of culture in the use of PBL to promote CT ⁴⁸ . In this SR, of the four studies that tested the use of PBL for the development of CT, three were developed in China and one in South Korea. This seems to be an important aspect to consider with regard to the external validity of the studies included in this SR, which demonstrated the effectiveness of PBL, since the cultures of Asian countries greatly differ from those in the West. Thus, the authors of the present study encourage the development of further experimental studies in Western countries to assess the most effective strategies for teaching CT. In this sense, we believe that the next steps of the multicenter project of the RIIEE will contribute to these demands, especially in Latin America, because it will enable approximation of different cultures in the context of an international network.

For teaching in nursing, the authors believe that this SR enables reflection on teaching practice in the training of nurses capable of thinking critically. Thus, the authors encourage teachers to implement, develop and research new teaching strategies to promote CT in nursing students. The findings of the present study demonstrated the effectiveness of PBL when the JBI guidelines were used as a methodological reference, because JBI is an organization internationally recognized for development of SR, since a comprehensive search of the published and unpublished literature was performed, and only studies with the highest level of evidence (RCT) were included, reflecting the credibility of the findings.

As a secondary study, the SR is limited to the availability of data from the primary studies included. In this way, the following limitations of this SR were identified: the difficulty in finding adequate information about the type of study design in the abstracts, as the authors put very different nomenclatures to designate experimental studies, particularly RCT, which may have produced a risk of search bias in this SR; there are several tools used to evaluate CT, few of which were specific to nursing, so that the validity and reliability of different instruments may have influenced the measurement of the outcome; finally, the difficulty of contacting authors to answer questions that would determine the inclusion of studies in the SR, which led to the exclusion of some studies due to lower methodological quality. It should be noted that for this SR, contact was attempted with six authors to obtain further information, though responses were obtained from only two.

As implications for future research, the authors of the present study believe the following to be necessary: ​​clarification of the concept of CT in nursing literature; development and evaluation of teaching strategies that are based on instructional models of teaching CT; development of studies with larger, high-quality sample sizes, to withstand the effects it proposes to prove, using a pre- and post-test randomized format to control internal and external threats to the validity of the study; researchers who apply the intervention must be trained, and a standardized intervention needs to be applied, so that nurses need to develop the intervention method according to their actual educational context; and, it is urgent to develop an instrument capable of evaluating the development of CT, which considers the aspects inherent to the science and profession of nursing.

Conclusion

The teaching strategies used and tested in the RCT with the aim of developing CT in undergraduate nursing students included PBL, the concept map, simulation, reflective writing, Role Modeling and Animated Pedagogical Agents. Furthermore, based on the meta-analysis of the studies included, the effectiveness of PBL was demonstrated in the increased overall CT scores from homogeneous studies. This result confirmed our hypothesis that the teaching strategies that show better efficacy in RCT are those that involve the use of active methodologies.

Further studies need to be undertaken in order to develop, implement and evaluate new teaching strategies, as well as to test existing strategies in different cultures, to develop CT in undergraduate nursing students that are guided by high methodological rigor, supported in theoretical teaching and learning models, and developed in multicenter research projects.

References

• ¹
  Chang MJ, Chang YJ, Kuo SH, Yang YH, Chou FH. Relationships between critical thinking ability and nursing competence in clinical nurses. J Clin Nurs [Internet]. 2011 [cited 2015 Aug 10];20(21-22):3224-32. Available from: Available from: http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2702.2010.03593.x/pdf
  » http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2702.2010.03593.x/pdf
• ²
  Pitt V, Powis D, Levett-Jones T, Hunter S. The influence of critical thinking skills on performance and progression in a pre-registration nursing program. Nurse Educ Today [Internet]. 2015 [cited 2015 Aug 16];35(1):125-31. Available from: Available from: http://dx.doi.org/10.1016/j.nedt.2014.08.006
  » http://dx.doi.org/10.1016/j.nedt.2014.08.006
• ³
  Choi E, Lindquist R, Song Y. Effects of problem-based learning vs. traditional lecture on Korean nursing students critical thinking, problem-solving, and self-directed learning. Nurse Educ Today [Internet]. 2014 [cited 2015 Sept 04];34(1):52-6. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691713000695
  » http://www.sciencedirect.com/science/article/pii/S0260691713000695
• ⁴
  Ozkahraman S, Yildirim B. An overview of critical thinking in nursing and education. Am Int J Contemp Research [Internet]. 2011 [cited 2015 Sept 02];1(2):190-6. Available from: Available from: http://www.aijcrnet.com/journals/Vol_1_No_2_September_2011/25.pdf .
  » http://www.aijcrnet.com/journals/Vol_1_No_2_September_2011/25.pdf
• ⁵
  Borglin, G. Promoting critical thinking and academic writing skills in nurse education. Nurse Educ Today [Internet]. 2012 [cited 2015 Aug 10];32(5):611-13. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691711001675
  » http://www.sciencedirect.com/science/article/pii/S0260691711001675
• ⁶
  Paul SA. Assessment of critical thinking: a Delphi study. Nurse Educ Today [Internet]. 2012 [cited 2015 Aug 09];34(11):1357-60. Available from: Available from: http://dx.doi.org/10.1016/j.nedt.2014.03.008 0260-6917
  » http://dx.doi.org/10.1016/j.nedt.2014.03.008 0260-6917
• ⁷
  Bensley A, Spero RA. Improving critical thinking skills and metacognitive monitoring through direct infusion. Thinking Skills Creativity [Internet]. 2014 [cited 2015 Aug 10];12:55-68. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S1871187114000066 .
  » http://www.sciencedirect.com/science/article/pii/S1871187114000066
• ⁸
  Papathanasiou IV, Kleisiaris CF, Fradelos EC, Kakou K, Kourkouta L. Critical thinking: the development of an essential skill for nursing students. Acta Inform Med [Internet]. 2014 [cited 2015 Aug 06];22(4):283-286. Available from: Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4216424/
  » http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4216424/
• ⁹
  Chan ZCY. A systematic review of critical thinking in nursing education. Nurse Educ Today [Internet]. 2013 [cited 2015 Aug 10];33(3):236-40. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691713000087
  » http://www.sciencedirect.com/science/article/pii/S0260691713000087
• ¹⁰
  Azizi-Fini I, Hajibagheri A, Adib-Hajbaghery M. Critical thinking skills in nursing students: a comparison between freshmen and senior students. Nurs Midwifery Stud [Internet]. 2015 [cited 2015 Aug 10];4(1):e25721. Available from: Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4377532/ .
  » http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4377532/
• ¹¹
  Huang GC, Newman LR, Schwartzstein RM. Critical thinking in health professions education: summary and Consensus Statments of the Millennium Conference 2011. Teach Learn Med [Internet]. 2014 [cited 2015 Aug 08];26(1):95-102. Available from: Available from: http://www.tandfonline.com/doi/pdf/10.1080/10401334.2013.857335
  » http://www.tandfonline.com/doi/pdf/10.1080/10401334.2013.857335
• ¹²
  Ozturk C, Muslu GK, Dicle A. A comparison of problem-based and traditional education on nursing students' critical thinking dispositions. Nurse Educ Today [Internet]. 2008 [cited 2015 July 28];28(5):627-32. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691707001529#
  » http://www.sciencedirect.com/science/article/pii/S0260691707001529#
• ¹³
  Lyons EM. Examining the effects of problem-based learning and NCLEX-RN scores on the critical thinking skills of associate degree nursing students in a Southeastern Community College. Int J Nurs Educ Scholarsh [Internet]. 2008 [cited 2015 Jun 24];5(1):1-17. Available from: Available from: http://www.degruyter.com/view/j/ijnes.2008.5.issue-1/ijnes.2008.5.1.1524/ijnes.2008.5.1.1524.xml
  » http://www.degruyter.com/view/j/ijnes.2008.5.issue-1/ijnes.2008.5.1.1524/ijnes.2008.5.1.1524.xml
• ¹⁴
  Yuan D, Kunaviktikul W, Klunklin A, Williams BA. Improvement of nursing students' critical thinking skills through problem-based learning in the People's Republic of China: a quasi-experimental study. Nurs Health Sci [Internet]. 2008 [cited 2015 Sept 01];10(1):70-6. Available from: Available from: http://onlinelibrary.wiley.com/doi/10.1111/j.1442-2018.2007.00373.x/epdf
  » http://onlinelibrary.wiley.com/doi/10.1111/j.1442-2018.2007.00373.x/epdf
• ¹⁵
  Atay S, Karabacak U. Care plans using concept maps and their effects on the critical thinking dispositions of nursing students. Int J Nurs Pract [Internet]. 2012 [cited 2015 Aug 18];18(3):233-9. Available from: Available from: http://onlinelibrary.wiley.com/doi/10.1111/j.1440-172X.2012.02034.x/epdf .
  » http://onlinelibrary.wiley.com/doi/10.1111/j.1440-172X.2012.02034.x/epdf
• ¹⁶
  Wheeler LA, Collins SKR. The influence of concept mapping on critical thinking in baccalaureate nursing students. J Prof Nurs [Internet]. 2003 [cited 2015 Aug 22];19(6), 339-46. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S8755722303001340 .
  » http://www.sciencedirect.com/science/article/pii/S8755722303001340
• ¹⁷
  Kong LN, Qin B, Zhou YQ, Mou SY, Gao HM. The effectiveness of problem-based learning on development of nursing students' critical thinking: a systematic review and meta-analysis. Int J Nurs Stud [Internet]. 2014 [cited 2015 Aug 08];51(3):458-69. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0020748913001910
  » http://www.sciencedirect.com/science/article/pii/S0020748913001910
• ¹⁸
  Yuan H, Willians BA, Fan L. A systematic review of selected evidence on developing nursing students critical thinking through problem-based learning. Nurse Educ Today [Internet]. 2008 [cited 2015 Aug 20];28(6):657-63. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S026069170700175X
  » http://www.sciencedirect.com/science/article/pii/S026069170700175X
• ¹⁹
  Cant RP, Cooper SJ. Simulation-based learning in nurse education: systematic review. J Adv Nurs [Internet]. 2010 [cited 2015 Sept 02];66(1):3-15. Available from: Available from: http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2648.2009.05240.x/epdf
  » http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2648.2009.05240.x/epdf
• ²⁰
  Joanna Briggs Institute (JBI). Joanna Briggs Institute Reviewer's Manual [internet]. Adelaide; 2014 [cited 2014 June 02]. Available from: Available from: http://joannabriggs.org/assets/docs/sumari/ReviewersManual-2014.pdf
  » http://joannabriggs.org/assets/docs/sumari/ReviewersManual-2014.pdf
• ²¹
  Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statment. Plos Med [Internet]. 2009 [cited 2015 Aug 04];6(7):1-6. Available from: Available from: http://www.plosmedicine.org/article/fetchObject.action?uri=info:doi/10.1371/journal.pmed.1000097&representation=PDF
  » http://www.plosmedicine.org/article/fetchObject.action?uri=info:doi/10.1371/journal.pmed.1000097&representation=PDF
• ²²
  Oliveira LB, Püschel VAA, Díaz LJR, Cruz DALM. The effectiveness of teaching strategies for the development of critical thinking in nursing undergraduate students: a systematic review protocol. JBI Database System Rev Implement Rep [Internet]. 2015 [cited 2015 Aug 22];13(2):26-36. http://joannabriggslibrary.org/index.php/jbisrir/article/view/1073/2379
• ²³
  Oliveira LB, Püschel VAA, Díaz LJR, Cruz DALM. The effectiveness of teaching strategies for the development of critical thinking in nursing undergraduate students: a systematic review protocol. PROSPERO 2015: CRD42015019034 Available from: http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015019034 .
  » http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015019034
• ²⁴
  Tang L, Sung H. The effectiveness of problem-based learning on nursing students' critical thinking: a systematic review. JBI Database of System Rev Implement Rep [Internet]. 2012 [cited 2015 Aug 19];10(57):3907-16. Available from: Available from: http://www.joannabriggslibrary.org/index.php/jbisrir/article/view/14/27
  » http://www.joannabriggslibrary.org/index.php/jbisrir/article/view/14/27
• ²⁵
  Carter AG, Creedy DK, Sidebothama M. Evaluation of tools used to measure critical thinking development in nursing and midwifery undergraduate students: a systematic review. Nurse Educ Today [Internet]. 2015 [cited 2015 Aug 26];35:864-74. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691715000994
  » http://www.sciencedirect.com/science/article/pii/S0260691715000994
• ²⁶
  Ried K. Interpreting and understanding meta-analysis graphs: a practical guide. Aust Fam Physician [Internet]. 2006 [cited 2015 Aug 10];35(8):635-8. Available from: Available from: http://www.racgp.org.au/afpbackissues/2006/200608/20060805ried.pdf
  » http://www.racgp.org.au/afpbackissues/2006/200608/20060805ried.pdf
• ²⁷
  Tiwari A, Lai P, So M, Yuen K. A comparison of the effects of problem-based learning and lecturing on the development of students' critical thinking. Med Educ [Internet]. 2006 [cited 2015 Aug 26];40(6):547-54. Available from: Available from: http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2929.2006.02481.x/epdf
  » http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2929.2006.02481.x/epdf
• ²⁸
  Ferguson RA. Critical thinking skills in nursing students: using Human Patient Simulation [thesis]. California: Northern California University; 2012.
• ²⁹
  Jun WH, Lee EJ, Park HJ, Chang AK, Kim MJ. Use of the 5E learning cycle model combined with Problem-Based Learning for a fundamentals of nursing course. J Nurs Educ. 2013;52(12): 681-9.
• ³⁰
  Naber J, Wyatt TH. The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Educ Today [Internet]. 2014 [cited 2015 Aug 26];34(1),67-72. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691713001251
  » http://www.sciencedirect.com/science/article/pii/S0260691713001251
• ³¹
  Ousley TL. The Development of Critical Thinking with Technology in Nursing Education [thesis]. Chicago: Northcentral University; 2012.
• ³²
  Morey DJ. Development and evaluation of web-based animated pedagogical agents for facilitating critical thinking in nursing. Nurs Educ Perspect. 2012;33(2):116-20.
• ³³
  Yu D, Zhang Y, Xu Y, Wu J, Wang C. Improvement in critical thinking dispositions of undergraduate nursing students through problem-based learning: a crossover-experimental study. J Nurs Educ. 2013;52(10):574-81.
• ³⁴
  Chen S, Liang T, Lee M, Liao IC. Effects of concept map teaching on students' critical thinking and approach to learning and studying. J Nurs Educ. 2011;50(8):466-9.
• ³⁵
  Brown SC. The impact of high fidelity simulation and role modeling in the acquisition of critical thinking skills and self-efficacy: an experimental study [thesis]. Colorado: University of Northern; School of Nursing, College of Natural and Health Sciences; 2008.
• ³⁶
  Carvalho APVC, Silva V, Grande A. Avaliação do risco de viés de ensaios clínicos randomizados pela ferramenta da colaboração Cochrane. Rev Diagn Tratamento. 2013;18(1):38-44.
• ³⁷
  Higgins JPT, Green S, editors. Cochrane Handbook for Systematic reviews of interventions. Version 5.1.0, updated March 2011 [Internet]. Geneva: The Cochrane Collaboration; 2011 [cited 2015 Aug 26]. Available from: Available from: http://www.cochrane-handbook.org
  » http://www.cochrane-handbook.org
• ³⁸
  Andreou C, Papastravou E, Merkouris A. Learning styles and critical thinking relationship in baccalaureate nursing education: a systematic review. Nurse Educ Today [Internet]. 2014 [cited 2015 Aug 16];34(3):362-71. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691713002049
  » http://www.sciencedirect.com/science/article/pii/S0260691713002049
• ³⁹
  Senita J. The use of concept maps to evaluate critical thinking in the clinical setting. Teach Learn Nurs [Internet]. 2008 [cited 2015 Aug 08];3(1):6-10. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S1557308707000844
  » http://www.sciencedirect.com/science/article/pii/S1557308707000844
• ⁴⁰
  Gerdeman JL, Lux K, Jacko J. Using concept mapping to build clinical judgment skills. Nurse Educ Pract [Internet]. 2013 [cited 2015 Aug 10]; 13(1):11-7. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S1471595312001047
  » http://www.sciencedirect.com/science/article/pii/S1471595312001047
• ⁴¹
  Lee W, Chiang CH, Liao IC, Lee ML, Chen SL, Liang T. The longitudinal effect of concept map teaching on critical thinking of nursing students. Nurse Educ Today [Internet]. 2013 [cited 2015 Aug 10];33(10):1219-23. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691712001992
  » http://www.sciencedirect.com/science/article/pii/S0260691712001992
• ⁴²
  Tseng H, Chou F, Wang H, Ko H, Jian S, Weng W. The effetiveness of problem-based learning and concept mapping among Taiwanese registred nursing studets. Nurs Educ Today [Internet]. 2011 [cited 2015 Aug 22];31(8):41-6. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691710002467
  » http://www.sciencedirect.com/science/article/pii/S0260691710002467
• ⁴³
  Orique SB, McCarthy MA. Critical thinking and the use of nontraditional instructional methodologies. J Nurs Educ .2015;54(8):455-9.
• ⁴⁴
  Crawford TR. Using problem-based learning in web-based components of nurse education. Nurse Educ Pract [Internet]. 2011 [cited 2015 Aug 22];11(2):124-30. Available from: http://www.sciencedirect.com/science/article/pii/S1471595310001368
• ⁴⁵
  Lovatt A. Defining critical thoughts. Nurse Educ Today [Internet]. 2014 [cited 2015 Sept 02];34(5):670-2. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691713004255
  » http://www.sciencedirect.com/science/article/pii/S0260691713004255
• ⁴⁶
  Niu L, Behar-Horenstein LS, Garvan CW. Do instructional interventions influence college students' critical thinking skills? A meta-analysis. Rev Educ Res [Internet]. 2013 [cited 2015 Aug 22];9:114-128. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S1747938X1300002X
  » http://www.sciencedirect.com/science/article/pii/S1747938X1300002X
• ⁴⁷
  Abrami PC, Bernard RM, Borokhovski E, Wade A, Surkes MA, Tamim R, et al. Instructional Interventions Affecting Critical Thinking Skills and Dispositions: A Stage 1 Meta-Analysis. Rev Educ Res [Internet]. 2008 [cited 2015 Aug 08];78(4):1102-34. Available from: Available from: http://www.physics.emory.edu/faculty/weeks//journal/abrami-rer08.pdf
  » http://www.physics.emory.edu/faculty/weeks//journal/abrami-rer08.pdf
• ⁴⁸
  Sommers CL. Considering culture in the use of problem-based learning to improve critical thinking - Is it important? Nurse Educ Today [Internet]. 2014 [cited 2015 Aug 10];34:110911. Available from: Available from: http://www.sciencedirect.com/science/article/pii/S0260691714001038
  » http://www.sciencedirect.com/science/article/pii/S0260691714001038

• *
  Extracted from the dissertation, "Efetividade das estratégias de ensino para o desenvolvimento do pensamento crítico em estudantes de graduação em Enfermagem: revisão sistemática e metanálise", Programa de Pós-graduação em Enfermagem na Saúde do Adulto, Escola de Enfermagem, Universidade de São Paulo, 2014.

Publication Dates

• Publication in this collection
  Apr 2016

History

• Received
  23 Sept 2015
• Accepted
  28 Dec 2015