Validity and reliability of the Clinical Learning Environment, Supervision and Nurse Teacher (CLES+T), Turkish version¹

ABSTRACT

Aim:

A methodological type of study was conducted for the purpose of investigating the validity and reliability of the Turkish version of the Clinical Learning Environment, Supervision and Nurse Teacher (CLES+T) evaluation scale of the clinical learning environment of students, clinical nurses, and educators.

Methods:

Sample was comprised of 602 Turkish nursing students with clinical practice experience at the hospital. The CLES+T, developed by Saarikoski, was used for data collection. Language equivalency, internal consistency, item-total correlation, and structure validity were conducted within the scope of the validity and reliability study on the CLES +T scale.

Results:

It was determined that item-total correlations of four items were lower than 0.30, and those items were removed from the scale as a result of item analysis. The Cronbach’s alpha value of the scale was 0.93-0.99; item total point correlations of the scale varied between 0.45 and 0.66; six factors were identified in the CLES+T factor analysis study, with a total variance explained by these six factors of 64%.

Conclusion:

According to the findings of the research, the CLES+T Turkish version was found to be a valid and reliable scale, which can be used to evaluate satisfaction of nursing students with their clinical education in Turkey.

Descriptors:
Nursing Student; Clinical Environment; Scale; Satisfaction; Validity; Reliability

RESUMO

Objetivo:

Um estudo do tipo metodológico foi desenvolvido com o propósito de investigar a validade e a confiabilidade da versão turca da escala de avaliação do Ambiente de Aprendizagem Clínica, Supervisão e Professor de Enfermagem (CLES + T) no ambiente de aprendizagem clínica de estudantes, enfermeiros clínicos e educadores.

Métodos:

A amostra foi composta por 602 estudantes de enfermagem turcos com experiência na prática clínica hospitalar. O CLES + T, desenvolvido por Saarikoski, foi utilizado para coleta de dados. Equivalência de linguagem, consistência interna, correlação item-total e validade de estrutura foram avaliados no escopo do estudo de validade e confiabilidade na escala CLES + T.

Resultados:

As correlações item-total de quatro itens foram inferiores a 0,30, e tais itens foram removidos da escala como resultado da análise de itens. O valor alfa de Cronbach da escala foi de 0,93-0,99; as correlações item-total da escala variaram entre 0,45 e 0,66; seis fatores foram identificados na análise fatorial da escala, com uma variância total explicada por esses seis fatores de 64%.

Conclusão:

De acordo com os resultados da pesquisa, a versão turca do escala CLES+T foi considerada válida e confiável, a qual pode ser usada para avaliar a satisfação de estudantes de enfermagem com sua educação clínica na Turquia.

Descritores:
Estudante de Enfermagem; Ambiente Clínico; Escala; Satisfação; Validade; Confiabilidade

RESUMEN

Objetivo:

Se realizó un estudio de tipo metodológico con el fin de investigar la validez y la fiabilidad de la versión turca de la escala de evaluación del entorno de aprendizaje clínico, la supervisión y la enfermera docente (CLES + T) del entorno clínico de aprendizaje de estudiantes, enfermeras clínicas, y docentes.

Métodos:

La muestra estuvo compuesta por 602 estudiantes de enfermería turcos con experiencia en práctica clínica en el hospital. Se utilizó el CLES + T, desarrollado por Saarikoski, para la recopilación de datos. Se realizaron la equivalencia idiomática, la consistencia interna, la correlación ítem-total y la validez de la estructura dentro del alcance del estudio de validez y confiabilidad en la escala CLES + T.

Resultados:

se determinó que las correlaciones ítem-total de cuatro ítems eran inferiores a 0.30, y se eliminaron de la escala como resultado del análisis. El valor alfa de Cronbach de la escala fue 0.93-0.99; las correlaciones de puntos totales de los ítems de la escala variaron entre 0.45 y 0.66; se identificaron seis factores en el estudio de análisis del factor CLES + T, con una varianza total explicada por estos seis factores del 64%.

Conclusión:

según los resultados de la investigación, se encontró que la versión turca de CLES + T era una escala válida y confiable, que se puede utilizar para evaluar la satisfacción de los estudiantes de enfermería con su educación clínica en Turquía.

Descriptores:
Estudiante de Enfermería; Ambiente Clínico; Escala; Satisfacción; Validez; Confiabilidad

Introduction

Clinical education is a process that provides the student with the opportunity to practice his/her theoretical knowledge, gain professional identity, and learn by practice; thus, it is crucial in nursing education programs¹. Clinical practice fields enable the students to combine their cognitive, psychomotor, and affection skills and contribute to the development of these competencies². In order for the students to be able to benefit from these opportunities, clinical learning environments must be designed in a way that serve these ends, and the students must be supported.

Clinical learning and clinical learning environments have been subjects of research since 1990³. The clinical learning environment plays a crucial role, especially in the clinical education of nursing students^4-6. The clinical learning environment includes attributes of the clinical work setting which nurses perceive to influence their professional development⁷. Employee and student relationships and significant learning situations in the clinical learning environment constitute the pedagogical atmosphere of the clinic⁸. Good relationships between individuals, support, and feedback affect the clinical learning environment, and are important for positive learning^9-10. Numerous studies emphasize that the clinical environment is crucial in learning and learning outcomes^8,11. One study discovered that a supportive learning environment creates a significant difference in students’ learning. The pedagogical atmosphere of the service affects the learning process and competencies. It has been emphasized that the skills of problem solving and asking questions would develop in a positive pedagogical atmosphere^3,12-13. A collaborative leadership style, less hierarchical structure, and positive team spirit allow nursing students to feel that they are supported in uncertainties^3,6. The acceptance of nursing students as “team members” in the clinical environment, and consideration of student opinions and experiences in the solution of problems, contributes to their professional development¹⁴. This critical thinking and mutually innovative atmosphere may influence nursing care and quality, thus it would also be reflected in the patient-nurse relationships¹⁴.

The learning environment is also related to the psychosocial environment of the health service. The most important feature of a good learning environment is the presence of trust from the perspective of the student. A just environment is possible by seeing the students as part of the problem solving process, and improving the culture of tolerance for mistakes^3,15.

During the period of clinical education, which is the basic part of nursing education, nurse educators especially are essential factors. Competency of nurse educators is the most important factor that determines the quality of the education. For this reason, nurse educators play a crucial role in both education and clinical practice¹⁶. Therefore, having nurse educators who are well-equipped, positive role models, with awareness and experience, is important in order to achieve practice purposes¹⁷. Numerous studies indicate that students who spend their clinical education with experienced and professional teaching staff and nurses adjust more easily to the clinic, develop a better concept of the professional role¹⁸, develop critical thinking abilities, have improved self-sufficiency,¹⁸ and communication skills¹⁹. Additionally, research emphasizes that the collaboration between educators and clinical nurses is also important in a good clinical learning environment^14,20-21. Nurse educators and clinical nurses are the primary responsible agents for different learning experiences^16,22.

It has been stated that clinical nurse supervision is also crucial during the clinical practice process in student competency^23-24. The concept of the clinical nurse has been used in the meaning of unifying and supporting nursing students. For example, they are people who teach and evaluate practice skills, complement the clinical knowledge of nursing students, provide feedback, help them to perform analysis between theory and practice, are a role model, and in addition, help students to socialize. According to Löfmark and Wikblad, negative attitudes and behaviors of clinical nurses affects the learning process of nursing students. There is evidence regarding the exact importance of one-to-one education for the learning and development of students in clinical practice²³. Generally, the clinical nurse is responsible for the supervision of the students. Similarly, whether the service culture is negative or positive reflects the leadership style of the responsible clinical nurse. A positive team spirit and less hierarchical leadership may enable nursing care, motivation of the personnel, and supervision of the students²⁵. In their studies, Lofmark and Wikblad stated that attributing responsibility, independence, providing opportunity for different tasks, and giving feedback are among the factors that make students’ learning easier, whereas supervision and insufficient opportunities are the factors that hinder learning.

The importance of clinical practice in converting theoretical knowledge into skills, and the development of professional identities of the students in nursing education cannot be overlooked. The evaluation of the clinical environment, clinical nurses, and educators, which are essential in the development of professional identities of the students, is very important. To this aim, this study was conducted to determine the validity and reliability of the Turkish version of the CLES+T scale.

Method

This study has been conducted methodologically in order to test the validity and reliability of the Turkish version of the CLES +T scale.

Sample: The research population was comprised of the students studying in the nursing department of a university. The criterion of selecting a minimum of five people for each scale item was used to determine sample size²⁶. As the CLES+T scale is comprised of 34 items in total, 602 students were used for the scope of sampling. The prerequisite of having performed clinical practice at least for one term at the hospital was among the sampling inclusion criteria. Data was collected in the 2015-2016-spring semester. The data tool was administered to the students in the classroom environment by a researcher, at the end of the clinical practice. The time required to complete the form was approximately 20 minutes.

In the study, the CLES+T scale was used as the data collection tool, originally developed by Saarikoski and Leino-Kilpi in 2002, and revised in 2008. The CLES+T scale evaluates the pedagogical atmosphere of the service, clinical educators, management style of the responsible nurse of the service, and the nursing care in the service. It is a 5-point Likert scale, comprised of 34 items in total (Completely disagree = 1, Disagree = 2, Partially agree / Partially disagree =3, Agree =4, Completely Agree =5). The original scale is comprised of five factors, namely: supervisory relationship (factor 1), pedagogical atmosphere on the ward (factor 2), role of the nurse teacher (factor 3), leadership style of the ward manager (factor 4), and premises of nursing on the ward (factor 5)²⁷. We also collected demographic data (age, gender) and clinical data (unit type, length of clinical placement).

Within the scope of the validity and reliability study of the CLES+T scale, language equivalency, structural validity, and reliability studies were conducted. For the adaptation of the English form of the scale into Turkish, a translation-back translation method suggested in the literature and commonly accepted for adaptation was used.²⁸ To this aim, firstly the original scale was translated into Turkish by two professional translators. The form translated into Turkish was examined by the researcher and a faculty member with a good command of English, then the best translation for each item was adopted. Following this stage, it was translated back into English by a professional Turkish language expert. Then the items in the original scale were compared to those in the back-translated scale, and meaning equivalency was ensured^28-29.

Structural validity indicates the capacity of the scale to measure the entire concept or conceptual structure. Structural validity of the scale was evaluated by using confirmative factor analysis. In the study, for the prediction of the factor analysis, the criteria of having an eigenvalue of >1, a factor load of at least 0.40, and variance exploration rate to be 0.40 or greater used ^(28-29. Barlett’s test is a statistical method used for controlling whether the data comes from a multivariable normal distribution. The significance of the chi-square test statistics, obtained as a result of this test, indicates that the data comes from a multivariable normal distribution³⁰.

This is the capability of a measuring tool to provide consistent and stable measuring results. For the reliability of the scale, internal consistency and item total correlation analysis were used in the study. To assess internal consistency, Cronbach’s alpha was computed. Depending on the relevant literature, a minimum Cronbach’s alpha of > 0.70 is considered satisfactory³⁰.

Item analysis is a correlation analysis that expresses the relation between the value each item takes within the measuring tool and the total value obtained from the entire measuring tool. The higher the correlation coefficient, the higher the relationship of that item to the quality to be measured. In the evaluation of total item correlation, items with a value >0.30 are considered satisfactory²⁹. An item indicating a lower relationship with regard to total points implies that the item measures a different quality than the other items in the scale, and thus it is not reliable; such an item is removed from the scale.

Data was evaluated by computer using descriptive statistics for the demographic qualities of the sampling group. Varimax rotation and exploratory factor analysis (principal component analysis) were conducted for structural validity. The appropriateness of the data for factor analysis was examined using the Kaiser Meyer-Olkin (KMO) value and the Barlett’s test. The Cronbach’s alpha coefficient was calculated for internal consistency. A Pearson correlation analysis was conducted for item total point correlation.

Prior to the initiation of the study, written consent from Saarikoski was obtained for the use and adaptation of CLES+T to Turkish society. Ethical compliance for the study was obtained from the Medical Faculty Ethics Committee, under decision No.2015-13 on August 5, 2015. Permission was obtained in writing from members of the university administration to conduct the study. The principle of voluntariness was taken as a basis, and the student nurses comprising the sample group were informed about what was expected from them and their legal rights, and their consent was obtained.

Results

There were 56.6% of the students who were in their third year; 79.9% of them were female, 36.0% of them had their apprenticeship experience within the internal medicine services, and 49.2% of them stated their time at the clinic had been four weeks. Additionally, the average age of the students was 20.5±1.5, and their average transcript grade was 2.60 ±0.4.

Factor analysis revealed that sample adequacy was confirmed by means of the Kaiser-Meyer-Olkin (KMO) test and Barlett’s test of sphericity. The KMO value of 0.940, and Barlett’s test (X²= 9772,44, p= .000) were found to be statistically significant.

As a result of item analysis, it was determined that item-total correlations of four items (10, 12, 13, 14) were <0.30, and those items were removed from the scale which then totaled 30 items and was composed of six subscales. We have shown this study, and the study of Saarikoski’s (2008) item subscales, in Table 1.

Table 1
Factors and the item of subscales of Saarikoski et al. (2008), and according to the study conducted in Canakkale, Turkey, 2015

İtem	Saarikoski et al. (2008)	Canakkale, Turkey study
Factor 1	Supervisory Relationship (1-8)	Supervisory Relationship (1-9)
Factor 2	Pedagogical atmosphere on the ward (9-17)	Pedagogical atmosphere on the ward (15-17)
Factor 3	Role of nurse teacher (18-26)	Role of nurse teacher (11, 24-26)
Factor 4	Leadership style of the ward manager (27-30)	Leadership style of the ward manager (27-29)
Factor 5	Premises of nursing on the ward (31-34)	Leadership style of the ward manager (30-34)
Factor 6		Relationship between student, mentor, and nurse teacher (18-23)

The scale of Saarikoski et al. (2008) and Johansson et al. (2010) has five subscales, but our scale identifies six subscales. Items 18-23 were part of the third factor in Saarikoski et al. (2008) and Johansson et al. (2010), but in our study these created their own factor. These items were part of the role of nurse teacher factor in Saarikoski’s scale, but in our scale these items are named as “Relationship between student, mentor, and nurse teacher”. Thus, in our study, factor 6 was named “Relationship between student, mentor, and nurse teacher”. The total variance explained by the six factors was 64%. Factor 1 accounted for 18% of response variance, factor 2 for 14%, factor 3 for 10%, factor 4 for 8%, factor 5 for 7%, and factor 6 for 7%.

Figure 1 shows the confirmatory factor analysis (CFA) fit indexes of the two models. Through the two proposed models, these differences were studied. Supervisory relationship (factor 1: items 1-9), pedagogical atmosphere on the ward (factor 2: items 15-17), role of nurse teacher (factor 3: items 11, 24-26), leadership style of the ward manager (factor 4: items 27-29), premises of nursing on the ward (factor 5: items 30-34), and role of theory and practice integration (factor 6: items 18-23) were items in model.

Figure 1
Model for 34 items of the Turkish version of CLES+T scale. Canakkale, Turkey, 2015

Reliability results of the CLES+T scale are shown in Table 2. According to this, for 30 items the Cronbach’s alpha value is 0.93, and the alpha value in sub-dimensions varied between 0.70 and 0.76 When the relationship between the points of each sub-dimension and the total scale points was examined, reliability coefficients were found to be 0.93-0.96 The item means ranged between 2.57 and 3.68 (on a scale of 1-6). According to these findings, the total item point correlations of the scale ranged between 0.45 and 0.66 (Table 2).

Table 2
Statistics and Cronbach’s alpha coefficients for Factors 1-6 of the CLES+T, Turkish version (n=602). Canakkale, Turkey, 2015

	Mean CLES+T Turkish version *	SD†	Corrected item-total correlation	Cronbach’s alpha if item deleted
Supervisory relationship (α=.70)
1 My supervisor showed a positive attitude towards supervision	3.26	.99	.62	.94
2 I felt that I received individual supervision	2.80	1.00	.56	.93
3 I continuously received feedback from my supervisor	3.02	1.03	.60	.93
4 Overall I am satisfied with the supervision I received	2.97	.98	.65	.94
5 The supervision was based on a relationship of equality	2.94	1.03	.62	.99
6 There was a mutual interaction in the supervisory relationship	3.16	.96	.66	.93
7 Mutual respect and approval prevailed in the supervisory relationship	3.21	1.02	.63	.93
8. The supervisory relationship was characterized by a sense of trust	3.10	.99	.66	.96
9. The staffs were easy to approach	3.22	.99	.49	.93
Pedagogical atmosphere on the ward (α=.76)
15. There were sufficient meaningful learning situations on the ward	3.37	.86	.46	.93
16. The learning situations were multi-dimensional in terms of content	3.02	.96	.54	.94
17. The ward can be regarded as a good learning environment	3.23	1.01	.62	.94
Role of nurse teacher (α=.74)
18. In my opinion, the nurse teacher was capable of integrating theoretical knowledge and everyday practice of nursing	3.66	1.00	.51	.93
19. The nurse teacher was capable of operationalizing the learning goals of this placement	3.63	.97	.52	.95
20. The nurse teacher helped me to reduce the theory-practice gap	3.60	.98	.51	.93
21. The nurse teacher was like a member of the nursing team	3.43	1.07	.49	.95
22. The nurse teacher was able to give his or her expertise to the clinical team	3.45	1.03	.43	.93
23. The nurse teacher and the clinical team worked together	3.34	.96	.65	.93
Relationship among student, mentor and nurse teacher (α=.75)
11. During staff meetings (e.g. before shifts) I felt comfortable taking part in the discussions	2.76	1.12	.49	.93
24. The common meetings between myself, mentor and nurse teacher were comfortable experience	3.00	1.02	.57	.96
25. In our common meetings I felt that we are colleagues	2.57	1.06	.59	.93
26. Focus on the meetings was in my learning needs	3.17	.97	.48	.99
Leadership style of the ward manager (WM‡) (α=.76)
27. The WM‡ regarded the staff on her/his ward as a key resource	3.06	1.04	.49	.93
28 The WM‡ was a team member	3.38	.97	.45	.97
29. Feedback from the WM‡ could easily be considered a learning situation	3.13	.98	.57	.94
Premises of nursing on the ward (α=.74)
30. The effort of individual employees was appreciated	2.96	.97	.57	.93
31. The wards nursing philosophy was clearly defined	2.75	.97	.55	.93
32. Patients received individual nursing care	2.99	1.02	.57	.96
33. There were no problems in the information flow related to patients’ care	3.02	.97	.57	.93
34. Documentation of nursing (e.g. nursing plans, daily recording of nursing procedures etc.) was clear	3.68	.99	.48	.98

• * CLES+T* - Clinical learning environment, supervision and nurse teacher; ^† SD- Standard deviation^{; ‡} WM - Ward manager

Discussion

The Kaiser-Meyer-Olkin (KMO) value = 0.940 and the Barlett’s test (X²= 9772, 44, p= .000) were found to be of a significant level for the scale’s structural validity. Johansson et. al. found KMO= 0.93 and p<0.001 in their study.

The total variance explained by the six factors was 64%. Factor 1 accounted for 18% of responses variance, factor 2 for 14%, factor 3 for 10%, factor 4 for 8%, factor 5 for 7%, and factor 6 for 7%. The variance explained in the study by Johansson et al., was 60.2% in a 34-item scale with 5 sub factors. In their study, Saarikoski et al. (2008) found a total explanation percentage of 67 of the sub-scale version, and Saarikoski and Leino-Kilpi (2002) found the explanation percentage of 64²⁵.

We tried to justify the reasons for the differences in the factor loadings, by conducting a CFA analysis. This indicates a suitable model fit for Model 1. An adequate fit to the data was suggested by values of X²/DF, IFI, CFI and RMSEA, with the exception of GFI. On the other hand, our data did not fit Model 2, which reproduced the conceptual structure of the original version of the CLES+T²⁷.

According to research findings, the total coefficient of the scale and the Cronbach’s alpha coefficient of the sub-scales are within an acceptable range. The Cronbach’s alpha coefficient is stated as 0.90 and as 0.96-0.77 for sub-scales in the findings of the study for the development of the original scale²⁷. In the study by Johansson et al. (2010), the Cronbach’s alpha coefficient was 0.95, and was 0.96-0.75 for the sub-scales^20). In another study conducted in nine European countries, the Cronbach’s alpha coefficient was found to be between 0.96-0.83 for the sub-scales. As a result, we can conclude that the findings of our study are reliable, in consideration of the previous findings.

Finding item total point correlations of the scale between 0.45 and 0.66 demonstrates that item total point correlation values are at a reliable level. In the study by Johansson et al., item total correlation range of the scale varied between 0.35 and 0.91. In another study by Vizcaya-Moreno et al. (2015), for factors 1-5 , the corrected item-total correlation ranged from 0.36 to 0.92³¹.

Conclusion

The CLES+T scale, the validity and reliability of which has been confirmed in the Turkish version, can be used in the evaluation of the satisfaction of student nurses with the clinical environment, clinical nurses, and nurse educators. This enables clinical education to be evaluated from the student’s perspective, and the quality of education can be improved.

Limitation of the study: The primary restriction of this research is the use of students from only two health colleges in the sampling.

References

• ¹
  Tiwari A, Lai P, So M, Yuen K. A comparison of the effects of problem-based learning and lecturing on the development of students’ critical thinking. Med Educ.[Internet]. 2006 [cited 2016 Mar 27]; 40 (6): 547-54. Available from: https://www.ncbi.nlm.nih.gov/pubmed/16700770
  » https://www.ncbi.nlm.nih.gov/pubmed/16700770
• ²
  Chan S. Factors influencing nursing leadership effectiveness in Hong Kong. J Adv Nurs.[Internet]. 2002 [cited 2016 Feb 23]; Jun;38(6): 615-23. Available from: https://www.ncbi.nlm.nih.gov/pubmed/12067401
  » https://www.ncbi.nlm.nih.gov/pubmed/12067401
• ³
  Bjork IT, Berntsen K, Brynildsen G, Hestetun MJ. Nursing students’ perceptions of their clinical learning environment in placements outside traditional hospital settings. J Clin Nurs. [Internet]. 2014 [cited 2016 Mar 27]; 23(19-20): 2958-67. Available from: https://www.ncbi.nlm.nih.gov/pubmed/24460862
  » https://www.ncbi.nlm.nih.gov/pubmed/24460862
• ⁴
  Egan T, Jaye C. Communities of clinical practice: the social organization of clinical learning. Health. (London). [Internet]. 2009 [cited 2016 Mar 27]; 13(1): 107-25. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19103718
  » https://www.ncbi.nlm.nih.gov/pubmed/19103718
• ⁵
  Salminen L, Stolt M, Saarikoski M, Suikkala A, Vaartio H, Leino-Kilpi H. Future challenges for nursing education e a European perspective. Nurse Educ Today. [Internet]. 2010. [cited 2016 Mar 27]; 30(3): 233-8. Available from: https://www.ncbi.nlm.nih.gov/pubmed/20005606
  » https://www.ncbi.nlm.nih.gov/pubmed/20005606
• ⁶
  Bergjan M, Hertel F. Evaluating students’ perception of their clinical placements - testing the clinical learning environment and supervision and nurse teacher scale (CLES + T scale) in Germany. Nurse Educ Today. [Internet]. 2013 [cited 2016 Mar 27]; 33(11): 1393-8. Available from: https://www.ncbi.nlm.nih.gov/pubmed/23200088
  » https://www.ncbi.nlm.nih.gov/pubmed/23200088
• ⁷
  Hart G, Rotem A. The clinical learning environment: nurses’ perceptions of professional development in clinical settings. Nurse Educ Today. [Internet]. 1995 [cited 2015 Jan 30]; 15(1):3-10. Available from: https://www.ncbi.nlm.nih.gov/pubmed/7708026
  » https://www.ncbi.nlm.nih.gov/pubmed/7708026
• ⁸
  Henderson A, Twentyman M, Eaton E, Creedy D, Stapleton P, Lloyd B. Creating supportive clinical learning environments: an intervention study. J Clin Nurs. [Internet]. 2010 [cited 2015 Feb 20]; 19(1-2):177-82. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19686319
  » https://www.ncbi.nlm.nih.gov/pubmed/19686319
• ⁹
  Levett Jones T, Lathlean J, Maguire J, McMillan M. Belongingness: a critique of the concept and implications for nursing education. Nurse Educ Today. [Internet]. 2007 [cited 2016 Mar 27]; 27(3):210-8. Available from: https://www.ncbi.nlm.nih.gov/pubmed/16828935
  » https://www.ncbi.nlm.nih.gov/pubmed/16828935
• ¹⁰
  Skaalvik M, Normann, HK, Henriksen N. Clinical learning environment and supervision: experiences of Norwegian nursing students - a questionnaire survey. J Clin Nurs. [Internet]. 2011 [cited 2017 Jan 15]; 20(15-16): 2294-304. Available from: https://www.ncbi.nlm.nih.gov/pubmed/21752120
  » https://www.ncbi.nlm.nih.gov/pubmed/21752120
• ¹¹
  Andrews GJ, Brodie DA, Andrews JP, Hillan E, Gail Thomas B, Wong J, et al. Professional roles and communications in clinical placements: a qualitative study of nursing students’ perceptions and some models for practice. Int J Nurs Stud. [Internet]. 2006 [cited 2017 Jan 15]; 43(7): 861-74. Epub 2005 Dec 27 Available from: https://www.ncbi.nlm.nih.gov/pubmed/16380124
  » https://www.ncbi.nlm.nih.gov/pubmed/16380124
• ¹²
  Tanner CA. The next transformation: Clinical education. J Nurs Educ. [Internet]. 2006 [cited 2016 Jan 10]; 45(4): 99-100. Available from: https://www.ncbi.nlm.nih.gov/pubmed/16629277
  » https://www.ncbi.nlm.nih.gov/pubmed/16629277
• ¹³
  Gillespie M, Peterson BL. Helping novice nurses make effective clinical decisions: the situated clinical decision-making framework. Nurs Educ Perspect. [Internet]. 2009 [cited 2017 Jan 10]; 30(3): 164-70. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19606659
  » https://www.ncbi.nlm.nih.gov/pubmed/19606659
• ¹⁴
  Papp I, Markkanen M, von Bonsdorff M. Clinical environment as a learning environment: student nurses’ perceptions concerning clinical learning experiences. Nurse Educ Today. [Internet]. 2003 [cited 2017 Jan 10]; 23(4): 262-8. Available from: https://www.ncbi.nlm.nih.gov/pubmed/12727093
  » https://www.ncbi.nlm.nih.gov/pubmed/12727093
• ¹⁵
  Sundler AJ, Björk M, Bisholt B, Ohlsson U, Engström AK, Gustafsson M. Student nurses’ experiences of the clinical learning environment in relation to the organization of supervision: a questionnaire survey. Nurse Educ Today. [Internet]. 2014 [cited 2017 Jan 10]; 34(4): 661-6. Available from: https://www.ncbi.nlm.nih.gov/pubmed/23850574
  » https://www.ncbi.nlm.nih.gov/pubmed/23850574
• ¹⁶
  Elisabeth C, Christine WH, Ewa P. Teaching during clinical practice: strategies and techniques used by perceptors in nursing education. Nurse Educ Today. [Internet]. 2009 [cited 2017 Jan 10]; 29(5): 522-6. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19108935
  » https://www.ncbi.nlm.nih.gov/pubmed/19108935
• ¹⁷
  Bishol B, Ohlsson U, Kullén Engström A, Johansson AS, Gustafsson M. Nursing students’ assessment of the learning environment in different clinical settings. Nurse Educ Practice. [Internet]. 2014 [cited 2016 May 15]; 14(3): 304-10. Available from: https://www.ncbi.nlm.nih.gov/pubmed/24355802
  » https://www.ncbi.nlm.nih.gov/pubmed/24355802
• ¹⁸
  Harrison TM, Stewart S Ball K, Brat MM. Enhancing the transition of senior nursing students to independent practice. J Nurs Admin. [Internet]. 2007 [cited 2016 Jun 16]; 37(6): 311-7. Available from: https://www.ncbi.nlm.nih.gov/pubmed/17563525
  » https://www.ncbi.nlm.nih.gov/pubmed/17563525
• ¹⁹
  Cooper C, Taft M, Thelen M. Preparing for practice: students’ reflections on their final clinical experience. J Prof Nurs. [Internet]. 2005 [cited 2017 Jun 16]; 21(5): 293-302 .Available from: https://www.ncbi.nlm.nih.gov/pubmed/16179242
  » https://www.ncbi.nlm.nih.gov/pubmed/16179242
• ²⁰
  Johansson UB, Kaila P, Ahlner-Elmqvist M, Leksell J, Isoaho H, Saarikoski M. Clinical learning environment, supervision and nurse teacher evaluation scale: sychometric evaluation of the Swedish version. J Adv Nurs. [Internet]. 2010 [cited 2017 Jun 16]; 66(9): 2085-93. Available from: https://www.ncbi.nlm.nih.gov/pubmed/20626485
  » https://www.ncbi.nlm.nih.gov/pubmed/20626485
• ²¹
  Warne T, Johansson UB, Papastavrou E, Tichelaar E, Tomietto M, Van den Bossche K, et al. An exploration of the clinical learning experience of nursing students in nine European countries. Nurse Educ Today. [Internet]. 2010 [cited 2017 Feb 22]; 30(8): 809-15. Available from: https://www.ncbi.nlm.nih.gov/pubmed/20409620
  » https://www.ncbi.nlm.nih.gov/pubmed/20409620
• ²²
  Bisholt B, Ohlsson U, Engström AK, Johansson AS, Gustafsson M. Nursing students’ assessment of the learning environment in different clinical settings. Nurse Educ Pract. [Internet]. 2014 [cited 2017 Feb 16]; 14(3):304-10. Available from: https://www.ncbi.nlm.nih.gov/pubmed/24355802
  » https://www.ncbi.nlm.nih.gov/pubmed/24355802
• ²³
  Allan H, Smith P, Lorentzon M. Leadership for learning: a literature study of leadership for learning in clinical practice. J Nurs Manage. [Internet]. 2008 [cited 2016 Jun 10]; 16(5):545-55. Available from: https://www.ncbi.nlm.nih.gov/pubmed/18558925
  » https://www.ncbi.nlm.nih.gov/pubmed/18558925
• ²⁴
  Papastavrou E, Dimitriadou M, Tsangari H, Andreou C. Nursing students’ satisfaction of the clinical learning environment: a research study. BMC Nurs. [Internet]. 2016 [cited 2016 May 19]; 15(44):1-10. Available from: https://bmcnurs.biomedcentral.com/articles/10.1186/s12912-016-0164-4
  » https://bmcnurs.biomedcentral.com/articles/10.1186/s12912-016-0164-4
• ²⁵
  Saarikoski M, Leino-Kilpi H. The clinical learning environment and supervision by staff nurses: developing the instrument. Int J Nurs Stud. [Internet]. 2002 [cited 2016 May 19]; 39(3):259-67. Available from: https://www.ncbi.nlm.nih.gov/pubmed/11864649
  » https://www.ncbi.nlm.nih.gov/pubmed/11864649
• ²⁶
  Shultz KS, Whitney DJ. Measure-ment Theory in Action, Case Studiesand Exercises. California; Sage Publications; 2004.
• ²⁷
  Saarikoski M, Isoaho H, Warne T, Leino-Kilpi H. The nurse teacher in clinical practice: Developing the new sub-dimension to the clinical learning environment and supervision (CLES) scale. Int J Nurs Stud. [Internet]. 2008 [cited 2016 Jun 29]; 45(8):1233-7. Available from: https://www.ncbi.nlm.nih.gov/pubmed/17803996
  » https://www.ncbi.nlm.nih.gov/pubmed/17803996
• ²⁸
  Erefe İ, editors. Veri toplama araçlarının niteliği: Hemşirelikte araştırma ilke süreç ve yöntemleri. 2nd ed. İstanbul: Odak Ofset; 2002. (Original work published in Turkish)
• ²⁹
  Polit DF, Beck CT. Nursing research: Generating and assessing evidence for nursing practice. 8th ed. Philadelphia: Wolters Klower/Lippincott Williams & Wilkins; 2009.
• ³⁰
  Buyukozturk S. Data Analysis Handbook for Social Sciences, 16th ed. Ankara: Pegem Publishing; 2014.
• ³¹
  Vizcaya-Moreno MF, Pérez-Cañaveras RM, De Juan J, Saarikoski M. Development and psychometric testing of the Clinical Learning Environment, Supervision and Nurse Teacher evaluation scale (CLES+T): the Spanish version. Int J Nurs Studies. [Internet]. 2015 [cited 2016 Jun 29]; 52(1):361-7. Available from: https://www.ncbi.nlm.nih.gov/pubmed/25220932
  » https://www.ncbi.nlm.nih.gov/pubmed/25220932

• 1
  Paper presented at “7th International Conference on Research in Education” between April 27-29 2017, Çanakkale, Turkey.

Publication Dates

• Publication in this collection
  2018

History

• Received
  31 Oct 2017
• Accepted
  20 May 2018