Acessibilidade / Reportar erro

Perceived Environmental Supportiveness Scale: Portuguese Translation, Validation and Adaptation to the Physical Education Domain

Abstract

Aim:

Grounded on Self-Determination Theory, this study aimed to translate, adapt and validate the Perceived Environmental Supportiveness Scale (PESS) in a sample of Portuguese physical education students.

Methods:

The global sample was comprised of 964 students (518 females), divided in two groups: the calibration (n = 469) and the validation one (n = 483), all of them enrolled in two Physical Education (PE) classes/week.

Results:

The analysis provided support for a one factor and 12 items model, which are in line with the values adopted in the methodology (χ² = 196.123, df = 54, p = <.001, SRMR = .035, NNFI = .943, CFI = .954, RMSEA = .074, 90% CI .063-.085). Results express that the models are invariant in all analysis (i.e., calibration vs. validation, male vs. female, and 3rd vs. secondary cycle; three and single factor models).

Conclusion:

The present study suggests that the PESS with one factor and 12 items has good psychometric properties and can be used to assess perceived need supportive motivational environments provided by PE teachers. Additionally, invariance analysis showed support for the use of the scale in both genders and in the 3rd and secondary cycles.

Keywords:
psychological assessment; confirmatory factor analysis; self-determination theory; multi-group analysis; physical education

Introduction

The understanding of human motivation has been proven useful in the improvement of several contexts of practice11. Hagger MS, Chatzisarantis NLD, editors. Intrinsic motivation and self-determination in exercise and sport. Champaign, IL, Human Kinetics, 2006.), (22. Ryan RM, Deci EL. Self-Determination Theory. Basic Psychological Needs in Motivation, Development and Wellness. New York, The Guilford Press, 2017.. Specifically, Self-Determination Theory (SDT) (33. Deci EL, Ryan RM. Intrinsic Motivation and Self-Determination in Human Behavior. New York, Plenum Press, 1985. doi: 10.1007/978-1-4899-2271-7
https://doi.org/10.1007/978-1-4899-2271-...
has been a recurrent theoretical approach in order to understand motivation in settings related to the current work: physical activity contexts (e.g., sports, physical education, exercise) (44. Ng JYY, Ntoumanis N, Thogersen-Ntoumani C, Deci EL, Ryan RM, Duda JL. et al. Self-determination theory applied to health contexts: a meta-analysis. Perspect Psychol Sci. 2010; 7(4): 325-40. https://doi.org/10.1177/1745691612447309.
https://doi.org/10.1177/1745691612447309...
), (55. Teixeira PJ, Carraça EV, Markland D, Silva MN, Ryan, RM. Exercise, physical activity, and self-determination theory: A systematic review. Int J Behav Nutr Phys Act. 2012; 9, 78. doi:10.1186/1479-5868-9-78
https://doi.org/10.1186/1479-5868-9-78...
. In Physical Education (PE), a better understanding of the possible interaction about teachers’ intervention and motivation styles, and students’ perceptions, may pose substantial benefits in a wide variety of positive influences (e.g., engagement, learning, self-esteem, enjoyment, intention to future practice), helping teachers’ to better develop their work, and to possess a wide array of pedagogical tools to develop their practice66. Hagger MS, Chatzisarantis NLD, Culverhouse T, Biddle S. The Processes by Which Perceived Autonomy Support in Physical Education Promotes Leisure-Time Physical Activity Intentions and Behavior: A Trans-Contextual Model. J Educ Psychol. 2003; 94(4): 784-795. doi: 10.1037/0022-0663.95.4.784
https://doi.org/10.1037/0022-0663.95.4.7...
)- (88. Hein V, Koka A, Hagger MS. Relationships between perceived teachers' controlling behaviour, psychological need thwarting, anger and bullying behaviour in high-school students. J Adolesc. 2015; 42: 103-14. doi: 10.1016/j.adolescence.2015.04.003.
https://doi.org/10.1016/j.adolescence.20...
.

According to SDT, self-determined behavioral regulation can be obtained through a well-succeeded internalization process, where the person internalizes and integrates the behavior in his/her sense of self, obtaining better cognitive, emotional and behavioral outcomes, as reported empirically in several educational, health and exercise contexts99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
), (1010. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.. The degree of internalization for a given behavior may vary reflecting different motivational regulations: total absence of motivation or intention to initiate/maintain a given activity or task (i.e., amotivation - no internalization whatsoever), extrinsically motivated behaviors (that may reflect external demands and impositions, rewards and/or to avoid some sort of punishment, i.e., external regulation; to address self-esteem related contingencies and internally imposed controls, i.e., introjected regulation; when there is a conscious understanding and acceptance of a behavior personally held as valued, i.e., identified regulation; when behaviors are fully incorporated in the person core values and beliefs, i.e., integrated regulation) and intrinsically regulated behaviors, that encompasses inherent enjoyment and interest (i.e., intrinsic motivation) (99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
), (1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
.

The SDT postulates that Basic Psychological Needs (BPN’s) satisfaction plays a key role in the successful internalization of the behavioral regulation99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
. BPN’s include the need of autonomy (i.e., experiencing volition and perception of choice in ones’ behavior), the need of competence (i.e., feeling of effectiveness producing desired outcomes) and the need of relatedness (i.e., being cared and respected by significant others), and reflect ones’ perception, at a given time and on a specific context, of the satisfaction of each need99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
), (1212. Vansteenkiste M, Niemiec CP, Soenens B. The development of the five mini-theories of self-determination theory: An historical overview, emerging trends, and future directions. In: T. C. Urdan & S. A. Karabenick (Eds.). Advances in motivation and achievement, v. 16A-The decade ahead: Theoretical perspectives on motivation and achievement. London, Emerald Group Publishing Limited; 2010: 105-65. doi:10.1108/S0749-7423(2010)000016A007
https://doi.org/10.1108/S0749-7423(2010)...
. Most importantly, social-contextual factors may facilitate or hinder these psychological needs, thus subsequently influencing the extent of the self-determined behavior. In other words, the relation between social-contextual factors and motivational regulations are mediated by the satisfaction of BPN’s1010. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.), (1313. Deci EL, Ryan RM. A motivational approach to self: Integration in personality. In: R. A. Dienstbier (Ed.), Current theory and research in motivation, 38. Nebraska Symposium on Motivation, 1990: Perspectives on motivation. Lincoln, NE, University of Nebraska Press; 1991: 237-88..

Three dimensions of contextual need support seem to theoretically emerge and are accountable for the facilitation of an adequate social environment: autonomy support, structure (competence support) and involvement (relatedness support) (1010. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.), (1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
. Autonomy support reflects the provision of choice and meaningful rational from the coach, fitness instructor or teacher1414. Deci EL, Eghrari H, Patrick BC, Leone DR. Facilitating internalization: the self-determination theory perspective. J. Pers. 1994; 62(1): 119-42.. For example, the physical education teacher may behave in an autonomy-supportive manner when trying to analyze the situation from the students’ perception, encouraging them to take their own decisions, without imposing his/her choice on them1515. Edmunds J, Ntoumanis N, Duda J. Testing a self-determination theory-based teaching style intervention in the exercise domain. Eur. J. Soc. Psychol. 2008; 38(2): 375-88. doi:10.1002/ejsp.463
https://doi.org/10.1002/ejsp.463...
), (1616. Pelletier L, Seguin-Levesque C, Legault L. Pressure from above and pressure from below as determinants of teachers' motivation and teaching behaviours. J. Educ. Psychol. 2002; 94: 186-96. http://dx.doi.org/10.1037//0022663.94.1.186
http://dx.doi.org/10.1037//0022663.94.1....
. Structure concerns to the behavior-outcome contingencies, where a clear explanation about expectations and a clear emission of positive feedbacks by the person with authority, may facilitate the receivers’ perception of competence1515. Edmunds J, Ntoumanis N, Duda J. Testing a self-determination theory-based teaching style intervention in the exercise domain. Eur. J. Soc. Psychol. 2008; 38(2): 375-88. doi:10.1002/ejsp.463
https://doi.org/10.1002/ejsp.463...
), (1717. Markland D, Ryan RM, Tobin V, Rollnick S. Motivational Interviewing and Self-Determination Theory. J Soc Clin Psychol. 2005; 24(6): 811-31. doi: https://doi.org/10.1521/jscp.2005.24.6.811
https://doi.org/https://doi.org/10.1521/...
. In a particular PE class, the teacher and the students should make the session goals definition in an autonomy-supportive manner, and the teacher should continuously provide positive feedback along activities1010. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.), (1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
. Finally, involvement reflects the quality of the relationship between the individual and the person in an authority position, and the willingness to dedicate, for example, time, energy and other psychological resources1010. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.), (1515. Edmunds J, Ntoumanis N, Duda J. Testing a self-determination theory-based teaching style intervention in the exercise domain. Eur. J. Soc. Psychol. 2008; 38(2): 375-88. doi:10.1002/ejsp.463
https://doi.org/10.1002/ejsp.463...
. In a PE class, this can be shown if the teacher recognizes the students’ interest/disinterest, delivered in a supportive manner, where the authority figure provides unconditional positive regard1010. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.), (1313. Deci EL, Ryan RM. A motivational approach to self: Integration in personality. In: R. A. Dienstbier (Ed.), Current theory and research in motivation, 38. Nebraska Symposium on Motivation, 1990: Perspectives on motivation. Lincoln, NE, University of Nebraska Press; 1991: 237-88..

The Perceived Environmental Supportiveness Scale (PESS) (1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
) has been created to assess perceptions of need support provided by professionals to exercise referral schemes and adapted to access need support in other contexts, like sport1818. Pope J, Wilson P. Understanding Motivational Processes in University Rugby Players: A Preliminary Test of the Hierarchical Model of Intrinsic and Extrinsic Motivation at the Contextual Level. Int J Sports Sci Coach. 2010; 7(1): 89-105. doi: 10.1260/1747-9541.7.1.89
https://doi.org/10.1260/1747-9541.7.1.89...
and exercise classes1515. Edmunds J, Ntoumanis N, Duda J. Testing a self-determination theory-based teaching style intervention in the exercise domain. Eur. J. Soc. Psychol. 2008; 38(2): 375-88. doi:10.1002/ejsp.463
https://doi.org/10.1002/ejsp.463...
. The instrument is composed of 15 items, with three dimensions (autonomy support, structure and involvement). Confirmatory factor analysis of the scale presented a good model adjustment with these three dimensions. However, due to the highly correlated values between factors, a problem of discriminant validity suggests the use of the scale with a unidimensional approach (i.e., need support factor), which also presented in the same confirmatory factor analysis a good model fit1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
.

To our knowledge, this scale has not been tested and validated to access students’ perceptions of teachers need support in PE classes. Considering the aforementioned importance of the PE teachers to be knowledgeable of how to better improve and adapt their teaching styles, and the lack of a proper and validated scale, adapted to this specific context and Portuguese language, the proposed aim of this study was to translate, adapt and validate the Perceived Environmental Supportiveness Scale (PESS) in a sample of Portuguese physical education students.

Method

Participants

For the proposed analysis in this study, we defined two samples of PE students randomly assigned from the global sample. This procedure increases the robustness of the measurement instrument in the subsequent analysis. The global sample was comprised of 964 students (446 males and 518 females). The first group, defined as the calibration sample, consisted of 469 students (219 males and 250 females; 415 of the 3rd cycle (Portuguese educational cycle; ages between 12 and 15 years in general) and 549 of the secondary cycle (last mandatory Portuguese educational cycle; ages between 15 and 18 years in general). The second group, i.e., the validation sample, was composed of 483 students (223 males and 260 females; 212 of the 3rd cycle and 271 of the secondary cycle). All students were enrolled in two PE classes/week, with a total of 135 min/week.

Measures

The Perceived Environmental Supportiveness Scale1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
(PESS) consists of 15 items with a five-point bi-polar scale, ranging between 0 (“Not true for me”) to 4 (“Very true for me”). This questionnaire encompasses three dimensions in line with the SDT framework99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
- autonomy support (five items, e.g., ‘Provide a range of activities’), structure (five items, e.g., ‘Make clear to me what I need to do to get results’) and involvement (five items, e.g., ‘Care about me’), and was originally built to assess the need support provided by exercise practitioners in exercise referral scheme clients1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
. A composite variable named ‘need support’ was also calculated according to the authors’ suggestions. This was obtained through the calculation of the mean score for the 15 items following authors’ recommendations.

Procedures

Data collection

This study was part of a large cross-sectional study aiming to understand motivational aspects in PE classes. Several Lisbon public schools were selected and invited to participate in this study. Information about the study objectives and participation were sent to the schools’ direction boards and legal guardians. After obtaining the required permissions and signed informed consents, date to the application of the instruments was scheduled. PE teachers were debriefed about study characteristics, application particularities and participation requirements. A calm and peaceful place was used to fulfill the questionnaires, in order to read, fill and ask any question about the completion of the instruments. No dropouts were reported. The University Scientific Board approved the development of this study (nº 1/2014-2015).

Procedures of translation of the PESSp

To ensure an adequate translation and adaptation of the PESS from the original language (English) to Portuguese1919. Banville D, Desrosiers P., Genet-Volet Y. Translating Questionnaires and Inventories Using a Cross-Cultural Translation Technique. J TEACH PHYS EDUC. 2000; 19, 374-87. doi: 10.1123/jtpe.19.3.374
https://doi.org/10.1123/jtpe.19.3.374...
), (2020. Vallerand R. Toward a methodology for the transcultural validation of psychological questionnaires: Implications for research in the French language. Can Psychol Rev. 1989; 30(4): 662-80. http://dx.doi.org/10.1037/h0079856
http://dx.doi.org/10.1037/h0079856...
, the translation/back translation technique, as well as the committee approach methodology2121. Brislin R. Translation and content analysis for oral and written material. In H. Triandis & J. Berry (Eds.), Handbook of Cross-Cultural Psychology (Vol. 2, pp. 389-444). Needham Heights, MA: Allyn and Bacon, 1980. were employed. For this process, five steps were followed: 1) Preliminary Translation; 2) First Committee; 3) Second Committee (this stage was over only when all the specialists agreed with each other and their opinion was unanimous towards the item contents); 4) Pilot Study; 5) Final Review (only syntax aspects). Some contextual changes were made in some items across this methodology, regarding the needed adaptation to the PE context (e.g., the stem, “my instructor…” was changed to “my PE teacher…”).

Data analysis

For data analysis, descriptive statistics were used in both samples for all variables. To develop the confirmatory factor analysis, we used several authors’ recommendations2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.)- (2424. Marsh H, Hau K, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Modeling. 2004; 11(3), 320-341. doi: 10.1207/s15328007sem1103_2
https://doi.org/10.1207/s15328007sem1103...
with regard to the use of the estimated method of maximum likelihood (ML), chi-squared (χ2) testing of the respective degrees of freedom (df), and the level of significance (p). Additionally, the following adjustment goodness-of-fit indexes were used: Standardized Root Mean Square Residual (SRMR), Comparative Fit Index (CFI), Non-Normed Fit Index (NNFI), Root Mean Square Error of Approximation (RMSEA) and the respective confidence interval (90% CI). Traditionally, NNFI and CFI values ≥ .90 and RMSEA and SRMR ≤ .08 have been used as cut-off criteria2323. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis (7th ed.). New Jersey, Pearson Educational, Inc., 2014..

To check if the items were related with each of the defined factors, the convergent validity was calculated using the average variance extracted (AVE) and considering the ≥ .50 as cut-off value2323. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis (7th ed.). New Jersey, Pearson Educational, Inc., 2014.. The composite reliability (CR) was determined in order to assess the internal consistency of the factors, and the ≥ .70 defined as reference2323. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis (7th ed.). New Jersey, Pearson Educational, Inc., 2014.. Finally, to verify the distinction between factors, the discriminant validity was calculated through the square of the correlation between the factors, were variance extracted estimates should be greater than the squared correlation estimate. The analyses were undertaken using AMOS and SPSS 21.0.

Multi-group analysis

To assess if the measurement model structure is equivalent (i.e., invariant), a multi-group analysis is crucial in psychometric instrument validation2525. Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modelling: Banwa. 2002; 9, 233-55. doi:10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
), (2626. Sass D. Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. J. Psychoeduc. Assess. 2011; 29: 347-63. doi: 10.1177/0734282911406661
https://doi.org/10.1177/0734282911406661...
. For the present study, samples (i.e., validation and calibration), gender and age (i.e., grade/cycle of teaching) were submitted to multi-group analysis. As suggested by some authors2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.), (2525. Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modelling: Banwa. 2002; 9, 233-55. doi:10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
, invariance criteria needs to be checked for the existence of two criteria: 1) the measurement model is adjusted to each group, and 2) to perform a multi-group analysis, considering the following invariance types: configural invariance (model without constraints), metric invariance (equality of factorial weights), scalar invariance (factorial weights and covariance equals) and residual invariance (factorial weights, covariance and equal measure errors). According with Cheung and Resvold2525. Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modelling: Banwa. 2002; 9, 233-55. doi:10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
, differences in values between the models without constrains (free parameters) vs. models with constrains (fixed parameters) should be verified through the difference in the Δχ2 test or by the differences in ∆CFI ≤ .01.

Nomological validity

For the relation between constructs based in the same theoretical framework, a bivariate correlation was made between PESS and PLOCQp2727. Teixeira DS, Monteiro D, Carraça E, Palmeira AL. Translation and validation of the perceived locus of causality questionnaire (PLOCQ) in a sample of Portuguese physical education students. Motriz: J. Phys. Ed. 2018; 24(2)., an SDT based instrument, translated and adapted to Portuguese and in the PE context. This instrument is composed of 18 items with five subscales - amotivation, external regulation, introjected regulation, identified regulation and intrinsic motivation. This measurement model presented a good fit to the data (χ2 = 491.473, df = 125, p = <.001, SRMR = .062, NNFI = .908, CFI = .924, RMSEA = .067, 90% CI .061-.073), a good internal reliability (composite reliability between 0.67 - 0.82) and a gender and study cycle invariance (i.e., 3rd cycle and secondary cycle).

Results

Preliminary Analysis

Data analysis indicated that there were six multivariate outliers (i.e., four in the calibration sample; two in the validation sample) (D2 = p1 < .01; p2 < .01). Due to these results, participants were removed from the analysis, as suggested by several authors2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.), (2323. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis (7th ed.). New Jersey, Pearson Educational, Inc., 2014.. When Mardia’s coefficient was used to analyze multivariate kurtosis, results in both samples were higher than five (i.e., calibration sample = 40.00; validation sample = 43.41), surpassing expected values for the assumption of multivariate normality2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.. For this matter, Bollen-Stine bootstrap with 2000 samples was used for subsequent analysis as suggested by Nevitt and Hancock2828. Nevitt J, Hancock GR. Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Struct Equ Modeling. 2001; 8(3): 353-77. http://dx.doi.org/10.1207/S15328007SEM0803_2
http://dx.doi.org/10.1207/S15328007SEM08...
.

Descriptive analysis of participants’ answers showed a normal univariate distribution of the data in both samples, with the tendency to answer near the center of the five-point bi-polar Likert scale (i.e., positions two and three).

Table 1
Descriptive analysis of the answers to the items in the calibration and validation samples of PESS

As seen in Table 2, the initial models (i.e., global, calibration, validation, male, female, 3rd cycle and secondary cycle models; three factors and 15 items), presented a reasonable adjustment. However, after the analysis of the residual values between items, the modification indexes and factors covariance’s, some fragilities were identified, particularly, due to the high covariance values between the factors (Figures 1 and 2). For this matter, and in accordance with the original instrument authors and other recommendations2929. Kline R. Principles and Practice of Structural Equation Modeling (4th ed). New York, The Guilford Press, 2016., a unidimensional model was tested. All models presented, once again, a reasonable model fit. After modification indexes and residual analysis, three items were removed (item 8, structure support; item 14, autonomy support; and item 15; involvement support). All final models (i.e., one factor and 12 items) presented a good model fit and are in line with the values adopted in the methodology (Table 2).

Table 2
Fit indices of the three factor and one factor measurement models of PESSp

Figure 1
Standardized individual parameters (covariance factors. factorial weights and measurement errors), all of which were significant in the measurement model (PESSp - three factors/15 items) for the Portuguese calibration sample

Figure 2
Standardized individual parameters (covariance factors. factorial weights and measurement errors), all of which were significant in the measurement model (PESSp - three factors/15 items) for the Portuguese validation sample

In Figures 1 and 2 correlated variables appear to reflect SDT theoretical assumptions, where it is expected that the three BPN should be highly correlated1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
. In this instrument, in particular, the three factors reflect students’ perceptions of the need-support given by teachers in each dimension, which is assumed to follow BPN predicted relations1818. Pope J, Wilson P. Understanding Motivational Processes in University Rugby Players: A Preliminary Test of the Hierarchical Model of Intrinsic and Extrinsic Motivation at the Contextual Level. Int J Sports Sci Coach. 2010; 7(1): 89-105. doi: 10.1260/1747-9541.7.1.89
https://doi.org/10.1260/1747-9541.7.1.89...
. Additionally, these results follow the tendency of the original instrument as reported by Markland and Tobin1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
. Figure 3 presents the unidimensional model and the standardized individual parameters (factorial weights and measurement errors). All factorial weights presented statistical differences, indicating factorial validity, ranging between .29 and .67. All items explained more than 25% of the variance of the latent factor (λij2 ≥ .25), as recommended by Hair, Black, Babin, Anderson23. Figure 4 depicts the final model (i.e., 1 factor and 12 items) where factorial weight ranged between .41 and .65 and all items explained more than 25% of the variance of the latent factor.

Figure 3
Standardized individual parameters (covariance factors, factorial weights and measurement errors), all of which were significant in the measurement model (PESSp - one factor/15 items) for the Portuguese calibration sample

Figure 4
Standardized individual parameters (covariance factors, factorial weights and measurement errors), all of which were significant in the measurement model (PESSp - one factor/12 items) for the Portuguese validation sample

In Table 3 it is possible to observe that composite reliability testing showed values >.70, presenting adjusted composite reliability (all models). Regarding convergent validity, the AVE calculated presented minor issues in the autonomy support dimensions, both in the calibration and validation samples (i.e., .46 and .45, respectively). However, in the unidimensional model, values of AVE are, in both samples, >.50. In the discriminant validity analysis, several problems appeared in the three-factor model and in both samples, where the square of the correlation of the factors was higher than the AVE2323. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis (7th ed.). New Jersey, Pearson Educational, Inc., 2014..

Table 3
Internal reliability, convergent and discriminant validity and average variance extracted - Calibration and Validation samples

Invariance testing is presented in Table 4. As previously seen in Table 2, all final models presented a good adjustment, a condition necessary to invariance testing. Results express that the models are invariant in all analysis (i.e., calibration vs. validation, male vs. female, and 3rd cycle vs. secondary cycle; three and single factor models). These results suggest that the same number of factors were present in each group and associated with the same group of items (configural invariance), the factor of the PEES had the same understanding between groups (measurement invariance), the latent and observable means are comparable and valid among groups (scale invariance), and that comparison between observable items was supported (residual invariance). An exception exists in the residual invariance in the 3rd cycle vs. secondary cycle (∆CFI = .012) (Table 4b).

Table 4a
Fit indices for the invariance of the measurement model of the PESS in the Portuguese sample across samples, gender and cycles in the three factor model
Table 4b
Fit indices for the invariance of the measurement model of the PESS in the Portuguese sample across sample, gender and cycles in the one factor model

The final analysis is presented in Table 5, where the nomological validity was tested between the PESSp and another SDT based instrument (PLOCQp). As supported theoretically, the three BPN’s were positively associated with more autonomous motivational regulations, and negatively associated with controlled ones. This was also present in the one factor model.

Table 5
Nomological validity between PESSp and PLOCQp

Discussion

The main purpose of this study was to translate, adapt and validate the Perceived Environmental Supportiveness Scale (PESS) in a sample of Portuguese physical education students. This work, seeking to improve the quality of psychological assessments, a never-ending process, as suggested by some authors (e.g., Nunnaly & Bernstein3030. Nunnally JC, Bernstein IH. Psychometric theory. New York, NY, McGraw Hill, 1994.), will also allow better research and practice in the PE domain, and is in line with what Deci and Ryan3131. Deci EL, Ryan RM. Self-Determination Theory: A Macrotheory of Human Motivation, Development, and Health. Can Psychol. 2008; 49(3): 182-85. Doi:10.1037/a0012801
https://doi.org/10.1037/a0012801...
call the development of knowledge regarding the universality of SDT variables and, in this case, regarding BPN contextual perceptions.

Preliminary analysis of the PESSp psychometric properties showed that the three factors and 15 items model had a reasonable fit when confronted with the cut-off values defined in the methodology2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.)- (2424. Marsh H, Hau K, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Modeling. 2004; 11(3), 320-341. doi: 10.1207/s15328007sem1103_2
https://doi.org/10.1207/s15328007sem1103...
. Some issues with the RMSEA appeared in almost all samples. The predefined methodology values for this test were <.08, which represents a good model fit; according to some authors, values between 0.08 and 0.10 represent a reasonable adjustment2424. Marsh H, Hau K, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Modeling. 2004; 11(3), 320-341. doi: 10.1207/s15328007sem1103_2
https://doi.org/10.1207/s15328007sem1103...
), (3232. Arbuckle JL. AMOS 17 User's Guide. Chicago, IL, SPSS, 2008.. Additionally, and according to Chen3333. Chen F. What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. J Pers Soc Psychol. 2008; 95: 1005-18. doi: 10.1037/a0013193
https://doi.org/10.1037/a0013193...
, the RMSEA value strongly depends of other model parameters, such as the degrees of freedom, sample size and magnitude of correlations, and should not be assumed as a predefined and universal rule for scoring. Thus, in the initial models, it was assumed that some of the covariance values between factors could be influencing this test score. As theoretically assumed, high covariance values (Figure 1 and 2) anticipated discriminant validity issues, as posteriorly reported, where the square of all the factors correlation were higher than the AVE (Table 3) (2929. Kline R. Principles and Practice of Structural Equation Modeling (4th ed). New York, The Guilford Press, 2016..

Due to the previous model fit score and following Markland and Tobin1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
recommendation to assume the uni-dimensionality of the PESS (i.e., one total need support factor), the analysis was conducted to test models fit with this condition (i.e., one factor and 15 items; Figure 3). Preliminary analysis showed, once again, a reasonable fit for all models. Inspection of factorial weights and measurement errors presented some issues, and three items were removed (items 8, 14 and 15; one of each of the initial factors) due to high residual values, presenting, in the final analysis (i.e., one factor and 12 items), a good model fit in all samples, and a RMSEA ≤.08 (Figure 4 and Table 2). After semantic and syntax analysis, some similarities between items may justify these issues (e.g., item 13, ‘Look after me well’ vs. item 15, ‘Care about me’), in which some phrasing proximity may have posted some difficulties for students to untangle.

Internal consistency analysis (i.e., composite reliability) presented a good adjustment. CR values in the final model, both in calibration and validation samples, were .93, and in line with previous calculations for the one-factor and 15 items model1111. Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
https://doi.org/10.1016/j.psychsport.200...
(CR = .97).

Invariance testing procedures (i.e., across samples, gender and cycle of study), followed the procedures recommended by several authors1919. Banville D, Desrosiers P., Genet-Volet Y. Translating Questionnaires and Inventories Using a Cross-Cultural Translation Technique. J TEACH PHYS EDUC. 2000; 19, 374-87. doi: 10.1123/jtpe.19.3.374
https://doi.org/10.1123/jtpe.19.3.374...
), (2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.. Invariance testing was conducted in all of the tested models (i.e., three-factors and 15 items, one -actor and 15 items, and one-factor and 12 items), mainly because of the readjustments made to ensure a more parsimoniously final model2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.), (2929. Kline R. Principles and Practice of Structural Equation Modeling (4th ed). New York, The Guilford Press, 2016.. In that way, and according with Sass2626. Sass D. Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. J. Psychoeduc. Assess. 2011; 29: 347-63. doi: 10.1177/0734282911406661
https://doi.org/10.1177/0734282911406661...
and Chen3333. Chen F. What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. J Pers Soc Psychol. 2008; 95: 1005-18. doi: 10.1037/a0013193
https://doi.org/10.1037/a0013193...
, all measurement models that are readjusted need an invariance analysis, in order to demonstrate, independently of the adjustments made, that the measurement models are equivalent in different groups of the same population. Consequently, the invariance measurement in the final models (i.e., one factor and 12 items) showed that all criteria were met (with exception of residual invariance in the 3rd cycle-secondary cycle model), supporting equality in the PESSp in all groups2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.), (2525. Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modelling: Banwa. 2002; 9, 233-55. doi:10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
. These results indicate that: i) the unique factor is present in the same data set, regardless of group characteristics (i.e., gender and cycle of study), thus confirming configural invariance; ii) factorial weights are equivalent in both samples (calibration and validation), gender and study cycles, confirming that items have equal importance, supporting metric invariance; iii) the intercepts of items are equivalent in both samples, gender and study cycles, therefore presenting scalar invariance. This last criterion, when verified, ensures that the measurement model is able to properly facilitate comparisons between analyzed groups. Finally, the residual invariance testing was met in the samples and gender analysis, indicating that factorial weights, covariances and errors of measurement operate in the same way across samples. This was not the case of the study cycles samples (∆CFI = .012). However, Byrne2222. Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010. and Cheung & Rensvold2525. Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modelling: Banwa. 2002; 9, 233-55. doi:10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
postulate that this criterion could be considered optional in social sciences, mainly because 1) is very difficult to achieve and, 2) does not indicate the presence of an invariant model. To our knowledge, no invariance measurement testing was made to the original PESS in order to confirm and compare our testing. Nevertheless, taken together, the results suggest that PESSp can be adequately used in both genders and study cycles in the PE context.

Finally, the nomological assessment was made using other SDT based instrument that evaluates a related construct (i.e., behavioral regulations), also adapted to PE contexts (i.e., PLOCQp). SDT posits that a motivational supportive social environment may facilitate BPN’s satisfaction and, consequently, facilitate behavioral regulation and internalization99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
), (3131. Deci EL, Ryan RM. Self-Determination Theory: A Macrotheory of Human Motivation, Development, and Health. Can Psychol. 2008; 49(3): 182-85. Doi:10.1037/a0012801
https://doi.org/10.1037/a0012801...
. Positive and significant associations were present between perceived need support and autonomous motivational regulations, and negative and significant associations between perceived need support and controlled regulation. These results support the use of PESSp in PE context, and in line with SDT framework99. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
https://doi.org/10.1207/S15327965PLI1104...
.

The present study addresses a gap in the literature regarding the measurement of the perceived need motivational climate. Strong theoretical background and psychometric testing ensure a trustworthy instrument to assess these variables in PE context. Due to intra-class dynamics, inter-individual personality differences, school year transitions, and many other organizational factors, the PE teachers encounter several challenges in order to obtain an adjusted motivational environment that may promote students learning and engagement. Additionally, considering the extensive support of the BPN’s satisfaction in motivational outcomes, the acquisition of psychological tools that may allow the improvement of teachers’ intervention in these matters is crucial. This may be particularly important in order to prevent undesired student behaviors, poor motivational profiles and engagement issues, lack of in-task and in-class enjoyment, and the necessary teacher interaction adjustment universally supported and required in any pedagogical intervention22. Ryan RM, Deci EL. Self-Determination Theory. Basic Psychological Needs in Motivation, Development and Wellness. New York, The Guilford Press, 2017..

Some reflections and possible limitations should be made to better understand the present results. First, to our knowledge, and besides the original scale, no other psychometric validation was made to this instrument. If the universality of this SDT construct has been shown in several contexts and languages22. Ryan RM, Deci EL. Self-Determination Theory. Basic Psychological Needs in Motivation, Development and Wellness. New York, The Guilford Press, 2017., psychometric testing and validations could help in the identification of possible recurrent issues with the instrument, allowing semantic and contextual adjustments. Additionally, psychometric testing may allow cultural invariance measurements and latent mean analysis, further enhancing gender and study cycle characteristics understanding. Finally, given the social environmental fluctuations across the school year, a longitudinal invariance analysis could provide an increase in the robustness of the instrument.

In conclusion, the present study suggests that the PESSp with one-factor and 12 items have good psychometric properties and can be used to assess perceptions of the need supportive social environment provided by PE teachers.

References

  • 1
    Hagger MS, Chatzisarantis NLD, editors. Intrinsic motivation and self-determination in exercise and sport. Champaign, IL, Human Kinetics, 2006.
  • 2
    Ryan RM, Deci EL. Self-Determination Theory. Basic Psychological Needs in Motivation, Development and Wellness. New York, The Guilford Press, 2017.
  • 3
    Deci EL, Ryan RM. Intrinsic Motivation and Self-Determination in Human Behavior. New York, Plenum Press, 1985. doi: 10.1007/978-1-4899-2271-7
    » https://doi.org/10.1007/978-1-4899-2271-7
  • 4
    Ng JYY, Ntoumanis N, Thogersen-Ntoumani C, Deci EL, Ryan RM, Duda JL. et al. Self-determination theory applied to health contexts: a meta-analysis. Perspect Psychol Sci. 2010; 7(4): 325-40. https://doi.org/10.1177/1745691612447309
    » https://doi.org/10.1177/1745691612447309
  • 5
    Teixeira PJ, Carraça EV, Markland D, Silva MN, Ryan, RM. Exercise, physical activity, and self-determination theory: A systematic review. Int J Behav Nutr Phys Act. 2012; 9, 78. doi:10.1186/1479-5868-9-78
    » https://doi.org/10.1186/1479-5868-9-78
  • 6
    Hagger MS, Chatzisarantis NLD, Culverhouse T, Biddle S. The Processes by Which Perceived Autonomy Support in Physical Education Promotes Leisure-Time Physical Activity Intentions and Behavior: A Trans-Contextual Model. J Educ Psychol. 2003; 94(4): 784-795. doi: 10.1037/0022-0663.95.4.784
    » https://doi.org/10.1037/0022-0663.95.4.784
  • 7
    Hein V, Koka A. Perceived feedback and motivation in physical education and physical activity. In: M.S. Hagger & N.L.D. Chatzisarantis (Eds.), Intrinsic motivation and self-determination in exercise and sport. Champaign, IL, Human Kinetics, 2007: 127-40.
  • 8
    Hein V, Koka A, Hagger MS. Relationships between perceived teachers' controlling behaviour, psychological need thwarting, anger and bullying behaviour in high-school students. J Adolesc. 2015; 42: 103-14. doi: 10.1016/j.adolescence.2015.04.003.
    » https://doi.org/10.1016/j.adolescence.2015.04.003
  • 9
    Deci EL, Ryan RM. The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000; 11(4) : 227-68. Doi:10.1207/S15327965PLI1104_01
    » https://doi.org/10.1207/S15327965PLI1104_01
  • 10
    Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000; 55: 68-78.
  • 11
    Markland D, Tobin V. Need support and behavioural regulations for exercise among exercise referral scheme clients: The mediating role of psychological need satisfaction. Psychology of Sport and Exercise. 2010; 11: 91-99. doi:10.1016/j.psychsport.2009.07.001.
    » https://doi.org/10.1016/j.psychsport.2009.07.001
  • 12
    Vansteenkiste M, Niemiec CP, Soenens B. The development of the five mini-theories of self-determination theory: An historical overview, emerging trends, and future directions. In: T. C. Urdan & S. A. Karabenick (Eds.). Advances in motivation and achievement, v. 16A-The decade ahead: Theoretical perspectives on motivation and achievement. London, Emerald Group Publishing Limited; 2010: 105-65. doi:10.1108/S0749-7423(2010)000016A007
    » https://doi.org/10.1108/S0749-7423(2010)000016A007
  • 13
    Deci EL, Ryan RM. A motivational approach to self: Integration in personality. In: R. A. Dienstbier (Ed.), Current theory and research in motivation, 38. Nebraska Symposium on Motivation, 1990: Perspectives on motivation. Lincoln, NE, University of Nebraska Press; 1991: 237-88.
  • 14
    Deci EL, Eghrari H, Patrick BC, Leone DR. Facilitating internalization: the self-determination theory perspective. J. Pers. 1994; 62(1): 119-42.
  • 15
    Edmunds J, Ntoumanis N, Duda J. Testing a self-determination theory-based teaching style intervention in the exercise domain. Eur. J. Soc. Psychol. 2008; 38(2): 375-88. doi:10.1002/ejsp.463
    » https://doi.org/10.1002/ejsp.463
  • 16
    Pelletier L, Seguin-Levesque C, Legault L. Pressure from above and pressure from below as determinants of teachers' motivation and teaching behaviours. J. Educ. Psychol. 2002; 94: 186-96. http://dx.doi.org/10.1037//0022663.94.1.186
    » http://dx.doi.org/10.1037//0022663.94.1.186
  • 17
    Markland D, Ryan RM, Tobin V, Rollnick S. Motivational Interviewing and Self-Determination Theory. J Soc Clin Psychol. 2005; 24(6): 811-31. doi: https://doi.org/10.1521/jscp.2005.24.6.811
    » https://doi.org/https://doi.org/10.1521/jscp.2005.24.6.811
  • 18
    Pope J, Wilson P. Understanding Motivational Processes in University Rugby Players: A Preliminary Test of the Hierarchical Model of Intrinsic and Extrinsic Motivation at the Contextual Level. Int J Sports Sci Coach. 2010; 7(1): 89-105. doi: 10.1260/1747-9541.7.1.89
    » https://doi.org/10.1260/1747-9541.7.1.89
  • 19
    Banville D, Desrosiers P., Genet-Volet Y. Translating Questionnaires and Inventories Using a Cross-Cultural Translation Technique. J TEACH PHYS EDUC. 2000; 19, 374-87. doi: 10.1123/jtpe.19.3.374
    » https://doi.org/10.1123/jtpe.19.3.374
  • 20
    Vallerand R. Toward a methodology for the transcultural validation of psychological questionnaires: Implications for research in the French language. Can Psychol Rev. 1989; 30(4): 662-80. http://dx.doi.org/10.1037/h0079856
    » http://dx.doi.org/10.1037/h0079856
  • 21
    Brislin R. Translation and content analysis for oral and written material. In H. Triandis & J. Berry (Eds.), Handbook of Cross-Cultural Psychology (Vol. 2, pp. 389-444). Needham Heights, MA: Allyn and Bacon, 1980.
  • 22
    Byrne BM. Structural equation modeling with AMOS: Basic concepts, applications, and programming. 2nd Edition. Routledge, Taylor & Francis Group, 2010.
  • 23
    Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis (7th ed.). New Jersey, Pearson Educational, Inc., 2014.
  • 24
    Marsh H, Hau K, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Modeling. 2004; 11(3), 320-341. doi: 10.1207/s15328007sem1103_2
    » https://doi.org/10.1207/s15328007sem1103_2
  • 25
    Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modelling: Banwa. 2002; 9, 233-55. doi:10.1207/S15328007SEM0902_5
    » https://doi.org/10.1207/S15328007SEM0902_5
  • 26
    Sass D. Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. J. Psychoeduc. Assess. 2011; 29: 347-63. doi: 10.1177/0734282911406661
    » https://doi.org/10.1177/0734282911406661
  • 27
    Teixeira DS, Monteiro D, Carraça E, Palmeira AL. Translation and validation of the perceived locus of causality questionnaire (PLOCQ) in a sample of Portuguese physical education students. Motriz: J. Phys. Ed. 2018; 24(2).
  • 28
    Nevitt J, Hancock GR. Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Struct Equ Modeling. 2001; 8(3): 353-77. http://dx.doi.org/10.1207/S15328007SEM0803_2
    » http://dx.doi.org/10.1207/S15328007SEM0803_2
  • 29
    Kline R. Principles and Practice of Structural Equation Modeling (4th ed). New York, The Guilford Press, 2016.
  • 30
    Nunnally JC, Bernstein IH. Psychometric theory. New York, NY, McGraw Hill, 1994.
  • 31
    Deci EL, Ryan RM. Self-Determination Theory: A Macrotheory of Human Motivation, Development, and Health. Can Psychol. 2008; 49(3): 182-85. Doi:10.1037/a0012801
    » https://doi.org/10.1037/a0012801
  • 32
    Arbuckle JL. AMOS 17 User's Guide. Chicago, IL, SPSS, 2008.
  • 33
    Chen F. What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. J Pers Soc Psychol. 2008; 95: 1005-18. doi: 10.1037/a0013193
    » https://doi.org/10.1037/a0013193

Publication Dates

  • Publication in this collection
    01 July 2019
  • Date of issue
    2019

History

  • Received
    18 Oct 2018
  • Accepted
    19 Dec 2018
Universidade Estadual Paulista Universidade Estadual Paulista, Av. 24-A, 1515, 13506-900 Rio Claro, SP/Brasil, Tel.: (55 19) 3526-4330 - Rio Claro - SP - Brazil
E-mail: motriz.rc@unesp.br