Acessibilidade / Reportar erro

Sport Connection Scale (ECE): Acquiescence Control and Invariance

Abstract

The Sports Connection Scale (ECE) is one instrument to assess the connection of the 5C’s model of positive youth development. In a previous study, the scale presented a two-factor solution, despite the theory suggesting a unifactorial structure. This study aims to compare the ECE unifactorial model with and without acquiescence control to the two-factor model and to test the scale invariance between collective and individual modalities practitioners in a sample of young Brazilians. The results indicate the unifactorial solution is acceptable for the controlled model and that the instrument is not equivalent between the two groups. The adequacy of the instrument and the influence of response bias in the item's answers were verified.

Keywords:
sports psychology; psychometrics; test bias; psychological assessment

Resumo

A Escala de Conexão no Esporte (ECE) é um dos instrumentos para avaliar a conexão no modelo dos 5C’s do desenvolvimento positivo de jovens. Em estudo anterior, a escala apresentou uma solução de dois fatores, apesar da teoria sugerir uma estrutura unifatorial. Este estudo teve como objetivo comparar o modelo unifatorial da ECE, com e sem controle de aquiescência, ao modelo de dois fatores e testar a invariância da escala entre praticantes de modalidades coletivas e individuais, em uma amostra de jovens brasileiros. Os resultados indicaram a solução unifatorial como aceitável para o modelo controlado e que o instrumento não é equivalente entre os dois grupos. Constatou-se a adequação do instrumento e a influência de viés nas respostas aos itens.

Palavras-chave:
psicologia do esporte; psicometria; viés do teste; avaliação psicológica

Sports practice is associated with several social benefits (e.g., interpersonal relationships), psychological benefits (self-confidence), and physical benefits (motor development; Galatti et al., 2017Galatti, L. R., Bettega, O. B., Paes, R. R., Reverdito, R. S., Seoane, A. M., & Scaglia, A. J. (2017). O ensino dos jogos esportivos coletivos: Avanços metodológicos dos aspectos estratégico-tático-técnicos [Teaching team sports games: Methodological advances in strategic-tactical-technical aspects]. Pensar a Prática, 20(3). https://doi.org/10.5216/rpp.v20i3.39593
https://doi.org/10.5216/rpp.v20i3.39593...
; Reverdito et al., 2017Reverdito, R. S., Carvalho, H. M., Galatti, L. R., Scaglia, A. J., Goncalves, C. E., & Paes, R. R. (2017). Effects of youth participation in extra-curricular sport programs on perceived self-efficacy: A multilevel analysis. Perceptual and Motor Skills, 124(3), 569-583. https://doi.org/10.1177/0031512517697069
https://doi.org/10.1177/0031512517697069...
). Research focused on understanding the environment, relationships, and sports activities has advanced, especially among the young population (e.g., Côté et al., 2010Côté, J., Buner, M. W. , Erickson, K. Strachan, L., & Fraser-Thomas, J. (2010). Athlete development and coaching. In J. Lyle & C. Cushion (Eds.), Sport Coaching: Professionalism and Practice (pp. 63-79). Elsevier.; Fraser-Thomas et al., 2005Fraser-Thomas, J., Côté, J., & Deakin, J. (2005). Youth sport programs: An avenue to foster positive youth development. Physical Education & Sport Pedagogy, 10(1), 19-40. https://doi.org/10.1080/1740898042000334890
https://doi.org/10.1080/1740898042000334...
; Kavussanu & Boardley, 2009Kavussanu, M., & Boardley, I. D. (2009). The prosocial and antisocial behavior in sport scale. Journal Sport of Exercise Psychology, 31, 97-117. https://doi.org/10.1123/jsep.31.1.97
https://doi.org/10.1123/jsep.31.1.97...
; MacDonald et al., 2012MacDonald, D. J., Côté, J., Eys, M., & Deakin, J. (2012). Psychometric properties of the youth experience survey with young athletes. Psychology of Sport and Exercise, 13, 332-340. https://doi.org/10.1016/j.psychsport.2011.09.001
https://doi.org/10.1016/j.psychsport.201...
; Panza et al., 2020Panza, M. J., Graupensperger, S., Agans, J. P., Doré, I., Vella, S. A., & Evans, M. B. (2020). Adolescent sport participation and symptoms of anxiety and depression: A systematic review and meta-analysis. Journal of sport and exercise psychology, 42(3), 201-218. https://doi.org/10.1123/jsep.2019-0235
https://doi.org/10.1123/jsep.2019-0235...
; Turnnidge et al., 2012Turnnidge, J., Vierimaa, M., & Côté, J. (2012). An in-depth investigation of a model sport program for athletes with a physical disability. Psychology, 3(12), 1131. http://dx.doi.org/10.4236/psych.2012.312A167
http://dx.doi.org/10.4236/psych.2012.312...
; Vierimaa et al., 2017Vierimaa, M., Turnnidge, J., Bruner, M., & Côté, J. (2017). Just for the fun of it: Coaches’ perceptions of an exemplary community youth sport program. Physical Education and Sport Pedagogy, 22(6), 603-617. https://doi.org/10.1080/17408989.2017.1341473
https://doi.org/10.1080/17408989.2017.13...
). Among the perspectives for analyzing youth participation in sports and its benefits, Positive Youth Development (PYD; Holt, 2016Holt, N. L. (2016). Introduction: Positive youth development through sport. In N. L. Holt (Ed.), Positive Youth Development Through Sport (2. ed., pp. 1-4). Routledge.; Holt et al., 2020Holt, N. L., Deal, C. J., & Pankow, K. (2020). Positive youth development through sport. In G. Tenenbaum, & R. C. Eklund (Eds.), Handbook of Sport Psychology (4. ed, pp. 429-446). Wiley. ) presents principles and assumptions from different measurement approaches of the construct. The 5C’s theoretical model is one of the assumptions aimed at assessing PYD through five characteristics (competence, confidence, connection, caring, and character; Lerner et al., 2005Lerner, R. M., Lerner, J. V., Almerigi, J., Theokas, C., Phelps, E., Gestsdottir, S. Naudeau, S., Jelicic, H., Alberts, A. E., Ma, L., Smith, L. M., Bobek, D. L., Richman-Raphael, D., Simpson, I., Christiansen, E. D., & von Eye, A. (2005). Positive youth development, participation in community youth development programs, and community contributions of fifth grade adolescents: Findings from the first wave of the 4-H study of positive youth development. Journal of Early Adolescence, 25(1), 17-71. https://doi.org/10.1177%2F0272431604272461
https://doi.org/10.1177%2F02724316042724...
). The C corresponding to connection is associated with fundamental skills for the maintenance of the other C’s, such as social skills, based on the idea that athletes are constantly interacting with coaches or teammates (Goldenberg et al., 2016Goldenberg, A., Halperin, E., van Zomeren, M., & Gross, J. (2016). The process model of group-based emotion: Integrating intergroup emotion and emotion regulation perspectives. Personality and Social Psychology Review, 20, 118-141. http://dx.doi.org/10.1177/1088868315581263
http://dx.doi.org/10.1177/10888683155812...
; Santos et al., 2016Santos, F. S. F., Camiré, M., Campos, P. H. F. (2016). Youth sport coaches’ role in facilitating positive youth development in Portuguese field hockey. International Journal of Sport and Exercise Psychology, 16(3), 221-234. https://doi.org/10.1080/1612197X.2016.1187655
https://doi.org/10.1080/1612197X.2016.11...
; Vierimaa et al., 2017Vierimaa, M., Turnnidge, J., Bruner, M., & Côté, J. (2017). Just for the fun of it: Coaches’ perceptions of an exemplary community youth sport program. Physical Education and Sport Pedagogy, 22(6), 603-617. https://doi.org/10.1080/17408989.2017.1341473
https://doi.org/10.1080/17408989.2017.13...
). Understanding the various measurement possibilities of this construct, this research proposes the investigation of the psychometric properties of the Sports Connection Scale (ECE).

Connection is an umbrella term that encompasses different constructs, such as social identity (Bruner et al., 2014Bruner, M. W., Boardley, I. D., & Côté, J. (2014). Social identity and prosocial and antisocial behavior in youth sport. Psychology of Sport and Exercise, 15(1), 56-64. https://doi.org/10.1016/j.psychsport.2013.09.003
https://doi.org/10.1016/j.psychsport.201...
), relationships with other athletes (Weiss & Smith, 2002Weiss, M. R., & Smith, A. L. (2002). Friendship quality in youth sport: Relationship to age, gender, and motivation variables. Journal of Sport & Exercise Psychology, 24(4), 420-437.), and cohesion (Eys et al., 2009Eys, M. A., Loughead, T. M., Bray, S. R., & Carron, A. V. (2009). Perceptions of cohesion by youth sport participants. The Sport Psychologist, 23(3), 330-345. https://doi.org/10.1123/tsp.23.3.330
https://doi.org/10.1123/tsp.23.3.330...
). Furthermore, it refers to the quality of relationships built within a given environment. In the sports context, athletes can establish and develop bonds with coaches, fellow athletes, opponents, referees, or even with the institution itself (e.g., sports center). Meaningful and positive relationships within the sports environment can be an important component in promoting psychological well-being (Vierimaa et al., 2012Vierimaa, M., Erickson, K., & Gilbert, W. (2012). Positive youth development: A measurement framework for sport. International Journal of Sports Science & Coaching, 7(3), 601- 614. https://doi.org/10.1260/1747-9541.7.3.601
https://doi.org/10.1260/1747-9541.7.3.60...
), as most individuals need to belong and feel accepted within a group (Baumeister & Leary, 1995Baumeister, R. F., & Leary, M. R. (1995). The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Psychological Bulletin, 117(3), 497-529. https://doi.org/10.1037/0033-2909.117.3.497
https://doi.org/10.1037/0033-2909.117.3....
).

Among all these relationships, the relationship with the coach plays a fundamental role in the functioning of the relationship with other athletes (Compton, 2005Compton, W. C. (2005). An introduction to positive psychology. Thomson Wadsworth.; Tavares et al., 2021Tavares, M. A., Fonseca, S., Lopes, A., Galatti, L. R., & Reverdito, R. S. (2021). Coach-athlete relationship and youth positive experience in sport extracurricular. Cuadernos de Psicología del Deporte, 21(1), 146-161. https://doi.org/10.6018/cpd.428691
https://doi.org/10.6018/cpd.428691 ...
). The coach’s role is associated with the responsibility of assisting in the development of a healthier, supportive, learning, and nurturing environment (Tavares et al., 2021Tavares, M. A., Fonseca, S., Lopes, A., Galatti, L. R., & Reverdito, R. S. (2021). Coach-athlete relationship and youth positive experience in sport extracurricular. Cuadernos de Psicología del Deporte, 21(1), 146-161. https://doi.org/10.6018/cpd.428691
https://doi.org/10.6018/cpd.428691 ...
). This enables a positive climate, encourages cooperation and contribution from the athletes, and promotes the development and strengthening of other relationships within the environment (Compton, 2005Compton, W. C. (2005). An introduction to positive psychology. Thomson Wadsworth.; MacDonald et al., 2010MacDonald, D. J., Côté, J., & Deakin, J. (2010). The impact of informal coach training on the personal development of youth sport athletes. International Journal of Sports Science & Coaching, 5(3), 363-372. https://doi.org/10.1260/1747-9541.5.3.363
https://doi.org/10.1260/1747-9541.5.3.36...
; Tavares et al., 2021Tavares, M. A., Fonseca, S., Lopes, A., Galatti, L. R., & Reverdito, R. S. (2021). Coach-athlete relationship and youth positive experience in sport extracurricular. Cuadernos de Psicología del Deporte, 21(1), 146-161. https://doi.org/10.6018/cpd.428691
https://doi.org/10.6018/cpd.428691 ...
; Weiss & Stuntz, 2004Weiss, M. R., & Stuntz, C. P. (2004). A little friendly competition: Peer relationships and psychosocial development in youth sport and physical activity contexts. In M. R. Weiss (Ed.), Developmental sport and exercise psychology: A lifespan perspective (pp. 165- 196). Fitness Information Technology.).

When relationships occur healthily, whether with the coach or with other athletes, young individuals tend to engage more and become satisfied with their practice (Tavares et al., 2021Tavares, M. A., Fonseca, S., Lopes, A., Galatti, L. R., & Reverdito, R. S. (2021). Coach-athlete relationship and youth positive experience in sport extracurricular. Cuadernos de Psicología del Deporte, 21(1), 146-161. https://doi.org/10.6018/cpd.428691
https://doi.org/10.6018/cpd.428691 ...
; Weiss & Stuntz, 2004Weiss, M. R., & Stuntz, C. P. (2004). A little friendly competition: Peer relationships and psychosocial development in youth sport and physical activity contexts. In M. R. Weiss (Ed.), Developmental sport and exercise psychology: A lifespan perspective (pp. 165- 196). Fitness Information Technology.). This enables athletes to develop self-awareness, responsibility, and self-control, facilitating the enhancement and maintenance of social skills (e.g., leadership, and communication; Goldenberg et al., 2016Goldenberg, A., Halperin, E., van Zomeren, M., & Gross, J. (2016). The process model of group-based emotion: Integrating intergroup emotion and emotion regulation perspectives. Personality and Social Psychology Review, 20, 118-141. http://dx.doi.org/10.1177/1088868315581263
http://dx.doi.org/10.1177/10888683155812...
; Sanches & Rubio, 2011Sanches, S. M., & Rubio, K. (2011). Sports practice as an educational tool: Working with values and resilience. Educação e Pesquisa, 37(4), 825-841. https://doi.org/10.1590/S1517-97022011000400010
https://doi.org/10.1590/S1517-9702201100...
), as well as promoting morality and integrity (Kavussanu & Stanger, 2017Kavussanu, M. & Stanger, N. (2017). Moral behavior in sport. Current Opinion in Psychology, 16, 185-192. http://doi.org/10.1016/j.copsyc.2017.05.010
http://doi.org/10.1016/j.copsyc.2017.05....
; Shields & Bredmeier, 2007Shields, D. L., & Bredemeier, B. L. (2007). Advances in sport mortality research. In G. Tenenbaum & R. C. Eklund (Eds.), Handbook of Sport Psychology (3. ed, pp. 662-684). John Wiley.).

It is important to highlight that when young individuals are committed to others, establishing emotional and trusting bonds, social and personal skills can also be developed (Bruner et al., 2014Bruner, M. W., Boardley, I. D., & Côté, J. (2014). Social identity and prosocial and antisocial behavior in youth sport. Psychology of Sport and Exercise, 15(1), 56-64. https://doi.org/10.1016/j.psychsport.2013.09.003
https://doi.org/10.1016/j.psychsport.201...
). However, the athlete-to-athlete connection will depend on the coach's role within the environment (Lorimer, 2009Lorimer, R. (2009). Coaches’ satisfaction with their athletic partnerships. International Journal of Coaching Science, 3(2), 55-64. https://rke.abertay.ac.uk/en/publications/coaches-satisfaction-with-their-athletic-partnerships
https://rke.abertay.ac.uk/en/publication...
). In summary, the outcomes of healthy relationships in the sports environment promote feelings and thoughts directed toward the group, such as clarity of roles, empathy, and social acceptance (Jowett & Poczwardowski, 2007Jowett, S., & Poczwardowski, A. (2007). Understanding the coach-athlete relationship. In S. Jowett & D. Lavalee (Eds.), Social Psychology in Sport (pp. 3-14). Human Kinetics. ).

In this way, there are different instruments recommended to understand the connection in sports. When proposing a test battery to assess the 5C’s model of Positive Youth Development (PYD) according to the theoretical framework developed by Côté et al. (2010Côté, J., Buner, M. W. , Erickson, K. Strachan, L., & Fraser-Thomas, J. (2010). Athlete development and coaching. In J. Lyle & C. Cushion (Eds.), Sport Coaching: Professionalism and Practice (pp. 63-79). Elsevier.), Vierimaa et al. (2012Vierimaa, M., Erickson, K., & Gilbert, W. (2012). Positive youth development: A measurement framework for sport. International Journal of Sports Science & Coaching, 7(3), 601- 614. https://doi.org/10.1260/1747-9541.7.3.601
https://doi.org/10.1260/1747-9541.7.3.60...
) suggested the Coach-Athlete Relationship Questionnaire (coach-athlete connection) and the Peer Connection Inventory (athlete-athlete connection) as scales to evaluate connection in sports.

The Coach-Athlete Relationship Questionnaire, which measures the relationship between coach and athlete, consists of three dimensions: closeness (emotions), commitment (cognitions), and complementarity (behaviors). It is composed of two versions, one for the coach and one for the athletes (Jowett & Ntoumanis, 2004Jowett, S., & Ntoumanis, N. (2004). The coach-athlete relationship questionnaire (CART‐Q): Development and initial validation. Scandinavian Journal of Medicine & Science in Sports, 14(4), 245-257. https://doi.org/10.1111/j.1600-0838.2003.00338.x
https://doi.org/10.1111/j.1600-0838.2003...
). The Peer Connection Inventory instrument aims to assess the relationship between athletes based on the athlete's selection of three teammates they enjoy working with. This type of assessment involves two oscillometric classifications: social impact and social preference (Coie & Dodge, 1983Coie, J. D., & Dodge, K. A. (1983). Continuities and changes in children’s social status: A five-year longitudinal study. Merrill-Palmer Quarterly, 29(3), 261-282. https://www.jstor.org/stable/23086262
https://www.jstor.org/stable/23086262...
).

Despite the advancements in providing a measure to assess the 5C’s, the Peer Connection Inventory has an intragroup evaluation approach, which hinders the understanding of connection in research with large samples (Vierimaa et al., 2012Vierimaa, M., Erickson, K., & Gilbert, W. (2012). Positive youth development: A measurement framework for sport. International Journal of Sports Science & Coaching, 7(3), 601- 614. https://doi.org/10.1260/1747-9541.7.3.601
https://doi.org/10.1260/1747-9541.7.3.60...
). Due to this limitation, a study conducted by Silva & Peixoto (in press) proposed a new scale to evaluate connection among athletes, called the Teamwork Scale for Youth (TSY; Anderson-Butcher et al., 2014Anderson-Butcher, D., Wade-Mdivanian, R., Paluta, L., Lower, L., Amorose, A., & Davis, J. (2014). OSU LiFE Sports 2013 annual report. College of Social Work, The Ohio State University.). The TSY aims to measure adolescents’ perceived ability to work and contribute with other team members towards a common goal. However, the instrument is focused only on the relationship among athletes within the same team, disregarding other relationships present in sports.

However, none of these instruments proposed to measure more than one perspective of connection. This can make it difficult for researchers in the field to assess athletes’ relationships with coaches and other athletes since it would require applying multiple measures with divergent objectives and structures. In this regard, Campos et al. (2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.) proposed a scale to measure both types of relationships (coach-athlete/athlete-athlete), called the Sports Connection Scale (ECE), as part of a battery to measure the 5C’s of Positive Youth Development. The battery aims to evaluate the presence of positive skills fostered in the sports environment among young individuals aged 12 to 24 years. The results from exploratory factor analysis suggested a unifactorial structure for each subscale, except for the ECE, which exhibited a structure composed of two factors. However, it was interpreted that this configuration may have resulted from the organization of items based on positive and negative content.

Considering the importance of having appropriate instruments to assess the coach-athlete and athlete-athlete relationships in the sports context, the present study will utilize the ECE. The ECE is a brief two-factor instrument in which participants are asked to respond about the quality of relationships established in sports. The instrument addresses openness to new ideas and group goals, the relationship with the coach and team, and feelings of group belongingness. The scale has demonstrated adequate psychometric properties (Campos et al., 2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.).

The fact that the ECE was the only subscale in the battery that did not exhibit a unifactorial internal structure may be attributed to measurement error due to response biases, as the results indicated two factors, with the first containing items of positive content and the second consisting of items of negative content (Campos et al., 2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.). Response biases refer to the tendency of individuals to respond to a group of items based on factors other than the construct itself, such as a preference for extreme categories (extreme response style; Baumgartner & Steenkamp, 2001Baumgartner, H., & Steenkamp, J. B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 28, 143-156. https://doi.org/10.1509/jmkr.38.2.143.18840
https://doi.org/10.1509/jmkr.38.2.143.18...
), a tendency to respond in a socially desirable manner according to social norms (social desirability; Uziel, 2010Uziel, L. (2010). Rethinking social desirability scales: From impression management to interpersonally oriented self-control. Perspectives on Psychological Science, 5(3), 243-262. https://doi.org/10.1177/1745691610369465
https://doi.org/10.1177/1745691610369465...
), and a tendency to agree with an item regardless of its content (acquiescence; Valentini, 2017Valentini, F. (2017). Influência e controle da aquiescência na análise fatorial [Influence and control of acquiescence in factor analysis]. Avaliação Psicológica, 16(2), 116-119. https://doi.org/10.15689/ap.2017.1602.ed
https://doi.org/10.15689/ap.2017.1602.ed...
; Ziegler, 2015Ziegler, M. (2015). “F*** you, I won’t do what you told me!”: Response biases as threats to psychological assessment. European Journal of Psychological Assessment, 31(3), 153-158. https://doi.org/10.1027/1015-5759/a000292
https://doi.org/10.1027/1015-5759/a00029...
).

A bias of particular relevance in the case of the ECE is acquiescence. Due to the scale containing items with both positive and negative semantics, the endorsement of items regardless of their content will impair model fit and the factor loadings of negative items (Danner et al., 2015Danner, D., Aichholzer, J., & Rammstedt, B. (2015). Acquiescence in personality questionnaires: Relevance, domain specificity, and stability. Journal of Research in Personality, 57, 119-130. https://doi.org/10.1016/j.jrp.2015.05.004
https://doi.org/10.1016/j.jrp.2015.05.00...
; Maydeu-Olivares & Coffman, 2006Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
https://doi.org/10.1037/1082-989X.11.4.3...
; Valentini, 2017Valentini, F. (2017). Influência e controle da aquiescência na análise fatorial [Influence and control of acquiescence in factor analysis]. Avaliação Psicológica, 16(2), 116-119. https://doi.org/10.15689/ap.2017.1602.ed
https://doi.org/10.15689/ap.2017.1602.ed...
). To control for this response bias, a random intercept model can be employed, in which an additional factor called “acquiescence” is established. This factor is orthogonal to the “connection” factor, and its factor loadings are fixed at 1 (Maydeu-Olivares & Coffman, 2006). The scores of the acquiescence factor will correspond to the scores resulting from this response bias (Maydeu-Olivares & Steenkamp, 2018Maydeu-Olivares, A., & Steenkamp, J. B. E. M. (2018). An integrated procedure to control for common method variance in survey data using random intercept factor analysis models. Academia.edu. https://www.academia.edu/36641946/An_integrated_procedure_to_control_f or_common_method_variance_in_survey_data_using_random_intercept_factor_analysis_models
https://www.academia.edu/36641946/An_int...
).

By advancing measurement proposals with control for acquiescence using the random intercept model, professionals in the sports field can have more appropriate tools. The model has proven to be useful in estimating more accurate factorial structures (Maydeu-Olivares & Coffman, 2006Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
https://doi.org/10.1037/1082-989X.11.4.3...
; Maydeu-Olivares & Steenkamp, 2018Maydeu-Olivares, A., & Steenkamp, J. B. E. M. (2018). An integrated procedure to control for common method variance in survey data using random intercept factor analysis models. Academia.edu. https://www.academia.edu/36641946/An_integrated_procedure_to_control_f or_common_method_variance_in_survey_data_using_random_intercept_factor_analysis_models
https://www.academia.edu/36641946/An_int...
). In other words, the intercept model has a positive impact on psychological assessment processes by offering a measure with a greater ability to capture the target construct while minimizing the effects of response biases generated by the sample (Primi et al., 2019Primi, R., Santos, D., De Fruyt, F., & John, O. P. (2019). Comparison of classical and modern methods for measuring and correcting for acquiescence. British Journal of Mathematical and Statistical Psychology, 72(3), 447-465. https://doi.org/10.1111/bmsp.12168
https://doi.org/10.1111/bmsp.12168...
; Valentini et al., 2020Valentini, F., Mose, L. D. B., Ramos, I. D. S., & Conceição, N. M. D. (2020). Development of the inventory of supporting for socio-emotional skills, evidence of internal structure controlling for acquiescence. Estudos de Psicologia (Campinas), 37. https://doi.org/10.1590/1982-0275202037e180161
https://doi.org/10.1590/1982-0275202037e...
).

Additionally, it is important to consider the athlete-to-athlete relationship across different sports modalities. For instance, athletes involved in table tennis (Fuchs et al., 2019Fuchs, M., Faber, I. R., & Lames, M. (2019). Game characteristics in elite para table tennis. German Journal of Exercise and Sport Research, 49(3), 251-258. https://doi.org/10.1007/s12662-019-00575-4
https://doi.org/10.1007/s12662-019-00575...
) and taekwondo (Kim & Nam, 2021Kim, J. W., & Nam, S. S. (2021). Physical characteristics and physical fitness profiles of Korean Taekwondo Athletes: A systematic review. International Journal of Environmental Research and Public Health, 18(18), 9624. https://doi.org/10.3390/ijerph18189624
https://doi.org/10.3390/ijerph18189624...
; Wazir et al., 2019Wazir, M. R. W. N., Van Hiel, M., Mostaert, M., Deconinck, F. J., Pion, J., & Lenoir, M. (2019). Identification of elite performance characteristics in a small sample of taekwondo athletes. PloS One, 14(5), e0217358. https://doi.org/10.1371/journal.pone.0217358
https://doi.org/10.1371/journal.pone.021...
) have relationships with other athletes outside their team due to the individual nature of these sports. In contrast, team sports such as volleyball (Lidor & Ziv, 2010Lidor, R., & Ziv, G. (2010). Physical characteristics and physiological attributes of adolescent volleyball players: A review. Pediatric Exercise Science, 22(1). https://doi.org/ 10.1123/pes.22.1.114
https://doi.org/ 10.1123/pes.22.1.114...
), basketball (Bazanov et al., 2006Bazanov, B., Võhandu, P., & Haljand, R. (2006). Factors influencing the teamwork intensity in basketball. International Journal of Performance Analysis in Sport, 6(2), 88-96. https://doi.org/10.1080/24748668.2006.11868375
https://doi.org/10.1080/24748668.2006.11...
), and football (Jong et al., 2022Jong, L. M., Gastin, P. B., Bruce, L., & Dwyer, D. B. (2022). Teamwork and performance in professional women’s football: A network-based analysis. International Journal of Sports Science & Coaching, 18(3), 848-857. https://doi.org/10.1177/17479541221092355
https://doi.org/10.1177/1747954122109235...
) involve athletes playing as part of a team. Previous studies have observed that athletes in individual sports tend to have higher scores on the friendship component, while athletes in team sports tend to endorse more teamwork (Benar & Loghmani, 2014Benar, N., & Loghmani, M. (2014). Factor analysis of teenage athletes’ goal orientations and sports participation motives in leisure time. Annals of Applied Sport Science, 2(1), 69-80. https://doi.org/10.18869/acadpub.aassjournal.2.1.69
https://doi.org/10.18869/acadpub.aassjou...
; Howard et al., 2018Howard, S. J., Vella, S. A., & Cliff, D. P. (2018). Children’s sports participation and self-regulation: Bi-directional longitudinal associations. Early Childhood Research Quarterly, 42, 140-147. https://doi.org/10.1016/j.ecresq.2017.09.006
https://doi.org/10.1016/j.ecresq.2017.09...
; Moradi et al., 2020Moradi, J., Bahrami, A., & Dana, A. (2020). Motivation for participation in sports based on athletes in team and individual sports. Physical Culture and Sport: Studies and Research, 85(1), 14-21. https://doi.org/ 10.2478/pcssr-2020-0002
https://doi.org/ 10.2478/pcssr-2020-0002...
).

The present study aims to estimate new evidence of validity based on the internal structure of the Scale of Connection in Sports using the random intercept model to control for acquiescence. It also seeks to investigate the equivalence of the instrument between team and individual sports modalities. Based on the theoretical foundation, the hypotheses are as follows: (a) the two-factor structure will fit the data from the sample, as found by Campos et al. (2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.), considering the content of the items (positive and negative) for the model without controlling for acquiescence; (b) it is expected that in the model with control for the bias, the unidimensional structure will demonstrate the most appropriate fit; (c) controlling for acquiescence will improve the fit indices, indicating the influence of response biases (Maydeu-Olivares & Coffman, 2006Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
https://doi.org/10.1037/1082-989X.11.4.3...
); (d) the instrument will not be equivalent between the two groups (team vs. individual) since the items do not consider relationships with other athletes, but rather focus on team relationships.

Method

Data is available upon request to the authors.

Participants

We used a convenience sample of 377 young athletes, aged between 12 and 24 years (M = 17.9 ± 2.84), of both genders (54.6% male). The majority of athletes described practicing team sports (52.5%), such as soccer, basketball, volleyball, and handball, among others. The remaining athletes described practicing individual sports, such as tennis, athletics, taekwondo, and judo, among others. Regarding the competitive level, 30% stated that they do not compete in their sport, 24.9% described themselves as competing at a national level, 18% at a state and regional level, with the remaining 9% at an international level. In general, the participants reported having at least three years of experience in their sport (65.8%), and it was not their first sport practiced (65.5%). Additionally, they mentioned having trained previously with other coaches (76.7%).

Instruments

Sociodemographic Questionnaire

Specifically designed for this research, the questionnaire aimed to obtain relevant information about the participants. For this purpose, questions were formulated regarding age, gender, type of sport practiced (team or individual), competitive level, years of experience, and whether they have practiced the sport with different coaches than the current ones.

Scale of Connection in Sports (ECE)

The ECE is part of a battery to assess the theoretical model of the 5C’s (competence, confidence, connection, caring, and character) of Positive Youth Development in Sport, initially developed by Campos et al. (2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.). Its objective is to measure the C connection, which investigates the quality of relationships within the sports environment. The instrument consists of 15 items, in which participants are required to respond about the quality of relationships established in sport using a five-point Likert scale (1, strongly disagree, to 5, strongly agree). The content of the items generally addresses openness to new ideas, group goals, good relationships with the coach and team, and feelings of group belonging. Parallel analysis demonstrated the retention of two factors (Factor 1 = 44%; Factor 2 = 17%) given the item variances, compared to respective random data of 15% and 13%. Additionally, the fit indices of the one-factor structure obtained values below the expected for the Comparative Fit Index (CFI = .894) and Tucker-Lewis Index (TLI = .879), and presented values higher than expected for Root-Mean-Square Error of Approximation (RMSEA = .140; Campos et al., 2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.).

Procedures

Ethical Aspects

The research was submitted to and approved by the Ethics Committee of the University of São Francisco (CAAE: 50705221.3.0000.5514). Participants were assured the right to confidentiality of the collected data and the possibility to withdraw from participation at any time, by Resolution No. 466/2012 of the Brazilian National Health Council.

Data collection was conducted in sports institutions and through the researchers' social media channels, with a link shared via Google Forms. Only athletes who agreed to the informed consent form and the assent form were eligible to participate in the research.

Data Analysis

To estimate the factorial structure of the scale, a Confirmatory Factor Analysis (CFA) was conducted using the Diagonal Weighted Least Square (DWLS) estimation method. For the interpretation of fit indices, the following cutoff parameter was used: χ2 /df ≤ 3, RMSEA ≤ .08, CFI ≥ .90, and TLI ≥ .90 (Brown, 2015Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.).

Next, to identify the influence of response bias, the Random Intercept (RI) model was employed to control for acquiescence, allowing for the estimation of improved parameters for the factorial structure of the instrument (Zanon et al., 2018Zanon, C., Lessa, J. P. A., & Dellazzana-Zanon, L. L. (2018). Acquiescence in self-report personality assessment: A comparison between methods. Avaliação Psicológica, 17(4), 428-438. http://dx.doi.org/10.15689/ap.2018.1704.3.03
http://dx.doi.org/10.15689/ap.2018.1704....
). The analysis used the Diagonal Weighted Least Square (DWLS) estimation method, considering the parameters described in the previous paragraph. It aimed to account for individual differences not accounted for in common factor models, thus extending the standard confirmatory factor model (Maydeu-Olivares & Coffman, 2006Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
https://doi.org/10.1037/1082-989X.11.4.3...
).

To verify the invariance of item parameters, the Multigroup Confirmatory Factor Analysis (MG-CFA) method was employed, using the Diagonal Weighted Least Square (DWLS) estimator. Three models were compared to assess the equivalence of the measurement instrument among team and individual sport athletes: the configural model (internal structure), metric model (factor loadings), and scalar model (intercepts). The interpretation of the results considered the variability of the indices RMSEA (ΔRSMEA < .01), CFI (ΔCFI < .01), McDonald’s (ΔMcDonald < .02) e Gamma-hat (ΔGamma-hat < .001; Cheung & Rensvold, 2002Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233- 255. https://doi.org/10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
). All analyses were conducted using the RStudio software in the R language, through the lavaan package (Rosseel, 2012Rosseel, Y. (2012). lavaan: An R package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. https://www.jstatsoft.org/v48/i02/
https://www.jstatsoft.org/v48/i02/...
).

Results

The CFA estimated two factorial structures, namely, a one-factor model and a correlated two-factor model. Among these structures, the two-factor model better fit the data, as it exhibited indices of good fit (χ2 = 145.00, df = 89, CFI = .972, TLI = .967, and RMSEA = .041, CI 90% [.028, .053]). Although the items were designed to assess a single construct, the one-factor structure proved inadequate as it showed indices below the literature’s expected values for CFI and TLI, along with a substantially higher value for RMSEA (χ2 = 352.72, df = 90, CFI = .871, TLI = .849 and RMSEA = .088, CI 90% (.079, .098). The factor loadings for both structures were significant, for one-factor (λ < .38) and for the two-factor structure (first factor: positive λ < .59; second factor: negative λ < .44). Item 11, however, did not load significantly in both cases.

Understanding that the purpose of the instrument is to assess a single construct, the CFA with random intercept was employed aiming to improve the parameters of the one-factor structure by controlling for acquiescence. The fit indices improved, providing support for the theoretical foundation by corroborating a one-factor structure: χ2 = 176.26, df = 88, CFI = .957, TLI = .948, RMSEA = .052, 90% CI (.040, .063). The factor loadings of the model without and with acquiescence control for the ECE are presented in Table 1.

Table 1
Factor loadings of the unifactorial structure

The factor loadings of the items with negative content increased substantially, and there was also an improvement in the factor loadings of the positive items, except for items 1 and 14. Although the results were more appropriate with acquiescence control, item 11 did not show significant loading on the factor (Table 1). Additionally, an MG-CFA was employed to test the equivalence of the ECE between athletes who engage in team sports and athletes who engage in individual sports (Table 2).

Table 2
Factorial invariance between team sports (n = 198) and individual sports (n = 179)

The variability of the indices was higher than expected, except for the RMSEA from the metric model to the scalar model (Table 2). Thus, the results suggest that the ECE is not equivalent between the two groups of athletes (team sports practitioners vs. individual sports practitioners), indicating that the scores are variant and the item parameters are biased.

Discussion

The objective of the present study was to seek new evidence of validity regarding the internal structure of the ECE. The results demonstrated that the model controlling acquiescence by random intercepts yielded more appropriate fit indices for the one-factor structure, supporting hypothesis “b” of the present study by indicating the presence of response biases that influenced the interpretability of the data (Maydeu-Olivares & Coffman, 2006Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
https://doi.org/10.1037/1082-989X.11.4.3...
). As expected, the MG-CFA indicated that the instrument does not work equivalently among athletes in team and individual sports (Cheung & Rensvold, 2002Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233- 255. https://doi.org/10.1207/S15328007SEM0902_5
https://doi.org/10.1207/S15328007SEM0902...
).

According to the results observed in the study by Campos et al. (2022Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.), the two-factor structure was found to be more appropriate for the sample data, as it exhibited adequate fit indices. In this regard, the random intercept model was applied to control for acquiescence since the items in the scale assess connection, representing a single construct. The comparison between the one-factor models with and without acquiescence control highlights the impact of response bias on the internal structure of the instrument.

In the model without the use of random intercepts, the factor loadings of the negative items were underestimated. Additionally, the model fit was biased, resulting in non-acceptable fit indices. In contrast, the model with the use of random intercepts showed an improvement in the factor loadings of the negative items, and the model obtained acceptable fit indices (Ziegler, 2015Ziegler, M. (2015). “F*** you, I won’t do what you told me!”: Response biases as threats to psychological assessment. European Journal of Psychological Assessment, 31(3), 153-158. https://doi.org/10.1027/1015-5759/a000292
https://doi.org/10.1027/1015-5759/a00029...
). Thus, the results indicate that biases should not be ignored in the estimation of factor scores (Valentini et al., 2020Valentini, F., Mose, L. D. B., Ramos, I. D. S., & Conceição, N. M. D. (2020). Development of the inventory of supporting for socio-emotional skills, evidence of internal structure controlling for acquiescence. Estudos de Psicologia (Campinas), 37. https://doi.org/10.1590/1982-0275202037e180161
https://doi.org/10.1590/1982-0275202037e...
).

Regarding the factor loadings, item 11 showed a lower value compared to the other items, and it did not demonstrate a more appropriate value even in the controlled model. The low factor loading of item 11 may be attributed to its content, which differs from the other items that specifically refer to the team or coach, as it uses the term “participants.” As a result, respondents may interpret “participants” as any individual involved in their sports practice context (e.g., coach, team athletes, opponents, referees, spectators, etc.). Due to this ambiguity, the factor loading of the item may have been heavily penalized.

By controlling for acquiescence, the data exhibited more reliable scores with more appropriate parameters (Zanon et al., 2018Zanon, C., Lessa, J. P. A., & Dellazzana-Zanon, L. L. (2018). Acquiescence in self-report personality assessment: A comparison between methods. Avaliação Psicológica, 17(4), 428-438. http://dx.doi.org/10.15689/ap.2018.1704.3.03
http://dx.doi.org/10.15689/ap.2018.1704....
). These findings are aligned with the perspective that controlling for acquiescence is a significant procedure as it reproduces a more suitable internal structure that does not influence the data and does not compromise the validity evidence of the instrument and the reliability of the scores (Valentini, 2017Valentini, F. (2017). Influência e controle da aquiescência na análise fatorial [Influence and control of acquiescence in factor analysis]. Avaliação Psicológica, 16(2), 116-119. https://doi.org/10.15689/ap.2017.1602.ed
https://doi.org/10.15689/ap.2017.1602.ed...
; Zanon et al., 2018Zanon, C., Lessa, J. P. A., & Dellazzana-Zanon, L. L. (2018). Acquiescence in self-report personality assessment: A comparison between methods. Avaliação Psicológica, 17(4), 428-438. http://dx.doi.org/10.15689/ap.2018.1704.3.03
http://dx.doi.org/10.15689/ap.2018.1704....
).

The results of the AFCMG indicated that the scale does not work equivalently across groups. This suggests that the instrument is not able to capture real differences between practitioners of team and individual sports regarding connection within the sports environment. Since invariance was only supported in the restricted model (configural), differences between groups may reflect measurement error rather than real differences (Fischer & Karl, 2019Fischer, R., & Karl, J. A. (2019). A primer to (cross-cultural) multi-group invariance testing possibilities in R. Frontiers in psychology, 1507. https://doi.org/10.3389/fpsyg.2019.01507
https://doi.org/10.3389/fpsyg.2019.01507...
; Milfont & Fischer, 2010Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-130. https://doi.org/10.21500/20112084.857
https://doi.org/10.21500/20112084.857...
).

Therefore, the results support hypothesis “d” of the present study by suggesting that although the ECE demonstrates configural invariance across groups in terms of factorial structure, it does not exhibit stability in terms of the weight of items on the latent factor (factor loadings) and item intercepts (endorsement difficulty). One possibility for the lack of invariance may stem from the content of the items, which, when referring to athletes' relationships with other athletes, are focused on the team. Athletes who participate in individual sports may train with other athletes, develop a bond, and establish trust, i.e., a connection with another athlete. However, their focus is not on facing competitive challenges through the team’s potential, as they tend to compete alone.

The content of the item influences the factor loadings and intercept, impairing the equivalence of the instrument for athletes in both types of sports. In individual sports, the items may not be assessing what they intend to measure, namely the connection between athletes. The factor loadings, therefore, tend to be lower for the individual sport group compared to the team sport group, making it impossible to compare the relationships between constructs (Brown, 2015Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.), and indicating that the items do not have the same relevance for the construct (Byrne, 2010Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2. ed.). Routledge, Taylor & Francis.). Regarding the intercepts, the results suggest that there is no equality among the items, as the latent means are different between the two groups (Steenkamp & Baumgartner, 1998Steenkamp, J. B. E., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78-90. https://doi.org/10.1086/209528
https://doi.org/10.1086/209528...
).

In the sports environment, relationships are essential components for the development and enhancement of skills (Santos et al., 2016Santos, F. S. F., Camiré, M., Campos, P. H. F. (2016). Youth sport coaches’ role in facilitating positive youth development in Portuguese field hockey. International Journal of Sport and Exercise Psychology, 16(3), 221-234. https://doi.org/10.1080/1612197X.2016.1187655
https://doi.org/10.1080/1612197X.2016.11...
; Vierimaa et al., 2017Vierimaa, M., Turnnidge, J., Bruner, M., & Côté, J. (2017). Just for the fun of it: Coaches’ perceptions of an exemplary community youth sport program. Physical Education and Sport Pedagogy, 22(6), 603-617. https://doi.org/10.1080/17408989.2017.1341473
https://doi.org/10.1080/17408989.2017.13...
). The role of the coach influences the athlete’s relationship with other athletes and is also associated with learning and support. In this scenario, the athlete tends to develop aspects both within and outside of sports, such as leadership, academic performance, and family relationships (Bean et al., 2018Bean, C., Kramers, S., Forneris, T., & Camiré, M. (2018). The implicit/explicit continuum of life skills development and transfer. Quest, 70(4), 456-470. https://doi.org/10.1080/00336297.2018.1451348
https://doi.org/10.1080/00336297.2018.14...
). In turn, the relationship with other athletes is associated with motivation and engagement. When athletes feel part of a group, they build a connection with others and experience a supportive environment, which stimulates their social and personal skills (Bruner et al., 2014Bruner, M. W., Boardley, I. D., & Côté, J. (2014). Social identity and prosocial and antisocial behavior in youth sport. Psychology of Sport and Exercise, 15(1), 56-64. https://doi.org/10.1016/j.psychsport.2013.09.003
https://doi.org/10.1016/j.psychsport.201...
).

Based on the above considerations, the importance of proposing and refining measures that assess the quality of relationships in the sports context becomes evident. Such measures can identify the quality of connections and pinpoint areas that require interventions for improvement, leading to the development of beneficial relationships and an environment that fosters positive athlete development (Scott et al., 2021Scott, C. E., Fry, M. D., Weingartner, H., & Wineinger, T. O. (2021). Collegiate sport club athletes’ psychological well-being and perceptions of their team climate. Recreational Sports Journal, 45(1), 17-26. https://doi.org/10.1177/1558866121995169
https://doi.org/10.1177/1558866121995169...
; Silva & Peixoto, in press; Van Yperen et al., 2021Van Yperen, N. W., Dankers, S., Elbe, A. M., Sanchez, X., & Otten, S. (2021). Perceived inclusion in youth soccer teams: The role of societal status and perceived motivational goal climate. Psychology of Sport and Exercise, 53, 101882. https://doi.org/10.1016/j.psychsport.2020.101882
https://doi.org/10.1016/j.psychsport.202...
; Yukhymenko-Lescroar, 2021Yukhymenko-Lescroart, M. A. (2021). The role of team and sport social contexts: Are three-level models needed in studies of sport conduct? Psychology of Sport and Exercise, 53, 101848. https://doi.org/10.1016/j.psychsport.2020.101848
https://doi.org/10.1016/j.psychsport.202...
).

In sum, advancing with instruments that aim to assess relationships in the sports environment provides professionals (e.g., coaches, physical educators, and sports psychologists) a better understanding of the athlete’s feelings, emotions, and behaviors towards others. It also helps in planning strategies to facilitate connection and, consequently, stimulates the enhancement of skills such as empathy, leadership, and decision-making (Holt et al., 2017Holt, N. L., Neely, K. C., Slater, L. G., Camiré, M., Côté, J., Fraser-Thomas, J., MacDonald, D., Strachan, L., & Tamminen, K. A. (2017). A grounded theory of positive youth development through sport based on results from a qualitative meta-study. International Review of Sport and Exercise Psychology, 10(1), 1-49. https://doi.org/10.1080/1750984X.2016.1180704
https://doi.org/10.1080/1750984X.2016.11...
; Santos et al., 2016Santos, F. S. F., Camiré, M., Campos, P. H. F. (2016). Youth sport coaches’ role in facilitating positive youth development in Portuguese field hockey. International Journal of Sport and Exercise Psychology, 16(3), 221-234. https://doi.org/10.1080/1612197X.2016.1187655
https://doi.org/10.1080/1612197X.2016.11...
; Vierimaa et al., 2017Vierimaa, M., Turnnidge, J., Bruner, M., & Côté, J. (2017). Just for the fun of it: Coaches’ perceptions of an exemplary community youth sport program. Physical Education and Sport Pedagogy, 22(6), 603-617. https://doi.org/10.1080/17408989.2017.1341473
https://doi.org/10.1080/17408989.2017.13...
).

Thus, these professionals can use the instrument to provide a more appropriate assessment of the construct in different circumstances, depending on the team’s demands, individual athletes, or sport-specific characteristics. An example of application would be during competitive moments when athletes are more prone to response biases due to environmental stressors and internal pressure for performance (Coakley & Pike, 2009Coakley, J. J., & Pike, E. (2009). Sports in society: Issues and controversies. McGraw Hill Companies.; Elendu & Dennis, 2017Elendu, I. C., & Dennis, M. I. (2017). Over-emphasis on winning, host-to-win and winning-at-all-cost syndrome in modern sports competitions: Implications for unsportsmanship behaviours of sports participants. International Journal of Physical Education, Sports and Health, 4(5), 104-107. https://www.kheljournal.com/archives/?year=2017&vol=4&issue=5∂=B&ArticleId=1123
https://www.kheljournal.com/archives/?ye...
). In this case, applying the ECE controlled by the RI model allows evaluators to interpret the quality of relationships more suitably with low indications of response biases (Maydeu-Olivares & Coffman, 2006Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
https://doi.org/10.1037/1082-989X.11.4.3...
; Primi et al., 2019Primi, R., Santos, D., De Fruyt, F., & John, O. P. (2019). Comparison of classical and modern methods for measuring and correcting for acquiescence. British Journal of Mathematical and Statistical Psychology, 72(3), 447-465. https://doi.org/10.1111/bmsp.12168
https://doi.org/10.1111/bmsp.12168...
).

The results of the present study indicate the adequacy of the instrument in measuring overall connection. Results also suggest the influence of response bias in answering the items. Thus, providing support for a tool that assists professionals in psychology and sports sciences. Additionally, the results contribute to the advancement of assessment in the sports context by considering adaptive aspects and athletes’ potential beyond competitive gains and high performance. By operationalizing a tool capable of identifying relationships and social skills, the assessment can encompass a broader understanding. However, despite the relevance of the findings and the progress made in measuring relationships in the sports environment, the present study has some limitations.

It was not possible to estimate mean differences between groups since the instrument demonstrated a lack of equivalence among the groups. Therefore, the comparisons could be associated with measurement error rather than the latent trait. In this regard, investments should be made to separately develop standardization proposals for athletes in team sports and individual sports. It is recommended that future studies adapt the ECE or include new items, considering the control of response biases through other techniques, such as social desirability. Suggestions include adapting or constructing new items using quadruplets, item neutralization (Costa & Hauck-Filho, 2017Costa, A. R. L., & Hauck Filho, N. (2017). Less social desirability is more desirable: Neutralizing personality inventories. Interação em Psicologia, 21(3). http://dx.doi.org/10.5380/psi.v21i3.53054
http://dx.doi.org/10.5380/psi.v21i3.5305...
; Ziegler, 2015Ziegler, M. (2015). “F*** you, I won’t do what you told me!”: Response biases as threats to psychological assessment. European Journal of Psychological Assessment, 31(3), 153-158. https://doi.org/10.1027/1015-5759/a000292
https://doi.org/10.1027/1015-5759/a00029...
), and excluding item 11 as it did not show values considered adequate in factor loading in both models (with and without control of acquiescence).

References

  • Anderson-Butcher, D., Wade-Mdivanian, R., Paluta, L., Lower, L., Amorose, A., & Davis, J. (2014). OSU LiFE Sports 2013 annual report College of Social Work, The Ohio State University.
  • Baumgartner, H., & Steenkamp, J. B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 28, 143-156. https://doi.org/10.1509/jmkr.38.2.143.18840
    » https://doi.org/10.1509/jmkr.38.2.143.18840
  • Baumeister, R. F., & Leary, M. R. (1995). The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Psychological Bulletin, 117(3), 497-529. https://doi.org/10.1037/0033-2909.117.3.497
    » https://doi.org/10.1037/0033-2909.117.3.497
  • Bazanov, B., Võhandu, P., & Haljand, R. (2006). Factors influencing the teamwork intensity in basketball. International Journal of Performance Analysis in Sport, 6(2), 88-96. https://doi.org/10.1080/24748668.2006.11868375
    » https://doi.org/10.1080/24748668.2006.11868375
  • Bean, C., Kramers, S., Forneris, T., & Camiré, M. (2018). The implicit/explicit continuum of life skills development and transfer. Quest, 70(4), 456-470. https://doi.org/10.1080/00336297.2018.1451348
    » https://doi.org/10.1080/00336297.2018.1451348
  • Benar, N., & Loghmani, M. (2014). Factor analysis of teenage athletes’ goal orientations and sports participation motives in leisure time. Annals of Applied Sport Science, 2(1), 69-80. https://doi.org/10.18869/acadpub.aassjournal.2.1.69
    » https://doi.org/10.18869/acadpub.aassjournal.2.1.69
  • Brown, T. A. (2015). Confirmatory factor analysis for applied research Guilford Press.
  • Bruner, M. W., Boardley, I. D., & Côté, J. (2014). Social identity and prosocial and antisocial behavior in youth sport. Psychology of Sport and Exercise, 15(1), 56-64. https://doi.org/10.1016/j.psychsport.2013.09.003
    » https://doi.org/10.1016/j.psychsport.2013.09.003
  • Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2. ed.). Routledge, Taylor & Francis.
  • Campos, D., Silva, M. P. P., & Peixoto, M. E. (2022). Escala dos 5Cs do Desenvolvimento Positivo de Jovens no Esporte: Propriedades psicométricas [The 5Cs Scale of Positive Youth Development in Sport: Psychometric Properties; Submitted manuscript]. Universidade São Francisco.
  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233- 255. https://doi.org/10.1207/S15328007SEM0902_5
    » https://doi.org/10.1207/S15328007SEM0902_5
  • Coakley, J. J., & Pike, E. (2009). Sports in society: Issues and controversies McGraw Hill Companies.
  • Coie, J. D., & Dodge, K. A. (1983). Continuities and changes in children’s social status: A five-year longitudinal study. Merrill-Palmer Quarterly, 29(3), 261-282. https://www.jstor.org/stable/23086262
    » https://www.jstor.org/stable/23086262
  • Compton, W. C. (2005). An introduction to positive psychology Thomson Wadsworth.
  • Costa, A. R. L., & Hauck Filho, N. (2017). Less social desirability is more desirable: Neutralizing personality inventories. Interação em Psicologia, 21(3). http://dx.doi.org/10.5380/psi.v21i3.53054
    » http://dx.doi.org/10.5380/psi.v21i3.53054
  • Côté, J., Buner, M. W. , Erickson, K. Strachan, L., & Fraser-Thomas, J. (2010). Athlete development and coaching. In J. Lyle & C. Cushion (Eds.), Sport Coaching: Professionalism and Practice (pp. 63-79). Elsevier.
  • Danner, D., Aichholzer, J., & Rammstedt, B. (2015). Acquiescence in personality questionnaires: Relevance, domain specificity, and stability. Journal of Research in Personality, 57, 119-130. https://doi.org/10.1016/j.jrp.2015.05.004
    » https://doi.org/10.1016/j.jrp.2015.05.004
  • Elendu, I. C., & Dennis, M. I. (2017). Over-emphasis on winning, host-to-win and winning-at-all-cost syndrome in modern sports competitions: Implications for unsportsmanship behaviours of sports participants. International Journal of Physical Education, Sports and Health, 4(5), 104-107. https://www.kheljournal.com/archives/?year=2017&vol=4&issue=5∂=B&ArticleId=1123
    » https://www.kheljournal.com/archives/?year=2017&vol=4&issue=5∂=B&ArticleId=1123
  • Eys, M. A., Loughead, T. M., Bray, S. R., & Carron, A. V. (2009). Perceptions of cohesion by youth sport participants. The Sport Psychologist, 23(3), 330-345. https://doi.org/10.1123/tsp.23.3.330
    » https://doi.org/10.1123/tsp.23.3.330
  • Fraser-Thomas, J., Côté, J., & Deakin, J. (2005). Youth sport programs: An avenue to foster positive youth development. Physical Education & Sport Pedagogy, 10(1), 19-40. https://doi.org/10.1080/1740898042000334890
    » https://doi.org/10.1080/1740898042000334890
  • Fischer, R., & Karl, J. A. (2019). A primer to (cross-cultural) multi-group invariance testing possibilities in R. Frontiers in psychology, 1507 https://doi.org/10.3389/fpsyg.2019.01507
    » https://doi.org/10.3389/fpsyg.2019.01507
  • Fuchs, M., Faber, I. R., & Lames, M. (2019). Game characteristics in elite para table tennis. German Journal of Exercise and Sport Research, 49(3), 251-258. https://doi.org/10.1007/s12662-019-00575-4
    » https://doi.org/10.1007/s12662-019-00575-4
  • Galatti, L. R., Bettega, O. B., Paes, R. R., Reverdito, R. S., Seoane, A. M., & Scaglia, A. J. (2017). O ensino dos jogos esportivos coletivos: Avanços metodológicos dos aspectos estratégico-tático-técnicos [Teaching team sports games: Methodological advances in strategic-tactical-technical aspects]. Pensar a Prática, 20(3). https://doi.org/10.5216/rpp.v20i3.39593
    » https://doi.org/10.5216/rpp.v20i3.39593
  • Goldenberg, A., Halperin, E., van Zomeren, M., & Gross, J. (2016). The process model of group-based emotion: Integrating intergroup emotion and emotion regulation perspectives. Personality and Social Psychology Review, 20, 118-141. http://dx.doi.org/10.1177/1088868315581263
    » http://dx.doi.org/10.1177/1088868315581263
  • Howard, S. J., Vella, S. A., & Cliff, D. P. (2018). Children’s sports participation and self-regulation: Bi-directional longitudinal associations. Early Childhood Research Quarterly, 42, 140-147. https://doi.org/10.1016/j.ecresq.2017.09.006
    » https://doi.org/10.1016/j.ecresq.2017.09.006
  • Holt, N. L. (2016). Introduction: Positive youth development through sport. In N. L. Holt (Ed.), Positive Youth Development Through Sport (2. ed., pp. 1-4). Routledge.
  • Holt, N. L., Deal, C. J., & Pankow, K. (2020). Positive youth development through sport. In G. Tenenbaum, & R. C. Eklund (Eds.), Handbook of Sport Psychology (4. ed, pp. 429-446). Wiley.
  • Holt, N. L., Neely, K. C., Slater, L. G., Camiré, M., Côté, J., Fraser-Thomas, J., MacDonald, D., Strachan, L., & Tamminen, K. A. (2017). A grounded theory of positive youth development through sport based on results from a qualitative meta-study. International Review of Sport and Exercise Psychology, 10(1), 1-49. https://doi.org/10.1080/1750984X.2016.1180704
    » https://doi.org/10.1080/1750984X.2016.1180704
  • Jong, L. M., Gastin, P. B., Bruce, L., & Dwyer, D. B. (2022). Teamwork and performance in professional women’s football: A network-based analysis. International Journal of Sports Science & Coaching, 18(3), 848-857. https://doi.org/10.1177/17479541221092355
    » https://doi.org/10.1177/17479541221092355
  • Jowett, S., & Ntoumanis, N. (2004). The coach-athlete relationship questionnaire (CART‐Q): Development and initial validation. Scandinavian Journal of Medicine & Science in Sports, 14(4), 245-257. https://doi.org/10.1111/j.1600-0838.2003.00338.x
    » https://doi.org/10.1111/j.1600-0838.2003.00338.x
  • Jowett, S., & Poczwardowski, A. (2007). Understanding the coach-athlete relationship. In S. Jowett & D. Lavalee (Eds.), Social Psychology in Sport (pp. 3-14). Human Kinetics.
  • Kavussanu, M., & Boardley, I. D. (2009). The prosocial and antisocial behavior in sport scale. Journal Sport of Exercise Psychology, 31, 97-117. https://doi.org/10.1123/jsep.31.1.97
    » https://doi.org/10.1123/jsep.31.1.97
  • Kavussanu, M. & Stanger, N. (2017). Moral behavior in sport. Current Opinion in Psychology, 16, 185-192. http://doi.org/10.1016/j.copsyc.2017.05.010
    » http://doi.org/10.1016/j.copsyc.2017.05.010
  • Kim, J. W., & Nam, S. S. (2021). Physical characteristics and physical fitness profiles of Korean Taekwondo Athletes: A systematic review. International Journal of Environmental Research and Public Health, 18(18), 9624. https://doi.org/10.3390/ijerph18189624
    » https://doi.org/10.3390/ijerph18189624
  • Lerner, R. M., Lerner, J. V., Almerigi, J., Theokas, C., Phelps, E., Gestsdottir, S. Naudeau, S., Jelicic, H., Alberts, A. E., Ma, L., Smith, L. M., Bobek, D. L., Richman-Raphael, D., Simpson, I., Christiansen, E. D., & von Eye, A. (2005). Positive youth development, participation in community youth development programs, and community contributions of fifth grade adolescents: Findings from the first wave of the 4-H study of positive youth development. Journal of Early Adolescence, 25(1), 17-71. https://doi.org/10.1177%2F0272431604272461
    » https://doi.org/10.1177%2F0272431604272461
  • Lidor, R., & Ziv, G. (2010). Physical characteristics and physiological attributes of adolescent volleyball players: A review. Pediatric Exercise Science, 22(1). https://doi.org/ 10.1123/pes.22.1.114
    » https://doi.org/ 10.1123/pes.22.1.114
  • Lorimer, R. (2009). Coaches’ satisfaction with their athletic partnerships. International Journal of Coaching Science, 3(2), 55-64. https://rke.abertay.ac.uk/en/publications/coaches-satisfaction-with-their-athletic-partnerships
    » https://rke.abertay.ac.uk/en/publications/coaches-satisfaction-with-their-athletic-partnerships
  • MacDonald, D. J., Côté, J., & Deakin, J. (2010). The impact of informal coach training on the personal development of youth sport athletes. International Journal of Sports Science & Coaching, 5(3), 363-372. https://doi.org/10.1260/1747-9541.5.3.363
    » https://doi.org/10.1260/1747-9541.5.3.363
  • MacDonald, D. J., Côté, J., Eys, M., & Deakin, J. (2012). Psychometric properties of the youth experience survey with young athletes. Psychology of Sport and Exercise, 13, 332-340. https://doi.org/10.1016/j.psychsport.2011.09.001
    » https://doi.org/10.1016/j.psychsport.2011.09.001
  • Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11(4), 344-362. https://doi.org/10.1037/1082-989X.11.4.344
    » https://doi.org/10.1037/1082-989X.11.4.344
  • Maydeu-Olivares, A., & Steenkamp, J. B. E. M. (2018). An integrated procedure to control for common method variance in survey data using random intercept factor analysis models Academia.edu. https://www.academia.edu/36641946/An_integrated_procedure_to_control_f or_common_method_variance_in_survey_data_using_random_intercept_factor_analysis_models
    » https://www.academia.edu/36641946/An_integrated_procedure_to_control_f or_common_method_variance_in_survey_data_using_random_intercept_factor_analysis_models
  • Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-130. https://doi.org/10.21500/20112084.857
    » https://doi.org/10.21500/20112084.857
  • Moradi, J., Bahrami, A., & Dana, A. (2020). Motivation for participation in sports based on athletes in team and individual sports. Physical Culture and Sport: Studies and Research, 85(1), 14-21. https://doi.org/ 10.2478/pcssr-2020-0002
    » https://doi.org/ 10.2478/pcssr-2020-0002
  • Panza, M. J., Graupensperger, S., Agans, J. P., Doré, I., Vella, S. A., & Evans, M. B. (2020). Adolescent sport participation and symptoms of anxiety and depression: A systematic review and meta-analysis. Journal of sport and exercise psychology, 42(3), 201-218. https://doi.org/10.1123/jsep.2019-0235
    » https://doi.org/10.1123/jsep.2019-0235
  • Primi, R., Santos, D., De Fruyt, F., & John, O. P. (2019). Comparison of classical and modern methods for measuring and correcting for acquiescence. British Journal of Mathematical and Statistical Psychology, 72(3), 447-465. https://doi.org/10.1111/bmsp.12168
    » https://doi.org/10.1111/bmsp.12168
  • Reverdito, R. S., Carvalho, H. M., Galatti, L. R., Scaglia, A. J., Goncalves, C. E., & Paes, R. R. (2017). Effects of youth participation in extra-curricular sport programs on perceived self-efficacy: A multilevel analysis. Perceptual and Motor Skills, 124(3), 569-583. https://doi.org/10.1177/0031512517697069
    » https://doi.org/10.1177/0031512517697069
  • Rosseel, Y. (2012). lavaan: An R package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. https://www.jstatsoft.org/v48/i02/
    » https://www.jstatsoft.org/v48/i02/
  • Sanches, S. M., & Rubio, K. (2011). Sports practice as an educational tool: Working with values and resilience. Educação e Pesquisa, 37(4), 825-841. https://doi.org/10.1590/S1517-97022011000400010
    » https://doi.org/10.1590/S1517-97022011000400010
  • Santos, F. S. F., Camiré, M., Campos, P. H. F. (2016). Youth sport coaches’ role in facilitating positive youth development in Portuguese field hockey. International Journal of Sport and Exercise Psychology, 16(3), 221-234. https://doi.org/10.1080/1612197X.2016.1187655
    » https://doi.org/10.1080/1612197X.2016.1187655
  • Scott, C. E., Fry, M. D., Weingartner, H., & Wineinger, T. O. (2021). Collegiate sport club athletes’ psychological well-being and perceptions of their team climate. Recreational Sports Journal, 45(1), 17-26. https://doi.org/10.1177/1558866121995169
    » https://doi.org/10.1177/1558866121995169
  • Shields, D. L., & Bredemeier, B. L. (2007). Advances in sport mortality research. In G. Tenenbaum & R. C. Eklund (Eds.), Handbook of Sport Psychology (3. ed, pp. 662-684). John Wiley.
  • Silva, M. P. P, & Peixoto, E. M. (in press). Escala de trabalho em equipe para jovens: Adaptação transcultural e propriedades psicométricas [Teamwork scale for young people: Cross-cultural adaptation and psychometric properties]. PSICO
  • Steenkamp, J. B. E., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78-90. https://doi.org/10.1086/209528
    » https://doi.org/10.1086/209528
  • Tavares, M. A., Fonseca, S., Lopes, A., Galatti, L. R., & Reverdito, R. S. (2021). Coach-athlete relationship and youth positive experience in sport extracurricular. Cuadernos de Psicología del Deporte, 21(1), 146-161. https://doi.org/10.6018/cpd.428691
    » https://doi.org/10.6018/cpd.428691
  • Turnnidge, J., Vierimaa, M., & Côté, J. (2012). An in-depth investigation of a model sport program for athletes with a physical disability. Psychology, 3(12), 1131. http://dx.doi.org/10.4236/psych.2012.312A167
    » http://dx.doi.org/10.4236/psych.2012.312A167
  • Uziel, L. (2010). Rethinking social desirability scales: From impression management to interpersonally oriented self-control. Perspectives on Psychological Science, 5(3), 243-262. https://doi.org/10.1177/1745691610369465
    » https://doi.org/10.1177/1745691610369465
  • Valentini, F. (2017). Influência e controle da aquiescência na análise fatorial [Influence and control of acquiescence in factor analysis]. Avaliação Psicológica, 16(2), 116-119. https://doi.org/10.15689/ap.2017.1602.ed
    » https://doi.org/10.15689/ap.2017.1602.ed
  • Valentini, F., Mose, L. D. B., Ramos, I. D. S., & Conceição, N. M. D. (2020). Development of the inventory of supporting for socio-emotional skills, evidence of internal structure controlling for acquiescence. Estudos de Psicologia (Campinas), 37 https://doi.org/10.1590/1982-0275202037e180161
    » https://doi.org/10.1590/1982-0275202037e180161
  • Van Yperen, N. W., Dankers, S., Elbe, A. M., Sanchez, X., & Otten, S. (2021). Perceived inclusion in youth soccer teams: The role of societal status and perceived motivational goal climate. Psychology of Sport and Exercise, 53, 101882. https://doi.org/10.1016/j.psychsport.2020.101882
    » https://doi.org/10.1016/j.psychsport.2020.101882
  • Vierimaa, M., Erickson, K., & Gilbert, W. (2012). Positive youth development: A measurement framework for sport. International Journal of Sports Science & Coaching, 7(3), 601- 614. https://doi.org/10.1260/1747-9541.7.3.601
    » https://doi.org/10.1260/1747-9541.7.3.601
  • Vierimaa, M., Turnnidge, J., Bruner, M., & Côté, J. (2017). Just for the fun of it: Coaches’ perceptions of an exemplary community youth sport program. Physical Education and Sport Pedagogy, 22(6), 603-617. https://doi.org/10.1080/17408989.2017.1341473
    » https://doi.org/10.1080/17408989.2017.1341473
  • Wazir, M. R. W. N., Van Hiel, M., Mostaert, M., Deconinck, F. J., Pion, J., & Lenoir, M. (2019). Identification of elite performance characteristics in a small sample of taekwondo athletes. PloS One, 14(5), e0217358. https://doi.org/10.1371/journal.pone.0217358
    » https://doi.org/10.1371/journal.pone.0217358
  • Weiss, M. R., & Smith, A. L. (2002). Friendship quality in youth sport: Relationship to age, gender, and motivation variables. Journal of Sport & Exercise Psychology, 24(4), 420-437.
  • Weiss, M. R., & Stuntz, C. P. (2004). A little friendly competition: Peer relationships and psychosocial development in youth sport and physical activity contexts. In M. R. Weiss (Ed.), Developmental sport and exercise psychology: A lifespan perspective (pp. 165- 196). Fitness Information Technology.
  • Yukhymenko-Lescroart, M. A. (2021). The role of team and sport social contexts: Are three-level models needed in studies of sport conduct? Psychology of Sport and Exercise, 53, 101848. https://doi.org/10.1016/j.psychsport.2020.101848
    » https://doi.org/10.1016/j.psychsport.2020.101848
  • Zanon, C., Lessa, J. P. A., & Dellazzana-Zanon, L. L. (2018). Acquiescence in self-report personality assessment: A comparison between methods. Avaliação Psicológica, 17(4), 428-438. http://dx.doi.org/10.15689/ap.2018.1704.3.03
    » http://dx.doi.org/10.15689/ap.2018.1704.3.03
  • Ziegler, M. (2015). “F*** you, I won’t do what you told me!”: Response biases as threats to psychological assessment. European Journal of Psychological Assessment, 31(3), 153-158. https://doi.org/10.1027/1015-5759/a000292
    » https://doi.org/10.1027/1015-5759/a000292
  • Data availability statement

    Research data is available upon request to the corresponding author.

Edited by

Responsible editor

Pedro Afonso Cortez

Data availability

Research data is available upon request to the corresponding author.

Publication Dates

  • Publication in this collection
    07 Oct 2024
  • Date of issue
    2024

History

  • Received
    10 Jan 2023
  • Accepted
    09 Apr 2023
Instituto de Psicologia, Universidade de Brasília Instituto de Psicologia, Universidade de Brasília, 70910-900 - Brasília - DF - Brazil, Tel./Fax: (061) 274-6455 - Brasília - DF - Brazil
E-mail: revistaptp@gmail.com