ABSTRACT
Objective:
To evaluate the factorial structure of the instrument measuring university administrators’ knowledge of gender-based violence.
Methods:
This cross-sectional methodological study was conducted from August to November 2020 with 101 university administrators. Data on demographic and functional characteristics were collected, and the “QUEST VBG UNIV” instrument was applied. Descriptive analysis was performed, the structure of the questionnaire was assessed using exploratory factor analysis (EFA), and the stability of the factors was verified through ORION and FDI tests.
Results:
Of the original 38 items across the 4 sections of the questionnaire, 19 were retained within 2 factors, with appropriate factor loadings. Factor 1 had an explained variance of 15.69%, and Factor 2 had an explained variance of 9.10%. The reliability was deemed satisfactory (ORION > 0.900, FDI > 0.900).
Conclusions:
The questionnaire presented a valid and reliable factorial structure for measuring knowledge about gender-based violence, thereby representing a suitable option for situational assessments in universities.
Descriptors:
Validation Study; Factor Analysis; Statistical; Psychometrics; Gender-Based Violence; Workplace Violence
RESUMEN
Objetivo:
Evaluar la estructura factorial del instrumento que mide el conocimiento de los administradores universitarios sobre la violencia de género.
Métodos:
Estudio metodológico transversal se llevó a cabo de agosto a noviembre de 2020 con 101 administradores universitarios. Se recogieron datos sobre características demográficas y funcionales, y se aplicó el instrumento “QUEST VBG UNIV”. Se realizó un análisis descriptivo, se evaluó la estructura del cuestionario utilizando análisis factorial exploratorio (AFE), y se verificó la estabilidad de los factores a través de las pruebas ORION y FDI.
Resultados:
De los 38 ítems originales en las 4 secciones del cuestionario, se retuvieron 19 en 2 factores, con cargas factoriales adecuadas. El Factor 1 tuvo una varianza explicada del 15.69%, y el Factor 2 una varianza explicada del 9.10%. Se consideró que la fiabilidad era satisfactoria (ORION > 0.900, FDI > 0.900).
Conclusiones:
El cuestionario es una herramienta válida y confiable para medir el conocimiento sobre la violencia de género en las universidades.
Descriptores:
Estudio de Validación; Análisis Factorial; Psicometría; Violencia de Género; Violencia Laboral
RESUMO
Objetivo:
Avaliar a estrutura fatorial do instrumento de medição do conhecimento de gestores sobre violência de gênero na universidade.
Métodos:
Estudo transversal de caráter metodológico, realizado no período de agosto a novembro de 2020 com 101 gestores universitários. Foram coletados dados sobre características demográficas e funcionais, e o instrumento “QUEST VBG UNIV” foi aplicado. Realizou-se análise descritiva, avaliação da estrutura do questionário usando análise fatorial exploratória (AFE), e verificação da estabilidade dos fatores pelos testes ORION e FDI.
Resultados:
Dos 38 itens originais das 4 seções do questionário, 19 foram retidos em 2 fatores, com cargas fatoriais adequadas. O Fator 1 teve variância explicada de 15,69%, e o Fator 2 de 9,10%. A confiabilidade foi considerada satisfatória (ORION > 0,900, FDI > 0,900).
Conclusões:
O questionário apresentou estrutura fatorial válida e confiável para mensurar o conhecimento sobre violência de gênero, representando uma opção adequada para avaliações situacionais em universidades.
Descritores:
Estudo de validação; Análise Fatorial; Psicometria; Violência Baseada em Gênero; Violência no Ambiente de Trabalho
INTRODUCTION
Violence against women, or Gender-Based Violence (GBV), is an escalating public health issue worldwide and must be recognized as a socio-historical phenomenon, complex in its multicausality and its multiple consequences. This type of violence is present in the university context, making it crucial to measure the understanding of Gender-Based Violence within the university, especially from the perspective of administrators, who are responsible for university policies.
The WHO recognizes violence against women as a global health problem of epidemic proportions(11 World Health Organization (WHO). Department of Reproductive Health and Research, London School of Hygiene and Tropical Medicine, South African Medical Research Council. Global and regional estimates of violence against women: prevalence and health effects of intimate partner violence and non-partner sexual violence. World Health Organization; 2013.). GBV refers to situations that affect women because they are women, and its various manifestations range from subtle forms, which may be overlooked as violence in daily relations (such as sexist jokes and minor disqualifications based on gender stereotypes), to terribly concrete forms, such as sexual violence and femicide(22 Panúncio-Pinto MP, Maito DC, Vieira EM. Gênero, saúde e violência: implicações para a formação profissional na universidade. In: Souza CD, Rocha CMF, Carneiro M, (Orgs.). Educação e saúde: experiências de formação e trabalho. Santa Cruz do Sul: EDUNISC; 2022.).
Situations of discrimination and gender-based violence are also present in the academic university context, affecting the personal and professional development of female students, employees, and teachers, as various studies point out(33 Rauhaus BM, Carr IAS. The leaky pipeline: gender and public administration professional education. In: Shields PM, Elias NM, (Eds.). Handbook on Gender and Public Administration. Massachusetts (USA): Elgaronline; 2022.
4 Reverter-Bañón S. La igualdad de género en la universidad: capitalismo académico y rankings globales. Rev Investig Fem. 2021;12(2):271-81. https://doi.org/10.5209/infe.72331
https://doi.org/10.5209/infe.72331...
5 Fedina L, Holmes J, Backes BL. Campus Sexual Assault: a systematic review of prevalence research. Trauma, Violence Abuse. 2018;19:76-93. https://doi.org/10.1177/15248380166311
https://doi.org/10.1177/15248380166311...
-66 Cantor D, Fisher B, Chibnall S, Townsend R, Lee H, Bruce WC, et al. Report on the AAU Campus Climate Survey on Sexual Assault and Sexual Misconduct [Internet]. The Association of American Universities; 2017[cited 2022 Oct 06]. Available from: https://www.aau.edu/sites/default/files/AAU-Files/Key-Issues/Campus-Safety/AAU-Campus-Climate-Survey-FINAL-10-20-17.pdf
https://www.aau.edu/sites/default/files/...
). In the Brazilian university context, work on the topic of GBV in academia has been produced(77 Freitas RCS, Musmanno RG, Carvalho MS. Violência de gênero: o caso da Universidade Federal Fluminense. Argumentum. 2020;12(3):102-16. https://doi.org/10.47456/argumentum.v12i3.28387
https://doi.org/10.47456/argumentum.v12i...
8 Bellini DMG. Violência contra mulheres nas universidades: contribuições da produção científica para sua superação [Dissertação]. Universidade Federal de São Carlos; 2018.-99 Maito DC. Parâmetros teóricos e normativos para o enfrentamento à violência contra as mulheres na Universidade de São Paulo [Dissertação]. Faculdade de Direito de Ribeirão Preto, Universidade de São Paulo; 2017.), notably after the repercussion of the report from the Parliamentary Inquiry Commission of the Legislative Assembly of the State of São Paulo, Brazil(1010 Assembleia Legislativa do Estado de São Paulo. Relatório da Comissão Parlamentar de Inquérito, para investigar violações dos Direitos Humanos e demais ilegalidades ocorridas no âmbito das Universidades do Estado de São Paulo ocorridas nos chamados “trotes”, festas e no seu cotidiano [Internet]. Imprensa Oficial Governo do Estado de São Paulo; 2015[cited 2022 Oct 06]. Available from: https://www.al.sp.gov.br/spl_consultas/spl_icons/icoPDF.gif
https://www.al.sp.gov.br/spl_consultas/s...
), which investigated violence within the context of the Universities of São Paulo, calling them to confront these forms of violence in the university everyday life(1111 Universidade Estadual Paulista (Unesp). Educando para a diversidade: guia de prevenção assédio [Internet]. Ouvidoria Geral; 2020[cited 2022 Oct 06]. Available from: https://www.foar.unesp.br/Modulos/Noticias/234/guia_prevencao_assedio.pdf
https://www.foar.unesp.br/Modulos/Notici...
-1212 Universidade Estadual de Campinas (Unicamp). Resolução GR-017/2019, de 03/04/2019. Dispõe sobre a criação da Comissão Assessora da Política de Combate à Discriminação Baseada em Gênero e/ou Sexualidade e à Violência Sexual e o Serviço de Atenção à Violência Sexual na Universidade Estadual de Campinas [Internet]. Imprensa Oficial Governo do Estado de São Paulo; 2019[cited 2022 Oct 06]. Available from: https://www.pg.unicamp.br/norma/14481/0
https://www.pg.unicamp.br/norma/14481/0...
).
Much has been discussed, since the last three decades of the twentieth century, about the challenge that higher education institutions must face: to train not only technically competent professionals but also individuals with humanism, ethics, and political commitment in building a better society that welcomes diversity and promotes the rights of all and equity(1313 Panúncio-Pinto MP, Colares MFA. O estudante universitário: os desafios de uma educação integral. Medicina (Ribeirão Preto). 2015;48(3):273-81. https://doi.org/10.11606/issn.2176-7262.v48i3p273-281
https://doi.org/10.11606/issn.2176-7262....
). Thus, the university is conceived as a space for the encounter of various forms of knowledge, where solutions to social issues are sought(1414 Santos BS. Da Ideia de Universidade à Universidade de Ideias. Rev Crít Ciênc Soc [Internet]. 1989[cited 2022 Oct 06];27(28):11-52. Available from: http://www.boaventuradesousasantos.pt/media/pdfs/Da_ideia_de_universidade_RCCS27-28.PDF
http://www.boaventuradesousasantos.pt/me...
). In this context, it’s important to recognize that the university, as a social institution, reflects the way society functions and, as a subset of it, is affected by the dominant ideology. Gender-based violence is structural and is universally expressed, produced, and reproduced, regardless of socioeconomic, educational, and cultural conditions(1515 Maito DC, Panúncio-Pinto MP, Severi FC, Vieira EM. A universidade como reflexo e agente transformador da sociedade: a contradição movendo a história. Interface (Botucatu). 2019;23:e190711. https://doi.org/10.1590/Interface.19071b
https://doi.org/10.1590/Interface.19071b...
). Therefore, various types of violence against women present in society in general are reproduced in the context of higher education, from subtle daily discriminations to more concrete forms of violence, such as sexual violence.
At the University in focus, where all stages of this study were carried out, 2/3 of the teaching staff are men, and hirings over the past decades perpetuate this pattern, which is reflected in its scientific output. Subjected to a gender bias, it remains a predominantly male institution, as the highest-ranking and most powerful positions are dominated by men, who, in turn, have a higher H index in publications, increasing their chances of advancement in the academic career(1616 Oliveira-Ciabati L, Santos LL, Hsiou AS, Sasso AM, Castro M, Souza JP. Sexismo científico: o viés de gênero na produção científica da Universidade de São Paulo. Rev Saúde Pública [Internet]. 2021[cited 2022 Oct 06];55(46). Available from: https://doi.org/10.11606/s1518-8787.2021055002939
https://doi.org/10.11606/s1518-8787.2021...
).
In 2019, the “Interactions” survey(1717 Blay EA, Venturi G, Santos PK, Pasinato W, Alves LP, Capocchi E. Pesquisa interações na USP: primeiros resultados da pesquisa [Internet]. 2018[cited 2022 Oct 06]. Available from: http://uspmulheres.usp.br/pesquisa-interacoes-na-usp/
http://uspmulheres.usp.br/pesquisa-inter...
), with the participation of 13,377 undergraduate and post graduate students, showed that, although the majority of students consider the university a less discriminatory environment than society in general, 26% rated the institution as very sexist; 26% as very racist; 11% as very LGBTphobic, and 56% as very elitist. In this study, violence based on gender, race, and social class was also evidenced. An example is the moral violence suffered by women and men, from social markers of differences: of the black homo or bisexual women who participated in the survey, 52% suffered moral violence, that is, more than triple the percentage of heterosexual white men who suffered the same type of violence (17%). This is an example of how violence is interconnected with social markers, as per the concept of intersectionality(1818 Crenshaw K. Demarginalizing the intersection of race and sex; a black feminist critique discrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum; 1989. P.139-67.).
At the University in question, policies were established to confront GBV after the mobilization of student and teacher collectives(1919 Cruz F, Almeida HB, Oliveira AFPL, Lima EFA, Lago C, Machado AM. Don’t Stay Silent: network of female professors against gender violence at University of São Paulo (USP): Special Issue ‘Sex and Power in the University’. Ann Rev Crit Psychol[Internet]. 2018[cited 2022 Oct 06];(15):223-45. Available from: https://www.eca.usp.br/acervo/producao-academica/002997738.pdf
https://www.eca.usp.br/acervo/producao-a...
). In 2016, a partnership between the university and UN Women was created(2020 Organização das Nações Unidas (ONU). ONU Mulheres. Movimento ElesPorElas (HeForShe) de Solidariedade da ONU Mulheres pela Igualdade de Gênero: impactando Universidades [Internet]. Genebra: Organização das Nações Unidas; 2015[cited 2022 Oct 06]. Available from: https://www.onumulheres.org.br/elesporelas/
https://www.onumulheres.org.br/elesporel...
). This context of mobilization also resulted in the creation of special commissions to deal with violence, such as CAV-Women(2121 Universidade de São Paulo, Campus Ribeirão Preto. Portaria do Conselho Gestor do Campus de Ribeirão Preto nº 6, de 11 de julho de 2016. Dispõe sobre a criação de Comissão para apurar denúncias de discriminação, assédio e violência contra mulheres e gêneros no Campus USP de Ribeirão Preto. 2016. Ribeirão Preto, SP, 2016.).
In this scenario, with the institutional commitment to confront all forms of discrimination and GBV, the study that originated the questionnaire, whose process of evaluating measurement properties is reported here, was developed.
OBJECTIVE
To evaluate the factorial structure of an instrument that measures university administrators’ knowledge of gender-based violence.
METHODS
Ethical Aspects
The study adhered to both national(2222 Conselho Nacional de Saúde (CNS). Resolução nº 510, de 07 de abril de 2016 [Internet]. Diário Oficial República Federativa do Brasil: seção 1, Brasília, DF, nº 98 [Internet]. 2018 [cited 2022 Oct 06]. Available from: http://conselho.saude.gov.br/resolucoes/2016/Reso510.pdf
http://conselho.saude.gov.br/resolucoes/...
) and international ethical guidelines and was approved by the Research Ethics Committee of Hospital das Clínicas da Faculdade de Medicina de Ribeirão Preto/SP. The committee’s opinion is attached to this submission.
Free and Informed Consent was obtained from all study participants online, via the completion of an online form held by the researchers.
Study Design, Period, and Location
This cross-sectional methodological study, guided by the STROBE tool, was carried out at São Paulo University (USP) in the municipality of Ribeirão Preto from August to November 2020.
Population and Sample
The study population comprised 259 university administrators on a campus of the subject university who occupied 283 positions, given that it’s possible for one person to hold more than one position. Inclusion criteria included being involved in the implementation of university policy due to participation in collegiate bodies or administrative positions and having held disciplinary power in teaching units over the past four years. Exclusion criteria included inability to make contact (7 people were in this condition) and being in close proximity to the research team (4 people were in this condition).
The sample was non-probabilistic, using convenience sampling. A total of 248 staff members-both teaching (directors, chairpersons of statutory commissions, course coordinators, department heads and their deputies) and non-teaching (academic, administrative, financial technical assistants, and representatives from their respective categories in congregations and technical-administrative councils of the units)-were identified and invited to participate. The 101 administrators who responded to the emails and completed the instruments during the specified data collection period were included in the study.
Study Protocol
The instrument used was named “Questionnaire for Assessing Institutional Agents’ Knowledge about Gender-Based Violence at the University”, or in its abbreviated form, “QUEST VBG UNIV”. The questionnaire was part of a larger study conducted to broaden the understanding of how the University in question handles gender-based violence (GBV), aiming to identify the University’s institutional agents’ knowledge of gender-based violence on the said campus (23). The research was developed in two stages. The first consisted of 17 qualitative interviews with key informants (students, teachers, and employees) conducted with a semi-structured script. The analysis of these interviews served as the basis for the construction of the questionnaire, which was applied in the subsequent quantitative stage.
The questionnaire was specifically constructed for this study, as scientific literature provides similar instruments for investigating student perceptions of violence, but not university administrators’(2424 Rodríguez-Osuna LM, Dios I, Amor MI. Perception of gender-based violence and sexual harassment in university students: analysis of the information sources and risk within a relationship. Int J Environ Res Public Health. 2020;17:3754. https://doi.org/10.3390/ijerph17113754
https://doi.org/10.3390/ijerph17113754...
-2525 Carlson M, Kamimura A, Trinh HN, Mo W, Yamawaki N, Bhattacharya H, et al. Perceptions of violence against women among college students in the United States, Japan, India, Vietnam and China. Public Pol Adm Res [Internet]. 2015[cited 2022 Oct 06];5(11):82. Available from: https://www.iiste.org/Journals/index.php/PPAR/article/view/27219
https://www.iiste.org/Journals/index.php...
). Other studies investigated intimate partner violence among university students, which was also not the focus of our study(2626 Pengpid S, Peltzer K. Associations of physical partner violence and sexual violence victimization on health risk behaviours and mental health among university students from 25 countries. BMC Public Health. 2020;20(937). https://doi.org/10.1186/s12889-020-09064-y
https://doi.org/10.1186/s12889-020-09064...
-2727 Wang L. Education, perception factors, and prevention of intimate partner violence: empirical research on Chinese University students’ perceptions and attitudes concerning intimate partner violence. J Interpers Violence. 2019;34(8):1611-32. https://doi.org/10.1177/0886260516652263
https://doi.org/10.1177/0886260516652263...
).
The questionnaire contained the following groups of variables:
-
“Professional characterization,” with six questions about the current position, career position, and previous positions. These questions are objective and can be modified according to the characteristics of the location and population of each new application. They were not included in the factorial analysis.
-
“Knowledge about violence in the university environment,” with 10 questions referencing categories identified in the qualitative stage and in the Interactions research(1717 Blay EA, Venturi G, Santos PK, Pasinato W, Alves LP, Capocchi E. Pesquisa interações na USP: primeiros resultados da pesquisa [Internet]. 2018[cited 2022 Oct 06]. Available from: http://uspmulheres.usp.br/pesquisa-interacoes-na-usp/
http://uspmulheres.usp.br/pesquisa-inter... ). The responses to each question in this section were tallied in a score, where each correct answer corresponds to one point, and incorrect answers and “don’t know” options were not scored. Part “a” of question 10 is only descriptive and does not score, being excluded from the factorial analysis. -
“Opinion on violence at the university,” with 6 statements based on qualitative interviews and classified according to a Likert scale. To obtain the participants’ opinion, a figure was displayed with the options: “strongly agree,” “agree,” “neither agree nor disagree,” “disagree,” and “strongly disagree.” The “strongly agree” option counts as 1 point, “agree” as 2 points, “neither agree nor disagree” as zero, “disagree” as 3, and “strongly disagree” as 4 points.
-
“Experience with violence and discrimination at the university,” a section composed of 11 questions, covering the experience in the current management position, as well as the experience before it (witnessed or received reports of different types of violence). Question 17, on a Likert scale, counts 4 points for the “frequently” option, 3 for “sometimes”, 2 for “rarely”, and 1 point for “never”. Question 21, on a Likert scale, counts 1 point for the “frequently” option, 2 points for “sometimes”, and 3 points for both “rarely” and “never”. For the remaining questions, each affirmative response receives 1 point, and the sum of the categories defines a score: 0 to 6 points for questions 18, 19, 20, 22, 23, and 25; 0 to 7 points for questions 24 and 26; 0 to 5 points for question 27. Parts “a” and “b” of question 23, parts “a” and “b” of question 26, and question 27 are only descriptive, do not score, and are excluded from the factorial analysis.
-
“Knowledge about procedures related to gender-based violence and ways to confront it,” a section composed of 12 questions with true or false, yes or no, and multiple-choice questions. Correct answers are based on current Brazilian legislation(2828 Presidência da República (BR). Lei nº 11.340, de 07 de agosto de 2006: Lei Maria da Penha [Internet]. Brasília: Congresso Nacional; 2006[cited 2022 Oct 06]. Available from: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2006/lei/l11340.htm
http://www.planalto.gov.br/ccivil_03/_at... ), literature(1818 Crenshaw K. Demarginalizing the intersection of race and sex; a black feminist critique discrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum; 1989. P.139-67.,2929 Butler J. Problemas de gênero. Rio de Janeiro: Civilização Brasileira; 2003.-3030 Bueno S, Lima RS. Visível e invisível: vitimização de mulheres no Brasil [Internet]. 3ª ed. Fórum Brasileiro de Segurança Pública. 2021[cited 2022 Oct 06]. Available from: https://forumseguranca.org.br/wp-content/uploads/2021/06/relatorio-visivel-e-invisivel-3ed-2021-v3.pdf
https://forumseguranca.org.br/wp-content... ), and administrative norms applicable to USP(2121 Universidade de São Paulo, Campus Ribeirão Preto. Portaria do Conselho Gestor do Campus de Ribeirão Preto nº 6, de 11 de julho de 2016. Dispõe sobre a criação de Comissão para apurar denúncias de discriminação, assédio e violência contra mulheres e gêneros no Campus USP de Ribeirão Preto. 2016. Ribeirão Preto, SP, 2016.,3131 Universidade de São Paulo (USP). Portaria GR nº 3154, de 27 de abril de 1999. Dispõe sobre a proibição do trote na USP [Internet]. In: Normas USP. São Paulo: USP; 1999[cited 2022 Oct 06]. Available from: https://prg.usp.br/institucional/reitoria/gr-315499-dispoe-sobre-a-proibicao-do-trote-na-usp/
https://prg.usp.br/institucional/reitori...
32 Universidade de São Paulo (USP). Portaria GR nº 6766, de 10 de agosto de 2016. Dispõe sobre o Escritório USP Mulheres [Internet]. In: Normas USP. São Paulo: USP; 2016[cited 2022 Oct 06]. Available from: http://www.leginf.usp.br/?portaria=portaria-gr-6766-de-10-de-agosto-de-2016
http://www.leginf.usp.br/?portaria=porta... -3333 Universidade de São Paulo (USP). Resolução nº 3745, de 19 de outubro de 1990. Baixa o Regimento Geral da Universidade de São Paulo [Internet]. In: Normas USP. São Paulo: 1990[cited 2022 Oct 06]. Available from: http://www.leginf.usp.br/?resolucao=consolidada-resolucao-no-3745-de-19-de-outubro-de-1990#t1
http://www.leginf.usp.br/?resolucao=cons... ). Each correct answer scored a positive point; errors and “don’t know” options were not scored. -
“Sociodemographic information of participants,” with 13 questions such as age, sex, sexual orientation, religion, marital status, number, and sex of children. These questions are objective and can be modified according to the characteristics of the location and population of each new application. They were not included in the factorial analysis.
Study Protocol Modification and Analysis
The questionnaire underwent modifications inspired by a literature review of Rowling’s work (3434 Bowling A. Research methods in health: investigating health and health services. Buchingham: Open University Press; 1997.) and a pre-test with five university professors, two of whom are specialists in the field of violence. The results from the first version of this questionnaire’s application have been published(3535 American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME). Standards for educational and psychological testing [Internet]. Washington, DC: American Educational Research Association; 2014[cited 2022 Oct 06]. https://www.testingstandards.net/open-access-files.html
https://www.testingstandards.net/open-ac...
), and the complete original questionnaire can be found in Supplemental Material 1. In addition, questions about demographic characteristics were incorporated, including sex, sexual orientation, age range, race/color, religion, marital status, and the presence of children. Data collection was conducted face-to-face on the Google Meets platform by two trained interviewers. Data collection was supervised on a weekly basis, facilitating critique of the questionnaire and control of the field.
Data Analysis and Statistics
Initially, a descriptive analysis was conducted using absolute and relative values to characterize the sample. Based on the literature standards of the American Educational Research Association / American Psychological Association / National Council on Measurement in Education (2014)(3535 American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME). Standards for educational and psychological testing [Internet]. Washington, DC: American Educational Research Association; 2014[cited 2022 Oct 06]. https://www.testingstandards.net/open-access-files.html
https://www.testingstandards.net/open-ac...
), the COSMIN Consensus - COnsensus-based Standards for the selection of health Measurement INstruments(3636 Mokkink LB, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, Vet HCW, et al. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs); user manual Version 1.0 [Internet]. Netherlands: COSMIN; 2018[cited 2022 Oct 06]. Available from: https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf
https://cosmin.nl/wp-content/uploads/COS...
), and other authors proposals(3737 Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Measur [Internet]. 2018[cited 2022 Oct 06];78(5):762-80. Available from: https://journals.sagepub.com/doi/abs/10.1177/0013164417719308
https://journals.sagepub.com/doi/abs/10....
), the measurement properties were evaluated through construct validity, investigating the questionnaire’s internal structure, and through the instrument’s reliability, probing its internal consistency and stability.
The evaluation of the internal structure verifies the degree to which the items and components of an instrument reflect the dimensionality of the construct to be measured, based on the proposed score interpretations(3535 American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME). Standards for educational and psychological testing [Internet]. Washington, DC: American Educational Research Association; 2014[cited 2022 Oct 06]. https://www.testingstandards.net/open-access-files.html
https://www.testingstandards.net/open-ac...
36 Mokkink LB, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, Vet HCW, et al. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs); user manual Version 1.0 [Internet]. Netherlands: COSMIN; 2018[cited 2022 Oct 06]. Available from: https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf
https://cosmin.nl/wp-content/uploads/COS...
-3737 Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Measur [Internet]. 2018[cited 2022 Oct 06];78(5):762-80. Available from: https://journals.sagepub.com/doi/abs/10.1177/0013164417719308
https://journals.sagepub.com/doi/abs/10....
). To assess the factorial structure of the QUEST VBG UNIV, Exploratory Factor Analysis (EFA) was carried out, based on the procedures proposed by Lorenzo-Seva and Ferrando(3838 Lorenzo-Seva U, Ferrando PJ. Terragona: manual of the program FACTOR v. 9.20 [Internet]. Universitat Rovira i Virgili; 2013 [cited 2022 Oct 06]. Available from: https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual-of-the-Factor-Program-v92.pdf
https://psico.fcep.urv.cat/utilitats/fac...
) and Damásio(3939 Damásio BF. Uso da análise fatorial exploratória em psicologia. Aval Psicol [Internet]. 2012;11(2):213-28 [cited 2022 Oct 06]. Available from: http://pepsic.bvsalud.org/pdf/avp/v11n2/v11n2a07.pdf
http://pepsic.bvsalud.org/pdf/avp/v11n2/...
). Of the 58 original questions, 38 were included in the analysis, 6 were excluded because they are pertinent to the professional characterization, 13 to sociodemographic characterization, and one due to its purely descriptive nature. A Pearson correlation matrix was used, along with a robust factorial analysis technique, and a robust diagonally weighted least squares extraction method (RDWLS). Parallel Analysis with a random permutation of the observed data was implemented for the determination of the number of factors to retain, and the rotation used was Robust Promin.
The suitability of applying EFA to the dataset was evaluated by Bartlett’s test of sphericity and the Kaiser-Meyer-Olkin (KMO) measure, while the model’s adequacy was assessed via the Root Mean Square Error of Approximation (RMSEA), Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Minimum Fit Function Chi Square (χ2/gl) indices.
The questionnaire’s unidimensionality was appraised through the unidimensional congruence (UniCo), explained common variance (ECV), and mean of item residual absolute loadings (MIREAL) indicators. Reliability pertains to a test’s capability to consistently reproduce results over time, across space, or during test procedure replications(3737 Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Measur [Internet]. 2018[cited 2022 Oct 06];78(5):762-80. Available from: https://journals.sagepub.com/doi/abs/10.1177/0013164417719308
https://journals.sagepub.com/doi/abs/10....
-3838 Lorenzo-Seva U, Ferrando PJ. Terragona: manual of the program FACTOR v. 9.20 [Internet]. Universitat Rovira i Virgili; 2013 [cited 2022 Oct 06]. Available from: https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual-of-the-Factor-Program-v92.pdf
https://psico.fcep.urv.cat/utilitats/fac...
). The internal consistency and stability of the achieved factors were evaluated via the composite reliability index - FC, the Overall Reliability of fully-Informative prior Oblique N-EAP scores (ORION), the Factor Determinacy Index (FDI), and the H-Latent and H-Observed (generalized h index - H Index) estimates(3838 Lorenzo-Seva U, Ferrando PJ. Terragona: manual of the program FACTOR v. 9.20 [Internet]. Universitat Rovira i Virgili; 2013 [cited 2022 Oct 06]. Available from: https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual-of-the-Factor-Program-v92.pdf
https://psico.fcep.urv.cat/utilitats/fac...
). Additionally, an assessment of the questionnaire items’ internal consistency was conducted using McDonald’s omega coefficient.
Software Utilized
Data collection and storage were conducted through the REDCap application. The data were then exported to Excel and subsequently to STATA version 14 for consistency verification, recoding, and descriptive data analysis. Factor Program version 11.05.01 was utilized for conducting the EFA, and the Composite Reliability Calculator from The Statistical Mind website was used for calculating the composite reliability index. For the calculation of the omega coefficient, JASP software, version 0.16.4, was used.
RESULTS
In regards to the characteristics of the managers who made up the study population (as shown in the table in Appendix 2), we observed that women constituted 50.5% of the participants. Additionally, 63.4% were 50 years of age or older, 81.2% self-identified as white, 52.5% identified as Christian (either Catholic or Evangelical), 83.2% were married or in a stable relationship, and 77.2% had children. With respect to their professional history, 50.5% had been employed at the university for up to 18 years, 45.5% held management positions (as directors, vice-directors, or chairs of statutory committees), 37.6% had been in a management position for more than two years, 86.1% had prior management experience, and 84.2% were part of the teaching staff (as associate professors, full professors, or endowed chairs).
The EFA was initially conducted with the four factors anticipated in the questionnaire structure (knowledge about violence and VBG, experience with violence and VBG, opinion about violence and VBG, and knowledge about procedures) and their respective 38 questions. However, the parallel analysis did not confirm this projected structure, indicating that the instrument consists solely of two factors: knowledge and experience.
We subsequently executed another EFA model with the two identified factors. Bartlett’s test of sphericity (995.9, df=703, p<0.001) demonstrated that the correlation matrix was favorable, and the Kaiser-Meyer-Olkin (KMO - 0.622) index suggested a mediocre interpretability of the item correlation matrix. The parallel analysis ratified the two factors as the most representative for the data, which were renamed Current Knowledge/Experience (Factor 1) and Previous Knowledge/Experience (Factor 2) in relation to violence at the university. Factor 1 accounted for 15.69% of the variance, while Factor 2 accounted for 9.10% of the variance. The data are illustrated in Figure 1.
Parallel Analysis of the QUEST VBG UNIV answered by university managers, Universidade de São Paulo, from September to November 2020, Ribeirão Preto, São Paulo, Brazil
The factor loadings of the items on the two factors and the stability indices are presented in Table 1. Of the original 38 items from the 4 sections of the questionnaire, 19 were retained in the 2 obtained factors, with 11 items in Factor 1 and 8 items in Factor 2. The retained items demonstrated adequate factor loadings. No pattern of cross-loadings was found, with factor loadings above 0.300 or below -0.300 in more than one factor.
Factor structure of the University Violence Questionnaire answered by university managers, Universidade de São Paulo, from September to November 2020, Ribeirão Preto, São Paulo, Brazil
The evaluation of the model’s adequacy demonstrated that the factorial structure exhibited suitable adjustment indices or ones very close to the ideal: RMSEA=0.051, CFI=0.947, TLI=0.941, and χ22 Panúncio-Pinto MP, Maito DC, Vieira EM. Gênero, saúde e violência: implicações para a formação profissional na universidade. In: Souza CD, Rocha CMF, Carneiro M, (Orgs.). Educação e saúde: experiências de formação e trabalho. Santa Cruz do Sul: EDUNISC; 2022.=668.94 with df=628 and p=0.125. The unidimensionality of the scale was refuted by the UniCo (0.713), ECV (0.634), and MIREAL (0.232) indicator values, while the evaluation of the instrument’s reliability indicated that, for both factors, the composite fidelity indices were favorable (>0.800), as were the ORION (>0.900), FDI (>0.900), and the latent and observed H index estimates (>0.900).
Additionally, the instrument’s internal consistency was evaluated using McDonald’s omega coefficient. In Table 2, it can be observed that when all 38 items of the instrument are considered, the result of the coefficient is unsatisfactory (ω=0.580). When the evaluation is repeated, considering the items retained in each factor in the EFA, it can be seen that the results are more favorable, with ω=0.770 in factor 1 and ω=0.666 in factor 2. However, the analysis revealed that some items are negatively correlated with the scale, suggesting that they should be reversed. These items are the same ones that exhibited a negative factorial load in the EFA: in factor 1, these are items “4. Frequency of violence in the university environment” and “5. Frequency of sexism and sexual discrimination in the university environment.” When the scoring of these items is reversed, the results become more favorable, with ω=0.858 in factor 1 and ω=0.805 in factor 2.
McDonald’s Omega values per question of the University Violence Questionnaire answered by university managers, Universidade de São Paulo, from September to November 2020, Ribeirão Preto, São Paulo, Brazil
DISCUSSION
This study aimed to conduct a psychometric validation of the ‘Questionnaire for the Evaluation of Institutional Agents’ Knowledge about Violence in the University’ (QUEST VBG UNIV). This instrument, constructed based on a literature review and a qualitative phase of the research, originally had a structure comprising four dimensions. However, these were not confirmed by the Exploratory Factor Analysis (EFA), with parallel analysis indicating two factors. Despite the ambiguous results regarding the adequacy of EFA for the sample data (with favorable results in Bartlett’s test and mediocre outcomes in Kaiser-Meyer-Olkin (KMO) measure), all other evaluations demonstrated a high degree of stability and reproducibility of the two factors obtained. These assessments included tests of composite reliability, ORION, Factorial Discriminant Index (FDI), and Latent and Observed H, internal consistency (using the omega coefficient), and a satisfactory or near-ideal model fit (as shown by RMSEA, Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and chi-square tests). Furthermore, the tests confirmed the non-unidimensional character of the questionnaire (UniCo, ECV, and MIREAL tests).
From the 38 items in the original composition of QUEST VBG UNIV, 19 were retained in the final questionnaire’s two factors (see Supplementary Material 2). Several potential elements may have led to the non-retention of items. One aspect is the similarity in the wording of some questions, although this was mitigated by the interview format of the questionnaire application, facilitated with interviewer guidance.
Another aspect is the structuring of the questions, some of which had ordinal responses while others were qualitative in nature. This could have interfered with normality and variances among the items, as qualitative variables did not necessarily follow an ordinal configuration. To minimize this, we used a robust factorial analysis and the Robust Diagonally Weighted Least Squares (RDWLS) extraction method, which considers the ordinal nature of the variables and adjusts the data to a normal distribution(4040 Asparouhov T, Muthén B. Simple Second Order Chi-Square Correction: Mplus Technical Appendix [Internet]. Los Angeles: Mplus; 2010[cited 2022 Oct 06] Available from: https://www.statmodel.com/download/WLSMV_new_chi21.pdf
https://www.statmodel.com/download/WLSMV...
-4141 Zygmont C, Smith MR. Robust factor analysis in the presence of normality violations, missing data, and outliers: empirical questions and possible solutions. Quantit Method Psychol [Internet]. 2014;10(1):40-55[cited 2022 Oct 06]. Available from: https://www.tqmp.org/RegularArticles/vol10-1/p040/
https://www.tqmp.org/RegularArticles/vol...
).
Sample size is another consideration. There is no consensus on the ideal sample size for conducting factor analysis, with guidelines ranging from 100 to 250 subjects and/or a minimum of 5 to 20 observations per variable analyzed(3939 Damásio BF. Uso da análise fatorial exploratória em psicologia. Aval Psicol [Internet]. 2012;11(2):213-28 [cited 2022 Oct 06]. Available from: http://pepsic.bvsalud.org/pdf/avp/v11n2/v11n2a07.pdf
http://pepsic.bvsalud.org/pdf/avp/v11n2/...
,4242 Pereira AS, Paludo B, Vieira M, Caerbaro RH. Apostila Análise Fatorial: Texto para discussão Nº 02/2019 [Internet]. Passo Fundo: Universidade de Passo Fundo; 2019[cited 2022 Oct 06] Available from: https://www.upf.br/_uploads/Conteudo/cepeac/textos-discussao/texto-02-2019.pdf
https://www.upf.br/_uploads/Conteudo/cep...
). In this investigation, we performed 101 evaluations for 38 questions, resulting in a low ratio that may introduce some degree of imprecision into the results, a limitation of our study. Establishing an appropriate sample size is complex, as it depends on the number of measured variables, the strength of relationships between variables and factors, factor determination, and the quality of the instrument. However, it is generally agreed that factor analysis requires large samples because correlation coefficients fluctuate more in smaller samples, compromising the reliability of the factor analysis(3838 Lorenzo-Seva U, Ferrando PJ. Terragona: manual of the program FACTOR v. 9.20 [Internet]. Universitat Rovira i Virgili; 2013 [cited 2022 Oct 06]. Available from: https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual-of-the-Factor-Program-v92.pdf
https://psico.fcep.urv.cat/utilitats/fac...
,4141 Zygmont C, Smith MR. Robust factor analysis in the presence of normality violations, missing data, and outliers: empirical questions and possible solutions. Quantit Method Psychol [Internet]. 2014;10(1):40-55[cited 2022 Oct 06]. Available from: https://www.tqmp.org/RegularArticles/vol10-1/p040/
https://www.tqmp.org/RegularArticles/vol...
-4242 Pereira AS, Paludo B, Vieira M, Caerbaro RH. Apostila Análise Fatorial: Texto para discussão Nº 02/2019 [Internet]. Passo Fundo: Universidade de Passo Fundo; 2019[cited 2022 Oct 06] Available from: https://www.upf.br/_uploads/Conteudo/cepeac/textos-discussao/texto-02-2019.pdf
https://www.upf.br/_uploads/Conteudo/cep...
). Caution should be used when incorporating samples from different populations, as the specific factors of one population may be obscured when grouped(4343 Watkins MW. Exploratory factor analysis: a guide to best practice. J Black Psychol. 2018;44(3):219-46. https://doi.org/10.1177/0095798418771807
https://doi.org/10.1177/0095798418771807...
). In this research, we limited the sample to a specific university campus, reducing this risk.
When considering the parameters from the literature(3939 Damásio BF. Uso da análise fatorial exploratória em psicologia. Aval Psicol [Internet]. 2012;11(2):213-28 [cited 2022 Oct 06]. Available from: http://pepsic.bvsalud.org/pdf/avp/v11n2/v11n2a07.pdf
http://pepsic.bvsalud.org/pdf/avp/v11n2/...
,4343 Watkins MW. Exploratory factor analysis: a guide to best practice. J Black Psychol. 2018;44(3):219-46. https://doi.org/10.1177/0095798418771807
https://doi.org/10.1177/0095798418771807...
-4444 Lorenzo-Seva U, Timmerman ME, Kiers HA. The Hull Method for Selecting the Number of Common Factors. Multivariate Behav Res. 2011;46(2):340-64. https://doi.org/10.1080/00273171.2011.564527
https://doi.org/10.1080/00273171.2011.56...
), the KMO test showed a mediocre shared variance among the variables. However, Bartlett’s test confirmed that the correlation matrix was not random. Therefore, the two factors composed of the 19 items obtained in this study could be considered plausible within a knowledge structure about GBV, which may depend on current and past experiences.
Another aspect that supports the appropriateness of the factorial structure obtained pertains to the stability tests. Composite reliability is a robust indicator used to determine item consistency, checking if all items consistently measure the same construct, based on factorial loads and measurement error variances(4545 Valentini F, Damásio BF. Variância média extraída e confiabilidade composta: indicadores de precisão. Psic Teor e Pesq. 2016;32(2):1-7. https://doi.org/10.1590/0102-3772e322225
https://doi.org/10.1590/0102-3772e322225...
). The two factors obtained for QUEST VBG UNIV showed favorable results for internal consistency and absence of measurement error, supporting the association between knowledge and experience of GBV.
Furthermore, university managers do not associate GBV present in the university context with the recommendations outlined in the Maria da Penha Law(2323 Maito DC, Panuncio-Pinto MP, Vieira EM. Percepções de Gestores sobre Violência Baseada em Gênero na Universidade. Res, Soc Develop [Internet]. 2022[cited 2022 Oct 06];11:E1611527815. Available from: https://rsdjournal.org/index.php/rsd/article/view/27815
https://rsdjournal.org/index.php/rsd/art...
). With literature parameters(4646 Ferrando PJ, Lorenzo-Seva U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicol [Internet]. 2016[cited 2022 Oct 06];37(2):235-47. https://www.uv.es/revispsi/articulos2.16/7Ferrando.pdf
https://www.uv.es/revispsi/articulos2.16...
-4747 Gibson Jr TO, Morrow JA, Roccon LM. A Modernized heuristic approach to robust exploratory factor analysis. Quant Method Psychol [Internet]. 2020[cited 2022 Oct 06];16(4):295-307. Available from: https://www.tqmp.org/RegularArticles/vol16-4/p295/
https://www.tqmp.org/RegularArticles/vol...
), internal consistency was also attested by the ORION and FDI indices, which showed favorable results in the precision of measuring factorial scores and the representation of the latent trait. The evaluation of internal consistency through McDonald’s omega coefficient yielded satisfactory results, particularly when the scores of items 4, 5, 17, and 38 were reversed due to their negative correlation with the scale. These items were also those with a negative factorial load in the EFA. Additionally, the bidimensional structure of the model showed a satisfactory fit for the studied sample, evidenced by the RMSEA, CFI, TLI, and chi-square indicators(4848 Finch WH. Using fit statistic differences to determine the optimal number of factors to retain in an exploratory factor analysis. Educ Psychol Measur. 2020;80(2):217-41. https://doi.org/10.1177/0013164419865769
https://doi.org/10.1177/0013164419865769...
-4949 UCLA Statistical Consulting Group. A practical introduction to factor analysis: confirmatory factor analysis [Internet]. Los Angeles: UCLA Statistical Consulting Group; 2021 [cited 2022 Oct 06] Available from: https://stats.oarc.ucla.edu/spss/seminars/introduction-to-factor-analysis/a-practical-introduction-to-factor-analysis-confirmatory-factor-analysis/
https://stats.oarc.ucla.edu/spss/seminar...
), with unidimensionality refuted by the UniCo, ECV, and MIREAL indicators(4949 UCLA Statistical Consulting Group. A practical introduction to factor analysis: confirmatory factor analysis [Internet]. Los Angeles: UCLA Statistical Consulting Group; 2021 [cited 2022 Oct 06] Available from: https://stats.oarc.ucla.edu/spss/seminars/introduction-to-factor-analysis/a-practical-introduction-to-factor-analysis-confirmatory-factor-analysis/
https://stats.oarc.ucla.edu/spss/seminar...
).
Study Limitations
The preliminary results of this study show evidence of appropriate measurement properties, supporting its use. However, the results also pointed to weaknesses in the instrument, especially concerning the response scoring scales. Furthermore, it is necessary to take into account that the sample was restricted to a single university campus, which prevents the establishment of the factor structure’s maintenance in other populations.
Given the scarcity of tools for measuring violence in the university environment, as well as the limitations of the instrument and the study design, it is suggested that new studies be conducted with other population groups and an expanded sample. It is also proposed that an evaluation be carried out with a committee of experts for the improvement of the instrument’s content, considering the theoretical framework used, the results obtained, and the characteristics of the instrument, especially in relation to item scoring.
Contributions to the Field of Nursing and Public Health
The validation of this instrument can contribute to the diagnosis of reality regarding the operators of university policies: the confrontation of GBV in the university is intrinsically linked to the efficacy of university policies to combat violence, and the definition and execution of these policies are subordinate to the knowledge and experience of managers.
CONCLUSIONS
The sum of the evaluations indicates that the QUEST VBG UNIV, in the configuration of the two retained factors, can be considered an adequate and reliable instrument to measure latent traits of knowledge about gender-based violence in the university. This instrument has applicability both in academic research on the subject and as a tool for situational diagnosis in university violence management programs.
-
EDITOR IN CHIEF: Antonio José de Almeida Filho
-
ASSOCIATE EDITOR: Hugo Fernandes
AVAILABILITY OF DATA AND MATERIAL
-
FUNDINGThe present study was carried out with the support of Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Funding Code 001 and FAPESP, financial support granted through process n. 2018/25529-8 Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP).
REFERENCES
-
1World Health Organization (WHO). Department of Reproductive Health and Research, London School of Hygiene and Tropical Medicine, South African Medical Research Council. Global and regional estimates of violence against women: prevalence and health effects of intimate partner violence and non-partner sexual violence. World Health Organization; 2013.
-
2Panúncio-Pinto MP, Maito DC, Vieira EM. Gênero, saúde e violência: implicações para a formação profissional na universidade. In: Souza CD, Rocha CMF, Carneiro M, (Orgs.). Educação e saúde: experiências de formação e trabalho. Santa Cruz do Sul: EDUNISC; 2022.
-
3Rauhaus BM, Carr IAS. The leaky pipeline: gender and public administration professional education. In: Shields PM, Elias NM, (Eds.). Handbook on Gender and Public Administration. Massachusetts (USA): Elgaronline; 2022.
-
4Reverter-Bañón S. La igualdad de género en la universidad: capitalismo académico y rankings globales. Rev Investig Fem. 2021;12(2):271-81. https://doi.org/10.5209/infe.72331
» https://doi.org/10.5209/infe.72331 -
5Fedina L, Holmes J, Backes BL. Campus Sexual Assault: a systematic review of prevalence research. Trauma, Violence Abuse. 2018;19:76-93. https://doi.org/10.1177/15248380166311
» https://doi.org/10.1177/15248380166311 -
6Cantor D, Fisher B, Chibnall S, Townsend R, Lee H, Bruce WC, et al. Report on the AAU Campus Climate Survey on Sexual Assault and Sexual Misconduct [Internet]. The Association of American Universities; 2017[cited 2022 Oct 06]. Available from: https://www.aau.edu/sites/default/files/AAU-Files/Key-Issues/Campus-Safety/AAU-Campus-Climate-Survey-FINAL-10-20-17.pdf
» https://www.aau.edu/sites/default/files/AAU-Files/Key-Issues/Campus-Safety/AAU-Campus-Climate-Survey-FINAL-10-20-17.pdf -
7Freitas RCS, Musmanno RG, Carvalho MS. Violência de gênero: o caso da Universidade Federal Fluminense. Argumentum. 2020;12(3):102-16. https://doi.org/10.47456/argumentum.v12i3.28387
» https://doi.org/10.47456/argumentum.v12i3.28387 -
8Bellini DMG. Violência contra mulheres nas universidades: contribuições da produção científica para sua superação [Dissertação]. Universidade Federal de São Carlos; 2018.
-
9Maito DC. Parâmetros teóricos e normativos para o enfrentamento à violência contra as mulheres na Universidade de São Paulo [Dissertação]. Faculdade de Direito de Ribeirão Preto, Universidade de São Paulo; 2017.
-
10Assembleia Legislativa do Estado de São Paulo. Relatório da Comissão Parlamentar de Inquérito, para investigar violações dos Direitos Humanos e demais ilegalidades ocorridas no âmbito das Universidades do Estado de São Paulo ocorridas nos chamados “trotes”, festas e no seu cotidiano [Internet]. Imprensa Oficial Governo do Estado de São Paulo; 2015[cited 2022 Oct 06]. Available from: https://www.al.sp.gov.br/spl_consultas/spl_icons/icoPDF.gif
» https://www.al.sp.gov.br/spl_consultas/spl_icons/icoPDF.gif -
11Universidade Estadual Paulista (Unesp). Educando para a diversidade: guia de prevenção assédio [Internet]. Ouvidoria Geral; 2020[cited 2022 Oct 06]. Available from: https://www.foar.unesp.br/Modulos/Noticias/234/guia_prevencao_assedio.pdf
» https://www.foar.unesp.br/Modulos/Noticias/234/guia_prevencao_assedio.pdf -
12Universidade Estadual de Campinas (Unicamp). Resolução GR-017/2019, de 03/04/2019. Dispõe sobre a criação da Comissão Assessora da Política de Combate à Discriminação Baseada em Gênero e/ou Sexualidade e à Violência Sexual e o Serviço de Atenção à Violência Sexual na Universidade Estadual de Campinas [Internet]. Imprensa Oficial Governo do Estado de São Paulo; 2019[cited 2022 Oct 06]. Available from: https://www.pg.unicamp.br/norma/14481/0
» https://www.pg.unicamp.br/norma/14481/0 -
13Panúncio-Pinto MP, Colares MFA. O estudante universitário: os desafios de uma educação integral. Medicina (Ribeirão Preto). 2015;48(3):273-81. https://doi.org/10.11606/issn.2176-7262.v48i3p273-281
» https://doi.org/10.11606/issn.2176-7262.v48i3p273-281 -
14Santos BS. Da Ideia de Universidade à Universidade de Ideias. Rev Crít Ciênc Soc [Internet]. 1989[cited 2022 Oct 06];27(28):11-52. Available from: http://www.boaventuradesousasantos.pt/media/pdfs/Da_ideia_de_universidade_RCCS27-28.PDF
» http://www.boaventuradesousasantos.pt/media/pdfs/Da_ideia_de_universidade_RCCS27-28.PDF -
15Maito DC, Panúncio-Pinto MP, Severi FC, Vieira EM. A universidade como reflexo e agente transformador da sociedade: a contradição movendo a história. Interface (Botucatu). 2019;23:e190711. https://doi.org/10.1590/Interface.19071b
» https://doi.org/10.1590/Interface.19071b -
16Oliveira-Ciabati L, Santos LL, Hsiou AS, Sasso AM, Castro M, Souza JP. Sexismo científico: o viés de gênero na produção científica da Universidade de São Paulo. Rev Saúde Pública [Internet]. 2021[cited 2022 Oct 06];55(46). Available from: https://doi.org/10.11606/s1518-8787.2021055002939
» https://doi.org/10.11606/s1518-8787.2021055002939 -
17Blay EA, Venturi G, Santos PK, Pasinato W, Alves LP, Capocchi E. Pesquisa interações na USP: primeiros resultados da pesquisa [Internet]. 2018[cited 2022 Oct 06]. Available from: http://uspmulheres.usp.br/pesquisa-interacoes-na-usp/
» http://uspmulheres.usp.br/pesquisa-interacoes-na-usp/ -
18Crenshaw K. Demarginalizing the intersection of race and sex; a black feminist critique discrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum; 1989. P.139-67.
-
19Cruz F, Almeida HB, Oliveira AFPL, Lima EFA, Lago C, Machado AM. Don’t Stay Silent: network of female professors against gender violence at University of São Paulo (USP): Special Issue ‘Sex and Power in the University’. Ann Rev Crit Psychol[Internet]. 2018[cited 2022 Oct 06];(15):223-45. Available from: https://www.eca.usp.br/acervo/producao-academica/002997738.pdf
» https://www.eca.usp.br/acervo/producao-academica/002997738.pdf -
20Organização das Nações Unidas (ONU). ONU Mulheres. Movimento ElesPorElas (HeForShe) de Solidariedade da ONU Mulheres pela Igualdade de Gênero: impactando Universidades [Internet]. Genebra: Organização das Nações Unidas; 2015[cited 2022 Oct 06]. Available from: https://www.onumulheres.org.br/elesporelas/
» https://www.onumulheres.org.br/elesporelas/ -
21Universidade de São Paulo, Campus Ribeirão Preto. Portaria do Conselho Gestor do Campus de Ribeirão Preto nº 6, de 11 de julho de 2016. Dispõe sobre a criação de Comissão para apurar denúncias de discriminação, assédio e violência contra mulheres e gêneros no Campus USP de Ribeirão Preto. 2016. Ribeirão Preto, SP, 2016.
-
22Conselho Nacional de Saúde (CNS). Resolução nº 510, de 07 de abril de 2016 [Internet]. Diário Oficial República Federativa do Brasil: seção 1, Brasília, DF, nº 98 [Internet]. 2018 [cited 2022 Oct 06]. Available from: http://conselho.saude.gov.br/resolucoes/2016/Reso510.pdf
» http://conselho.saude.gov.br/resolucoes/2016/Reso510.pdf -
23Maito DC, Panuncio-Pinto MP, Vieira EM. Percepções de Gestores sobre Violência Baseada em Gênero na Universidade. Res, Soc Develop [Internet]. 2022[cited 2022 Oct 06];11:E1611527815. Available from: https://rsdjournal.org/index.php/rsd/article/view/27815
» https://rsdjournal.org/index.php/rsd/article/view/27815 -
24Rodríguez-Osuna LM, Dios I, Amor MI. Perception of gender-based violence and sexual harassment in university students: analysis of the information sources and risk within a relationship. Int J Environ Res Public Health. 2020;17:3754. https://doi.org/10.3390/ijerph17113754
» https://doi.org/10.3390/ijerph17113754 -
25Carlson M, Kamimura A, Trinh HN, Mo W, Yamawaki N, Bhattacharya H, et al. Perceptions of violence against women among college students in the United States, Japan, India, Vietnam and China. Public Pol Adm Res [Internet]. 2015[cited 2022 Oct 06];5(11):82. Available from: https://www.iiste.org/Journals/index.php/PPAR/article/view/27219
» https://www.iiste.org/Journals/index.php/PPAR/article/view/27219 -
26Pengpid S, Peltzer K. Associations of physical partner violence and sexual violence victimization on health risk behaviours and mental health among university students from 25 countries. BMC Public Health. 2020;20(937). https://doi.org/10.1186/s12889-020-09064-y
» https://doi.org/10.1186/s12889-020-09064-y -
27Wang L. Education, perception factors, and prevention of intimate partner violence: empirical research on Chinese University students’ perceptions and attitudes concerning intimate partner violence. J Interpers Violence. 2019;34(8):1611-32. https://doi.org/10.1177/0886260516652263
» https://doi.org/10.1177/0886260516652263 -
28Presidência da República (BR). Lei nº 11.340, de 07 de agosto de 2006: Lei Maria da Penha [Internet]. Brasília: Congresso Nacional; 2006[cited 2022 Oct 06]. Available from: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2006/lei/l11340.htm
» http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2006/lei/l11340.htm -
29Butler J. Problemas de gênero. Rio de Janeiro: Civilização Brasileira; 2003.
-
30Bueno S, Lima RS. Visível e invisível: vitimização de mulheres no Brasil [Internet]. 3ª ed. Fórum Brasileiro de Segurança Pública. 2021[cited 2022 Oct 06]. Available from: https://forumseguranca.org.br/wp-content/uploads/2021/06/relatorio-visivel-e-invisivel-3ed-2021-v3.pdf
» https://forumseguranca.org.br/wp-content/uploads/2021/06/relatorio-visivel-e-invisivel-3ed-2021-v3.pdf -
31Universidade de São Paulo (USP). Portaria GR nº 3154, de 27 de abril de 1999. Dispõe sobre a proibição do trote na USP [Internet]. In: Normas USP. São Paulo: USP; 1999[cited 2022 Oct 06]. Available from: https://prg.usp.br/institucional/reitoria/gr-315499-dispoe-sobre-a-proibicao-do-trote-na-usp/
» https://prg.usp.br/institucional/reitoria/gr-315499-dispoe-sobre-a-proibicao-do-trote-na-usp/ -
32Universidade de São Paulo (USP). Portaria GR nº 6766, de 10 de agosto de 2016. Dispõe sobre o Escritório USP Mulheres [Internet]. In: Normas USP. São Paulo: USP; 2016[cited 2022 Oct 06]. Available from: http://www.leginf.usp.br/?portaria=portaria-gr-6766-de-10-de-agosto-de-2016
» http://www.leginf.usp.br/?portaria=portaria-gr-6766-de-10-de-agosto-de-2016 -
33Universidade de São Paulo (USP). Resolução nº 3745, de 19 de outubro de 1990. Baixa o Regimento Geral da Universidade de São Paulo [Internet]. In: Normas USP. São Paulo: 1990[cited 2022 Oct 06]. Available from: http://www.leginf.usp.br/?resolucao=consolidada-resolucao-no-3745-de-19-de-outubro-de-1990#t1
» http://www.leginf.usp.br/?resolucao=consolidada-resolucao-no-3745-de-19-de-outubro-de-1990#t1 -
34Bowling A. Research methods in health: investigating health and health services. Buchingham: Open University Press; 1997.
-
35American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME). Standards for educational and psychological testing [Internet]. Washington, DC: American Educational Research Association; 2014[cited 2022 Oct 06]. https://www.testingstandards.net/open-access-files.html
» https://www.testingstandards.net/open-access-files.html -
36Mokkink LB, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, Vet HCW, et al. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs); user manual Version 1.0 [Internet]. Netherlands: COSMIN; 2018[cited 2022 Oct 06]. Available from: https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf
» https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf -
37Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Measur [Internet]. 2018[cited 2022 Oct 06];78(5):762-80. Available from: https://journals.sagepub.com/doi/abs/10.1177/0013164417719308
» https://journals.sagepub.com/doi/abs/10.1177/0013164417719308 -
38Lorenzo-Seva U, Ferrando PJ. Terragona: manual of the program FACTOR v. 9.20 [Internet]. Universitat Rovira i Virgili; 2013 [cited 2022 Oct 06]. Available from: https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual-of-the-Factor-Program-v92.pdf
» https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual-of-the-Factor-Program-v92.pdf -
39Damásio BF. Uso da análise fatorial exploratória em psicologia. Aval Psicol [Internet]. 2012;11(2):213-28 [cited 2022 Oct 06]. Available from: http://pepsic.bvsalud.org/pdf/avp/v11n2/v11n2a07.pdf
» http://pepsic.bvsalud.org/pdf/avp/v11n2/v11n2a07.pdf -
40Asparouhov T, Muthén B. Simple Second Order Chi-Square Correction: Mplus Technical Appendix [Internet]. Los Angeles: Mplus; 2010[cited 2022 Oct 06] Available from: https://www.statmodel.com/download/WLSMV_new_chi21.pdf
» https://www.statmodel.com/download/WLSMV_new_chi21.pdf -
41Zygmont C, Smith MR. Robust factor analysis in the presence of normality violations, missing data, and outliers: empirical questions and possible solutions. Quantit Method Psychol [Internet]. 2014;10(1):40-55[cited 2022 Oct 06]. Available from: https://www.tqmp.org/RegularArticles/vol10-1/p040/
» https://www.tqmp.org/RegularArticles/vol10-1/p040/ -
42Pereira AS, Paludo B, Vieira M, Caerbaro RH. Apostila Análise Fatorial: Texto para discussão Nº 02/2019 [Internet]. Passo Fundo: Universidade de Passo Fundo; 2019[cited 2022 Oct 06] Available from: https://www.upf.br/_uploads/Conteudo/cepeac/textos-discussao/texto-02-2019.pdf
» https://www.upf.br/_uploads/Conteudo/cepeac/textos-discussao/texto-02-2019.pdf -
43Watkins MW. Exploratory factor analysis: a guide to best practice. J Black Psychol. 2018;44(3):219-46. https://doi.org/10.1177/0095798418771807
» https://doi.org/10.1177/0095798418771807 -
44Lorenzo-Seva U, Timmerman ME, Kiers HA. The Hull Method for Selecting the Number of Common Factors. Multivariate Behav Res. 2011;46(2):340-64. https://doi.org/10.1080/00273171.2011.564527
» https://doi.org/10.1080/00273171.2011.564527 -
45Valentini F, Damásio BF. Variância média extraída e confiabilidade composta: indicadores de precisão. Psic Teor e Pesq. 2016;32(2):1-7. https://doi.org/10.1590/0102-3772e322225
» https://doi.org/10.1590/0102-3772e322225 -
46Ferrando PJ, Lorenzo-Seva U. A note on improving EAP trait estimation in oblique factor-analytic and item response theory models. Psicol [Internet]. 2016[cited 2022 Oct 06];37(2):235-47. https://www.uv.es/revispsi/articulos2.16/7Ferrando.pdf
» https://www.uv.es/revispsi/articulos2.16/7Ferrando.pdf -
47Gibson Jr TO, Morrow JA, Roccon LM. A Modernized heuristic approach to robust exploratory factor analysis. Quant Method Psychol [Internet]. 2020[cited 2022 Oct 06];16(4):295-307. Available from: https://www.tqmp.org/RegularArticles/vol16-4/p295/
» https://www.tqmp.org/RegularArticles/vol16-4/p295/ -
48Finch WH. Using fit statistic differences to determine the optimal number of factors to retain in an exploratory factor analysis. Educ Psychol Measur. 2020;80(2):217-41. https://doi.org/10.1177/0013164419865769
» https://doi.org/10.1177/0013164419865769 -
49UCLA Statistical Consulting Group. A practical introduction to factor analysis: confirmatory factor analysis [Internet]. Los Angeles: UCLA Statistical Consulting Group; 2021 [cited 2022 Oct 06] Available from: https://stats.oarc.ucla.edu/spss/seminars/introduction-to-factor-analysis/a-practical-introduction-to-factor-analysis-confirmatory-factor-analysis/
» https://stats.oarc.ucla.edu/spss/seminars/introduction-to-factor-analysis/a-practical-introduction-to-factor-analysis-confirmatory-factor-analysis/
Publication Dates
-
Publication in this collection
04 Dec 2023 -
Date of issue
2023
History
-
Received
16 Jan 2023 -
Accepted
10 July 2023