Acessibilidade / Reportar erro

Analysis of factors related to the H Index of CNPq scientific productivity researchers in the field of Physical Education in Brazil

Abstract

Aim:

To verify the association between sociodemographic, academic background, professional performance, bibliographic production and training of human resources factors with the H Index of CNPq scientific productivity researchers in the field of Physical Education.

Methods:

This cross-sectional study included 94 researchers with scientific productivity grants (PQ) in the field of Physical Education in Brazil distributed into academic prestige level: PQ 1A-1D (n = 41) and PQ 2 (n = 53). For this, the H Index of these researchers was analyzed in the Scopus database. Related factors were sociodemographic, academic background, professional performance, bibliographic production, and training of human resources (student supervisor). Simple and multiple linear regression was used with a 5% significance level.

Results:

The H Index, number of citations, number of scientific articles in the last 10 years, number of books in the last 10 years, and the training of students at graduate levels of PQ 1A-1D was higher than that of PQ 2 (p <0.05). The H Index of PQ 1A-1D scholarship researchers was directly related to the number of scientific articles [H index = 8.48 + 0.11 * (Articles)]. The H index of PQ 2 scholarship researchers was directly related to the number of scientific articles and academic books and, inversely to the student supervision at master level [H index = 15.19 + 0.06 * (Articles) + 2.45 * (Books) - 0.34 * (Masters)].

Conclusion:

H Index of researchers in the field of Physical Education in Brazil varied according to the academic recognition level.

Keywords:
physical education; productivity; researcher

Introduction

The academic recognition of a researcher can be manifested in several ways, among which research funding stands out11. Wood BP, May W. Academic recognition of educational scholarship. Acad Radiol. 2006;13(2):254-7. https://doi.org/10.1016/j.acra.2005.10.001
https://doi.org/10.1016/j.acra.2005.10.0...
. In Brazil, the Fields of Knowledge are defined and evaluated by agencies that manage Graduate studies and research (i.e., Coordination for the Improvement of Higher Education Personnel - CAPES; and the National Council for Scientific and Technological Development - CNPq). Brazilian researchers are evaluated by these agencies and evaluation criteria are defined by peers as state policies that define the allocation of public investments in the Fields of Knowledge and in priority research22. Brasil. Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES. Cursos Recomendados Web Page . Disponível em: https://sucupira.capes.gov.br/sucupira/public/consultas/coleta/programa/quantitativos/quantitativoIes.jsf?areaAvaliacao=21&areaConhecimento=40900002 Acessado em 26 de Dezembro de 2019 .
https://sucupira.capes.gov.br/sucupira/p...
,33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
.

One of the criteria most frequent in research funding public notices in Brazil for the distribution of public resources is the researcher being a CNPq Scientific Productivity Researcher (PQ). PQ scholarship has the particularity of being aimed at researchers who enjoy high recognition among peers (based on criteria defined by peers themselves)44. Guedes MC, Azevedo N, Ferreira LO. A produtividade científica tem sexo? Um estudo sobre bolsistas de produtividade do CNPq*. Cad Pagu. 2015; 45:367-99. https://doi.org/10.1590/18094449201500450367
https://doi.org/10.1590/1809444920150045...
and grants the researcher a monthly financial resource, according to the scholarship level33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. In order to apply for PQ scholarship, the researcher must compete in a public notice, annually launched, and be classified in the share of scholarships for a specific Field of Knowledge. Once classified, the researcher becomes a fellow in one of the following categories (order of academic prestige): 1A, 1B, 1C, 1D, and 2. The entry door as a PQ scholarship researcher is category 2. Categories 1A-1D are for researchers who have already gone through category 2 and who presented academic performance (defined by peers and exposed in the public notice) sufficiently relevant in comparison to peers in that Field of Knowledge44. Guedes MC, Azevedo N, Ferreira LO. A produtividade científica tem sexo? Um estudo sobre bolsistas de produtividade do CNPq*. Cad Pagu. 2015; 45:367-99. https://doi.org/10.1590/18094449201500450367
https://doi.org/10.1590/1809444920150045...
.

The field of Physical Education has scholarship quota in the PQ public notice, and in 2019, ninety-four researchers linked to educational institutions in Brazil were PQ scholarship researcher33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
, who benefited from academic prestige. The condition of being ad hoc reviewers of funding agencies in Brazil is among assignments of these researchers, so that they evaluate the research projects of the entire field of Physical Education submitted to these agencies; they have priorities in some research notices and define the evaluation criteria of other researchers44. Guedes MC, Azevedo N, Ferreira LO. A produtividade científica tem sexo? Um estudo sobre bolsistas de produtividade do CNPq*. Cad Pagu. 2015; 45:367-99. https://doi.org/10.1590/18094449201500450367
https://doi.org/10.1590/1809444920150045...
, that is, they define the allocation of public money to finance research in the field of Physical Education.

Scientific production stands out among evaluation criteria for researchers in Brazil and worldwide11. Wood BP, May W. Academic recognition of educational scholarship. Acad Radiol. 2006;13(2):254-7. https://doi.org/10.1016/j.acra.2005.10.001
https://doi.org/10.1016/j.acra.2005.10.0...
,55. Kunsch MMK. A produção científica em relações públicas e comunicação organizacional no Brasil: análise, tendências e perspectivas. Asociación Latinoamericana de Investigadores de La Comunicación, 2003. Disponível em: http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm Acessado em 01 de Abril de 2020 .
http://www.eca.usp.br/associa/alaic/bole...
. Scientific production, by itself, is a very broad dimension, being considered the way in which the university or research institution (and even researchers) is present in the production of science55. Kunsch MMK. A produção científica em relações públicas e comunicação organizacional no Brasil: análise, tendências e perspectivas. Asociación Latinoamericana de Investigadores de La Comunicación, 2003. Disponível em: http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm Acessado em 01 de Abril de 2020 .
http://www.eca.usp.br/associa/alaic/bole...
. In other words, it is the basis for the development and overcoming of dependency between countries and regions of the same country, being considered a vehicle for improving people’s quality of life and the way of being present in society55. Kunsch MMK. A produção científica em relações públicas e comunicação organizacional no Brasil: análise, tendências e perspectivas. Asociación Latinoamericana de Investigadores de La Comunicación, 2003. Disponível em: http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm Acessado em 01 de Abril de 2020 .
http://www.eca.usp.br/associa/alaic/bole...
. Kunsch55. Kunsch MMK. A produção científica em relações públicas e comunicação organizacional no Brasil: análise, tendências e perspectivas. Asociación Latinoamericana de Investigadores de La Comunicación, 2003. Disponível em: http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm Acessado em 01 de Abril de 2020 .
http://www.eca.usp.br/associa/alaic/bole...
reinforces that scientific production is linked to almost all things, events, places with which individuals are involved in their daily lives. Thus, scientific production must be the object of evaluation by researchers.

A debate that gains space within science is what to consider as scientific production55. Kunsch MMK. A produção científica em relações públicas e comunicação organizacional no Brasil: análise, tendências e perspectivas. Asociación Latinoamericana de Investigadores de La Comunicación, 2003. Disponível em: http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm Acessado em 01 de Abril de 2020 .
http://www.eca.usp.br/associa/alaic/bole...

6. Antunes AA. Como avaliar produção científica. Rev Col Bras Cir. 2015; 42(Supl. 1):17-19. https://doi.org/10.1590/0100-69912015S01006
https://doi.org/10.1590/0100-69912015S01...
-77. Jialal I, Schreiber WE, Giustini DM. H-index and Academic Medicine. Am J Clin Pathol. 2019;151(6):648-649. https://doi.org/10.1093/ajcp/aqz037.
https://doi.org/10.1093/ajcp/aqz037...
. According to the Fields of Knowledge in Brazil, different products can be considered scientific production33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. In Physical Education, one of these products that are also an evaluation criterion in the PQ scholarship public notice is the production of scientific articles in journals indexed in the Institute for Scientific Information (ISI) and in SciELO/SCOPUS databases33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. Thus, the production of scientific articles is a state policy for Brazilian Physical Education researchers. The debate about the quantity and quality of these products is associated with the production of scientific articles, which must be taken into consideration to reflect on the quality of the researcher, the quality of products developed in the Field of Knowledge.

Different metrics (scientometrics) have been developed to guide or assess the quality of scientific production66. Antunes AA. Como avaliar produção científica. Rev Col Bras Cir. 2015; 42(Supl. 1):17-19. https://doi.org/10.1590/0100-69912015S01006
https://doi.org/10.1590/0100-69912015S01...
. All of these metrics have advantages and disadvantages, so that a metric that has been equitable for the different Fields of Knowledge and the different theoretical and methodological perspectives of the same Field of Knowledge, as is the case of Physical Education, known as an inter and multidisciplinary area, has not yet been achieved88. Renson R. From Physical Education to Kinanthropology: A Quest for Academic and Professional Identity, Quest. 1989;41(3):235-56. https://doi.org/10.1080/00336297.1989.10483973
https://doi.org/10.1080/00336297.1989.10...
,99. Twietmeyer G. What is Kinesiology? Historical and Philosophical Insights. Quest. 2012;64(1):4-23. https://doi.org/10.1080/00336297.2012.653268
https://doi.org/10.1080/00336297.2012.65...
. Among these scientometric measures, the H Index stands out1010. Hirsch JE. An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569-72. https://doi.org/10.1073/pnas.0507655102
https://doi.org/10.1073/pnas.0507655102...
. This index was proposed in 2005, by scientist Jorge Hirsch, as a tool capable of combining quantity and quality of academic production1010. Hirsch JE. An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569-72. https://doi.org/10.1073/pnas.0507655102
https://doi.org/10.1073/pnas.0507655102...
and soon became a parameter in evaluations by researchers and universities around the world66. Antunes AA. Como avaliar produção científica. Rev Col Bras Cir. 2015; 42(Supl. 1):17-19. https://doi.org/10.1590/0100-69912015S01006
https://doi.org/10.1590/0100-69912015S01...
,77. Jialal I, Schreiber WE, Giustini DM. H-index and Academic Medicine. Am J Clin Pathol. 2019;151(6):648-649. https://doi.org/10.1093/ajcp/aqz037.
https://doi.org/10.1093/ajcp/aqz037...
,1111. Dinis-Oliveira RJ. The H-index in Life and Health Sciences: Advantages, Drawbacks and Challenging Opportunities. Curr Drug Res Rev. 2019; 11(2):82-84. https://doi.org/10.2174/258997751102191111141801.
https://doi.org/10.2174/2589977511021911...
. The H Index is defined as the largest (“h”) number of scientific articles by this researcher that have at least the same (“h”) number of citations each. A researcher with H Index of 10, for example, has published at least 10 scientific articles that have been cited in at least 10 other works. Weighting excludes poorly cited works and also disregards highly cited articles if they are isolated examples66. Antunes AA. Como avaliar produção científica. Rev Col Bras Cir. 2015; 42(Supl. 1):17-19. https://doi.org/10.1590/0100-69912015S01006
https://doi.org/10.1590/0100-69912015S01...
,77. Jialal I, Schreiber WE, Giustini DM. H-index and Academic Medicine. Am J Clin Pathol. 2019;151(6):648-649. https://doi.org/10.1093/ajcp/aqz037.
https://doi.org/10.1093/ajcp/aqz037...
,1111. Dinis-Oliveira RJ. The H-index in Life and Health Sciences: Advantages, Drawbacks and Challenging Opportunities. Curr Drug Res Rev. 2019; 11(2):82-84. https://doi.org/10.2174/258997751102191111141801.
https://doi.org/10.2174/2589977511021911...
.

In a recent discussion on this index, it was argued that having cited article (s) depends on different factors, such as Field of Knowledge, the size of this field, the vehicle for scientific dissemination used, how respected this researcher is the respective area, among others66. Antunes AA. Como avaliar produção científica. Rev Col Bras Cir. 2015; 42(Supl. 1):17-19. https://doi.org/10.1590/0100-69912015S01006
https://doi.org/10.1590/0100-69912015S01...
,77. Jialal I, Schreiber WE, Giustini DM. H-index and Academic Medicine. Am J Clin Pathol. 2019;151(6):648-649. https://doi.org/10.1093/ajcp/aqz037.
https://doi.org/10.1093/ajcp/aqz037...
,1111. Dinis-Oliveira RJ. The H-index in Life and Health Sciences: Advantages, Drawbacks and Challenging Opportunities. Curr Drug Res Rev. 2019; 11(2):82-84. https://doi.org/10.2174/258997751102191111141801.
https://doi.org/10.2174/2589977511021911...
. Additionally, Yang et al.1212. Yang HY, Rhee G, Xuan L, Silver JK, Jalal S, Khosa F. Analysis of H-index in Assessing Gender Differences in Academic Rank and Leadership in Physical Medicine and Rehabilitation in the United States and Canada. Am J Phys Med Rehabil. 2019; 98(6):479-483. https://doi.org/10.1097/PHM.0000000000001129.
https://doi.org/10.1097/PHM.000000000000...
compared the H Index of researchers from the United States and Canada in relation to sex and identified that different factors of academic life were related to the H Index in both sexes and that such factors should be taken into account for a more detailed analysis of the academic performance. For this reason, the H Index value is linked to different correlated factors that may explain, at least in part, why a given researcher has cited works.

The gap that this work aims to fill is in the possibility of the Brazilian academic community to know the academic factors that are related to the H index of researchers considered as references in the field of Physical Education. Searching until April 2019 in PUBMED, Scopus, Web of Science, LILACS, and SciELO databases, no articles investigating this topic with researchers in the field of Physical Education in Brazil were found. In this search, an article was found that aimed to characterize the profile of these researchers1313. Fagundes LC, Paz CJR, Freitas DA, Soares WD. Productivity profile of CNPq scholarship researchers in Physical Education. Motriz: J. Phys. Ed. 2020; 26(2):e10200204. https://doi.org/10.1590/s1980-6574202000010204
https://doi.org/10.1590/s1980-6574202000...
, however, no analysis of the H index was made. This information will serve for reflection within the Field of Knowledge itself and for debate on which factors are associated with this metric in Brazil.

This article aimed to verify the association between sociodemographic, academic training, professional performance, bibliographic production and training of human resources (student supervisor) factors with the H Index of researchers with scientific productivity grants (PQ) in the field of Physical Education in Brazil.

Methods

This research surveyed data in March/2020 and is characterized as descriptive, with a cross-sectional design. For the development of this study, public domain data obtained from the information contained in official websites of the Brazilian government were used. For this reason, it did not have direct contact with human beings and did not need approval by an ethics committee on research with human beings.

Research subjects

The subjects of this research were researchers with scientific productivity grants (PQ) in the field of Physical Education in Brazil in the year 202033. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. In 2020, there were 94 researchers with scientific productivity grants (PQ) in the field of Physical Education in Brazil distributed into prestigious level as follows: 1A (n = 09), 1B (n = 05), 1C (n = 05), 1D (n = 22) and 2 (n = 53).

For the present study, in order to increase the power in statistical analysis, categories PQ 1A-1D were grouped into a single category (n = 41). This stratification was also chosen because categories PQ 1A-1D are recognized for researchers with greater experience and/or academic prestige compared to category 2, which is the first level of entry for researchers44. Guedes MC, Azevedo N, Ferreira LO. A produtividade científica tem sexo? Um estudo sobre bolsistas de produtividade do CNPq*. Cad Pagu. 2015; 45:367-99. https://doi.org/10.1590/18094449201500450367
https://doi.org/10.1590/1809444920150045...
.

Dependent Variable

The dependent variable of this study was the H index1010. Hirsch JE. An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569-72. https://doi.org/10.1073/pnas.0507655102
https://doi.org/10.1073/pnas.0507655102...
in the Scopus database. We chose the H Index of the Scopus database, as this base is used in the evaluations of research public notices in Brazil33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. This variable was continuously analyzed.

Independent variables

One of the independent variables in this study was the researcher’s sex (male/female). This information is considered important because there are several international gender equity movements in science1414. Huang G, Fang CH, Lopez SA, Bhagat N, Langer PD, Eloy JA. Impact of fellowship training on research productivity in academic ophthalmology. J Surg Educ. 2015;72(3):410-7. https://doi.org/10.1016/j.jsurg.2014.10.010
https://doi.org/10.1016/j.jsurg.2014.10....
,1515. Practising Gender Equality in Science Teams. Guidelines for Gender Equality Programmes in Science. 1ª ed. Roma, Ministry for Economy and Finance from Italy; 2009.. Another variable investigated was the geographic region of the researcher receiving a scholarship. Brazil is divided into five geographic regions (Midwestern, Northeastern, Northern, Southeastern, and Southern), which present social and economic discrepancies1616. Szwarcwald CL, Souza Júnior PRB, Marques AP, Almeida WS, Montilla DER. Inequalities in healthy life expectancy by Brazilian geographic regions: Findings from the National health survey, 2013. Int J Equity Health. 2016;15(1):141. https://doi.org/10.1186/s12939-016-0432-7 that reflect formal education opportunities.

Another independent variable was the researcher’s training area at the doctoral level. This information is important because Physical Education is considered an area that interrelates with different fields of knowledge88. Renson R. From Physical Education to Kinanthropology: A Quest for Academic and Professional Identity, Quest. 1989;41(3):235-56. https://doi.org/10.1080/00336297.1989.10483973
https://doi.org/10.1080/00336297.1989.10...
,99. Twietmeyer G. What is Kinesiology? Historical and Philosophical Insights. Quest. 2012;64(1):4-23. https://doi.org/10.1080/00336297.2012.653268
https://doi.org/10.1080/00336297.2012.65...
.

Other variables in this study were the place where the doctorate was held (Brazil or abroad) and the time the researcher has the doctorate title. Both variables can bring reflections on the relationship between scientific productivity and academic background, as addressed in studies from other fields of knowledge1414. Huang G, Fang CH, Lopez SA, Bhagat N, Langer PD, Eloy JA. Impact of fellowship training on research productivity in academic ophthalmology. J Surg Educ. 2015;72(3):410-7. https://doi.org/10.1016/j.jsurg.2014.10.010
https://doi.org/10.1016/j.jsurg.2014.10....
,1717. Ence AK, Cope SR, Holliday EB, Somerson JS. Publication Productivity and Experience: Factors Associated with Academic Rank Among Orthopaedic Surgery Faculty in the United States. J Bone Joint Surg Am. 2016;98(10):e41. https://doi.org/10.2106/JBJS.15.00757.
https://doi.org/10.2106/JBJS.15.00757...
,1818. LaRocca CJ, Wong P, Eng OS, Raoof M, Warner SG, Melstrom LG. Academic productivity in surgical oncology: Where is the bar set for those training the next generation? J Surg Oncol. 2018; 118(3):397-402. https://doi.org/10.1002/jso.25143.
https://doi.org/10.1002/jso.25143...
. The variable time the researcher has the doctorate title (in years) had the reference year 2019 as it was the year of the last public notice that researchers participated until the survey of this study33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. This variable was categorized as 8-10 years, 11-15 years, 16-20 years, 21-25 years, = 25 years.

The type of university in which the researcher works (Public or Private) was a study variable, as there is a decrease in investments from the Brazilian government in public education in Brazil1919. Terra R. Desequilíbrio financeiro, missões da universidade e avaliação - Autorreflexão na USP. Estud Av. 2019;33(95):35-50. https://doi.org/10.1590/s0103-4014.2019.3395.0004
https://doi.org/10.1590/s0103-4014.2019....
.

Another variable investigated was whether the researcher works in Graduate Programs in the field of Physical Education or not, as inter and multidisciplinary area88. Renson R. From Physical Education to Kinanthropology: A Quest for Academic and Professional Identity, Quest. 1989;41(3):235-56. https://doi.org/10.1080/00336297.1989.10483973
https://doi.org/10.1080/00336297.1989.10...
,99. Twietmeyer G. What is Kinesiology? Historical and Philosophical Insights. Quest. 2012;64(1):4-23. https://doi.org/10.1080/00336297.2012.653268
https://doi.org/10.1080/00336297.2012.65...
, there may have researchers working in Graduate Programs from different fields of knowledge.

The bibliographic production indicators investigated the number of scientific articles, academic books, and chapters of academic books published in the last five (2015-2019) and in the last 10 years (2010-2019) of the researcher’s evaluation in the 2019 public notice33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. In addition, the number of citations in the Scopus bibliographic database was analyzed.

The training of human resources by researchers with scientific productivity grants (PQ) was analyzed through the number of masters, doctors, and post-doctors that they have trained/supervised in the last five years (2015-2019) and 10 years (2010-2019), of the evaluation in the 2019 public notice. The training of human resources at the Graduate level is one of the criteria for the evaluation of CNPq public notices for PQ scholarship researchers33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
.

Procedures

Information obtained in this research came from official websites of the Brazilian government, in the public domain, with free and free access. Information on PQ researchers, such as sex, geographic region, and type of institution was accessed on the website http://cnpq.br/bolsistas-vigentes in the week of March 23 to 27/2020. Information on professional performance, bibliographic production, graduation year and field, and training of human resources, were taken from the researchers’ curricula registered in the Lattes Platform of public domain (http://lattes.cnpq.br/), in the week of March 23 to 27/2020.

Statistical analysis

For inferential statistics, the Chi-square test of heterogeneity or Fisher’s Exact test, Student’s t-test for independent samples or equivalent non-parametric Mann-Whitney U test were used. In addition, Spearman’s correlation coefficient (rho) was used to test the linear relationship between the H index and the other variables. In this verification, high multicollinearity was identified between H Index and the number of citations (rho> 0.90), for this reason, the number of citations did not follow linear regression analyses.

In the simple and multiple linear regression analysis, associations between the H Index and variables significantly related in the Spearman correlation were tested, estimating regression coefficients (B0), regression coefficient related to the predictor (B1), 95% confidence interval (95% CI) and determination coefficient (R2). In the multiple linear regression analysis, the multicollinearity of models was tested using variance inflation factors (VIF). Additionally, the independence of errors was tested and/or if the model errors were independent using the Durbin-Watson test (DW). Finally, a prediction equation for the H Index was estimated based on analyzed variables. This study considered 5% significance level and all analyses were performed using the Statistical Package for the Social Sciences software (IBM®, Armonk, NY), version 22.0.

Results

The characteristics of the sample are shown in table 1. When comparing the sample distribution in relation to PQ scholarship level, it was observed that most PQ 1A-1D scholarship researchers had doctorate time over 20 years, while PQ 2 scholarship researchers had doctorate time from 8 to 15 years (p <0.01). In addition, of the total of researchers with doctorate degree obtained abroad (n = 17), most were PQ 1A-1D scholarship researchers (n = 12), and of those with doctorate degree obtained in Brazil (n = 77), most were PQ 2 scholarship researchers (n = 48) (p = 0.013) (Table 1).

The H Index, number of citations, number of scientific articles in the last 10 years (2010-2019), and number of books in the last 10 years (2010-2019) of PQ 1A-1D scholarship researchers were higher compared to PQ 2 (p <0.05). The guidance of students at the master level in the last five years (2015-2019) was higher in PQ 2 compared to PQ 1A-1D (p <0.05). PQ 1A-1D scholarship researchers had a greater number of guidance of students at the doctoral and postdoctoral level (2010-2019) than PQ 2 scholarship researchers (p <0.05) (Table 2).

When comparing the H Index of researchers according to sex, geographic region, doctorate area, time of doctorate completion, place of doctorate completion, the educational institution working and participating in Graduate Programs in the field of Physical Education, there were no differences between categories of these variables, neither for the group of PQ 1A-1D and PQ 2 scholarship researchers (p> 0.05) (Table 3).

The H Index of PQ 1A-1D was directly related to the number of citations (rho = 0.92, p <0.01), and scientific articles published in the last five years (rho = 0.34, p <0.01) and 10 years (rho = 0.50, p <0.01). The H Index of PQ 2 was directly related to the number of citations (rho = 0.91, p <0.01), scientific articles in the last 10 years (rho = 0.29, p = 0.03), and books in the last five years (rho = 0.26, p = 0.05). However, the H Index of PQ 2 was inversely related to the guidance of students in the last 10 years (rho = -0.31, p = 0.02) (Table 4).

Simple linear regression analysis for PQ 1A-1D scholarship researchers showed that the publication of a scientific article in the last five years (2015-2019) and a scientific article in the last 10 years (2010-2019) reflected an increase of 0.13 (95% CI: 0.03; 0.23) and 0.11 (95% CI: 0.07; 0.15) units in the H Index, respectively. When performing multiple linear regression modeling, it was observed that these predictors (Step 1) violated the assumption of multicollinearity of the model (VIF = 4.95) and, for this reason, the predictor publication of the scientific article in the last five years (2015-2019) was removed from the model. Thus, the final explanatory model (Step 2) of the H Index of PQ 1A-1D scholarship researchers remained with variable the publication of the scientific article in the last 10 years (2010-2019) [H index = 8.48 + 0.11 * (Articles)], and the number of scientific articles published in the last 10 years explained variation of around 43% (R2 = 0.43) of the H Index of these researchers (Table 5).

For the group of PQ 2 fellowship researchers, predictors in simple linear regression demonstrated that the publication of one scientific article in the last 10 years (2010-2019) and one book in the last five years (2015-2019) reflected an increase of 0.06 (95% CI: 0.03; 0.09) and 2.78 (95% CI: 0.01; 5.55) units in the H Index, respectively. On the other hand, the guidance of students at the master level in the last 10 years (2010-2019) reflected in a decrease of 0.30 (95% CI: -0.56; -0.02) units in the H Index. All these predictors were significant in the multiple linear regression (Step 1) and explained variation in the H index by 38% [H index = 15.19 + 0.06 * (Articles) + 2.45 * (Books) - 0.34 * (Masters)] (Table 5).

Table 1
Distribution of CNPq Productivity Researchers in the field of ??Physical Education, Brazil.
Table 2
Average values, standard deviation, median and interquartile range of the bibliographic production and training of human resources indicators of CNPq Productivity Researchers in the field of Physical Education. Brazil.
Table 3
Comparison of the H Index according to the characterization variables for CNPq Productivity Researchers in the field of ??Physical Education, Brazil.
Table 4
Correlation coefficient between H Index and sociodemographic, professional training/performance indicators, bibliographic production and guidance of CNPq Productivity Researchers in the field of ??Physical Education, Brazil.
Table 5
Simple and multiple linear regression analysis between H Index and respective predictors for CNPq Productivity Researchers in the field of ??Physical Education, Brazil.

Discussion

This research found that PQ 1A-1D scholarship researchers in the field of Physical Education in Brazil presented higher amounts in bibliographic production and training of human resources indicators than PQ 2 scholarship researchers, which can be explained by the criteria adopted to apply for PQ 1A-1D and PQ 2 scholarships33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. One of the criteria established to apply for PQ 1A-1D scholarship is to have completed the guidance of at least 10 masters or doctors, with at least three doctors33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. One of the results identified in the present research was that the majority of PQ 1A-1D scholarship researchers have doctorate time of more than 20 years, which allows establishing a relationship between the time since doctorate completion with bibliographic production and training of human resource11. Wood BP, May W. Academic recognition of educational scholarship. Acad Radiol. 2006;13(2):254-7. https://doi.org/10.1016/j.acra.2005.10.001
https://doi.org/10.1016/j.acra.2005.10.0...
,2020. Imasato T, Perlin MS, Borenstein D. Análise do Perfil dos Acadêmicos e de suas Publicações Científicas em Administração. Rev Adm Contemp. 2017; 21(1):62-83. https://doi.org/10.1590/1982-7849rac2017150329
https://doi.org/10.1590/1982-7849rac2017...
. Thus, to become a PQ 1A-1D scholarship holder, it is necessary to have more time in the career and adequacy of the interests of research funding agencies. Having completed the guidance of at least three doctors, the scholarship applicant has a greater number of trained researchers working together to publish researches, which increases the possibility of having greater bibliographic production. With the high quantity and quality of human resources trained for research, there is a tendency for a greater number of publications. Thus, PQ 1A-1D the scholarship researchers, researchers with more than 20 years of doctoral completion and with at least three doctorate students under their guidance, form new agents in the scientific field, products of the social world that they are inserted2121. Bourdieu P. O poder simbólico. Rio de Janeiro, Bertrand Brasil; 2009.,2222. Bourdieu P. Homo Academicus. Tradução: Ione Ribeiro Valle. Florianópolis, Editora da UFSC; 2011., which has the diffusion of knowledge-centered in journals2323. Lazzarotti Filho A, Silva AM, Mascarenhas F. Transformações contemporâneas do campo acadêmico-científico da Educação Física no Brasil: novos habitus, modus operandi e objetos de disputas. Mov. 2014;20: 67-80., which increases the likelihood of these researchers of being cited in comparison to PQ 2 scholarship researchers.

For PQ 1A-1D scholarship researchers, the number of scientific articles published in the last 10 years was the only among factors investigated in this research that directly reflected the variation in the H Index. This result demonstrates that for researchers in the field of Physical Education in Brazil with greater experience and academic insertion, the quantity and quality of the production of scientific articles (i.e., Index H) exclusively depends on the quantity of these publications. Other studies have already shown that the H Index is linked to the amount of publication, that is, the quality and quantity of scientific research go together1111. Dinis-Oliveira RJ. The H-index in Life and Health Sciences: Advantages, Drawbacks and Challenging Opportunities. Curr Drug Res Rev. 2019; 11(2):82-84. https://doi.org/10.2174/258997751102191111141801.
https://doi.org/10.2174/2589977511021911...
. What can explain this in this group of researchers (PQ 1A-1D) is that as they have a greater number of trained masters, doctors, and post-doctors, and such researchers establish a tradition in research, in which students, after being trained, become new agents in the scientific field2121. Bourdieu P. O poder simbólico. Rio de Janeiro, Bertrand Brasil; 2009.,2222. Bourdieu P. Homo Academicus. Tradução: Ione Ribeiro Valle. Florianópolis, Editora da UFSC; 2011.. That is, these trained human resources become new advisors, who create new groups of researchers with the same or similar epistemological bias, which start to cite studies previously carried out, generating several citations.

For PQ 2 scholarship researchers in the field of Physical Education in Brazil, the number of scientific articles also reflected in the variation of the H Index, as presented in the group of PQ 1A-1D scholarship researchers, and also presented in other studies on the H Index77. Jialal I, Schreiber WE, Giustini DM. H-index and Academic Medicine. Am J Clin Pathol. 2019;151(6):648-649. https://doi.org/10.1093/ajcp/aqz037.
https://doi.org/10.1093/ajcp/aqz037...
,1111. Dinis-Oliveira RJ. The H-index in Life and Health Sciences: Advantages, Drawbacks and Challenging Opportunities. Curr Drug Res Rev. 2019; 11(2):82-84. https://doi.org/10.2174/258997751102191111141801.
https://doi.org/10.2174/2589977511021911...
. Due to the regression coefficient of the number of scientific articles published by PQ 2 scholarship researchers (B1 = 0.06), the magnitude of influence of these scientific articles in the variation of the H Index was lower than for PQ 1A-1D scholarship researchers (B1 = 0.11). This result demonstrates that PQ 2 scholarship researchers have to publish a larger number of scientific articles in order to be cited and increase their H Index. On the other hand, each article published by PQ 1A-1D scholarship researchers is more likely to be cited than those of PQ 2 scholarship researchers. This difference in the magnitude of scientific articles in the variation of the H Index reinforces the fact that PQ 2 scholarship researchers are in career consolidation, at the same time that the careers of PQ 1A-1D scholarship researchers are already consolidated.

For the group of PQ 2 scholarship researchers, the number of books published in the last five years was a factor directly associated with the variation in the H Index. Books are an effective strategy for disseminating knowledge produced by researchers in the process of career consolidation2424. Spinak E. A relevância dos livros na comunicação científica - o caso do SciELO Livros online . SciELO em Perspectiva, 2018. Disponível em: https://blog.scielo.org/blog/2018/08/07/a-relevancia-dos-livros-na-comunicacao-cientifica-o-caso-do-scielo-livros/ Acessado em 06 de Maio de 2020 .
https://blog.scielo.org/blog/2018/08/07/...
. Unlike articles, which must be short and respect a standard systemization, academic books have a more extensive textual presentation, enabling the greater collection of information, in which aesthetic, academic, and social values are incorporated2424. Spinak E. A relevância dos livros na comunicação científica - o caso do SciELO Livros online . SciELO em Perspectiva, 2018. Disponível em: https://blog.scielo.org/blog/2018/08/07/a-relevancia-dos-livros-na-comunicacao-cientifica-o-caso-do-scielo-livros/ Acessado em 06 de Maio de 2020 .
https://blog.scielo.org/blog/2018/08/07/...
. Such elements of symbolic capital collaborate to legitimize researchers in the academic scenario2121. Bourdieu P. O poder simbólico. Rio de Janeiro, Bertrand Brasil; 2009.. In Brazil, there is an additional element in relation to the publication of academic books, which is the fact that such books, in general, are written in Portuguese, and articles, in turn, have English as the official language in most journals. Thus, books reach a larger number of people who intend to start training in research, such as students at the master and doctorate levels. This fact is necessary for researchers who are still in career consolidation, as is the case of PQ 2 researchers, who still need to increase training of human resources to consolidate themselves in the scientific field.

The number of students that were supervised at the master level in the last 10 years has been inversely reflected in the H Index of PQ 2 scholarship researchers. Unlike PQ 1A-1D scholarship researchers, most PQ 2 scholarship researchers have between eight and 15 years of doctoral training and have supervised more master students in the last five years, and these numbers identify the beginning of the training of human resources for research since the master’s degree is the period in which students enter the Graduate Program and begin to acquire experience2222. Bourdieu P. Homo Academicus. Tradução: Ione Ribeiro Valle. Florianópolis, Editora da UFSC; 2011. to improve it in the doctorate degree. The first master’s degrees require more time from the advisor2020. Imasato T, Perlin MS, Borenstein D. Análise do Perfil dos Acadêmicos e de suas Publicações Científicas em Administração. Rev Adm Contemp. 2017; 21(1):62-83. https://doi.org/10.1590/1982-7849rac2017150329
https://doi.org/10.1590/1982-7849rac2017...
,2525. Golde CM, Walker GE, Jones L, Bueschel AC, Hutchings P. The formation of scholars: Rethinking doctoral education for the twenty-first century. 1a ed. San Francisco, Jossey-Bass; 2008.,2626. Minayo MCS. Thesis supervision as professional work. Cad Saude Publica. 2019; 35(10):e00135719. https://doi.org/10.1590/0102-311X00135719.
https://doi.org/10.1590/0102-311X0013571...
since the training of new researchers is at the beginning, which may be related to the inverse relationship with the H index, as it influences in the period of dedication to the publication of articles with quality to be cited.

The limitations of this research are numerous, for example, the analysis of the H Index of the Scopus database, considering that other databases also present the researcher’s H index. However, it was decided to analyze the H Index of the Scopus database because this base is taken into account in the assessment of the quantity and quality of PQ scholarship researchers by CNPq33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
. Another limitation of this research is the fact that it analyzed only PQ scholarships in the field of Physical Education, since other fields of knowledge may have predictors of the H Index different from those of Physical Education. The fact that it did not analyze researchers that applied in the PQ 2019 scholarship notice33. Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020 .
http://www.cnpq.br/ Acessado em 25 de Ja...
, but that were not contemplated is another limitation of this research, as it does not allow knowing the H Index of these researchers or the factors related to that index. However, information from non-contemplated researchers is not public, so there is no access to that information. Another limitation of this study is its design (cross-sectional), which prevents any causal inference among variables.

Conclusions

PQ 1A-1D scholarship researchers in the field of Physical Education in Brazil have higher amounts in indicators of bibliographic production and training of human resources than PQ 2 scholarship researchers. For PQ 1A-1D scholarship researchers, the number of scientific articles published in the last few 10 years directly reflected the variation in the H Index of these researchers. On the other hand, for PQ 2 scholarship researchers, the number of the scientific articles published in the last 10 years and books published in the last five years directly reflected the variation in their H Index. In addition, for PQ 2, the amount of guidance of students at the master level in the last 10 years inversely reflected in their H Index.

This system demonstrates the logic of the distribution of PQ scholarships in the field of Physical Education in Brazil, which is related to scientific experience and a standardized structure of the systematized organization of the academic career, as well as a sequential perspective, in which the time of involvement with research is related to the type of scholarship that one can apply for, according to the current structured system.

References

  • 1
    Wood BP, May W. Academic recognition of educational scholarship. Acad Radiol. 2006;13(2):254-7. https://doi.org/10.1016/j.acra.2005.10.001
    » https://doi.org/10.1016/j.acra.2005.10.001
  • 2
    Brasil. Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES. Cursos Recomendados Web Page . Disponível em: https://sucupira.capes.gov.br/sucupira/public/consultas/coleta/programa/quantitativos/quantitativoIes.jsf?areaAvaliacao=21&areaConhecimento=40900002 Acessado em 26 de Dezembro de 2019 .
    » https://sucupira.capes.gov.br/sucupira/public/consultas/coleta/programa/quantitativos/quantitativoIes.jsf?areaAvaliacao=21&areaConhecimento=40900002
  • 3
    Brasil. Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq. Chamada CNPq N º 06/2019 - Bolsas de Produtividade em Pesquisa Web Page . Disponível em: http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020
    » http://www.cnpq.br/ Acessado em 25 de Janeiro de 2020
  • 4
    Guedes MC, Azevedo N, Ferreira LO. A produtividade científica tem sexo? Um estudo sobre bolsistas de produtividade do CNPq*. Cad Pagu. 2015; 45:367-99. https://doi.org/10.1590/18094449201500450367
    » https://doi.org/10.1590/18094449201500450367
  • 5
    Kunsch MMK. A produção científica em relações públicas e comunicação organizacional no Brasil: análise, tendências e perspectivas. Asociación Latinoamericana de Investigadores de La Comunicación, 2003. Disponível em: http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm Acessado em 01 de Abril de 2020 .
    » http://www.eca.usp.br/associa/alaic/boletin11/kunsch.htm
  • 6
    Antunes AA. Como avaliar produção científica. Rev Col Bras Cir. 2015; 42(Supl. 1):17-19. https://doi.org/10.1590/0100-69912015S01006
    » https://doi.org/10.1590/0100-69912015S01006
  • 7
    Jialal I, Schreiber WE, Giustini DM. H-index and Academic Medicine. Am J Clin Pathol. 2019;151(6):648-649. https://doi.org/10.1093/ajcp/aqz037.
    » https://doi.org/10.1093/ajcp/aqz037
  • 8
    Renson R. From Physical Education to Kinanthropology: A Quest for Academic and Professional Identity, Quest. 1989;41(3):235-56. https://doi.org/10.1080/00336297.1989.10483973
    » https://doi.org/10.1080/00336297.1989.10483973
  • 9
    Twietmeyer G. What is Kinesiology? Historical and Philosophical Insights. Quest. 2012;64(1):4-23. https://doi.org/10.1080/00336297.2012.653268
    » https://doi.org/10.1080/00336297.2012.653268
  • 10
    Hirsch JE. An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569-72. https://doi.org/10.1073/pnas.0507655102
    » https://doi.org/10.1073/pnas.0507655102
  • 11
    Dinis-Oliveira RJ. The H-index in Life and Health Sciences: Advantages, Drawbacks and Challenging Opportunities. Curr Drug Res Rev. 2019; 11(2):82-84. https://doi.org/10.2174/258997751102191111141801.
    » https://doi.org/10.2174/258997751102191111141801
  • 12
    Yang HY, Rhee G, Xuan L, Silver JK, Jalal S, Khosa F. Analysis of H-index in Assessing Gender Differences in Academic Rank and Leadership in Physical Medicine and Rehabilitation in the United States and Canada. Am J Phys Med Rehabil. 2019; 98(6):479-483. https://doi.org/10.1097/PHM.0000000000001129.
    » https://doi.org/10.1097/PHM.0000000000001129
  • 13
    Fagundes LC, Paz CJR, Freitas DA, Soares WD. Productivity profile of CNPq scholarship researchers in Physical Education. Motriz: J. Phys. Ed. 2020; 26(2):e10200204. https://doi.org/10.1590/s1980-6574202000010204
    » https://doi.org/10.1590/s1980-6574202000010204
  • 14
    Huang G, Fang CH, Lopez SA, Bhagat N, Langer PD, Eloy JA. Impact of fellowship training on research productivity in academic ophthalmology. J Surg Educ. 2015;72(3):410-7. https://doi.org/10.1016/j.jsurg.2014.10.010
    » https://doi.org/10.1016/j.jsurg.2014.10.010
  • 15
    Practising Gender Equality in Science Teams. Guidelines for Gender Equality Programmes in Science. 1ª ed. Roma, Ministry for Economy and Finance from Italy; 2009.
  • 16
    Szwarcwald CL, Souza Júnior PRB, Marques AP, Almeida WS, Montilla DER. Inequalities in healthy life expectancy by Brazilian geographic regions: Findings from the National health survey, 2013. Int J Equity Health. 2016;15(1):141. https://doi.org/10.1186/s12939-016-0432-7
  • 17
    Ence AK, Cope SR, Holliday EB, Somerson JS. Publication Productivity and Experience: Factors Associated with Academic Rank Among Orthopaedic Surgery Faculty in the United States. J Bone Joint Surg Am. 2016;98(10):e41. https://doi.org/10.2106/JBJS.15.00757.
    » https://doi.org/10.2106/JBJS.15.00757
  • 18
    LaRocca CJ, Wong P, Eng OS, Raoof M, Warner SG, Melstrom LG. Academic productivity in surgical oncology: Where is the bar set for those training the next generation? J Surg Oncol. 2018; 118(3):397-402. https://doi.org/10.1002/jso.25143.
    » https://doi.org/10.1002/jso.25143
  • 19
    Terra R. Desequilíbrio financeiro, missões da universidade e avaliação - Autorreflexão na USP. Estud Av. 2019;33(95):35-50. https://doi.org/10.1590/s0103-4014.2019.3395.0004
    » https://doi.org/10.1590/s0103-4014.2019.3395.0004
  • 20
    Imasato T, Perlin MS, Borenstein D. Análise do Perfil dos Acadêmicos e de suas Publicações Científicas em Administração. Rev Adm Contemp. 2017; 21(1):62-83. https://doi.org/10.1590/1982-7849rac2017150329
    » https://doi.org/10.1590/1982-7849rac2017150329
  • 21
    Bourdieu P. O poder simbólico. Rio de Janeiro, Bertrand Brasil; 2009.
  • 22
    Bourdieu P. Homo Academicus. Tradução: Ione Ribeiro Valle. Florianópolis, Editora da UFSC; 2011.
  • 23
    Lazzarotti Filho A, Silva AM, Mascarenhas F. Transformações contemporâneas do campo acadêmico-científico da Educação Física no Brasil: novos habitus, modus operandi e objetos de disputas. Mov. 2014;20: 67-80.
  • 24
    Spinak E. A relevância dos livros na comunicação científica - o caso do SciELO Livros online . SciELO em Perspectiva, 2018. Disponível em: https://blog.scielo.org/blog/2018/08/07/a-relevancia-dos-livros-na-comunicacao-cientifica-o-caso-do-scielo-livros/ Acessado em 06 de Maio de 2020 .
    » https://blog.scielo.org/blog/2018/08/07/a-relevancia-dos-livros-na-comunicacao-cientifica-o-caso-do-scielo-livros/
  • 25
    Golde CM, Walker GE, Jones L, Bueschel AC, Hutchings P. The formation of scholars: Rethinking doctoral education for the twenty-first century. 1a ed. San Francisco, Jossey-Bass; 2008.
  • 26
    Minayo MCS. Thesis supervision as professional work. Cad Saude Publica. 2019; 35(10):e00135719. https://doi.org/10.1590/0102-311X00135719.
    » https://doi.org/10.1590/0102-311X00135719
  • Editor:

    Giselle Helena Tavares. UFU/Uberlândia, MG, Brazil

Publication Dates

  • Publication in this collection
    21 Sept 2020
  • Date of issue
    2020

History

  • Received
    12 May 2020
  • Accepted
    14 June 2020
Universidade Estadual Paulista Universidade Estadual Paulista, Av. 24-A, 1515, 13506-900 Rio Claro, SP/Brasil, Tel.: (55 19) 3526-4330 - Rio Claro - SP - Brazil
E-mail: motriz.rc@unesp.br