Acessibilidade / Reportar erro

Innovation in Brazil: Universities, Embraer and Petrobras

Abstract

Innovation affects a nation’s sovereignty. In this paper, we look at Science and Technology indicators as proxies for Innovation using databases such as WIPO, INPI, Sucupira and Scival, and including patents registered, academic-corporate collaborations, patents citing Brazilian articles (Number of patents and documents) and technical production in Brazilian higher education institutions. We also look at two major previously state-owned companies (Embraer and Petrobras) to see their patenting and citation behaviour compared to other companies worldwide. Brazilian science is a citation basis for patenting in companies and universities worldwide, but Brazil does not use its own publications to support patent proposals. While USP is the major cited university, Unicamp has more patents. Academic-corporate collaboration exists between Brazilian and foreign universities, especially in the US and Europe. The Brazilian companies show low patenting behaviour, but Embraer has a higher impact than Petrobras. As a consequence of the dynamics of science and technology, we suggest that the analyses of the innovation processes could focus on the generation of startups and, in particular, academic spin-offs.

Key words
citation; impact; patents; scientometrics

INTRODUCTION

Research quality and impact measurement has become an essential branch of science (Scientometrics) in recent years (Mingers & Leydesdorff 2015MINGERS J & LEYDESDORFF L. 2015. A review of theory and practice in scientometrics. Eur J Oper Res 246: 1-19.). This includes fields such as bibliometrics, informetrics, webometrics and altmetrics. These authors highlight that these studies have been based mainly on citation measures, largely ignoring other actions involved in the quality of research by an individual, institution, knowledge area or country. There are a large number of studies comparing databases such as SciVal (Elsevier) or InCites (Clarivate Analytics) in terms of their use and coverage as a measure of research quality (Ruas et al. 2017RUAS TL, PEREIRA L & GROSKY WI. 2017. Science, technology and innovation exploration in biophotonics through a scientometric approach. 2017 IEEE International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM). DOI: 10.1109/ICSTM.2017.8089124.). Still, few studies look at their adequacy to measure the impact of an institution or area of knowledge. McManus et al. (2021)MCMANUS C, BAETA NEVES AA & PRATA AT. 2021. Scientific publications from non-academic sectors and their impact. Scientometrics 126: 8887-8911. found that scientific papers from business had a higher impact and prominence than academic papers and were cited more often in patents.

Citing-cited patent activities are a critical source of emerging new patents (Oh et al. 2017OH G, KIM HY & PARK A. 2017. Analysis of technological Innovation based on citation information. Qual Quant 51: 1065. https://doi.org/10.1007/s11135-016-0460-9.
https://doi.org/10.1007/s11135-016-0460-...
), and patent citation reveals the diffusion of information and its applicability into many other technical fields, which gives birth to new technology (Sharma & Tripathi 2017SHARMA P & TRIPATHI RC. 2017. Patent citation: A technique for measuring the knowledge flow of information and Innovation. World Patent Info 51: 31-42 https://doi.org/10.1016/j.wpi.2017.11.002.
https://doi.org/10.1016/j.wpi.2017.11.00...
). Maggioni & Uberti (2011)MAGGIONI MA & UBERTI TE. 2011. Networks and geography in the economics of knowledge flows. Qual Quant 45: 1031-1051. state that innovative activity, organisation, especially firms, or territory of an agent can be analysed through patents because they reflect marketable information of innovative technology and, therefore, are a representative proxy for a technology (Trajtenberg et al. 1997TRAJTENBERG M, HENDERSON R & JAFFE A. 1997. University versus corporate patents: a window on the basicness of invention. Econ Innovat New Technol 5: 19-50.). Nevertheless, Wartburg et al. (2005)WARTBURG I, TEICHERT T & ROST K. 2005. Inventive progress measured by multi-stage patent citation analysis. Res Pol 34: 1591-1607. https://doi.org/10.1016/j.respol.2005.08.001.
https://doi.org/10.1016/j.respol.2005.08...
state that single-stage citation analysis cannot reveal technological paths or lineages, while Tijssen & Winnink (2018)TIJSSEN RJW & WINNINK JJ. 2018. Capturing ‘R&D excellence’: indicators, international statistics, and innovative universities. Scientometrics 114: 687-699. question the validity of metrics and quantitative indicators such as citation analysis used to measure excellence in Research, Development and Innovation (RD&I). Comparative measurement and large-scale benchmarking can only go so far, as in-depth understanding requires information from supporting case studies.

Table I
Companies and Research Institutions Compared.

The development of a nation depends on the production sector, and Brazil’s is primarily based on commodities such as petroleum and gas, agriculture and some innovative technologies1 1 https://oec.world/en/profile/country/bra/ . Brazil is classified as an Upper middle-income country, performing above expectations for the level of development in the 2021 WIPO report2 2 https://www.wipo.int/edocs/pubdocs/en/wipo_pub_gii_2021.pdf . It is currently ranked 57th in the Global Innovation Index rankings. The WIPO report states that Brazil is lagging in infrastructure (69th) and market sophistication (75th) and ranks 78th in institutions, 48th in Human Capital and research, business sophistication (34th), knowledge and technology outputs (51st) and creative outputs (66th). This indicates that many changes are needed for Brazil to improve its ratings. Vasconcelos & Silva (2019)VASCONCELOS C & SILVA D. 2019. Intellectual property challenges for the roads of Innovation in Brazil. Innov Manag Rev 16: 185-192. https://doi.org/10.1108/INMR-02-2019-0010.
https://doi.org/10.1108/INMR-02-2019-001...
discuss intellectual property rights (IPR) in Brazil and their effect on Innovation. They show that IP indicators in patent registration, industrial designs and technology contracts have declined. With the companies’ internationalisation, market strategies increasingly require the insertion of new technologies in their products and processes, making patents an essential factor among the different industrial segments, having a positive impact on the process of economic growth and technological progress of the countries in the international world trade (Cavalheiro et al. 2016CAVALHEIRO G, JOIA LA & VEENSTRA A. 2016. Examining the trajectory of a standard for patent classification: an institutional account of a technical cooperation between EPO and USPTO. Tech Soc 46: 10-17. https://doi.org/10.1016/j.techsoc.2016.04.004.
https://doi.org/10.1016/j.techsoc.2016.0...
).

Major companies involved in this sector are Petrobras and Embraer (Empresa Brasileira de Aeronáutica/Brazilian Corporation for Aeronautics). Both were State Owned Enterprises (SOEs), with the Brazilian government owning 64% of Petrobras. Embraer was privatised in 1994, but the Brazilian government retains veto power. At present these two companies account for 87% of scientific papers published in the Web of Science and 58% in Scopus by the corporate sector in Brazil.

The quality of Innovation is based on the quality of science. Therefore, using the scientometric databases and taking this as the premise, we look at Brazilian universities and these Brazilian companies using international databases and question whether their use is adequate to measure scientific quality. While using patent citations and citing patents can be examined (Kuhn et al. 2020KUHN J, YOUNGE K & MARCO A. 2020. Patent citations reexamined. RAND J Econ 51: 109-132.), studies have shown Petruzelli et al. (2015) that science-based patents are sources for the assignee’s subsequent inventive process, and patents with a broader scope influence non-industry-specific patents. Chen (2017)CHEN L. 2017. Do patent citations indicate knowledge linkage? The evidence from text similarities between patents and their citations. J Inform 11(1): 63-79. shows that patent citations can indicate knowledge linkage. Results vary by area of knowledge (Gazni 2020GAZNI A. 2020. The growing number of patent citations to scientific papers: Changes in the world, nations, and fields. Tech Soc 62: 101276.). According to Iizuka & Hollanders (2017), innovation indicators include those for Science and Technology (S&T), survey and composite combining the abovementioned indicators. The current paper is based on the first set (S&T) of indicators. Although indirect, they indicate factors closely associated with the innovation process based on shared understandings. These include patents, research cited by and citing patents, academic-corporate publishing and its impact.

MATERIALS AND METHODS

Information was collected on registered Brazilian innovation (from all sources – universities and companies) through different databases. Data from 2012 to 2021 was collected using online databases, including WIPO3 3 https://www.wipo.int/portal/en/index.html (World Intellectual Property Office), including Global Brand Database, Global Design Database and PCT (Patent Cooperation Treaty), INPI4 4 https://www.gov.br/inpi/pt-br (National Institute of Industrial Property - Instituto Nacional da Propriedade Industrial), as well as publication databases such as Scival (Elsevier) and InCites (Clarivate Analytics). Scival also indicates patent offices and research topics studied by companies. In WIPO we looked at International Registration of Appellations of Origin (AOs), Geographical Indications (GIs), The International Microorganism Deposit System, Global Brand and PCT Databases, as well as looking at patent classifications.

Further data was collected from the Sucupira5 5 https://sucupira.capes.gov.br/sucupira/ database with information on technical products from postgraduate courses in Brazil (where 95% of scientific production occurs), namely Apps, Patents, and research reports where private companies are significant funders, from 2012 to 2020.

Major Brazilian companies were identified6 6 https://companiesmarketcap.com/brazil/largest-companies-in-brazil-by-market-cap/ , with four companies are responsible for about 80% of publications in the sector in Brazil (Petrobras, Embraer, CPQD and Fleury). Publications and patents from two Brazilian private but previously state-owned companies/institutions (Petrobras and Embraer) were further evaluated. The two other companies listed were not included: CPQD (Centro de Pesquisa e Desenvolvimento em Telecommunicações - Research and Development Center in Telecommunications and IT) and Fleury, a company involved in clinical exams. CPQD published more than 70% in congresses, and Fleury published almost entirely in collaboration with national universities so their data were captured in the university analysis. Other Brazilian companies did not appear strongly (<20 papers/year) in the citation databases (WEG, CESAR, several governmental and private banks, Vale SA, Braskem, JBS, Copel) and were also not included in this analysis. This does not mean they do not innovate.

Petrobras and Embraer were compared with similar companies and research institutions in other countries (Table I) where data were available.

Data for these companies included annual revenue (from company homepages), number of papers published, field (FWCI) and normalised (CNCI) citation impact indices, international collaboration (%), number of patents, cited patent count, media exposure and impact, and academic-corporate (business) collaboration and impact. FWCI and CNCI are calculated based on one (1) as the world mean by area of knowledge, by taking into account different citation patterns. Therefore, they represent the ratio of the actual number of citations received by a document and the “expected” number for a document with similar characteristics.

Regressions of annual revenue on patent count were created and patent citations over time. Clusters of companies were formed within each area of knowledge (Oil & Gas/Aeronautics) based on all indicators and patent citations. Data were analysed using SAS® (Statistical Analysis System Inc, Cary, North Carolina). Published papers by these companies from 2012 to 2021 was also collected from Scopus and network analyses performed in Vosviewer.

RESULTS

Brazilian information in WIPO (World Intellectual Property Organization)

No information was registered for Brazil in the International Registration of Appellations of Origin (AOs), Geographical Indications (GIs), or The International Microorganism Deposit System. Brazil had no indications in the Global Brand Database in the Designated Contracting Party or as Applicants Contracting Party. In the Holder section, there were 5,515 registers for Brazil, of which 2,245 were active, 38 were pending, and 2,389 were inactive. Brazil has no Global Brands but acts as a Holder Country and Designating Contracting Party for 56,099 and 32,085, respectively. In the PCT Database, Brazil has 23,120 registers, with 11,912 since 2012 (Table II). HP, Whirlpool and Petrobras are major companies, with Unicamp registering most among Brazilian universities. Most patents from Whirlpool were registered by EMBRACO (Brazilian Compressor Industry), a Brazilian company founded in 1971 that from 2006 on became Whirlpool SA (a subsidiary of Whirlpool Corporation) and in 2019 was sold to the Japanese company NIDEC.

Table II
Number of Brazilian patents by patent office and company.

Compounds registered are mainly in the biochemical and medical areas (Supplementary Material - Table SI, Figure S1), with A61K – medical, dental or toilet purposes being the most evident. These involve detection, treatments, use (verwendung) and procedures (verfahren) for diseases such as cancer. Patents in the areas of C07C (Acyclic or Carbocyclic Compounds (macromolecular compounds; production of organic compounds by electrolysis or electrophoresis) and A01N (Preservation of bodies of humans or animals or plants or parts thereof (preservation of food or foodstuff) and Biocides) have decreased since 2012, while A61Q (specific use of cosmetics or similar toilet preparations) and E21B (Earth or rock drilling (mining, quarrying e21c; making shafts, driving galleries or tunnels e21d); obtaining oil, gas, water, soluble or meltable materials or a slurry of minerals from wells) have become more prevalent.

In the INPI (Instituto Nacional de Propriedade Industrial) database, there are 68 geographic indications with known precedence (mainly foods such as wine or cachaça, meat, coffee, fruits, cheese, chocolate, shoes, and handcrafts), 32 Designations of Origin (again dominated by foodstuffs). There were also 362 Computer Programs and 912 Industrial Designs. There were 40,397 processes in the INPI patent database.

Brazilian Publications

Brazil produced 16,517 publications with Academic-corporate collaboration (Table III) during the period (SciVal). These received 37 citations per publication and had a FWCI of 3.27, compared with 0.90 for all publications and 1.54 for international collaboration. Natural Sciences dominated Academic-corporate collaboration, followed by Engineering & Technology and medical. Nevertheless, Medical and Engineering had more patent citations per output. A low percentage of Social Sciences and Humanities publications were in collaboration with corporations. In all areas, collaboration increased FWCI.

Table III
Scholarly Output in Brazil with both academic and corporate author affiliations by knowledge area.

Over the years, academic-corporate collaboration increased linearly (Figure 1a), and patent citations of these papers increased exponentially (Figure 1b).

Figure 1
Brazilian publications in Academic – Corporate collaboration (a) and their citations in patents (b).

The USA has the highest use of Brazilian papers (Figure 2) in patents. USP and Petrobras have the highest number of publications in patents, mainly in super-journals such as PlosOne or Scientific Reports and specialist journals such as in Medicine, physics and engineering. International collaborations are important, as some of the major Brazilian academic-corporate collaboration shows triangulation, such as those with CNRS (France), Harvard (USA) and other universities in several countries (Heidelberg, Paris, Helsinki, Lund, etc).

Figure 2
Publications in Brazil with author(s) with both academic and corporate affiliation: a) Country affiliation (except Brazil, > 1000 publications); b) Top Countries citing Brazilian papers; c) Sources and d) Institutions cited in patents.

Patent Citations

From 2012 to 2021, 17,552 patents cited 6,198 scholarly outputs published in Brazil (Figure 3). There were 21,479 patent citations received, averaging 27 per scholarly output. The major citing countries were USA, UK and Germany. Universities such as the University of California, MIT, and Duke cite Brazilian papers in their patents and private companies such as AT&T and CPG.

Figure 3
a) Distribution of citing Countries; b) Major citing countries; c) Top 20 applicants/Owners and d) year of publication.

When looking by area of knowledge (Figure 4), the USA and Europe are major citing countries. Argentina is seen in natural and medical sciences and the UK in Social Sciences.

Figure 4
Heat maps for Patent country citing Brazilian authors by area of knowledge a) Agriculture; b) Engineering & Technology; c) Humanities; d) Medical Sci; e) Natural Science and f) Social Sciences.

USPTO (United States Patent and Trademark Office) and WIPO are the top offices with patents citing Brazilian literature (Table SII) with 6572 and 5387 respectively, followed by the European Patent Office with 3644.

Citing applicants are mainly private companies and universities (Table IV) in all areas of knowledge (>90%). Private companies have over double the patents of universities. The Brazilian institutions cited in patents are USP and Unicamp and include foreign institutions such as CNRS, Harvard, Inserm and CSIC. USP is the leader in all areas, especially Medicine. As seen with citing sources, publication sources are either super-journals or area specific, with few Brazilian journals cited.

Table IV
Citing applicants for papers by Brazilian authors worldwide in Patents based on the top 100 applicants by area of knowledge Top 20 publishing institutions with Brazilian authors and Top 20 Publishing Sources.

Most of the papers cited in patents (Table V) were open access (especially green). Nevertheless, the difference between open and non-open access was small.

Table V
Type of publishing for patent – citations.

Other Production

Data from the postgraduate network from 2013 to 2020 (Table VI) and their word clouds in Figure 10 show a comprehensive production of technical products, totaling 65,860 in 8 years. These included apps for computers, products, patent applications, and techniques.

Table VI
Type of technical products declared by postgraduate courses in Brazil (2013-2020) on the Sucupira platform.

The emphasis on education and health matters are dominant, as well as management and control (Figure 5).

Figure 5
WordClouds for a) Apps, b) Technical Products; c) Products and d) patents from Sucupira database.

Brazilian companies

Petrobras was responsible for 56.3% of publications in Scopus by Brazilian companies and Embraer 6%. While Brazilian companies tend to publish a high percentage of papers in the top 10% of journals, the citation rates were significantly lower (Table VII). This is especially evident for Embraer, which also has no cited patents.

Table VII
Basic data on Brazilian companies in this study (2012-2021).

The predominant themes researched are similar to world themes (Figure 6), showing that research in these companies is aligned with major companies worldwide.

Figure 6
Word clouds for most common themes researched in selected Brazilian companies and worldwide in their area of knowledge (Scival).

Major collaborators for all four companies tend to be Brazilian universities (Table VIII), but the impact of these collaborations varies. For Petrobras, institutions other than UFRJ show higher impact such as UFRGS and Unicamp, with UFES the only one with an impact greater than the world mean. Embraer impact is higher than the world mean, and collaboration with international companies improved this. The collaboration with international institutions tended to lower the impact, except with ITA.

Table VIII
Major Brazilian collaborators and impact (FWCI) with Embraer and Petrobras.

Embraer’s impact aligned with the world average, while Petrobras’s was relatively low (Table SIII). Lower rates of international collaboration accompanied the lower impact. While most companies showed a higher impact with academic-corporative collaboration, this was not the case with Petrobras (see Tables SIII and SIV and Figure 7).

Figure 7
Number of patents (WIPO) by revenue for a) oil & gas and b) aviation companies.

The Brazilian companies (Figure 7) tend to show a low rate of patent registration compared to their revenue or budget, as all fall below the mean tendency line. Petrobras shows a patenting profile similar to Russian companies such as Lukoil, Rosneft, or Equinor (formerly Statoil). In the case of Embraer, few patents are registered, similar to Rayethon.

The Federal University of Rio de Janeiro (UFRJ) is Petrobras’s major collaborator, mainly through its COPE (Instituto Alberto Luiz Coimbra de Pós-Graduação e Pesquisa em Engenharia) division (Table IX). Results show that papers published by Petrobras or in conjunction with UFRJ tend to have a lower impact than papers published by other universities, depending on the field of knowledge.

Table IX
Impact of publications with Petrobras (SciVal).

Looking at clusters (Figure S2), only Embraer shows RD&I impact in line with major companies. As seen in Figure S3a, the collaboration of Petrobras with universities in Brazil and abroad is less than optimum. While other companies tend to collaborate more with institutions with a higher impact on scientific output, Petrobras does not follow the same model. Its top collaborators do not differ from the mean impact. This may be several-fold, but one reason may be the lack of open calls and competition for these research grants. There is no clear frontier between the federal government and Petrobras (Ribeiro & Furtado 2015RIBEIRO CG & FURTADO AT. 2015. A política de compras da Petrobras: o caso da P-51. Rev Bras Inov 14: 289-312.), so political actions often precede technical ones (Tõnurist & Karo 2016TÕNURIST P & KARO E. 2016. State owned enterprises as instruments of innovation policy. Annals Pub Coop Econ 87: 623-648.). Gay (2014)GAY C. 2014. Why is patent production so comparatively low at Petrobras? 3.03.2015, http://bibliotecadigital.fgv.br/dspace/bitstream/handle/10438/13312/petrobras_thesis_Christopher%20Gay.pdf?sequence=1&isAllowed=y.
http://bibliotecadigital.fgv.br/dspace/b...
argued that its innovation strengths are not presented through patent statistics but through applied engineering skills for domestic development and the customisation of oil industry technologies. Nevertheless, Brazilian companies publish in the same fields as their international counterparts, but their research shows a lower citation impact. This may have several reasons. While their major collaborator in Brazil is the Federal University of Rio de Janeiro, this collaboration has almost always had a lower impact than other universities in the country and abroad (Table SIII).

In the case of foreign collaboration, where Petrobras collaborates with the same universities as other major oil companies (Table SV), the impact of the science produced is almost always of low impact (taking one as the world mean in the specific field of knowledge) and of lower quality than that produced by the other companies. Petrobras collaborates significantly more in Engineering and Material Science than other companies and substantially less in Earth and Planetary Sciences (Fig. S2). The impact of the papers produced by Petrobras is lowest for all companies in all areas of knowledge examined (Fig. S2c), and only in Earth & Planetary Sciences is it greater than 1 (the world mean), while most other companies are above 1 in all areas.

The network analysis (Figure 8) shows poor institutional network construction with these companies. Most collaborations are with Brazilian institutions and researchers, but these tend not to form solid networks but instead rely on individual collaborations.

Figure 8
Co-author bibliographic mapping networks for Brazilian companies a), b) and c) for Embraer and d), e) and f) for Petrobras, by collaborating country, researchers and institutions respectively.

DISCUSSION

The question of sovereignty in science is essential in constructing national identities (Strasser 2009STRASSER B. 2009. The coproduction of neutral science and neutral State in Cold War Europe: Switzerland and international scientific cooperation, 1951–69. In: Harrison C, Johnson A (Eds), National Identify: The Role of Science and Technology. Chicago: University of Chicago Press, p. 165-187.), with a strong correlation between the quality of science produced in a country and that country’s development (Meyer et al. 2010MEYER M, DEBACKERE K & GLÄNZEL W. 2010. Can applied science be ‘good science’? Exploring the relationship between patent citations and citation impact in nanoscience. Scientometrics 85: 527-539.). Figueredo (2014) described innovation activities, including patenting and Research & Development, as key to the process and correlated with expenditure (Griliches 1990GRILICHES Z. 1990. Patent statistics as economic indicators: a survey. J Econ Lit 28(4): 1661-1707.). Patent citations are also used to indicate patent quality (Guan & Gao 2009GUAN JC & GAO X. 2009. Exploring the h-index at patent level. J Amer Soc Inform Sci Tech 60(1): 35-40., Hu et al. 2012HU X, ROUSSEAU R & CHEN J. 2012. A new approach for measuring the value of patents based on structural indicators for ego patent citation networks. J Amer Soc Inform Sci Tech 63(9): 18341842.). Hsu et al. (2021)HSU DH, HSU PH & ZHAO Q. 2021. Rich on paper? Chinese firms’ academic publications, patents, and market value. Res Pol 50: 104319. https://doi.org/10.1016/j.respol.2021.104319.
https://doi.org/10.1016/j.respol.2021.10...
showed that companies’ basic knowledge of technological advances comes from scientific journals and publications that can affect their commercial value (Arora et al. 2018ARORA A, BELENZON S & PATACCONI S. 2018. The decline of science in corporate R&D. Strat Manag J 39: 3-32. https://doi.org/10.1002/smj.2693.
https://doi.org/10.1002/smj.2693...
). In light of the results presented here, these point to a lack of innovation quantity and quality in Brazilian firms.

Brazil, like other countries, uses several methods to stimulate RD&I. These include tax incentives, for example, Lei do Bem 11.196/2005 (Brasil 2005BRASIL. 2005. Lei n. 11.196, de 21 de novembro de 2005. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2005/lei/l11196.
http://www.planalto.gov.br/ccivil_03/_at...
); Law 11.774/2008 (Brasil 2008BRASIL. 2008. Lei n. 11.774, de 17 de setembro de 2008. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2007-2010/2008/lei/l11774.
http://www.planalto.gov.br/ccivil_03/_at...
); Informatics Law 13.674/2018 (Brasil 2018a); Innovation Law 10.973/2004 (Brasil 2004BRASIL. 2004. Lei n. 10.973, de 2 de dezembro de 2004. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2004/lei/l10.973.
http://www.planalto.gov.br/ccivil_03/_at...
) and Regulatory Framework for Innovation (Brasil 2016aBRASIL. 2016. Lei n. 13.243, de 11 de janeiro de 2016. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2016/lei/l13243.
http://www.planalto.gov.br/ccivil_03/_at...
). Indirect support for science and technology from the State comes from subsidies in the form of low-interest loans such as BNDES shares (Cirani et al. 2016CIRANI CBS, KONO CM, DOS SANTOS AM & CASSIA AR. 2016. O papel das agências públicas de fomento à inovação no Brasil. Braz Bus Rev 13: 210-230.), credit guarantees, equity investment programs, and venture capital programs. The innovation discourse is exaggerated at the expense of a balanced view of the necessary relationship between investments in basic and applied research and Innovation (Arbix et al. 2017ARBIX G, SALERNO MS AMARAL G & LINS LM. 2017. Avanços, equívocos e instabilidade das políticas de inovação no Brasil. Novos estudos CEBRAP 36: 9-27.). Successive plans such as the National CT&I Plan (PNCTI), Industrial, Technological and Foreign Trade Policy (PITCE), Brasil Maior Plan (PBM), and National Knowledge Platforms Program (PNPC) lack a clear definition of instruments, resources and governance for implementation, as well as continuity (Baeta Neves et al. 2020BAETA NEVES AAB, MCMANUS C & DE CARVALHO CH. 2020. The Impact of Graduate Studies and Science in Brazil: an analysis in the light of the indicators. Revista NUPEM 12(27): 254-276.). A bigger problem is the inability to set priorities. According to Arbix et al. (2017)ARBIX G, SALERNO MS AMARAL G & LINS LM. 2017. Avanços, equívocos e instabilidade das políticas de inovação no Brasil. Novos estudos CEBRAP 36: 9-27., when many sectors are chosen as a priority, the ability of public agencies to react is diluted, and too many priorities are the same as none.

Several instruments and programs supporting RD&I in Brazil are hampered by the lack of continuity of the allocated resources. Additionally, most of these instruments and programs are driven much more by supply than demand. This second aspect is associated with the difficulty of establishing priorities, as pointed out earlier. Fostering demand-driven RD&I also allows innovation policies to be focused on solving structural problems such as sanitation, housing, etc., and developing strategic areas such as bioeconomy, renewable energy, water security, etc. Existing instruments that use the State’s purchasing power, such as public contracts for innovative solutions, competitive dialogues, and competitions for Innovation, among others, represent effective partnerships between government and companies to foster Innovation. These instruments are widely used in more innovative countries and need to be used more in Brazil.

Oil companies’ obligation to invest in RD&I is part of a specific contract clause for exploration, development and production. The RD&I clause establishes the application of a percentage of the gross revenue from production depending on each type of contract. The National Agency regulates this for Petroleum, Gas, and Biofuels (ANP). Mancini & Paz (2018)MANCINI L & PAZ MJ. 2018. Oil sector and technological development: effects of the mandatory research and development (R&D) investment clause on oil companies in Brazil. Res Pol 58: 131-143. show that it had a minor impact on fostering the relations between oil and service companies, and technology-based firms have played only a minor role. The same authors stated that Petrobras invested most of what it was not compelled to transfer to the STOs (Science and Technology Organizations) into its research Centre (CENPES), different from other companies, which may explain, in part, their low impact. Although more than 70 STOs were involved in the Thematic Network (De Negri & Squeff 2016DE NEGRI FO & SQUEFF FDHSO. 2016. Sistemas setoriais de inovação e infraestrutura de pesquisa no Brasil. Brasília: IPEA: FINEP: CNPq, 637 p.), most went to UFRJ (Mancini & Paz 2018MANCINI L & PAZ MJ. 2018. Oil sector and technological development: effects of the mandatory research and development (R&D) investment clause on oil companies in Brazil. Res Pol 58: 131-143.).

However, the understanding of what these laws do or do not allow is conditioned by the guidance of public spending control bodies and public administration rules in general (Federal Accounts Tribunal – Tribunal de Contas da União – TCU; Solicitor General of Brazil - Advogacia Geral da União – AGU; Judicial Power in Brazil - Poder Juridico da União – PJU), and entities representing the judiciary responsible for the defence of interests, such as the Public Defender’s Office (Ministério Público) that may be affected by public managers’ acts (McManus et al. 2020). These entities have a bureaucratic attitude and minor sensitivity to research management’s peculiarities in universities and other academic institutions (Almeida 2014)ALMEIDA FD 2014. As elites da justiça: instituições, profissões e poder na política da justiça brasileira. Rev Sociol Política 22: 77-95., especially in international collaborations. They are also more focused on control rather than outcome (Silva & Guimarães 2015SILVA LM & GUIMARÃES PBV. 2015. Law and innovation policies: an analysis of the mismatch between Innovation public policies and their results in Brazil. Law Devel Rev 9: 1-57.), with a focus on “what is permitted is only what the law says” (Meirelles 2005MEIRELLES HL. 2005. Direito administrativo brasileiro. São Paulo: Malheiros.).

Institutional inefficiency with University-Industry partnerships operates in the scientific scenario of inexperienced governance concerning technology transfer (TT) (Alves et al. 2015ALVES ADS, QUELHAS OLG, DA SILVA MHT & LAMEIRA VDJ. 2015. On the role of university in the promotion of Innovation: exploratory evidences from a university-industry cooperation experience in Brazil. Int J Innov Learn 17(1): 1-18., Silva & Guimarães 2015SILVA LM & GUIMARÃES PBV. 2015. Law and innovation policies: an analysis of the mismatch between Innovation public policies and their results in Brazil. Law Devel Rev 9: 1-57.), in addition to substantial bureaucratic barriers in universities, public institutions, and research institutes (Freitas et al. 2013FREITAS IMB, MARQUES RA & SILVA EMP. 2013. University-industry collaboration and Innovation in emergent and mature industries in new industrialised countries. Res Pol 42: 443-453.) that result in informal partnerships (Dewes et al. 2015DEWES MF, DALMARCO G & PADULA AD. 2015 Innovation policies in Brazilian and Dutch aerospace industries: how sectors driven by national procurement are influenced by its S&T environment. Space Pol 34: 32-38.). Thus, researchers tend not to fully disclose their knowledge transfer activities to managers and/or administrators (Landry et al. 2010LANDRY R, SAÏHI M, AMARA N & OUIMET M. 2010. Evidence on how academics manage their portfolio of knowledge transfer activities. Res Pol 39: 1387-1403.). According to Schwartzman (2002)SCHWARTZMAN S. 2002. A pesquisa científica e o interesse público. Rev Bras Inov 1: 361-395., the public sector is the leading partner and potential user of the knowledge generated by research in developing countries.

Wagner et al. (2015)WAGNER CS & PARK HW & LEYDESDORFF L. 2015. The continuing growth of global cooperation networks in research: A conundrum for national governments. PloS One 10: e0131816. hypothesise that how research is financed and measured may distract top thinkers from focusing on local needs. The shift towards global collaboration may present competition for rapid local assimilation of research results. These same authors show that the international system is highly influential in national, regional, and local scientific investment. This is discussed by Sampaio & Bonacelli (2018)SAMPAIO RM & BONACELLI MBM. 2018. Biodiesel in Brazil: Agricultural R&D at Petrobras Biocombustível. J Tech Manag Innov 13: 66-74. https://dx.doi.org/10.4067/S0718-27242018000100066.
https://doi.org/10.4067/S0718-2724201800...
in the case of biodiesel production in Brazil, where the formation of agricultural research networks favoured the construction of knowledge, research infrastructures and training of people but did not innovate biodiesel production. According to Gay (2014)GAY C. 2014. Why is patent production so comparatively low at Petrobras? 3.03.2015, http://bibliotecadigital.fgv.br/dspace/bitstream/handle/10438/13312/petrobras_thesis_Christopher%20Gay.pdf?sequence=1&isAllowed=y.
http://bibliotecadigital.fgv.br/dspace/b...
, Petrobras’ low patent intensity is influenced by cultural, institutional and firm-specific factors. This author highlights how personal networks, bureaucracy, paperwork, and authoritarian leadership, leading to a lack of trust, affect the firm’s results.

There is also a lack of strategic planning, both at the institutional level and in public policies, with clear goals in the short, medium and long term (Szapiro et al. 2016SZAPIRO M, VARGAS MA & CASSIOLATO JE. 2016. Avanços e limitações da política de inovação brasileira na última década: Uma análise exploratória. Rev Espacios 37: 18.). Foreign companies show a higher impact with their top 10 partner institutions in Brazil (about 30%) than the Impact Factor of all their partners (McManus & Baeta Neves 2021MCMANUS C & BAETA NEVES AA. 2021. Some insights into Internationalisation of Postgraduate Education from The Brazilian Perspective. In: Marilia M, Carla C, Cristina E & Craig W (Eds), Internationalisation of Higher Education: practices and reflections from Brazil and Australia. 1ed.Porto Alegre: EdiPUCRS and Brazilian Embassy, p. 317-350.), different from that seen here.

Studies show that patenting rates are low (Arundel & Kabla 1998ARUNDEL A & KABLA I. 1998. What percentage of innovations are patented? empirical estimates for European firms. Res Pol 27: 127-141) and depend on firm size. They are higher among firms that find patents an important method for preventing competitors from copying product and process innovations. This same study showed that firms that find secrecy an essential protection method for product innovations are less likely to patent. Still, secrecy has little effect on the propensity to patent process innovations. Regarding Petrobras, organisational and geographical diversity has positively affected focal organisations’ innovation performance through improving technological diversification (Zhang & Tang 2018ZHANG G & TANG C. 2018. How R&D partner diversity influences innovation performance: an empirical study in the nano-biopharmaceutical field. Scientometrics 116: 1487-1512. https://doi.org/10.1007/s11192-018-2831-6.
https://doi.org/10.1007/s11192-018-2831-...
). Petrobras’ research budget is divided into internal calls or discretionary distribution of funds without open competition. Embraer (private) shows better results (Maculan 2013MACULAN AM. 2013. Embraer and the growth of the Brazilian aircraft industry. Int J Tech Global 7: 41-59.). This may be due to strategic network partnerships (Fonseca et al. 2017FONSECA BDPFE, SILVA MVPD, ARAÚJO KMD, SAMPAIO RB & MORAES MO. 2017. Network analysis for science and technology management: evidence from tuberculosis research in Fiocruz, Brazil. PLoS One 12(8): e0181870.), improved governance (Silva et al. 2019SILVA MVPD, FONSECA FL, FONSECA BDPF, GUINDALINI C, FERRARI R & SANTOS PXD. 2019. Science, technology and Innovation indicators to support research management: the case of Oswaldo Cruz Foundation (Fiocruz). https://www.arca.fiocruz.br/bitstream/handle/icict/35425/ISSI2019_Observatorio_v10.pdf;jsessionid=CEC79BE4FE85DC43FEF4ABD9122BFC35?sequence=2.
https://www.arca.fiocruz.br/bitstream/ha...
), open access policy (Pinto & Costa 2019PINTO E & COSTA M. 2019. Dimensions of open science in open access policies to scientific knowledge: an analysis of the open access policies of Fundação Oswaldo Cruz (FIOCRUZ), Welcome Trust & National Institute of Health (NIH). http://eprints.rclis.org/38830/.
http://eprints.rclis.org/38830/...
), science dissemination (Mansur et al. 2021MANSUR V, GUIMARÃES C, CARVALHO MS, LIMA LDD & COELI CM 2021. From academic publication to science dissemination. Cad Saúde Púb 37: e00140821.) and international collaboration (Roa & Silva 2015ROA AC & SILVA FRB. 2015. Fiocruz as an actor in Brazilian foreign relations in the context of the Community of Portuguese-Speaking Countries: an untold story. História, Ciências, Saúde-Manguinhos 22: 153-169.).

The sector of activity has a strong influence on product patent propensities but minimal effect on process patent propensities after controlling for the impact of other factors. Huang & Cheng (2015)HUANG K-F & CHENG T-C. 2015. Determinants of firms’ patenting or not patenting behaviors. J Eng Tech Manag 36: 52-77. https://doi.org/10.1016/j.jengtecman.2015.05.003.
https://doi.org/10.1016/j.jengtecman.201...
look at determinants of firms’ patenting behaviours and found that larger firms and firms that exhibit a strong commitment to RD&I collaborations with universities have a lower propensity for non-patenting behaviours. Emodi et al. (2015)EMODI NV, BAYARAA Z & YUSUF SD. 2015. Energy Technology Innovation in Brazil. Int J Energy Econ Policy 5:263-287 showed that Brazilian patenting was very low compared to the investment. Patenting may be misleading for assessing the innovativeness of the oil sector (Gay 2014GAY C. 2014. Why is patent production so comparatively low at Petrobras? 3.03.2015, http://bibliotecadigital.fgv.br/dspace/bitstream/handle/10438/13312/petrobras_thesis_Christopher%20Gay.pdf?sequence=1&isAllowed=y.
http://bibliotecadigital.fgv.br/dspace/b...
), as State Owned Enterprises (SOE) are often adopters/emulators or incremental adjusters of critical technologies as opposed to original innovators. Most of their use of Innovation is often either incremental and/or not patentable. Enforcement capabilities are also necessary (Papageorgiadis & Sharma 2016PAPAGEORGIADIS N & SHARMA A. 2016. Intellectual property rights and innovation: A panel analysis. Econ Let 141: 70-72. https://doi.org/10.1016/j.econlet.2016.01.003.
https://doi.org/10.1016/j.econlet.2016.0...
).

Other types of measures of scholarly impact also exist which are not reflected in traditional citations as well as other forms of scientific communication among scholars, which are not necessarily connected to knowledge production directly (Chi et al. 2019CHI PS, GORRAIZ J & GLÄNZEL W. 2019. Comparing capture, usage and citation indicators: an altmetric analysis of journal papers in chemistry disciplines. Scientometrics 120: 1461-1473. https://doi.org/10.1007/s11192-019-03168-y.
https://doi.org/10.1007/s11192-019-03168...
), such as usage, captures, mentions and social media and show different aspects of research impact.

Glänzel et al. (1999)GLÄNZEL W, SCHUBERT A & CZERWON H. 1999. A bibliometric analysis of international scientific cooperation of the European Union (1985–1995). Scientometrics 45(2): 185-202. found that international cooperation is particularly advantageous for less advanced countries; network participation should enhance that advantage because it enables efficient collective search. The overall system (global and national) may become more productive and efficient but at the expense of national visibility and local connectivity. The need for science in networks and collaboration is also becoming more evident (OECD 2015OECD. 2015. Inquiries into Intellectual Property’s Economic Impact. OECD Publishing, Paris.). While the WIPO (2021)WIPO. 2021. World Intellectual Property Indicators 2021. https://www.wipo.int/publications/en/details.jsp?id=4571.
https://www.wipo.int/publications/en/det...
reports the quality of science and technology as fundamental to the quality of Innovation in the country, results here show that collaboration should be built on the best results and not those institutions that are physically close or where researchers have been formed or have close work ties.

Important international universities, such as Sweden, have adopted bolder policies in Innovation (Prokop 2021PROKOP D. 2021. University entrepreneurial ecosystems and spinoff companies: Configurations, developments and outcomes. Technovation 107: 102286.). They are moving towards other models of value appropriation beyond the dynamics of patenting and licensing of knowledge generated by scientific and technological research, involving the generation of academic spinoffs (Meoli et al. 2013MEOLI M, PALEARI S & VISMARA S. 2013. Completing the technology transfer process: M&As of science-based IPOs. Small Bus Econ 40: 227-248.). These startups, of the spinoff type, represent another innovation measurement mechanism in the dynamics of University – Company – Government interaction. It is vital to move forward in evaluating this process, seeking reliable data regarding the generation of startups in the academic context as an essential and modern mechanism for generating value derived from the dynamics of transforming knowledge into wealth, which characterises Innovation. Brazil shows some successful examples (Dal-Soto et al. 2021DAL-SOTO F, SOUZA YSD & BENNER M. 2021. Basilar pathways towards an entrepreneurial university model. Educ Rev 37. https://doi.org/10.1590/0102-469820291.
https://doi.org/10.1590/0102-469820291...
). These new mechanisms related to spinoff startups developed in the research context must be incorporated into the analysis of Innovation in a complementary way, yet no less important than the traditional analysis of patents and licensing.

CONCLUSIONS

Brazilian investment in science requires competition to flourish. Maintaining long-term research contracts without sunset clauses and effectively evaluating the resources employed is no longer possible. Brazilian science is used as a citation basis for patenting companies and universities worldwide but tends not to use this as a patenting source. USP is the major cited university, and Unicamp has more patents (both in the State of São Paulo). Brazilian universities, coupled with their foreign counterparts in academic-corporate collaboration, especially in the USA and Europe, can help increase the impact of scientific studies.

ACKNOWLEDGMENTS

To Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES, Code 001) and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) for financing. The authors declare no conflict of interest.

  • 1
    https://oec.world/en/profile/country/bra/
  • 2
    https://www.wipo.int/edocs/pubdocs/en/wipo_pub_gii_2021.pdf
  • 3
    https://www.wipo.int/portal/en/index.html
  • 4
    https://www.gov.br/inpi/pt-br
  • 5
    https://sucupira.capes.gov.br/sucupira/
  • 6
    https://companiesmarketcap.com/brazil/largest-companies-in-brazil-by-market-cap/

SUPPLEMENTARY MATERIAL

Tables SI-SV.

Figures S1-S3.

REFERENCES

  • ALMEIDA FD 2014. As elites da justiça: instituições, profissões e poder na política da justiça brasileira. Rev Sociol Política 22: 77-95.
  • ALVES ADS, QUELHAS OLG, DA SILVA MHT & LAMEIRA VDJ. 2015. On the role of university in the promotion of Innovation: exploratory evidences from a university-industry cooperation experience in Brazil. Int J Innov Learn 17(1): 1-18.
  • ARBIX G, SALERNO MS AMARAL G & LINS LM. 2017. Avanços, equívocos e instabilidade das políticas de inovação no Brasil. Novos estudos CEBRAP 36: 9-27.
  • ARORA A, BELENZON S & PATACCONI S. 2018. The decline of science in corporate R&D. Strat Manag J 39: 3-32. https://doi.org/10.1002/smj.2693.
    » https://doi.org/10.1002/smj.2693
  • ARUNDEL A & KABLA I. 1998. What percentage of innovations are patented? empirical estimates for European firms. Res Pol 27: 127-141
  • BAETA NEVES AAB, MCMANUS C & DE CARVALHO CH. 2020. The Impact of Graduate Studies and Science in Brazil: an analysis in the light of the indicators. Revista NUPEM 12(27): 254-276.
  • BRASIL. 2004. Lei n. 10.973, de 2 de dezembro de 2004. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2004/lei/l10.973
    » http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2004/lei/l10.973
  • BRASIL. 2005. Lei n. 11.196, de 21 de novembro de 2005. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2005/lei/l11196
    » http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2005/lei/l11196
  • BRASIL. 2008. Lei n. 11.774, de 17 de setembro de 2008. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2007-2010/2008/lei/l11774
    » http://www.planalto.gov.br/ccivil_03/_ato2007-2010/2008/lei/l11774
  • BRASIL. 2016. Lei n. 13.243, de 11 de janeiro de 2016. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2016/lei/l13243
    » http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2016/lei/l13243
  • BRASIL. 2018. Lei n. 13.674, de 11 de junho de 2018. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2018/lei/L13674
    » http://www.planalto.gov.br/ccivil_03/_ato2015-2018/2018/lei/L13674
  • BRASIL. 2019. Lei n. 13.800, de 4 de janeiro de 2019. Brasília: Presidência da República. Recuperado de: http://www.planalto.gov.br/ccivil_03/_ato2019-2022/2019/lei/L13800
    » http://www.planalto.gov.br/ccivil_03/_ato2019-2022/2019/lei/L13800
  • CAVALHEIRO G, JOIA LA & VEENSTRA A. 2016. Examining the trajectory of a standard for patent classification: an institutional account of a technical cooperation between EPO and USPTO. Tech Soc 46: 10-17. https://doi.org/10.1016/j.techsoc.2016.04.004.
    » https://doi.org/10.1016/j.techsoc.2016.04.004
  • CHEN L. 2017. Do patent citations indicate knowledge linkage? The evidence from text similarities between patents and their citations. J Inform 11(1): 63-79.
  • CHI PS, GORRAIZ J & GLÄNZEL W. 2019. Comparing capture, usage and citation indicators: an altmetric analysis of journal papers in chemistry disciplines. Scientometrics 120: 1461-1473. https://doi.org/10.1007/s11192-019-03168-y.
    » https://doi.org/10.1007/s11192-019-03168-y
  • CIRANI CBS, KONO CM, DOS SANTOS AM & CASSIA AR. 2016. O papel das agências públicas de fomento à inovação no Brasil. Braz Bus Rev 13: 210-230.
  • DAL-SOTO F, SOUZA YSD & BENNER M. 2021. Basilar pathways towards an entrepreneurial university model. Educ Rev 37. https://doi.org/10.1590/0102-469820291
    » https://doi.org/10.1590/0102-469820291
  • DE NEGRI FO & SQUEFF FDHSO. 2016. Sistemas setoriais de inovação e infraestrutura de pesquisa no Brasil. Brasília: IPEA: FINEP: CNPq, 637 p.
  • DEWES MF, DALMARCO G & PADULA AD. 2015 Innovation policies in Brazilian and Dutch aerospace industries: how sectors driven by national procurement are influenced by its S&T environment. Space Pol 34: 32-38.
  • EMODI NV, BAYARAA Z & YUSUF SD. 2015. Energy Technology Innovation in Brazil. Int J Energy Econ Policy 5:263-287
  • FONSECA BDPFE, SILVA MVPD, ARAÚJO KMD, SAMPAIO RB & MORAES MO. 2017. Network analysis for science and technology management: evidence from tuberculosis research in Fiocruz, Brazil. PLoS One 12(8): e0181870.
  • FREITAS IMB, MARQUES RA & SILVA EMP. 2013. University-industry collaboration and Innovation in emergent and mature industries in new industrialised countries. Res Pol 42: 443-453.
  • GAY C. 2014. Why is patent production so comparatively low at Petrobras? 3.03.2015, http://bibliotecadigital.fgv.br/dspace/bitstream/handle/10438/13312/petrobras_thesis_Christopher%20Gay.pdf?sequence=1&isAllowed=y.
    » http://bibliotecadigital.fgv.br/dspace/bitstream/handle/10438/13312/petrobras_thesis_Christopher%20Gay.pdf?sequence=1&isAllowed=y
  • GAZNI A. 2020. The growing number of patent citations to scientific papers: Changes in the world, nations, and fields. Tech Soc 62: 101276.
  • GLÄNZEL W, SCHUBERT A & CZERWON H. 1999. A bibliometric analysis of international scientific cooperation of the European Union (1985–1995). Scientometrics 45(2): 185-202.
  • GRILICHES Z. 1990. Patent statistics as economic indicators: a survey. J Econ Lit 28(4): 1661-1707.
  • GUAN JC & GAO X. 2009. Exploring the h-index at patent level. J Amer Soc Inform Sci Tech 60(1): 35-40.
  • HSU DH, HSU PH & ZHAO Q. 2021. Rich on paper? Chinese firms’ academic publications, patents, and market value. Res Pol 50: 104319. https://doi.org/10.1016/j.respol.2021.104319.
    » https://doi.org/10.1016/j.respol.2021.104319
  • HU X, ROUSSEAU R & CHEN J. 2012. A new approach for measuring the value of patents based on structural indicators for ego patent citation networks. J Amer Soc Inform Sci Tech 63(9): 18341842.
  • HUANG K-F & CHENG T-C. 2015. Determinants of firms’ patenting or not patenting behaviors. J Eng Tech Manag 36: 52-77. https://doi.org/10.1016/j.jengtecman.2015.05.003.
    » https://doi.org/10.1016/j.jengtecman.2015.05.003
  • IIZUKA M & HOLLANDERS H 2017. The need to customise innovation indicators in developing countries. UNU-MERIT Working Paper Series. The Netherlands: Maastricht University.
  • KUHN J, YOUNGE K & MARCO A. 2020. Patent citations reexamined. RAND J Econ 51: 109-132.
  • LANDRY R, SAÏHI M, AMARA N & OUIMET M. 2010. Evidence on how academics manage their portfolio of knowledge transfer activities. Res Pol 39: 1387-1403.
  • MACULAN AM. 2013. Embraer and the growth of the Brazilian aircraft industry. Int J Tech Global 7: 41-59.
  • MAGGIONI MA & UBERTI TE. 2011. Networks and geography in the economics of knowledge flows. Qual Quant 45: 1031-1051.
  • MANCINI L & PAZ MJ. 2018. Oil sector and technological development: effects of the mandatory research and development (R&D) investment clause on oil companies in Brazil. Res Pol 58: 131-143.
  • MANSUR V, GUIMARÃES C, CARVALHO MS, LIMA LDD & COELI CM 2021. From academic publication to science dissemination. Cad Saúde Púb 37: e00140821.
  • MCMANUS C & BAETA NEVES AA. 2021. Some insights into Internationalisation of Postgraduate Education from The Brazilian Perspective. In: Marilia M, Carla C, Cristina E & Craig W (Eds), Internationalisation of Higher Education: practices and reflections from Brazil and Australia. 1ed.Porto Alegre: EdiPUCRS and Brazilian Embassy, p. 317-350.
  • MCMANUS C, BAETA NEVES AA & PRATA AT. 2021. Scientific publications from non-academic sectors and their impact. Scientometrics 126: 8887-8911.
  • MEIRELLES HL. 2005. Direito administrativo brasileiro. São Paulo: Malheiros.
  • MEOLI M, PALEARI S & VISMARA S. 2013. Completing the technology transfer process: M&As of science-based IPOs. Small Bus Econ 40: 227-248.
  • MEYER M, DEBACKERE K & GLÄNZEL W. 2010. Can applied science be ‘good science’? Exploring the relationship between patent citations and citation impact in nanoscience. Scientometrics 85: 527-539.
  • MINGERS J & LEYDESDORFF L. 2015. A review of theory and practice in scientometrics. Eur J Oper Res 246: 1-19.
  • OECD. 2015. Inquiries into Intellectual Property’s Economic Impact. OECD Publishing, Paris.
  • OH G, KIM HY & PARK A. 2017. Analysis of technological Innovation based on citation information. Qual Quant 51: 1065. https://doi.org/10.1007/s11135-016-0460-9.
    » https://doi.org/10.1007/s11135-016-0460-9
  • PAPAGEORGIADIS N & SHARMA A. 2016. Intellectual property rights and innovation: A panel analysis. Econ Let 141: 70-72. https://doi.org/10.1016/j.econlet.2016.01.003.
    » https://doi.org/10.1016/j.econlet.2016.01.003
  • PETRUZZELLI AM, ROTOLO D & ALBINO V. 2015. Determinants of patent citations in biotechnology: An analysis of patent influence across the industrial and organisational boundaries. Tech Forecast Soc Change 91: 208-221.
  • PINTO E & COSTA M. 2019. Dimensions of open science in open access policies to scientific knowledge: an analysis of the open access policies of Fundação Oswaldo Cruz (FIOCRUZ), Welcome Trust & National Institute of Health (NIH). http://eprints.rclis.org/38830/
    » http://eprints.rclis.org/38830/
  • PROKOP D. 2021. University entrepreneurial ecosystems and spinoff companies: Configurations, developments and outcomes. Technovation 107: 102286.
  • RIBEIRO CG & FURTADO AT. 2015. A política de compras da Petrobras: o caso da P-51. Rev Bras Inov 14: 289-312.
  • ROA AC & SILVA FRB. 2015. Fiocruz as an actor in Brazilian foreign relations in the context of the Community of Portuguese-Speaking Countries: an untold story. História, Ciências, Saúde-Manguinhos 22: 153-169.
  • RUAS TL, PEREIRA L & GROSKY WI. 2017. Science, technology and innovation exploration in biophotonics through a scientometric approach. 2017 IEEE International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM). DOI: 10.1109/ICSTM.2017.8089124.
  • SAMPAIO RM & BONACELLI MBM. 2018. Biodiesel in Brazil: Agricultural R&D at Petrobras Biocombustível. J Tech Manag Innov 13: 66-74. https://dx.doi.org/10.4067/S0718-27242018000100066.
    » https://doi.org/10.4067/S0718-27242018000100066
  • SCHNEIDER BR. 2015. The developmental State in Brazil: comparative and historical perspectives. Braz J Pol Econ 35: 114-132. https://dx.doi.org/10.1590/0101-31572015v35n01a07.
    » https://doi.org/10.1590/0101-31572015v35n01a07
  • SCHWARTZMAN S. 2002. A pesquisa científica e o interesse público. Rev Bras Inov 1: 361-395.
  • SHARMA P & TRIPATHI RC. 2017. Patent citation: A technique for measuring the knowledge flow of information and Innovation. World Patent Info 51: 31-42 https://doi.org/10.1016/j.wpi.2017.11.002.
    » https://doi.org/10.1016/j.wpi.2017.11.002
  • SILVA LM & GUIMARÃES PBV. 2015. Law and innovation policies: an analysis of the mismatch between Innovation public policies and their results in Brazil. Law Devel Rev 9: 1-57.
  • SILVA MVPD, FONSECA FL, FONSECA BDPF, GUINDALINI C, FERRARI R & SANTOS PXD. 2019. Science, technology and Innovation indicators to support research management: the case of Oswaldo Cruz Foundation (Fiocruz). https://www.arca.fiocruz.br/bitstream/handle/icict/35425/ISSI2019_Observatorio_v10.pdf;jsessionid=CEC79BE4FE85DC43FEF4ABD9122BFC35?sequence=2
    » https://www.arca.fiocruz.br/bitstream/handle/icict/35425/ISSI2019_Observatorio_v10.pdf;jsessionid=CEC79BE4FE85DC43FEF4ABD9122BFC35?sequence=2
  • STRASSER B. 2009. The coproduction of neutral science and neutral State in Cold War Europe: Switzerland and international scientific cooperation, 1951–69. In: Harrison C, Johnson A (Eds), National Identify: The Role of Science and Technology. Chicago: University of Chicago Press, p. 165-187.
  • SZAPIRO M, VARGAS MA & CASSIOLATO JE. 2016. Avanços e limitações da política de inovação brasileira na última década: Uma análise exploratória. Rev Espacios 37: 18.
  • TIJSSEN RJW & WINNINK JJ. 2018. Capturing ‘R&D excellence’: indicators, international statistics, and innovative universities. Scientometrics 114: 687-699.
  • TÕNURIST P & KARO E. 2016. State owned enterprises as instruments of innovation policy. Annals Pub Coop Econ 87: 623-648.
  • TRAJTENBERG M, HENDERSON R & JAFFE A. 1997. University versus corporate patents: a window on the basicness of invention. Econ Innovat New Technol 5: 19-50.
  • VASCONCELOS C & SILVA D. 2019. Intellectual property challenges for the roads of Innovation in Brazil. Innov Manag Rev 16: 185-192. https://doi.org/10.1108/INMR-02-2019-0010.
    » https://doi.org/10.1108/INMR-02-2019-0010
  • WAGNER CS & PARK HW & LEYDESDORFF L. 2015. The continuing growth of global cooperation networks in research: A conundrum for national governments. PloS One 10: e0131816.
  • WARTBURG I, TEICHERT T & ROST K. 2005. Inventive progress measured by multi-stage patent citation analysis. Res Pol 34: 1591-1607. https://doi.org/10.1016/j.respol.2005.08.001.
    » https://doi.org/10.1016/j.respol.2005.08.001
  • WIPO. 2021. World Intellectual Property Indicators 2021. https://www.wipo.int/publications/en/details.jsp?id=4571
    » https://www.wipo.int/publications/en/details.jsp?id=4571
  • ZHANG G & TANG C. 2018. How R&D partner diversity influences innovation performance: an empirical study in the nano-biopharmaceutical field. Scientometrics 116: 1487-1512. https://doi.org/10.1007/s11192-018-2831-6.
    » https://doi.org/10.1007/s11192-018-2831-6

Publication Dates

  • Publication in this collection
    00 00 2024
  • Date of issue
    2024

History

  • Received
    19 Aug 2023
  • Accepted
    4 Nov 2023
Academia Brasileira de Ciências Rua Anfilófio de Carvalho, 29, 3º andar, 20030-060 Rio de Janeiro RJ Brasil, Tel: +55 21 3907-8100 - Rio de Janeiro - RJ - Brazil
E-mail: aabc@abc.org.br