Acessibilidade / Reportar erro

Using the Chat Generative Pre-trained Transformer in academic writing in health: a scoping review

Objective:

to map the scientific literature regarding the use of the Chat Generative Pre-trained Transformer, ChatGPT, in academic writing in health.

Method:

this was a scoping review, following the JBI methodology. Conventional databases and gray literature were included. The selection of studies was applied after removing duplicates and individual and paired evaluation. Data were extracted based on an elaborate script, and presented in a descriptive, tabular and graphical format.

Results:

the analysis of the 49 selected articles revealed that ChatGPT is a versatile tool, contributing to scientific production, description of medical procedures and preparation of summaries aligned with the standards of scientific journals. Its application has been shown to improve the clarity of writing and benefits areas such as innovation and automation. Risks were also observed, such as the possibility of lack of originality and ethical issues. Future perspectives highlight the need for adequate regulation, agile adaptation and the search for an ethical balance in incorporating ChatGPT into academic writing.

Conclusion:

ChatGPT presents transformative potential in academic writing in health. However, its adoption requires rigorous human supervision, solid regulation, and transparent guidelines to ensure its responsible and beneficial use by the scientific community.

Descriptors:
Nursing; Artificial Intelligence; Scientific and Technical Publications; Writing; Research; Health Sciences


Objetivo:

mapear la literatura científica sobre el uso del Chat Generative Pre-trained Transformer , ChatGPT, en la escritura académica en salud.

Método:

se trató de una revisión de alcance, siguiendo la metodología del JBI. Se incluyeron bases de datos convencionales y literatura gris. La selección de los estudios se realizó previa eliminación de duplicados y evaluación individual y en pares. Los datos se extrajeron basándose en un guión elaborado y se presentaron en un formato descriptivo, tabular y gráfico.

Resultados:

el análisis de los 49 artículos seleccionados reveló que ChatGPT es una herramienta versátil, que contribuye a la producción científica, descripción de procedimientos médicos y elaboración de resúmenes alineados con los estándares de las revistas científicas. Se ha demostrado que su aplicación mejora la claridad de la redacción y beneficia áreas como la innovación y la automatización. También se observaron riesgos, como la posibilidad de falta de originalidad y cuestiones éticas. Las perspectivas futuras resaltan la necesidad de una regulación adecuada, adaptación ágil y búsqueda de un equilibrio ético en la incorporación del ChatGPT a la escritura académica.

Conclusión:

ChatGPT presenta un potencial transformador en la escritura académica en el área de la salud. Sin embargo, su adopción requiere una supervisión humana rigurosa, una regulación sólida y directrices transparentes para garantizar su uso responsable y beneficioso por parte de la comunidad científica.

Descriptores:
Enfermería; Inteligencia Artificial; Publicaciones Científicas y Técnicas; Escritura; Investigación; Ciencias de la Salud


Objetivo:

mapear a literatura científica referente ao uso do Chat Generative Pre-trained Transformer , ChatGPT, na escrita acadêmica em saúde.

Método:

tratou-se de uma revisão de escopo, seguindo o método do JBI. Foram incluídas bases de dados convencionais e literatura cinzenta. A seleção dos estudos foi realizada após a remoção de duplicatas e avaliação individual e em pares. Os dados foram extraídos com base em um roteiro elaborado, e apresentados de forma descritiva, tabular e gráfica.

Resultados:

a análise dos 49 artigos selecionados mostrou que o ChatGPT é uma ferramenta versátil, que contribui para a produção científica, descrição de procedimentos médicos e elaboração de resumos alinhados aos padrões das revistas científicas. Sua aplicação melhorou a clareza da redação e beneficia áreas como inovação e automação. Também foram observados riscos, como a possibilidade de falta de originalidade e questões éticas. Perspectivas futuras destacam a necessidade de regulamentação adequada, adaptação ágil e busca por um equilíbrio ético na incorporação do ChatGPT na escrita acadêmica.

Conclusão:

o ChatGPT apresenta um potencial transformador na escrita acadêmica na área da saúde. Contudo, sua adoção requer supervisão humana rigorosa, regulamentação sólida e diretrizes transparentes para garantir seu uso responsável e benéfico pela comunidade científica.

Descritores:
Enfermagem; Inteligência Artificial; Publicações Científicas e Técnicas; Redação; Pesquisa; Ciências da Saúde


Highlights:

(1) AI has transformative potential in medical research and nursing.

(2) ChatGPT generates ideas and essays, improves coherence, and supports writing in health.

(3) Professional supervision ensures ChatGPT quality and originality in writing.

(4) It is necessary to anchor the academic use of ChatGPT in responsibility and ethics.

(5) Progress is made by expanding the literature on the multifaceted and disruptive use of the chatbot.

Introduction

Contemporary digital health is influenced by technological advances, such as the Chat Generative Pre-trained Transformer (ChatGPT), within the scope of Artificial Intelligence (AI), which demonstrates potential for improving academic writing ( 11. Sharma A, Harrington RA, McClellan MB, Turakhia MP, Eapen ZJ, Steinhubl S, et al. Using Digital Health Technology to Better Generate Evidence and Deliver Evidence-Based Care. J Am Coll Cardiol. 2018;71(23):2680-90. https://doi.org/10.1016/j.jacc.2018.03.523
https://doi.org/10.1016/j.jacc.2018.03.5...
) . The definition of AI encompasses a multidisciplinary approach to creating machines capable of performing complex tasks, including natural language processing ( 22. Sarker IH. AI-Based Modeling: Techniques, Applications and Research Issues Towards Automation, Intelligent and Smart Systems. SN Comput Sci. 2022;3(2):158. https://doi.org/10.1007/s42979-022-01043-x
https://doi.org/10.1007/s42979-022-01043...
- 33. Korteling JEH, van de Boer-Visschedijk GC, Blankendaal RAM, Boonekamp RC, Eikelboom AR. Human- versus Artificial Intelligence. Front Artif Intell. 2021;4:622364. https://doi.org/10.3389/frai.2021.622364
https://doi.org/10.3389/frai.2021.622364...
) .

ChatGPT is a language model, developed by the company OpenAI and launched on the market in November 2022. OpenAI is an AI research laboratory based in the United States, comprised of two institutions: a non-profit entity (OpenAI Incorporated) and a for-profit entity (OpenAI Limited Partnership). It is worth noting that there are two ways to access the ChatGPT artificial intelligence platform: free, with limited access tools and longer time to update the information that supplies the platform - the last one occurred in 2022; and paid access, without limitations (ChatGPT Plus), updated in 2023. ChatGPT, an evolution of the GPT-3 model, is specifically trained to generate responses in human language, and is applied in several areas, such as chatbots and automated writing ( 22. Sarker IH. AI-Based Modeling: Techniques, Applications and Research Issues Towards Automation, Intelligent and Smart Systems. SN Comput Sci. 2022;3(2):158. https://doi.org/10.1007/s42979-022-01043-x
https://doi.org/10.1007/s42979-022-01043...

3. Korteling JEH, van de Boer-Visschedijk GC, Blankendaal RAM, Boonekamp RC, Eikelboom AR. Human- versus Artificial Intelligence. Front Artif Intell. 2021;4:622364. https://doi.org/10.3389/frai.2021.622364
https://doi.org/10.3389/frai.2021.622364...
- 44. Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al. Language models are few-shot learners. Adv Neural Inf Process Syst [Internet]. 2020 [cited 2023 Jun 07];33:1877-901. Available from: https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
https://proceedings.neurips.cc/paper/202...
) .

Chatbots are activated by a simple language instruction, also known as a “prompt”, provided by the user, and generate responses based on statistical and probabilistic language models ( 55. Wu T, He S, Liu J, Sun S, Liu K, Han QL, et al. A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development. IEEE/CAA J Autom Sinica. 2023;10(5):1122-36. https://doi.org/10.1109/JAS.2023.123618
https://doi.org/10.1109/JAS.2023.123618...
) . They are widely adopted due to their ability to provide detailed answers, however, there are concerns regarding their ability to produce accurate scientific texts ( 66. Dahmen J, Kayaalp ME, Ollivier M, Pareek A, Hirschmann MT, Karlsson J, et al. Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surg Sports Traumatol Arthrosc. 2023;31(4):1187-89. https://doi.org/10.1007/s00167-023-07355-6
https://doi.org/10.1007/s00167-023-07355...
) . Studies indicate that ChatGPT can be a valuable auxiliary tool in academic writing, but human supervision is crucial to ensure its precision ( 77. Macdonald C, Adeloye D, Sheikh A, Rudan I. Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. J Glob Health. 2023;13:01003. https://doi.org/10.7189/jogh.13.01003
https://doi.org/10.7189/jogh.13.01003...
) .

Many scientific journals still do not recognize ChatGPT as an author of articles, thus highlighting the need for ethical guidelines and regulations for its responsible use ( 88. Graham F. Daily briefing: ChatGPT listed as author on research papers. Nature. 2023. https://doi.org/10.1038/d41586-023-00188-w
https://doi.org/10.1038/d41586-023-00188...

9. Else H. Abstracts written by ChatGPT fool scientists. Nature. 2023;613(7944):423. https://doi.org/10.1038/d41586-023-00056-7
https://doi.org/10.1038/d41586-023-00056...
- 1010. Liebrenz M, Schleifer R, Buadze A, Bhugra D, Smith A. Generating scholarly content with ChatGPT: ethical challenges for medical publishing. Lancet Digit Health. 2023;5(3):e105-e6. https://doi.org/10.1016/S2589-7500(23)00019-5
https://doi.org/10.1016/S2589-7500(23)00...
) . Despite the concerns raised, a proper implementation of ChatGPT and other language models can accelerate innovation in healthcare and promote diversity in research, by eliminating language barriers ( 77. Macdonald C, Adeloye D, Sheikh A, Rudan I. Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. J Glob Health. 2023;13:01003. https://doi.org/10.7189/jogh.13.01003
https://doi.org/10.7189/jogh.13.01003...
, 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
) .

Given the legitimate concerns presented regarding the potential inappropriate use of ChatGPT, it is of utmost importance to establish appropriate guidelines and regulations to ensure the safe and responsible utilization of artificial intelligence capabilities. This becomes essential to limit possible future complications and mitigate potential risks and negative results. As ChatGPT is increasingly adopted in the scientific community, particularly in healthcare, there is a pressing need to better understand its specific applications and contributions.

The selection of the approach to conduct the present study is justified by the aim of identifying the available evidence in a specific domain, which in this case refers to the use of ChatGPT in academic writing. Exploring the scientific literature in this area can reveal significant patterns, gaps, and ethical and legal implications, as well as possibilities and contributions of artificial intelligence technology, such as language models. Therefore, the present study aims to map the scientific literature regarding the use of ChatGPT in academic writing in health, with the aim of identifying trends, gaps and contributions to scientific knowledge. This will allow for a more in-depth understanding of the applications of this technology in contemporary times, as well as the associated ethical implications.

Method

This was a scoping review conducted according to the JBI methodology ( 1212. Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Implement. 2021;19(1):3-10. https://doi.org/10.1097/XEB.0000000000000277
https://doi.org/10.1097/XEB.000000000000...
) . The research protocol was registered in the Open Science Framework under registration DOI 10.17605/OSF.IO/MDKHG ( 1313. Costa ICP, Chini LT, Nascimento MC, Treviso P, Barbosa SFF, Roza BA, et al. Mapping the potential use of ChatGPT in academic writing in the health area: a scope review protocol. OSF. 2023. https://doi.org/10.17605/OSF.IO/MDKHG
https://doi.org/10.17605/OSF.IO/MDKHG...
) , and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Scoping Reviews) extension was used to report the results of the scoping analysis ( 1414. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467-73. https://doi.org/10.7326/M18-0850
https://doi.org/10.7326/M18-0850...
) .

Eligibility criteria

Taking into account the acronym “Population, Concept and Context (PCC)” to formulate the research question, the following question was obtained: What is the current panorama of scientific literature in the health area that addresses the use of ChatGPT in academic writing, including its trends, gaps and contributions to current scientific knowledge?

Publications that focus on the use of ChatGPT in the production of academic writing in the health area were considered, excluding those studies that used writing tools or technologies other than ChatGPT. Regarding sources, the review encompassed experimental and quasi-experimental studies, analytical and descriptive observational studies, qualitative approaches, systematic reviews and meta-analyses. In addition, book chapters, conference summaries, theses, dissertations and other sources of gray literature relevant to the topic were considered, such as journals and websites specialized in the health area, in order to encompass a comprehensive range of perspectives and evidence.

Information sources and literature search

The search strategy sought to locate published and unpublished studies, including gray literature, in three stages. The first step involved an initial search in PubMed and the Cumulative Index to Nursing and Allied Health Literature (CINAHL) to find relevant articles on the topic. This included identifying keywords in titles and abstracts, as well as indexed terms (MeSH/CINAHL Headings), to develop a comprehensive search strategy ( 1515. Pollock D, Peters MDJ, Khalil H, McInerney P, Alexander L, Tricco AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. 2023;21(3):520-32. https://doi.org/10.11124/JBIES-22-00123
https://doi.org/10.11124/JBIES-22-00123...
) .

The review team decided to focus only on terms related to ChatGPT in their search strategy, given the newness of the topic. The inclusion of all elements of the PCC strategy did not help to find relevant records about scientific writing, due to the current stage of publications on ChatGPT. Using more specific terms ensured a sensitive and comprehensive search, without losing the focus of the review. Therefore, the choice to use only the concept terms in the search strategy was appropriate for the objectives of this study.

The final search pilot was conducted in two databases, namely PubMed and Latin American and Caribbean Health Sciences Literature (LILACS). After identifying the relevance of the implemented strategy, as well as the possible recognition of new terms related to the ChatGPT concept, the protocol was registered. As an example, the terms used in the search strategy implemented in international databases are highlighted: ((“ChatGPT” OR “Chat GPT” OR “Generative Pre-trained Transformer” OR “Generative Pretrained Transformer” OR “GPT language model” OR “Transformer-based language models”) AND (“academic writing” OR “academic publications” OR “scientific writing” OR “scientific publications” OR “scholarly writing” OR “scholarly publications” OR “Writing for Publication” OR “text production” OR “computer-assisted writing” OR “virtual writing assistance” OR “virtual writing assistant” OR “writing automation” OR “natural language processing”)).

After this step, the definitive search was carried out on May 12, 2023, in the following databases: LILACS, PubMed, CINAHL, Embase, Scopus, Cochrane Database of Systematic Reviews and Web of Science Core Collection. Gray literature identification was searched on Google Scholar. Studies published in any language were included.

Selection of evidence sources

After searching the information sources, the identified citations were imported into the EndNote 20 software (Clarivate Analytics, PA, EUA), where duplicates were removed ( 1616. Mendes KDS, Silveira RCCP, Galvão CM. Use of the bibliographic reference manager in the selection of primary studies in integrative reviews. Texto Contexto Enferm. 2019;28:e20170204. https://doi.org/10.1590/1980-265X-TCE-2017-0204
https://doi.org/10.1590/1980-265X-TCE-20...
) . Then, the articles were exported to the Rayyan application (Rayyan Systems Inc., Cambridge, MA, USA), used to select the studies ( 1717. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. https://doi.org/10.1186/s13643-016-0384-4
https://doi.org/10.1186/s13643-016-0384-...
) .

When selecting studies, two independent evaluators analyzed the titles and abstracts, following predefined criteria for inclusion. Subsequently, the full texts of potentially relevant studies underwent a thorough analysis by the same evaluators, maintaining the same inclusion criteria. All reasons for exclusion of studies that did not meet the criteria were documented in detail. Any disagreement between evaluators during the selection process was resolved through discussion or with the intervention of a third evaluator.

Data extraction

Two independent reviewers used a script in Microsoft Excel to extract data from the studies selected in the scoping review. The extracted data included identifying information such as authors, title, year, language, journal, institution and country. Objectives, methods and main results were also collected, when applicable, following the PCC structure. This step evaluated contributions from the literature, and identified limitations, gaps, emerging trends and practical implications of using ChatGPT in academic writing ( 1818. Peters MDJ, Godfrey C, McInerney P, Khalil H, Larsen P, Marnie C, et al. Best practice guidance and reporting items for the development of scoping review protocols. JBI Evid Synth. 2022;20(4):953-68. https://doi.org/10.11124/JBIES-21-00242
https://doi.org/10.11124/JBIES-21-00242...
) . The data extraction form, as well as the guidance form for data extraction, detailing each item to be extracted, is presented in the Supplementary Material (available at: https://doi.org/10.48331/scielodata.BMQMKD ).

Data analysis and presentation

When conducting data analysis, the basic qualitative content analysis method was used, involving a combined approach of inductive analysis, followed by deductive analysis. This method is widely recognized and used in qualitative research, as well as in scoping reviews ( 1515. Pollock D, Peters MDJ, Khalil H, McInerney P, Alexander L, Tricco AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. 2023;21(3):520-32. https://doi.org/10.11124/JBIES-22-00123
https://doi.org/10.11124/JBIES-22-00123...
, 1919. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-15. https://doi.org/10.1111/j.1365-2648.2007.04569.x
https://doi.org/10.1111/j.1365-2648.2007...
) .

It began with an open coding process, in which researchers, in an impartial manner, identified pertinent concepts, themes and characteristics in the raw data, in addition to the subsequent creation of general categories ( 1515. Pollock D, Peters MDJ, Khalil H, McInerney P, Alexander L, Tricco AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. 2023;21(3):520-32. https://doi.org/10.11124/JBIES-22-00123
https://doi.org/10.11124/JBIES-22-00123...
, 1919. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-15. https://doi.org/10.1111/j.1365-2648.2007.04569.x
https://doi.org/10.1111/j.1365-2648.2007...
) . These general categories emerged inductively were used to compose the variables of interest in the extraction instrument developed by the authors.

Subsequently, the content listed among the general categories was grouped according to identical, similar and complementary ideas, a refinement that contributed to updating the categories. The deductive emergence of the new grouped categories enabled a systematic organization of results, simplifying the understanding of information and facilitating the identification of trends, patterns and relevant insights related to the research question in focus ( 1515. Pollock D, Peters MDJ, Khalil H, McInerney P, Alexander L, Tricco AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. 2023;21(3):520-32. https://doi.org/10.11124/JBIES-22-00123
https://doi.org/10.11124/JBIES-22-00123...
, 1919. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-15. https://doi.org/10.1111/j.1365-2648.2007.04569.x
https://doi.org/10.1111/j.1365-2648.2007...
) .

The search strategy and results of the selection process were presented in a PRISMA-ScR flowchart ( 1414. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467-73. https://doi.org/10.7326/M18-0850
https://doi.org/10.7326/M18-0850...
) . The extracted data was presented in a descriptive and tabular format, observing the JBI guidelines ( 1515. Pollock D, Peters MDJ, Khalil H, McInerney P, Alexander L, Tricco AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. 2023;21(3):520-32. https://doi.org/10.11124/JBIES-22-00123
https://doi.org/10.11124/JBIES-22-00123...
) . Additionally, synthesis images and a worldwide choropleth map were generated, representing the percentage of articles published by country, with the aim of presenting the results in a visual and graphical way.

It should be noted that ChatGPT was not used in the textual preparation of this article, nor as a co-author responsible for the content, but only as an auxiliary tool in the spelling and grammar review of part of the sections of the manuscript.

Results

Initially, 646 studies were found in databases and gray literature. After removing duplicates, 408 potentially eligible publications remained. The analysis of titles and abstracts led to the exclusion of 341 documents, resulting in the selection of 67 articles for full reading. After a rigorous selection process, 49 articles composed the final sample, as represented in Figure 1 .

Figure 1
- Flowchart of the study selection process according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). Ribeirão Preto, SP, Brazil, 2023

Studies characteristics

The present article focuses on the wide range of contexts in which ChatGPT has been employed, as evidenced by analysis of the 49 articles included in this review. The authors explored several application areas, ranging from issues related to scientific integrity to generating scientific summaries and conducting systematic reviews.

The thematic map presented in Figure 2 offers a proportional choropleth representation of the distribution of the articles, considering the authors’ countries of origin, with emphasis on the United States of America (USA), India and the United Kingdom.

Figure 2
- Frequency distribution of articles published by countries. Ribeirão Preto, SP, Brazil, 2023

One of the articles was published in German, while the other 48 works were available in English, as shown in Figure 3 . In addition to this information, other details are available, such as types of sources, article titles and years of publication of the 49 articles included in this review.

Figure 3
- Characterization of articles included in the scoping review. Ribeirão Preto, SP, Brazil, 2023

More information about the publications analyzed and that composed the corpus of this study can be found in the Supplementary Material (available at: https://doi.org/10.48331/scielodata.BMQMKD ).

Using ChatGPT in academic and scientific writing

According to the studies analyzed, ChatGPT proved to be versatile in different contexts. In the context of scientific integrity, ChatGPT demonstrated its ability to answer questions, highlighting its applicability in obtaining answers and information ( 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
, 3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
, 5353. Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “authors” and Implications for the Integrity of Scientific Publication and Medical Knowledge. JAMA. 2023;329(8):637-9. https://doi.org/10.1001/jama.2023.1344
https://doi.org/10.1001/jama.2023.1344...
) . In the area of the pathogenesis of medical conditions, the model was evaluated for its ability to describe pathological processes in detail, contributing to a comprehensive understanding of these phenomena ( 5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
) .

Furthermore, its ability to generate simulated studies offered support in making methodological decisions and in the development of scientific manuscripts ( 77. Macdonald C, Adeloye D, Sheikh A, Rudan I. Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. J Glob Health. 2023;13:01003. https://doi.org/10.7189/jogh.13.01003
https://doi.org/10.7189/jogh.13.01003...
) . The generation of scientific summaries through ChatGPT has also demonstrated its ability to create summaries that meet the standards required by specific journals, using selected titles and journals as a basis ( 2626. Babl FE, Babl MP. Generative artificial intelligence: Can ChatGPT write a quality abstract? Emerg Med Australasia. 2023;35(5):809-11. https://doi.org/10.1111/1742-6723.14233
https://doi.org/10.1111/1742-6723.14233...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
, 3838. Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
https://doi.org/10.7861/clinmed.2023-007...
, 4747. Valentín-Bravo FJ, Mateos-Álvarez E, Usategui-Martín R, Andrés-Iglesias C, Pastor-Jimeno JC, Pastor-Idoate S. Artificial Intelligence and new language models in Ophthalmology: Complications of the use of silicone oil in vitreoretinal surgery. Arch Soc Esp Oftalmol (Engl Ed). 2023;98(5):298-303. https://doi.org/10.1016/j.oftale.2023.04.011
https://doi.org/10.1016/j.oftale.2023.04...
) .

With regard to writing academic content, ChatGPT demonstrated its ability to contribute to the formulation of parts of articles, promoting significant improvements in clarity and textual cohesion ( 2828. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
https://doi.org/10.1111/jerd.13046...
- 2929. Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15(4):e37285. https://doi.org/10.7759/cureus.37285
https://doi.org/10.7759/cureus.37285...
, 3838. Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
https://doi.org/10.7861/clinmed.2023-007...
, 4040. Ul Haq Z, Naeem H, Naeem A, Iqbal F, Zaeem D. Comparing human and artificial intelligence in writing for health journals: an exploratory study. medRxiv. 2023 Feb 26. https://doi.org/10.1101/2023.02.22.23286322
https://doi.org/10.1101/2023.02.22.23286...
) . Its ability to distinguish between machine-generated and human-generated text has proven valuable in evaluating AI texts and, consequently, in composing editorials, covering titles, introductions and supporting references ( 2828. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
https://doi.org/10.1111/jerd.13046...
) .

ChatGPT also facilitated the optimization of the writing of scientific articles itself, assisting in the creation of drafts, literature review and improvement of the language used ( 77. Macdonald C, Adeloye D, Sheikh A, Rudan I. Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. J Glob Health. 2023;13:01003. https://doi.org/10.7189/jogh.13.01003
https://doi.org/10.7189/jogh.13.01003...
, 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
- 2626. Babl FE, Babl MP. Generative artificial intelligence: Can ChatGPT write a quality abstract? Emerg Med Australasia. 2023;35(5):809-11. https://doi.org/10.1111/1742-6723.14233
https://doi.org/10.1111/1742-6723.14233...
, 2929. Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15(4):e37285. https://doi.org/10.7759/cureus.37285
https://doi.org/10.7759/cureus.37285...
- 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
, 3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...
, 4040. Ul Haq Z, Naeem H, Naeem A, Iqbal F, Zaeem D. Comparing human and artificial intelligence in writing for health journals: an exploratory study. medRxiv. 2023 Feb 26. https://doi.org/10.1101/2023.02.22.23286322
https://doi.org/10.1101/2023.02.22.23286...
- 4141. Vaishya R, Misra A, Vaish A. ChatGPT: Is this version good for healthcare and research? Diabetes Metab Syndr. 2023;17(4):102744. https://doi.org/10.1016/j.dsx.2023.102744
https://doi.org/10.1016/j.dsx.2023.10274...
) . Its influence has also been observed in systematic reviews, where its interaction with the tool has been examined ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
) .

Regarding emerging themes, the frequency of the terms “use”, “writing”, “scientific writing”, “academic authorship”, “generation” and “impact” stands out. The topics covered range from scientific integrity and the evaluation of writing generation ( 66. Dahmen J, Kayaalp ME, Ollivier M, Pareek A, Hirschmann MT, Karlsson J, et al. Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surg Sports Traumatol Arthrosc. 2023;31(4):1187-89. https://doi.org/10.1007/s00167-023-07355-6
https://doi.org/10.1007/s00167-023-07355...
) , to specific medical cases, such as acute dacryocystitis ( 4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
) , intracranial neoplasia ( 3636. Puthenpura V, Nadkarni S, DiLuna M, Hieftje K, Marks A. Personality Changes and Staring Spells in a 12-Year-Old Child: A Case Report Incorporating ChatGPT, a Natural Language Processing Tool Driven by Artificial Intelligence (AI). Cureus. 2023;15(3):e36408. https://doi.org/10.7759/cureus.36408
https://doi.org/10.7759/cureus.36408...
) , endometrial receptivity in in vitro fertilization ( 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
) and plantar fasciitis in children ( 2626. Babl FE, Babl MP. Generative artificial intelligence: Can ChatGPT write a quality abstract? Emerg Med Australasia. 2023;35(5):809-11. https://doi.org/10.1111/1742-6723.14233
https://doi.org/10.1111/1742-6723.14233...
) .

The exploration covers the use of ChatGPT in the generation, evaluation and editing of scientific texts ( 2323. Pekşen A. Using ChatGPT in the Medical Field: A Narrative. Infect Dis Clin Microbiol. 2023;5(1):66-8. https://doi.org/10.36519/idcm.2023.227
https://doi.org/10.36519/idcm.2023.227...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
- 3131. Hallo-Carrasco A, Gruenbaum BF, Gruenbaum SE. Heat and Moisture Exchanger Occlusion Leading to Sudden Increased Airway Pressure: A Case Report Using ChatGPT as a Personal Writing Assistant. Cureus. 2023;15(4):e37306. https://doi.org/10.7759/cureus.37306
https://doi.org/10.7759/cureus.37306...
, 3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...
, 4343. Zielinski C, Winker M, Aggarwal R, Ferris L, Heinemann M, Lapeña JF, et al. Chatbots, ChatGPT, and Scholarly Manuscripts: WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications. Open Access Maced J Med Sci. 2023;11:83-86. https://doi.org/10.3889/oamjms.2023.11502
https://doi.org/10.3889/oamjms.2023.1150...
, 5858. Quintans-Júnior LJ, Gurgel RQ, Araújo AAS, Correia D, Martins-Filho PR. ChatGPT: the new panacea of the academic world. Rev Soc Bras Med Trop. 2023;56:e0060-e. https://doi.org/10.1590/0037-8682-0060-2023
https://doi.org/10.1590/0037-8682-0060-2...
, 6565. Colletti PM. Chatbots in Medical Research: Advantages and Limitations of AI-Enabled Writing With a Focus on ChatGPT as an Author. Clin Nucl Med. 2023;48(9):839. https://doi.org/10.1097/rlu.0000000000004672
https://doi.org/10.1097/rlu.000000000000...
- 6666. Kundalia ND. ChatGPT and the future of writing [Internet]. 2023 [cited 2023 Jul 20]. Available from: https://www.hindustantimes.com/books/chatgpt-and-the-future-of-writing-101675090609362.html
https://www.hindustantimes.com/books/cha...
) , as well as its application in journals, academic and medical writing ( 3232. Hegde A, Srinivasan S, Menon G. Extraventricular Neurocytoma of the Posterior Fossa: A Case Report Written by ChatGPT. Cureus. 2023;15(3):e35850. https://doi.org/10.7759/cureus.35850
https://doi.org/10.7759/cureus.35850...
, 3838. Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
https://doi.org/10.7861/clinmed.2023-007...
, 5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
) , production of abstracts ( 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
) and health education ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 3838. Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
https://doi.org/10.7861/clinmed.2023-007...
) . The authors also reflect on the potential impact of ChatGPT on writing, considering its advantages and limitations, and speculate on the future of this tool in the development of scientific content ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 2424. Rahimi F, Abadi ATB. ChatGPT and publication ethics. Arch Med Res. 2023;54(3):272-4. https://doi.org/10.1016/j.arcmed.2023.03.004
https://doi.org/10.1016/j.arcmed.2023.03...
, 3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
- 3535. Lund BD, Wang T, Mannuru NR, Nie B, Shimray S, Wang Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J Assoc Inf Sci Technol. 2023;74(5):570-81. https://doi.org/10.1002/asi.24750
https://doi.org/10.1002/asi.24750...
, 3737. Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023;27(1):1-5. https://doi.org/10.1186/s13054-023-04380-2
https://doi.org/10.1186/s13054-023-04380...
, 5555. Macklon N, Garcia JV. ChatGPT and scientific publications: friend or foe? Reprod BioMed Online. 2023;47(1):1-2. https://doi.org/10.1016/j.rbmo.2023.04.007
https://doi.org/10.1016/j.rbmo.2023.04.0...
- 5656. Nayak P. Pros and Cons of using ChatGPT in scientific writing: as it identifies for itself. Indian J Physiol Allied Sci [Internet]. 2023 [cited 2023 Jul 12];75(1). Available from: https://ijpas.org/index.php/ijpas/article/view/131/89/
https://ijpas.org/index.php/ijpas/articl...
, 5959. Rozencwajg S, Kantor E. Elevating scientific writing with ChatGPT: A guide for reviewers, editors… and authors. Anesth Crit Care Pain Med. 2023;42(3):101209. https://doi.org/10.1016/j.accpm.2023.101209
https://doi.org/10.1016/j.accpm.2023.101...
, 6363. Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30:3170-3. https://doi.org/10.1245/s10434-023-13436-0
https://doi.org/10.1245/s10434-023-13436...
) . Furthermore, the researchers undertook an analysis to determine whether this AI in question should be recognized and considered as a legitimate author in academic productions ( 2222. Gurha P, Ishaq N, Marian AJ. ChatGPT and other artificial intelligence chatbots and biomedical writing. J Cardiovasc Aging. 2023;3(20):1-3. https://doi.org/10.20517/jca.2023.13
https://doi.org/10.20517/jca.2023.13...
, 3535. Lund BD, Wang T, Mannuru NR, Nie B, Shimray S, Wang Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J Assoc Inf Sci Technol. 2023;74(5):570-81. https://doi.org/10.1002/asi.24750
https://doi.org/10.1002/asi.24750...
) .

Benefits, risks, concerns and limitations

In examining the set of articles analyzed, the authors not only portrayed a diversity of ChatGPT applications, but also highlighted their benefits, risks and underlying concerns. The summary image presented in Figure 4 helps to identify the positive and negative aspects described.

Figure 4
- Benefits, risks and concerns regarding the use of ChatGPT in academic writing. Ribeirão Preto, SP, Brazil, 2023

In addition to the risks and benefits associated with using ChatGPT in academic writing, the mapped literature also highlighted the limits and restrictions of the tool today. Figure 5 illustrates the limitations of using ChatGPT in academic writing.

Figure 5
- Limitations associated with using ChatGPT in academic writing. Ribeirão Preto, SP, Brazil, 2023

Future perspectives

Finally, this review identified several perspectives related to the potential use of ChatGPT in academic writing. The analyzes revealed perspectives on several facets of this integration process, presented below:

Structure and Responsibility: The need to establish barriers and structures for the use of AI is highlighted, as well as assigning responsibility for authorship by chatbots. It is suggested that measures be adopted to fully exploit the potential of AI (5454. Fulton JS. Authorship and ChatGPT. Clin Nurse Spec. 2023;37(3):109-10. https://doi.org/10.1097/NUR.0000000000000750
https://doi.org/10.1097/NUR.000000000000...
,6060. Siegerink B, Pet LA, Rosendaal FR, Schoones JW. ChatGPT as an author of academic papers is wrong and highlights the concepts of accountability and contributorship. Nurse Educ Pract. 2023;68:103599. https://doi.org/10.1016/j.nepr.2023.103599
https://doi.org/10.1016/j.nepr.2023.1035...
,6262. Yeo-Teh NSL, Tang BL. NLP systems such as ChatGPT cannot be listed as an author because these cannot fulfill widely adopted authorship criteria. Account Res. 2023. https://doi.org/10.1080/08989621.2023.2185776
https://doi.org/10.1080/08989621.2023.21...
) .

Evolution of Chatbots and Positive Impact: The rapid evolution of chatbots is observed, with the potential to overcome current limitations. ChatGPT is recognized for accelerating innovation, optimizing academic training, improving writing and analysis skills, and bringing benefits to healthcare and research (3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
,5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
,5454. Fulton JS. Authorship and ChatGPT. Clin Nurse Spec. 2023;37(3):109-10. https://doi.org/10.1097/NUR.0000000000000750
https://doi.org/10.1097/NUR.000000000000...
) .

Modifications and Ethical Challenges: It is proposed to modify manuscript evaluation policies and practices, including the adoption of AI output detectors. Ethical concerns and the need to balance positive and negative impacts on academic writing are emphasized (1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
,2424. Rahimi F, Abadi ATB. ChatGPT and publication ethics. Arch Med Res. 2023;54(3):272-4. https://doi.org/10.1016/j.arcmed.2023.03.004
https://doi.org/10.1016/j.arcmed.2023.03...
,2929. Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15(4):e37285. https://doi.org/10.7759/cureus.37285
https://doi.org/10.7759/cureus.37285...
-3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
,3535. Lund BD, Wang T, Mannuru NR, Nie B, Shimray S, Wang Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J Assoc Inf Sci Technol. 2023;74(5):570-81. https://doi.org/10.1002/asi.24750
https://doi.org/10.1002/asi.24750...
,4747. Valentín-Bravo FJ, Mateos-Álvarez E, Usategui-Martín R, Andrés-Iglesias C, Pastor-Jimeno JC, Pastor-Idoate S. Artificial Intelligence and new language models in Ophthalmology: Complications of the use of silicone oil in vitreoretinal surgery. Arch Soc Esp Oftalmol (Engl Ed). 2023;98(5):298-303. https://doi.org/10.1016/j.oftale.2023.04.011
https://doi.org/10.1016/j.oftale.2023.04...
,4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
) .

Regulation and Technical Improvements: The importance of clear ethical guidelines and regulations for the use of AI is highlighted. The search for robust plagiarism detection tools and technical improvements is evidenced (1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
,2121. Frith KH. ChatGPT: Disruptive Educational Technology. Nurs Educ Perspect. 2023;44(3):198-9. https://doi.org/10.1097/01.NEP.0000000000001129
https://doi.org/10.1097/01.NEP.000000000...
,2323. Pekşen A. Using ChatGPT in the Medical Field: A Narrative. Infect Dis Clin Microbiol. 2023;5(1):66-8. https://doi.org/10.36519/idcm.2023.227
https://doi.org/10.36519/idcm.2023.227...
,3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
,3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...
,3838. Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
https://doi.org/10.7861/clinmed.2023-007...
-3939. Sonntagbauer M, Haar M, Kluge S. Artificial intelligence: How will ChatGPT and other AI applications change our everyday medical practice? Med Klin Intensivmed Notfmed. 2023;118:366-71. https://doi.org/10.1007/s00063-023-01019-6
https://doi.org/10.1007/s00063-023-01019...
,6262. Yeo-Teh NSL, Tang BL. NLP systems such as ChatGPT cannot be listed as an author because these cannot fulfill widely adopted authorship criteria. Account Res. 2023. https://doi.org/10.1080/08989621.2023.2185776
https://doi.org/10.1080/08989621.2023.21...
) .

Adaptation and Future of AI: There is a growing trend towards integrating AI, including ChatGPT, into academic writing, highlighting the need for rapid adaptation by researchers and editors (2020. Biswas S. ChatGPT and the future of medical writing. Radiol Soc North Am. 2023;307(2):e223312. https://doi.org/10.1148/radiol.223312
https://doi.org/10.1148/radiol.223312...
,2929. Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15(4):e37285. https://doi.org/10.7759/cureus.37285
https://doi.org/10.7759/cureus.37285...
,3232. Hegde A, Srinivasan S, Menon G. Extraventricular Neurocytoma of the Posterior Fossa: A Case Report Written by ChatGPT. Cureus. 2023;15(3):e35850. https://doi.org/10.7759/cureus.35850
https://doi.org/10.7759/cureus.35850...
,3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
,4848. Alattar AA, McDowell MM. The rise of AI co-authors: navigating the future of scientific writing with ChatGPT. J Neurosurg. 2023;139(5):1485-6. https://doi.org/10.3171/2023.3.Jns23254
https://doi.org/10.3171/2023.3.Jns23254...
,6363. Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30:3170-3. https://doi.org/10.1245/s10434-023-13436-0
https://doi.org/10.1245/s10434-023-13436...
-6464. Ali M, Ahmad N, Younus HA. Integrating chatbots (ChatGPT) in the process of manuscript writing and proposing a roadmap for their future adoption. Authorea. 2023;1-2. https://doi.org/10.22541/au.168052684.48458398/v1
https://doi.org/10.22541/au.168052684.48...
,6666. Kundalia ND. ChatGPT and the future of writing [Internet]. 2023 [cited 2023 Jul 20]. Available from: https://www.hindustantimes.com/books/chatgpt-and-the-future-of-writing-101675090609362.html
https://www.hindustantimes.com/books/cha...
) .

Automation and Enhancement: The potential for automating repetitive tasks and improving language through AI is highlighted, enabling statistical reviews and comprehensive research in the literature ( 2323. Pekşen A. Using ChatGPT in the Medical Field: A Narrative. Infect Dis Clin Microbiol. 2023;5(1):66-8. https://doi.org/10.36519/idcm.2023.227
https://doi.org/10.36519/idcm.2023.227...
) .

Collaboration and Ethics: The need for codes of ethics and guidelines for the responsible use of AI is emphasized, highlighting the importance of balancing automation and human supervision (1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
,3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
,3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
) .

Impact and Gradual Integration: The revolutionary potential of ChatGPT in scientific writing is recognized, with a trend towards gradual integration into medicine and academic research, emphasizing responsible use and development (2828. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
https://doi.org/10.1111/jerd.13046...
,3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
,3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...

34. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
-3535. Lund BD, Wang T, Mannuru NR, Nie B, Shimray S, Wang Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J Assoc Inf Sci Technol. 2023;74(5):570-81. https://doi.org/10.1002/asi.24750
https://doi.org/10.1002/asi.24750...
,5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
,5252. Elwood TW. Technological Impacts on the Sphere of Professional Journals. J Allied Health [Internet]. 2023 [cited 2023 Jun 18];52(1):1. Available from: https://pubmed.ncbi.nlm.nih.gov/36892853/
https://pubmed.ncbi.nlm.nih.gov/36892853...
,6161. Tiing Leong A, Mahesh C, Kay Choong S, Kian Keong P. The rise of artificial intelligence: addressing the impact of large language models such as ChatGPT on scientific publications. Singapore Med J. 2023;64(4):219-21. https://doi.org/10.4103/singaporemedj.SMJ-2023-055
https://doi.org/10.4103/singaporemedj.SM...
) .

Disruptive Changes and Improvements: Possible disruptive changes in science due to AI are observed, requiring adjustments in editorial policies and continuous improvements in ChatGPT, especially in medicine (2121. Frith KH. ChatGPT: Disruptive Educational Technology. Nurs Educ Perspect. 2023;44(3):198-9. https://doi.org/10.1097/01.NEP.0000000000001129
https://doi.org/10.1097/01.NEP.000000000...
,3838. Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
https://doi.org/10.7861/clinmed.2023-007...
) .

Specific Development and Impact in the Health Area: It is suggested that specific AI tools be developed for scientific needs, with attention to the potential impact on healthcare and collaboration between stakeholders (1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
,2828. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
https://doi.org/10.1111/jerd.13046...
,3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
,3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...

34. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
-3535. Lund BD, Wang T, Mannuru NR, Nie B, Shimray S, Wang Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J Assoc Inf Sci Technol. 2023;74(5):570-81. https://doi.org/10.1002/asi.24750
https://doi.org/10.1002/asi.24750...
,4040. Ul Haq Z, Naeem H, Naeem A, Iqbal F, Zaeem D. Comparing human and artificial intelligence in writing for health journals: an exploratory study. medRxiv. 2023 Feb 26. https://doi.org/10.1101/2023.02.22.23286322
https://doi.org/10.1101/2023.02.22.23286...
,5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
,5252. Elwood TW. Technological Impacts on the Sphere of Professional Journals. J Allied Health [Internet]. 2023 [cited 2023 Jun 18];52(1):1. Available from: https://pubmed.ncbi.nlm.nih.gov/36892853/
https://pubmed.ncbi.nlm.nih.gov/36892853...
,6161. Tiing Leong A, Mahesh C, Kay Choong S, Kian Keong P. The rise of artificial intelligence: addressing the impact of large language models such as ChatGPT on scientific publications. Singapore Med J. 2023;64(4):219-21. https://doi.org/10.4103/singaporemedj.SMJ-2023-055
https://doi.org/10.4103/singaporemedj.SM...
) .

These findings signal a future panorama regarding the needs, evolution, impacts and challenges of using ChatGPT in the academic context.

Discussion

The dominance of the US and UK in research on the use of ChatGPT in academic writing in health is due to their leadership in research, innovation and academic resources. These countries are highlighted in the Global Innovation Index 2022, leading the global innovation ranking. They are also home to renowned research and technology institutions, which encourages the exploration of technologies like ChatGPT, facilitating interdisciplinary collaborations. India, an emerging economy, is gaining prominence on the global innovation scene, and is among the 40 best-rated nations in the Global Innovation Index ( 6767. World Intellectual Property Organization. Global Innovation Index 2022: What is the future of innovation-driven growth? 15. ed. Geneva: WIPO; 2022. 266 p. https://doi.org/10.34667/tind.46596
https://doi.org/10.34667/tind.46596...
) .

The predominance of the English language in scientific studies is intrinsically linked to the success of researchers, whose trajectory depends on the production of scientific articles and the impact of the journals they publish. Given that most of the most prestigious journals are published in English, achieving research success is closely associated with publishing in that language ( 6868. Ramirez-Castaneda V. Disadvantages in preparing and publishing scientific papers caused by the dominance of the English language in science: The case of Colombian researchers in biological sciences. PLoS One. 2020;15(9):e0238372. https://doi.org/10.1371/journal.pone.0238372
https://doi.org/10.1371/journal.pone.023...
) . Furthermore, it is worth mentioning that ChatGPT is English-based.

Regarding the contexts and topics covered, it was evident that the majority of studies have as their main focus the exploration of scientific writing through ChatGPT ( 2323. Pekşen A. Using ChatGPT in the Medical Field: A Narrative. Infect Dis Clin Microbiol. 2023;5(1):66-8. https://doi.org/10.36519/idcm.2023.227
https://doi.org/10.36519/idcm.2023.227...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
- 3131. Hallo-Carrasco A, Gruenbaum BF, Gruenbaum SE. Heat and Moisture Exchanger Occlusion Leading to Sudden Increased Airway Pressure: A Case Report Using ChatGPT as a Personal Writing Assistant. Cureus. 2023;15(4):e37306. https://doi.org/10.7759/cureus.37306
https://doi.org/10.7759/cureus.37306...
, 3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...
, 4343. Zielinski C, Winker M, Aggarwal R, Ferris L, Heinemann M, Lapeña JF, et al. Chatbots, ChatGPT, and Scholarly Manuscripts: WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications. Open Access Maced J Med Sci. 2023;11:83-86. https://doi.org/10.3889/oamjms.2023.11502
https://doi.org/10.3889/oamjms.2023.1150...
, 4545. Zheng H, Zhan H. ChatGPT in Scientific Writing: A Cautionary Tale. Am J Med. 2023;136(8):725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
https://doi.org/10.1016/j.amjmed.2023.02...
, 5858. Quintans-Júnior LJ, Gurgel RQ, Araújo AAS, Correia D, Martins-Filho PR. ChatGPT: the new panacea of the academic world. Rev Soc Bras Med Trop. 2023;56:e0060-e. https://doi.org/10.1590/0037-8682-0060-2023
https://doi.org/10.1590/0037-8682-0060-2...
, 6565. Colletti PM. Chatbots in Medical Research: Advantages and Limitations of AI-Enabled Writing With a Focus on ChatGPT as an Author. Clin Nucl Med. 2023;48(9):839. https://doi.org/10.1097/rlu.0000000000004672
https://doi.org/10.1097/rlu.000000000000...
- 6666. Kundalia ND. ChatGPT and the future of writing [Internet]. 2023 [cited 2023 Jul 20]. Available from: https://www.hindustantimes.com/books/chatgpt-and-the-future-of-writing-101675090609362.html
https://www.hindustantimes.com/books/cha...
) . This reflects the growing quest to understand how this technology can impact and improve the production of scientific content, paving the way for discussions about its effectiveness, applicability and transformative potential in the academic field.

Regarding the positive aspects listed in studies concerning the use of ChatGPT, it is highlighted that ChatGPT offers benefits in academic and scientific writing, due to its speed, refined language and notable contribution ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 2626. Babl FE, Babl MP. Generative artificial intelligence: Can ChatGPT write a quality abstract? Emerg Med Australasia. 2023;35(5):809-11. https://doi.org/10.1111/1742-6723.14233
https://doi.org/10.1111/1742-6723.14233...
, 2828. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
https://doi.org/10.1111/jerd.13046...
, 3636. Puthenpura V, Nadkarni S, DiLuna M, Hieftje K, Marks A. Personality Changes and Staring Spells in a 12-Year-Old Child: A Case Report Incorporating ChatGPT, a Natural Language Processing Tool Driven by Artificial Intelligence (AI). Cureus. 2023;15(3):e36408. https://doi.org/10.7759/cureus.36408
https://doi.org/10.7759/cureus.36408...
) . This tool assists scientists in writing articles, speeds up the creation of documents with cohesive text generated from markers, improves medical and scientific writing ( 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
, 4646. Ariyaratne S, Botchu R, Iyengar KP. ChatGPT in academic publishing: An ally or an adversary? Scott Med J. 2023;68(3):129-30. https://doi.org/10.1177/00369330231174231
https://doi.org/10.1177/0036933023117423...
) , facilitates the writing of specific sections of articles ( 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
, 6969. Ang TL, Choolani M, See KC, Poh KK. The rise of artificial intelligence: addressing the impact of large language models such as ChatGPT on scientific publications. Singapore Med J. 2023;64(4):219-21. https://doi.org/10.4103/singaporemedj.SMJ-2023-055
https://doi.org/10.4103/singaporemedj.SM...
) , speeds up research and analysis, and promotes equity by assisting non-native English-speaking authors ( 4545. Zheng H, Zhan H. ChatGPT in Scientific Writing: A Cautionary Tale. Am J Med. 2023;136(8):725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
https://doi.org/10.1016/j.amjmed.2023.02...
, 5151. Chen TJ. ChatGPT and other artificial intelligence applications speed up scientific writing. J Chin Med Assoc. 2023;86(4):351-3. https://doi.org/10.1097/JCMA.0000000000000900
https://doi.org/10.1097/JCMA.00000000000...
) . It is believed that ChatGPT can make the research and publishing process more efficient, being useful for researchers, journal editors and reviewers ( 4242. Xames MD, Shefa J. ChatGPT for research and publication: Opportunities and challenges. J Appl Learn Teach. 2023;6(1):390-5. https://doi.org/10.37074/jalt.2023.6.1.20
https://doi.org/10.37074/jalt.2023.6.1.2...
) .

Therefore, ChatGPT functions as a multifaceted tool, generating high-quality ideas and essays, improving writing coherence and supporting scientific and medical writing. It also automates repetitive tasks in manuscript preparation. Its features include emulation of linguistic patterns from a vast database, fast and sophisticated responses, and support for hypothesis creation and data analysis.

ChatGPT is relevant for improving writing, reducing redundancies, suggesting synonyms to enrich vocabulary and paraphrasing to modify the style of the text. Furthermore, it effectively handles large volumes of data, contributing to automation and innovation ( 66. Dahmen J, Kayaalp ME, Ollivier M, Pareek A, Hirschmann MT, Karlsson J, et al. Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surg Sports Traumatol Arthrosc. 2023;31(4):1187-89. https://doi.org/10.1007/s00167-023-07355-6
https://doi.org/10.1007/s00167-023-07355...
, 5151. Chen TJ. ChatGPT and other artificial intelligence applications speed up scientific writing. J Chin Med Assoc. 2023;86(4):351-3. https://doi.org/10.1097/JCMA.0000000000000900
https://doi.org/10.1097/JCMA.00000000000...
) . It also assists in restructuring manuscripts, offers feedback and speeds up the writing process, being applicable in clinical reports, improving the quality of radiology reports and complex abstracts ( 66. Dahmen J, Kayaalp ME, Ollivier M, Pareek A, Hirschmann MT, Karlsson J, et al. Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surg Sports Traumatol Arthrosc. 2023;31(4):1187-89. https://doi.org/10.1007/s00167-023-07355-6
https://doi.org/10.1007/s00167-023-07355...
) .

Thus, in the set of articles analyzed, ChatGPT emerges as a valuable tool for researchers and scientists by improving writing, speeding up tasks, enhancing quality and offering support in various areas, boosting the efficiency and quality of academic and scientific production.

Assessing the limitations of ChatGPT in academic writing reveals significant challenges. AI cannot generate original knowledge, requiring prior research and collaboration from experienced researchers. Concerns include the possibility of incorrect citations and manipulation of chatbot output for personalized argumentation, emphasizing the importance of critical analysis of generated text and verification with original literature. There are also limitations in understanding specialized terminology and a lack of a clear methodology for selecting and citing sources ( 66. Dahmen J, Kayaalp ME, Ollivier M, Pareek A, Hirschmann MT, Karlsson J, et al. Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surg Sports Traumatol Arthrosc. 2023;31(4):1187-89. https://doi.org/10.1007/s00167-023-07355-6
https://doi.org/10.1007/s00167-023-07355...
, 4545. Zheng H, Zhan H. ChatGPT in Scientific Writing: A Cautionary Tale. Am J Med. 2023;136(8):725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
https://doi.org/10.1016/j.amjmed.2023.02...
, 6363. Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30:3170-3. https://doi.org/10.1245/s10434-023-13436-0
https://doi.org/10.1245/s10434-023-13436...
, 7070. Kim SG. Using ChatGPT for language editing in scientific articles. Maxillofac Plast Reconstr Surg. 2023;45(13):1-2. https://doi.org/10.1186/s40902-023-00381-x
https://doi.org/10.1186/s40902-023-00381...
) .

It is essential to note that references provided by ChatGPT are currently unreliable and require detailed review. In situations where ChatGPT has no response, it may generate fictitious output called “hallucination”, providing false information such as authors, titles, and article DOIs. To obtain reliable answers, it is necessary to train the language model on specific knowledge domains, a complex and expensive process. Stanford researchers and the company MosaicML are collaborating on the development of a model called PubMed GPT, but balancing the model’s complexity, costs, and need for specialized architecture is challenging ( 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
, 4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
, 6363. Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30:3170-3. https://doi.org/10.1245/s10434-023-13436-0
https://doi.org/10.1245/s10434-023-13436...
, 7171. Alvero R. ChatGPT: rumors of human providers’ demise have been greatly exaggerated. Fertil Steril. 2023;119(6):930-1. https://doi.org/10.1016/j.fertnstert.2023.03.010
https://doi.org/10.1016/j.fertnstert.202...
) .

An additional set of limitations is related to the inherent characteristics of chatbots. These systems have limitations, including a lack of originality and responses that are not always truthful, due to outdated or non-transparent AI sources. This raises concerns about the reliability of the generated content and, by repeating a question, different answers may be generated. The risk of disseminating incorrect information makes the use of AI in academic production complex, highlighting challenges in the accuracy and credibility of the content generated ( 5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
, 7272. Stokel-Walker C. AI bot ChatGPT writes smart essays - should professors worry? Nature. 2022 Dec 09. https://doi.org/10.1038/d41586-022-04397-7
https://doi.org/10.1038/d41586-022-04397...
) . Figure 5 presents a summary of the limitations associated with the use of ChatGPT in academic writing, and evidences the need for careful analysis of what is produced by this technology, in order to mitigate biases and inaccuracies.

Several academic actors, including editors of journals, periodicals and scientific institutions, such as WAME (World Association of Medical Editors), COPE (Committee on Publication Ethics) and the JAMA network, have highlighted the role of AI in scientific publications. COPE’s official position is enlightening in this context, as it emphasizes that AI tools cannot satisfy authorship criteria, as they cannot take responsibility for submitted content. As non-legal entities, they cannot assert the presence or absence of conflicts of interest, nor manage issues related to copyright and licenses. In appropriate situations, the chatbot can be recognized, but it is not allowed to assign any author status to it ( 4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
, 7373. Stokel-Walker C. ChatGPT listed as author on research papers: many scientists disapprove. Nature. 2023;613:620-1. https://doi.org/10.1038/d41586-023-00107-z
https://doi.org/10.1038/d41586-023-00107...
) .

It is crucial to understand that in the context of scientific publishing, an author is not just someone who writes a document, but a fundamental participant in an academic enterprise. According to the International Committee of Medical Journal Editors (ICMJE), chatbots do not meet authorship criteria, especially with regard to the ability to give “final approval of the version to be published” and assume responsibility for all aspects of the work to ensure accuracy and integrity. Authorship guidelines in scientific literature are strict, and chatbots do not meet these criteria, as AI cannot consent to being an author or take responsibility for its contributions ( 6262. Yeo-Teh NSL, Tang BL. NLP systems such as ChatGPT cannot be listed as an author because these cannot fulfill widely adopted authorship criteria. Account Res. 2023. https://doi.org/10.1080/08989621.2023.2185776
https://doi.org/10.1080/08989621.2023.21...
) .

Therefore, it is important to highlight WAME ( 4343. Zielinski C, Winker M, Aggarwal R, Ferris L, Heinemann M, Lapeña JF, et al. Chatbots, ChatGPT, and Scholarly Manuscripts: WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications. Open Access Maced J Med Sci. 2023;11:83-86. https://doi.org/10.3889/oamjms.2023.11502
https://doi.org/10.3889/oamjms.2023.1150...
) recommendations on “chatbots and generative artificial intelligence in relation to academic publishing”: 1) Chatbots cannot be authors, as these tools cannot be held responsible for any statement or any ethical violation; 2) Authors must be transparent when chatbots are used and provide information about how they were used. The extent and type of use of chatbots in journal publications should be indicated. This is consistent with the ICMJE recommendation to acknowledge written assistance and provide in the methods detailed information about how the study was conducted and the results generated.

In the context of using AI, it is crucial to establish specific guidelines to ensure the integrity and transparency of the results presented in scientific articles. To this end, it is essential that authors provide detailed information about the prompts used when employing AI in tasks such as analyzing data, creating tables, figures, or writing code. This information should be clearly described in the abstract and methods section of the article, including date, time, AI tool used and its corresponding version, in order to enable scientific scrutiny and replication of results ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
, 3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
) .

Furthermore, authors have the responsibility to ensure the accuracy of the content generated by chatbots in their articles, guaranteeing the absence of plagiarism and correctly attributing all sources, including the originals of the material generated by the chatbot. Editors and reviewers play a fundamental role when evaluating manuscripts that use chatbots, and must clearly communicate with each other and with the authors whether they used this technology in analyzing and reviewing articles. If they have used chatbots in their communications, it is important that they explain the context and purpose of this use ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
, 3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
) .

Finally, publishers must have effective tools to detect content generated or altered by AI, which must be available in an accessible way, regardless of financial resources. This measure is essential to preserve the integrity of information related to healthcare and mitigate possible risks to public health ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
, 3434. Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
https://doi.org/10.3126/nje.v13i1.53721...
) .

Furthermore, when using ChatGPT in academic writing, it is crucial to deal with ethical issues such as harmful instructions and the production of fraudulent content, as well as the manipulation or fabrication of images ( 4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
) . In this sense, human supervision is necessary, especially in fields with complex concepts and scientific subtleties, ensuring the accuracy and legitimacy of information and statements, and preserving the integrity of research and academic production. Discussions about potential biases in training data and lack of transparency highlight the need for caution and rigorous analysis when applying ChatGPT to scientific writing ( 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
) .

These challenges can affect the accuracy and reliability of the information generated, emphasizing the need for caution when incorporating ChatGPT into academic writing ( 4747. Valentín-Bravo FJ, Mateos-Álvarez E, Usategui-Martín R, Andrés-Iglesias C, Pastor-Jimeno JC, Pastor-Idoate S. Artificial Intelligence and new language models in Ophthalmology: Complications of the use of silicone oil in vitreoretinal surgery. Arch Soc Esp Oftalmol (Engl Ed). 2023;98(5):298-303. https://doi.org/10.1016/j.oftale.2023.04.011
https://doi.org/10.1016/j.oftale.2023.04...
) . Besides, the superficiality and lack of originality of the content produced by ChatGPT is evident, often due to the lack of context and AI expertise. Therefore, the inability to generate up-to-date content and innovative ideas also presents as a significant limitation, as well as the difficulty in understanding highly specialized areas such as human anatomy and medical information ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 3030. Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
https://doi.org/10.1038/s41746-023-00819...
) .

The set of future perspectives covered in the articles explores the various aspects of integrating ChatGPT into academic writing. The need to establish barriers and structures for the appropriate use of AI emerges, while emphasizing the importance of assigning responsibility for authorship to chatbots and adopting measures to fully harness their potential ( 4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
) . The rapid evolution of chatbots indicates the potential to overcome current limitations, highlighting ChatGPT as a tool that accelerates innovations, optimizes academic training and improves writing and analysis skills ( 7474. Asensio-Sanchez VM. Artificial intelligence and new language models in ophthalmology: Complications of the use of silicone oil in vitreoretinal surgery. Arch Soc Esp Oftalmol (Engl Ed). 2023;98(8):486-7. https://doi.org/10.1016/j.oftale.2023.06.009
https://doi.org/10.1016/j.oftale.2023.06...
) .

The perspectives also consider the need to reformulate evaluation policies, which include AI-generated result detectors, with a sharp focus on ethical issues and the search for a balance between benefits and challenges. This highlights the importance of clear ethical guidelines and regulations for AI, along with the continuous search for technical improvements and plagiarism detection tools ( 99. Else H. Abstracts written by ChatGPT fool scientists. Nature. 2023;613(7944):423. https://doi.org/10.1038/d41586-023-00056-7
https://doi.org/10.1038/d41586-023-00056...
, 7575. Anderson N, Belavy DL, Perle SM, Hendricks S, Hespanhol L, Verhagen E, et al. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in Sports & Exercise Medicine manuscript generation. BMJ Open Sport Exerc Med. 2023;9:e001568. https://doi.org/10.1136/bmjsem-2023-001568
https://doi.org/10.1136/bmjsem-2023-0015...
) . Tools like DetectGPT and Orginality.ai are coming to market to try to detect AI-written content ( 4949. Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
https://doi.org/10.1016/j.jtos.2023.04.0...
, 6363. Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30:3170-3. https://doi.org/10.1245/s10434-023-13436-0
https://doi.org/10.1245/s10434-023-13436...
) , in addition to GPTZero ( 7676. Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature. 2023;613:612. https://doi.org/10.1038/d41586-023-00191-1
https://doi.org/10.1038/d41586-023-00191...
) .

The use of ChatGPT in writing scientific essays has proven to be effective, however, it is important to recognize that the data generated by this tool consists of a combination of true and completely fictitious information. This duality raises significant concerns about the integrity and accuracy of using large language models like ChatGPT in academic writing ( 2525. Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
https://doi.org/10.1016/j.rbmo.2023.04.0...
, 3333. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
https://www.ncbi.nlm.nih.gov/pmc/article...
, 4848. Alattar AA, McDowell MM. The rise of AI co-authors: navigating the future of scientific writing with ChatGPT. J Neurosurg. 2023;139(5):1485-6. https://doi.org/10.3171/2023.3.Jns23254
https://doi.org/10.3171/2023.3.Jns23254...
) . Given this scenario, a review of the policies and practices for evaluating scientific manuscripts for journals and conferences in the health sector is suggested, in order to maintain rigorous scientific standards.

The discussion surrounding the use of extensive language models in scientific writing also raises ethical and acceptability questions. Additionally, there are concerns about the possibility of creating fake medical experts through AI, which could pose a risk due to the lack of real experience and the generation of opinions from supposed experts through ChatGPT (or similar AI). These considerations highlight the importance of an ongoing debate on the responsible use of AI in the production of scientific and medical content ( 5050. Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
https://doi.org/10.7759/cureus.35179...
) .

The trend towards integrating AI, more precisely ChatGPT, into academic writing is highlighted, showing the need for researchers to adapt and emphasizing the importance of human collaboration and supervision. Additionally, the relevance of AI in the healthcare context is emphasized, with suggestions for developing specific tools to meet scientific needs, along with careful attention to its impact on healthcare and research. This trend is corroborated by several studies ( 1111. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
https://doi.org/10.3390/healthcare110608...
, 2020. Biswas S. ChatGPT and the future of medical writing. Radiol Soc North Am. 2023;307(2):e223312. https://doi.org/10.1148/radiol.223312
https://doi.org/10.1148/radiol.223312...
, 2727. Dergaa I, Chamari K, Zmijewski P, Saad HB. From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biol Sport. 2023;40(2):615-22. https://doi.org/10.5114/biolsport.2023.125623
https://doi.org/10.5114/biolsport.2023.1...
- 2828. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
https://doi.org/10.1111/jerd.13046...
, 3737. Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023;27(1):1-5. https://doi.org/10.1186/s13054-023-04380-2
https://doi.org/10.1186/s13054-023-04380...
, 4040. Ul Haq Z, Naeem H, Naeem A, Iqbal F, Zaeem D. Comparing human and artificial intelligence in writing for health journals: an exploratory study. medRxiv. 2023 Feb 26. https://doi.org/10.1101/2023.02.22.23286322
https://doi.org/10.1101/2023.02.22.23286...
, 4545. Zheng H, Zhan H. ChatGPT in Scientific Writing: A Cautionary Tale. Am J Med. 2023;136(8):725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
https://doi.org/10.1016/j.amjmed.2023.02...
, 5252. Elwood TW. Technological Impacts on the Sphere of Professional Journals. J Allied Health [Internet]. 2023 [cited 2023 Jun 18];52(1):1. Available from: https://pubmed.ncbi.nlm.nih.gov/36892853/
https://pubmed.ncbi.nlm.nih.gov/36892853...
, 5656. Nayak P. Pros and Cons of using ChatGPT in scientific writing: as it identifies for itself. Indian J Physiol Allied Sci [Internet]. 2023 [cited 2023 Jul 12];75(1). Available from: https://ijpas.org/index.php/ijpas/article/view/131/89/
https://ijpas.org/index.php/ijpas/articl...
, 6666. Kundalia ND. ChatGPT and the future of writing [Internet]. 2023 [cited 2023 Jul 20]. Available from: https://www.hindustantimes.com/books/chatgpt-and-the-future-of-writing-101675090609362.html
https://www.hindustantimes.com/books/cha...
) .

Considering the important methodological limitations that must be taken into account, this study requires a critical analysis. Firstly, it is necessary to recognize that the scoping analysis carried out may not have covered all potential applications and contexts of AI in healthcare, due to the constant technological evolution in this field. Besides, the predominance of studies with a low level of evidence, based on reflections, experience reports and editorials, raises concerns about the robustness of the conclusions. Therefore, there is an urgent need to conduct more robust, evidence-based research to assess the impact of AI on healthcare and provide solid guidance for clinical decisions.

Moreover, other limitations of the study refer to the sources of information and databases, since the scoping review is comprehensive. In the sources identification step, comprising libraries and repositories, the detailed description of certain bases, which could be present in one or more of these information sources, was not undertaken in this study. However, this review stands out for the methodological rigor established by JBI, which reinforces the credibility of the findings presented.

By exploring the potential use of ChatGPT in academic writing, this research provides a deeper understanding of how AI can be applied to improve the production of academic content, ranging from scientific articles to healthcare documents. This can result in greater efficiency in creating academic materials, while also highlighting the importance of addressing ethical and quality issues when integrating AI in this context. Thus, this study significantly contributes to the understanding of the opportunities and challenges related to AI in the production of scientific knowledge in health and nursing.

Conclusion

The present study focused on mapping the potential use of ChatGPT in academic writing in health, addressing both its benefits and associated ethical concerns. In this context, this research contributes significantly to knowledge, as it highlights the disruptive nature of chatbots and the importance of effective integration of these tools in scientific publishing, while recognizing the limitations and risks involved in using AI in writing.

In short, we can conclude that ChatGPT has transformative potential in research and academic writing in the health area. However, its implementation must be accompanied by rigorous human supervision, solid regulations, and transparent guidelines to ensure its responsible integration into the scientific community. As healthcare and nursing are already being influenced by AI, it is essential to anchor this trajectory in responsibility and ethical use, especially when employing ChatGPT in academic writing in health.

References

  • 1.
    Sharma A, Harrington RA, McClellan MB, Turakhia MP, Eapen ZJ, Steinhubl S, et al. Using Digital Health Technology to Better Generate Evidence and Deliver Evidence-Based Care. J Am Coll Cardiol. 2018;71(23):2680-90. https://doi.org/10.1016/j.jacc.2018.03.523
    » https://doi.org/10.1016/j.jacc.2018.03.523
  • 2.
    Sarker IH. AI-Based Modeling: Techniques, Applications and Research Issues Towards Automation, Intelligent and Smart Systems. SN Comput Sci. 2022;3(2):158. https://doi.org/10.1007/s42979-022-01043-x
    » https://doi.org/10.1007/s42979-022-01043-x
  • 3.
    Korteling JEH, van de Boer-Visschedijk GC, Blankendaal RAM, Boonekamp RC, Eikelboom AR. Human- versus Artificial Intelligence. Front Artif Intell. 2021;4:622364. https://doi.org/10.3389/frai.2021.622364
    » https://doi.org/10.3389/frai.2021.622364
  • 4.
    Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al. Language models are few-shot learners. Adv Neural Inf Process Syst [Internet]. 2020 [cited 2023 Jun 07];33:1877-901. Available from: https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
    » https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
  • 5.
    Wu T, He S, Liu J, Sun S, Liu K, Han QL, et al. A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development. IEEE/CAA J Autom Sinica. 2023;10(5):1122-36. https://doi.org/10.1109/JAS.2023.123618
    » https://doi.org/10.1109/JAS.2023.123618
  • 6.
    Dahmen J, Kayaalp ME, Ollivier M, Pareek A, Hirschmann MT, Karlsson J, et al. Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surg Sports Traumatol Arthrosc. 2023;31(4):1187-89. https://doi.org/10.1007/s00167-023-07355-6
    » https://doi.org/10.1007/s00167-023-07355-6
  • 7.
    Macdonald C, Adeloye D, Sheikh A, Rudan I. Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. J Glob Health. 2023;13:01003. https://doi.org/10.7189/jogh.13.01003
    » https://doi.org/10.7189/jogh.13.01003
  • 8.
    Graham F. Daily briefing: ChatGPT listed as author on research papers. Nature. 2023. https://doi.org/10.1038/d41586-023-00188-w
    » https://doi.org/10.1038/d41586-023-00188-w
  • 9.
    Else H. Abstracts written by ChatGPT fool scientists. Nature. 2023;613(7944):423. https://doi.org/10.1038/d41586-023-00056-7
    » https://doi.org/10.1038/d41586-023-00056-7
  • 10.
    Liebrenz M, Schleifer R, Buadze A, Bhugra D, Smith A. Generating scholarly content with ChatGPT: ethical challenges for medical publishing. Lancet Digit Health. 2023;5(3):e105-e6. https://doi.org/10.1016/S2589-7500(23)00019-5
    » https://doi.org/10.1016/S2589-7500(23)00019-5
  • 11.
    Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887. https://doi.org/10.3390/healthcare11060887
    » https://doi.org/10.3390/healthcare11060887
  • 12.
    Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Implement. 2021;19(1):3-10. https://doi.org/10.1097/XEB.0000000000000277
    » https://doi.org/10.1097/XEB.0000000000000277
  • 13.
    Costa ICP, Chini LT, Nascimento MC, Treviso P, Barbosa SFF, Roza BA, et al. Mapping the potential use of ChatGPT in academic writing in the health area: a scope review protocol. OSF. 2023. https://doi.org/10.17605/OSF.IO/MDKHG
    » https://doi.org/10.17605/OSF.IO/MDKHG
  • 14.
    Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467-73. https://doi.org/10.7326/M18-0850
    » https://doi.org/10.7326/M18-0850
  • 15.
    Pollock D, Peters MDJ, Khalil H, McInerney P, Alexander L, Tricco AC, et al. Recommendations for the extraction, analysis, and presentation of results in scoping reviews. JBI Evid Synth. 2023;21(3):520-32. https://doi.org/10.11124/JBIES-22-00123
    » https://doi.org/10.11124/JBIES-22-00123
  • 16.
    Mendes KDS, Silveira RCCP, Galvão CM. Use of the bibliographic reference manager in the selection of primary studies in integrative reviews. Texto Contexto Enferm. 2019;28:e20170204. https://doi.org/10.1590/1980-265X-TCE-2017-0204
    » https://doi.org/10.1590/1980-265X-TCE-2017-0204
  • 17.
    Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. https://doi.org/10.1186/s13643-016-0384-4
    » https://doi.org/10.1186/s13643-016-0384-4
  • 18.
    Peters MDJ, Godfrey C, McInerney P, Khalil H, Larsen P, Marnie C, et al. Best practice guidance and reporting items for the development of scoping review protocols. JBI Evid Synth. 2022;20(4):953-68. https://doi.org/10.11124/JBIES-21-00242
    » https://doi.org/10.11124/JBIES-21-00242
  • 19.
    Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-15. https://doi.org/10.1111/j.1365-2648.2007.04569.x
    » https://doi.org/10.1111/j.1365-2648.2007.04569.x
  • 20.
    Biswas S. ChatGPT and the future of medical writing. Radiol Soc North Am. 2023;307(2):e223312. https://doi.org/10.1148/radiol.223312
    » https://doi.org/10.1148/radiol.223312
  • 21.
    Frith KH. ChatGPT: Disruptive Educational Technology. Nurs Educ Perspect. 2023;44(3):198-9. https://doi.org/10.1097/01.NEP.0000000000001129
    » https://doi.org/10.1097/01.NEP.0000000000001129
  • 22.
    Gurha P, Ishaq N, Marian AJ. ChatGPT and other artificial intelligence chatbots and biomedical writing. J Cardiovasc Aging. 2023;3(20):1-3. https://doi.org/10.20517/jca.2023.13
    » https://doi.org/10.20517/jca.2023.13
  • 23.
    Pekşen A. Using ChatGPT in the Medical Field: A Narrative. Infect Dis Clin Microbiol. 2023;5(1):66-8. https://doi.org/10.36519/idcm.2023.227
    » https://doi.org/10.36519/idcm.2023.227
  • 24.
    Rahimi F, Abadi ATB. ChatGPT and publication ethics. Arch Med Res. 2023;54(3):272-4. https://doi.org/10.1016/j.arcmed.2023.03.004
    » https://doi.org/10.1016/j.arcmed.2023.03.004
  • 25.
    Altmäe S, Sola-Leyva A, Salumets A. Artificial intelligence in scientific writing: a friend or a foe? Reprod Biomed Online. 2023;47(1):3-9. https://doi.org/10.1016/j.rbmo.2023.04.009
    » https://doi.org/10.1016/j.rbmo.2023.04.009
  • 26.
    Babl FE, Babl MP. Generative artificial intelligence: Can ChatGPT write a quality abstract? Emerg Med Australasia. 2023;35(5):809-11. https://doi.org/10.1111/1742-6723.14233
    » https://doi.org/10.1111/1742-6723.14233
  • 27.
    Dergaa I, Chamari K, Zmijewski P, Saad HB. From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biol Sport. 2023;40(2):615-22. https://doi.org/10.5114/biolsport.2023.125623
    » https://doi.org/10.5114/biolsport.2023.125623
  • 28.
    Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent. 2023;35(7):1098-102. https://doi.org/10.1111/jerd.13046
    » https://doi.org/10.1111/jerd.13046
  • 29.
    Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15(4):e37285. https://doi.org/10.7759/cureus.37285
    » https://doi.org/10.7759/cureus.37285
  • 30.
    Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6(75):1-5. https://doi.org/10.1038/s41746-023-00819-6
    » https://doi.org/10.1038/s41746-023-00819-6
  • 31.
    Hallo-Carrasco A, Gruenbaum BF, Gruenbaum SE. Heat and Moisture Exchanger Occlusion Leading to Sudden Increased Airway Pressure: A Case Report Using ChatGPT as a Personal Writing Assistant. Cureus. 2023;15(4):e37306. https://doi.org/10.7759/cureus.37306
    » https://doi.org/10.7759/cureus.37306
  • 32.
    Hegde A, Srinivasan S, Menon G. Extraventricular Neurocytoma of the Posterior Fossa: A Case Report Written by ChatGPT. Cureus. 2023;15(3):e35850. https://doi.org/10.7759/cureus.35850
    » https://doi.org/10.7759/cureus.35850
  • 33.
    Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res [Internet]. 2023 [cited 2023 Jul 20];13(4):1148-54. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
    » https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
  • 34.
    Khan NA, Osmonaliev K, Sarwar MZ. Pushing the Boundaries of Scientific Research with the use of Artificial Intelligence tools: Navigating Risks and Unleashing Possibilities. Nepal J Epidemiol. 2023;13(1):1258-63. https://doi.org/10.3126/nje.v13i1.53721
    » https://doi.org/10.3126/nje.v13i1.53721
  • 35.
    Lund BD, Wang T, Mannuru NR, Nie B, Shimray S, Wang Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J Assoc Inf Sci Technol. 2023;74(5):570-81. https://doi.org/10.1002/asi.24750
    » https://doi.org/10.1002/asi.24750
  • 36.
    Puthenpura V, Nadkarni S, DiLuna M, Hieftje K, Marks A. Personality Changes and Staring Spells in a 12-Year-Old Child: A Case Report Incorporating ChatGPT, a Natural Language Processing Tool Driven by Artificial Intelligence (AI). Cureus. 2023;15(3):e36408. https://doi.org/10.7759/cureus.36408
    » https://doi.org/10.7759/cureus.36408
  • 37.
    Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023;27(1):1-5. https://doi.org/10.1186/s13054-023-04380-2
    » https://doi.org/10.1186/s13054-023-04380-2
  • 38.
    Sedaghat S. Early applications of ChatGPT in medical practice, education and research. Clin Med (Lond). 2023;23(3):278-9. https://doi.org/10.7861/clinmed.2023-0078
    » https://doi.org/10.7861/clinmed.2023-0078
  • 39.
    Sonntagbauer M, Haar M, Kluge S. Artificial intelligence: How will ChatGPT and other AI applications change our everyday medical practice? Med Klin Intensivmed Notfmed. 2023;118:366-71. https://doi.org/10.1007/s00063-023-01019-6
    » https://doi.org/10.1007/s00063-023-01019-6
  • 40.
    Ul Haq Z, Naeem H, Naeem A, Iqbal F, Zaeem D. Comparing human and artificial intelligence in writing for health journals: an exploratory study. medRxiv. 2023 Feb 26. https://doi.org/10.1101/2023.02.22.23286322
    » https://doi.org/10.1101/2023.02.22.23286322
  • 41.
    Vaishya R, Misra A, Vaish A. ChatGPT: Is this version good for healthcare and research? Diabetes Metab Syndr. 2023;17(4):102744. https://doi.org/10.1016/j.dsx.2023.102744
    » https://doi.org/10.1016/j.dsx.2023.102744
  • 42.
    Xames MD, Shefa J. ChatGPT for research and publication: Opportunities and challenges. J Appl Learn Teach. 2023;6(1):390-5. https://doi.org/10.37074/jalt.2023.6.1.20
    » https://doi.org/10.37074/jalt.2023.6.1.20
  • 43.
    Zielinski C, Winker M, Aggarwal R, Ferris L, Heinemann M, Lapeña JF, et al. Chatbots, ChatGPT, and Scholarly Manuscripts: WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications. Open Access Maced J Med Sci. 2023;11:83-86. https://doi.org/10.3889/oamjms.2023.11502
    » https://doi.org/10.3889/oamjms.2023.11502
  • 44.
    Sharma P. Chatbots in Medical Research: Advantages and Limitations of Artificial Intelligence–Enabled Writing With a Focus on ChatGPT as an Author. Clin Nucl Med. 2023;48(9):838-9. https://doi.org/10.1097/RLU.0000000000004665
    » https://doi.org/10.1097/RLU.0000000000004665
  • 45.
    Zheng H, Zhan H. ChatGPT in Scientific Writing: A Cautionary Tale. Am J Med. 2023;136(8):725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
    » https://doi.org/10.1016/j.amjmed.2023.02.011
  • 46.
    Ariyaratne S, Botchu R, Iyengar KP. ChatGPT in academic publishing: An ally or an adversary? Scott Med J. 2023;68(3):129-30. https://doi.org/10.1177/00369330231174231
    » https://doi.org/10.1177/00369330231174231
  • 47.
    Valentín-Bravo FJ, Mateos-Álvarez E, Usategui-Martín R, Andrés-Iglesias C, Pastor-Jimeno JC, Pastor-Idoate S. Artificial Intelligence and new language models in Ophthalmology: Complications of the use of silicone oil in vitreoretinal surgery. Arch Soc Esp Oftalmol (Engl Ed). 2023;98(5):298-303. https://doi.org/10.1016/j.oftale.2023.04.011
    » https://doi.org/10.1016/j.oftale.2023.04.011
  • 48.
    Alattar AA, McDowell MM. The rise of AI co-authors: navigating the future of scientific writing with ChatGPT. J Neurosurg. 2023;139(5):1485-6. https://doi.org/10.3171/2023.3.Jns23254
    » https://doi.org/10.3171/2023.3.Jns23254
  • 49.
    Ali MJ, Djalilian A. Readership awareness series - Paper 4: Chatbots and ChatGPT - Ethical considerations in scientific publications. Ocul Surf. 2023;28:153-4. https://doi.org/10.1016/j.jtos.2023.04.001
    » https://doi.org/10.1016/j.jtos.2023.04.001
  • 50.
    Alkaissi H, McFarlane SI. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 2023;15(2):e35179. https://doi.org/10.7759/cureus.35179
    » https://doi.org/10.7759/cureus.35179
  • 51.
    Chen TJ. ChatGPT and other artificial intelligence applications speed up scientific writing. J Chin Med Assoc. 2023;86(4):351-3. https://doi.org/10.1097/JCMA.0000000000000900
    » https://doi.org/10.1097/JCMA.0000000000000900
  • 52.
    Elwood TW. Technological Impacts on the Sphere of Professional Journals. J Allied Health [Internet]. 2023 [cited 2023 Jun 18];52(1):1. Available from: https://pubmed.ncbi.nlm.nih.gov/36892853/
    » https://pubmed.ncbi.nlm.nih.gov/36892853/
  • 53.
    Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “authors” and Implications for the Integrity of Scientific Publication and Medical Knowledge. JAMA. 2023;329(8):637-9. https://doi.org/10.1001/jama.2023.1344
    » https://doi.org/10.1001/jama.2023.1344
  • 54.
    Fulton JS. Authorship and ChatGPT. Clin Nurse Spec. 2023;37(3):109-10. https://doi.org/10.1097/NUR.0000000000000750
    » https://doi.org/10.1097/NUR.0000000000000750
  • 55.
    Macklon N, Garcia JV. ChatGPT and scientific publications: friend or foe? Reprod BioMed Online. 2023;47(1):1-2. https://doi.org/10.1016/j.rbmo.2023.04.007
    » https://doi.org/10.1016/j.rbmo.2023.04.007
  • 56.
    Nayak P. Pros and Cons of using ChatGPT in scientific writing: as it identifies for itself. Indian J Physiol Allied Sci [Internet]. 2023 [cited 2023 Jul 12];75(1). Available from: https://ijpas.org/index.php/ijpas/article/view/131/89/
    » https://ijpas.org/index.php/ijpas/article/view/131/89/
  • 57.
    O’Connor S, ChatGpt. Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse? Nurse Educ Pract. 2023;66:103537 https://doi.org/10.1016/j.nepr.2022.103537
    » https://doi.org/10.1016/j.nepr.2022.103537
  • 58.
    Quintans-Júnior LJ, Gurgel RQ, Araújo AAS, Correia D, Martins-Filho PR. ChatGPT: the new panacea of the academic world. Rev Soc Bras Med Trop. 2023;56:e0060-e. https://doi.org/10.1590/0037-8682-0060-2023
    » https://doi.org/10.1590/0037-8682-0060-2023
  • 59.
    Rozencwajg S, Kantor E. Elevating scientific writing with ChatGPT: A guide for reviewers, editors… and authors. Anesth Crit Care Pain Med. 2023;42(3):101209. https://doi.org/10.1016/j.accpm.2023.101209
    » https://doi.org/10.1016/j.accpm.2023.101209
  • 60.
    Siegerink B, Pet LA, Rosendaal FR, Schoones JW. ChatGPT as an author of academic papers is wrong and highlights the concepts of accountability and contributorship. Nurse Educ Pract. 2023;68:103599. https://doi.org/10.1016/j.nepr.2023.103599
    » https://doi.org/10.1016/j.nepr.2023.103599
  • 61.
    Tiing Leong A, Mahesh C, Kay Choong S, Kian Keong P. The rise of artificial intelligence: addressing the impact of large language models such as ChatGPT on scientific publications. Singapore Med J. 2023;64(4):219-21. https://doi.org/10.4103/singaporemedj.SMJ-2023-055
    » https://doi.org/10.4103/singaporemedj.SMJ-2023-055
  • 62.
    Yeo-Teh NSL, Tang BL. NLP systems such as ChatGPT cannot be listed as an author because these cannot fulfill widely adopted authorship criteria. Account Res. 2023. https://doi.org/10.1080/08989621.2023.2185776
    » https://doi.org/10.1080/08989621.2023.2185776
  • 63.
    Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30:3170-3. https://doi.org/10.1245/s10434-023-13436-0
    » https://doi.org/10.1245/s10434-023-13436-0
  • 64.
    Ali M, Ahmad N, Younus HA. Integrating chatbots (ChatGPT) in the process of manuscript writing and proposing a roadmap for their future adoption. Authorea. 2023;1-2. https://doi.org/10.22541/au.168052684.48458398/v1
    » https://doi.org/10.22541/au.168052684.48458398/v1
  • 65.
    Colletti PM. Chatbots in Medical Research: Advantages and Limitations of AI-Enabled Writing With a Focus on ChatGPT as an Author. Clin Nucl Med. 2023;48(9):839. https://doi.org/10.1097/rlu.0000000000004672
    » https://doi.org/10.1097/rlu.0000000000004672
  • 66.
    Kundalia ND. ChatGPT and the future of writing [Internet]. 2023 [cited 2023 Jul 20]. Available from: https://www.hindustantimes.com/books/chatgpt-and-the-future-of-writing-101675090609362.html
    » https://www.hindustantimes.com/books/chatgpt-and-the-future-of-writing-101675090609362.html
  • 67.
    World Intellectual Property Organization. Global Innovation Index 2022: What is the future of innovation-driven growth? 15. ed. Geneva: WIPO; 2022. 266 p. https://doi.org/10.34667/tind.46596
    » https://doi.org/10.34667/tind.46596
  • 68.
    Ramirez-Castaneda V. Disadvantages in preparing and publishing scientific papers caused by the dominance of the English language in science: The case of Colombian researchers in biological sciences. PLoS One. 2020;15(9):e0238372. https://doi.org/10.1371/journal.pone.0238372
    » https://doi.org/10.1371/journal.pone.0238372
  • 69.
    Ang TL, Choolani M, See KC, Poh KK. The rise of artificial intelligence: addressing the impact of large language models such as ChatGPT on scientific publications. Singapore Med J. 2023;64(4):219-21. https://doi.org/10.4103/singaporemedj.SMJ-2023-055
    » https://doi.org/10.4103/singaporemedj.SMJ-2023-055
  • 70.
    Kim SG. Using ChatGPT for language editing in scientific articles. Maxillofac Plast Reconstr Surg. 2023;45(13):1-2. https://doi.org/10.1186/s40902-023-00381-x
    » https://doi.org/10.1186/s40902-023-00381-x
  • 71.
    Alvero R. ChatGPT: rumors of human providers’ demise have been greatly exaggerated. Fertil Steril. 2023;119(6):930-1. https://doi.org/10.1016/j.fertnstert.2023.03.010
    » https://doi.org/10.1016/j.fertnstert.2023.03.010
  • 72.
    Stokel-Walker C. AI bot ChatGPT writes smart essays - should professors worry? Nature. 2022 Dec 09. https://doi.org/10.1038/d41586-022-04397-7
    » https://doi.org/10.1038/d41586-022-04397-7
  • 73.
    Stokel-Walker C. ChatGPT listed as author on research papers: many scientists disapprove. Nature. 2023;613:620-1. https://doi.org/10.1038/d41586-023-00107-z
    » https://doi.org/10.1038/d41586-023-00107-z
  • 74.
    Asensio-Sanchez VM. Artificial intelligence and new language models in ophthalmology: Complications of the use of silicone oil in vitreoretinal surgery. Arch Soc Esp Oftalmol (Engl Ed). 2023;98(8):486-7. https://doi.org/10.1016/j.oftale.2023.06.009
    » https://doi.org/10.1016/j.oftale.2023.06.009
  • 75.
    Anderson N, Belavy DL, Perle SM, Hendricks S, Hespanhol L, Verhagen E, et al. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in Sports & Exercise Medicine manuscript generation. BMJ Open Sport Exerc Med. 2023;9:e001568. https://doi.org/10.1136/bmjsem-2023-001568
    » https://doi.org/10.1136/bmjsem-2023-001568
  • 76.
    Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature. 2023;613:612. https://doi.org/10.1038/d41586-023-00191-1
    » https://doi.org/10.1038/d41586-023-00191-1
  • 1
    All authors approved the final version of the text.
  • 2
    How to cite this article
    Costa ICP, Nascimento MC, Treviso P, Chini LT, Roza BA, Barbosa SFF, et al. Using the Chat Generative Pre-trained Transformer in academic writing in health: a scoping review. Rev. Latino-Am. Enfermagem. 2024;32:e4194 [cited year month day]. Available from: URL . https://doi.org/10.1590/1518-8345.7133.4194

Edited by

Associate Editor:
Maria Lúcia Zanetti

Publication Dates

  • Publication in this collection
    17 June 2024
  • Date of issue
    2024

History

  • Received
    26 Oct 2023
  • Accepted
    04 Feb 2024
Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br