Acessibilidade / Reportar erro

Educational technology for multidisciplinary training for managing waiting lists for elective patients

Tecnología educativa para la formación multidisciplinaria en la gestión de listas de espera de pacientes electivos

ABSTRACT

Objectives:

to construct and assess an educational technology for managing patient waiting lists for multidisciplinary training.

Methods:

study supported by Instructional Design - ADDIE model, whose stages of construction of educational technology were developed in the form of a multi-professional training course. Its respective content assessment was carried out by a committee of experts from 2021 to 2022. The analysis occurred based on the proportion of content adequacy with 95% Confidence Interval.

Results:

seventeen products were created as educational technology learning objects: five storyboards; four videos; three comic books; two pedagogical action plans; a mind map; and a YouTube® playlist. Nine experts assessed content adequacy, which reached 0.89.

Conclusions:

this educational technology contributes to the performance of professionals who manage waiting lists by reducing inequalities, alleviating differences, in addition to promoting equity in care and good health for patients in the Brazilian Health System.

Descriptors:
Health Management; Waiting Lists; Educational Technology; eHealth Strategies; Nursing

RESUMEN

Objetivos:

construir y evaluar una tecnología educativa para la gestión de listas de espera de pacientes para formación multidisciplinaria.

Métodos:

estudio apoyado en Diseño Instruccional - modelo ADDIE, cuyas etapas de construcción de tecnología educativa se desarrollaron en forma de curso de formación multiprofesional. Su respectiva evaluación de contenidos fue realizada por un comité de expertos del 2021 al 2022. El análisis se realizó utilizando la proporción de adecuación del contenido con un Intervalo de Confianza del 95%.

Resultados:

se crearon 17 productos como objetos de aprendizaje de tecnología educativa: cinco storyboards; cuatro vídeos; tres cómics; dos planes de acción pedagógicos; un mapa mental; y una lista de reproducción de YouTube®. Nueve expertos evaluaron la adecuación de los contenidos, que alcanzó un 0,89.

Conclusiones:

esta tecnología educativa contribuye al desempeño de los profesionales que gestionan las listas de espera, reduciendo las desigualdades, aliviando las diferencias, además de promover la equidad en la atención y la buena salud de los pacientes del Sistema de Salud Brasileño.

Descriptores:
Gestión en Salud; Listas de Espera; Tecnología Educacional; Estrategias de eSalud; Enfermería

RESUMO

Objetivos:

construir e avaliar uma tecnologia educativa de gerenciamento de listas de espera de pacientes para a formação multiprofissional.

Métodos:

estudo sustentado pelo Design Instrucional - modelo ADDIE, cujas etapas de construção da tecnologia educativa foram desenvolvidas na modalidade de curso de formação multiprofissional. Sua respectiva avaliação de conteúdo foi realizada por um comitê de especialistas de 2021 a 2022. A análise ocorreu pela proporção de adequação de conteúdo com Intervalo de Confiança de 95%.

Resultados:

elaboraram-se 17 produtos como objetos de aprendizagem da tecnologia educativa: cinco storyboards; quatro vídeos; três histórias em quadrinhos; dois planos de ação pedagógica; um mapa mental; e uma playlist do YouTube®. Nove especialistas avaliaram adequação de conteúdo, que atingiu 0,89.

Conclusões:

essa tecnologia educativa contribui na atuação dos profissionais que gerenciam listas de espera ao reduzir desigualdades, amenizar diferenças, além de promover equidade no atendimento e boa saúde ao paciente no Sistema Único de Saúde.

Descritores:
Gestão em Saúde; Listas de Espera; Tecnologia Educacional; Estratégias de eSaúde; Enfermagem

INTRODUCTION

The Brazilian Health System (SUS - Sistema Único de Saúde), created in 1990 based on the Federal Constitution of 1988, has been continually seeking its consolidation through policies, projects and actions, in order to qualify and increasingly achieve its principles, such as such as accessibility, completeness, equity, efficiency, among others(11 Lopes F. De volta aos primórdios: em defesa do SUS como uma política antirracista. Bol Anál Político-Instit. 2021;1:9-19. https://doi.org/10.38116/bapi26art1
https://doi.org/10.38116/bapi26art1...
). It is possible to state that, since its implementation, the Brazilian public health system has been improved over the decades.

One of the most noticeable problems in society, and which is the target of correct criticism from the population, is the long waiting time for elective (scheduled) surgeries(22 Lippi MC, Flexa RGC, Silva GV, Navarro LLL. Waiting list management as an approach to planning and coordination of elective health services. Rev Gestão Saúde [Internet]. 2018 [cited 2023 May 21];9(1):159-77. Available from: https://periodicos.unb.br/index.php/rgs/article/download/10448/9208/18739
https://periodicos.unb.br/index.php/rgs/...
). In Brazil, despite the subject being an important phenomenon for the health system, the national literary arsenal found on the subject is scarce(22 Lippi MC, Flexa RGC, Silva GV, Navarro LLL. Waiting list management as an approach to planning and coordination of elective health services. Rev Gestão Saúde [Internet]. 2018 [cited 2023 May 21];9(1):159-77. Available from: https://periodicos.unb.br/index.php/rgs/article/download/10448/9208/18739
https://periodicos.unb.br/index.php/rgs/...
-33 Lisbôa RL, Rodrigues CGS, Bittencourt CV, Paz AA. Estratégias de gerenciamento em listas de espera cirúrgicas: revisão integrativa. Acervo Saúde. 2022;15(2):e9612. https://doi.org/10.25248/reas.e9612.2022
https://doi.org/10.25248/reas.e9612.2022...
).

Waiting times for elective treatments, including elective surgery, are a source of public concern and therefore a concern for policymakers(44 Lisbôa RL, Kruel AJ, Marciniak JB, Paz AA. Actions of a regulatory nurse in the management of surgical waiting lists. Rev Bras Enferm. 2022;75(2):e20201233. https://doi.org/10.1590/0034-7167-2020-1233
https://doi.org/10.1590/0034-7167-2020-1...
). The average waiting time in several countries is at least three months and can reach years, which generates not only dissatisfaction among patients and the population in general, but also a worsening/deterioration of health conditions, prolongation of suffering, loss of utility/function and even progression to patient death(55 Siciliani L, Hurst J. Tackling excessive waiting times for elective surgery: a comparative analysis of policies in 12 OECD countries. Health Policy. 2005;72(2):201-15. https://doi.org/10.1016/j.healthpol.2004.07.003
https://doi.org/10.1016/j.healthpol.2004...
-66 Lungu DA, Grillo RT, Nuti S. Decision making tools for managing waiting times and treatment rates in elective surgery. BMC Health Serv Res. 2019;19(1):369-77. https://doi.org/10.1186/s12913-019-4199-6
https://doi.org/10.1186/s12913-019-4199-...
). Furthermore, there are economic risks, as patients with more serious clinical conditions tend to remain hospitalized for longer and, as a result, require more resources. The fact that these patients are more exposed to, for instance, hospital infections, generates a vicious cycle of increased length of stay and other damages(44 Lisbôa RL, Kruel AJ, Marciniak JB, Paz AA. Actions of a regulatory nurse in the management of surgical waiting lists. Rev Bras Enferm. 2022;75(2):e20201233. https://doi.org/10.1590/0034-7167-2020-1233
https://doi.org/10.1590/0034-7167-2020-1...
).

Among existing weaknesses in health systems, the management of waiting lists for elective surgeries and the lack of professional training in healthcare services stand out. In this regard, it is important to provide training and continuing education of human resources in health, including being constitutional to Brazilian society, and reaffirmed as one of the purposes of Law 8.080/90, which provides for the health system organization(77 Ministério da Saúde (BR). Lei nº 8.080, de 19 de setembro de 1990. Dispõe sobre as condições para a promoção, proteção e recuperação da saúde, a organização e o funcionamento dos serviços correspondentes e dá outras providências [Internet]. Brasília: Ministério da Saúde; 1990 [cited 2023 May 21]. Available from: http://www.planalto.gov.br/ccivil_03/leis/L8080.htm
http://www.planalto.gov.br/ccivil_03/lei...
). This topic is in line with the Sustainable Development Goals (SDGs) of the 2030 Agenda of the United Nations (UN) and the Organization for Economic Cooperation and Development (OECD), which contributes to reducing inequalities; good health and well-being; and quality education(88 Governo do Distrito Federal (BR). Secretaria das Relações Internacionais - SERINTER. Agenda 2030: Objetivos do Desenvolvimento Sustentável [Internet]. Brasília: SERINTER; 2022 [cited 2023 May 21]. Available from: https://www.internacional.df.gov.br/agenda-2030-objetivos-do-desenvolvimento-sustentavel/
https://www.internacional.df.gov.br/agen...
).

The Internal Regulation Center (IRC) is a sector that seeks to manage the service capacity of health system users in the hospital institution. The experience of one of the authors as a regulatory nurse at a large, general public hospital, located in southern Brazil, enabled reflecting on the work process. The action takes place alongside the sector’s coordination, with a series of practical measures for managing the institution’s lists as: meetings with teams and leaders of medical specialties; joint efforts to carry out pre-operative exams and consultations; monitoring; changes to processes and the information system; and adequacy of use of installed capacity.

This study is based on a Professional Master’s Dissertation that created an educational technology constructed and assessed with technical-scientific rigor. This technology fits into the form of a training course, with a view to qualifying healthcare professionals and administrative technicians who work in regulating services on waiting lists for elective surgical and clinical patients.

OBJECTIVES

To construct and assess an educational technology for multidisciplinary training for managing patient waiting lists.

METHODS

Ethical aspects

The study was approved by the Research Ethics Committee and met the guidelines and regulatory standards for research with human beings. The Informed Consent Form was obtained from all participants who registered acceptance in the Informed Consent Registry (ICR). This document informs on the guarantee of anonymity, confidentiality, privacy and secrecy.

Study design, period and location

This is a methodological study of technological production, developed in two stages and based on the Instructional Design of the ADDIE model (acronym for Analysis, Design, Development, Implementation and Evaluation)(99 Branch RM. Instructional design: the ADDIE approach. New York: Springer; 2009. https://doi.org/10.1007/978-0-387-09506-6
https://doi.org/10.1007/978-0-387-09506-...
). The model has two phases, namely conception and execution. In the conception phase (Analysis, Design and Development), the first stage comprised educational technology construction in the form of a multi-professional training course. The second stage refers to content adequacy assessment by a committee of experts.

The product was developed in a shared (remote) environment aligned with a Graduate Program in Nursing - Professional Master’s Degree at a public university in southern Brazil. The executing team was made up of three nurses (a doctoral holder, a master’s degree holder and a master’s student) and two nursing students (scientific initiation and teaching initiation scholarship holders). The stages took place from March 2021 to October 2022.

Methodological procedures

The first stage consisted of constructing educational technology products. To begin construction, it is necessary to analyze the demand and need for educational technology, which occurs from collecting information from scientific literature review, the team’s prior knowledge and experience in healthcare services and care and management indicators, such as number of surgeries, elective hospitalizations, monitoring of waiting lists, among others. All of this information provides an opportunity to improve the teaching-learning process for a specific target audience(99 Branch RM. Instructional design: the ADDIE approach. New York: Springer; 2009. https://doi.org/10.1007/978-0-387-09506-6
https://doi.org/10.1007/978-0-387-09506-...

10 Parulla CD, Galdino DM, Dal Pai D, Azzolin KO, Cogo ALP. Nursing assessment: the elaboration and development of a massive open online course. Rev Gaúcha Enferm. 2020;41(spe):e20190199. https://doi.org/10.1590/1983-1447.2020.20190199
https://doi.org/10.1590/1983-1447.2020.2...
-1111 Souza AMC, Oliveira MLG, Lima MAM, Batista BTB. Design de experiência de aprendizagem: avaliação do modelo ADDIE e contribuições para o ensino a distância. Regae: Rev Gest Aval Educ. 2019;8(17):1-9. http://dx.doi.org/10.5902/2318133831922
http://dx.doi.org/10.5902/2318133831922...
).

Based on demand analysis, pedagogical design was prepared, which consists of establishing strategies and tools that will be used as well as projection of professionals, costs and schedule for educational technology construction(99 Branch RM. Instructional design: the ADDIE approach. New York: Springer; 2009. https://doi.org/10.1007/978-0-387-09506-6
https://doi.org/10.1007/978-0-387-09506-...
,1111 Souza AMC, Oliveira MLG, Lima MAM, Batista BTB. Design de experiência de aprendizagem: avaliação do modelo ADDIE e contribuições para o ensino a distância. Regae: Rev Gest Aval Educ. 2019;8(17):1-9. http://dx.doi.org/10.5902/2318133831922
http://dx.doi.org/10.5902/2318133831922...
). A Pedagogical Action Plan (PAP) was structured for each module of the course.

In addition to conducting the theoretical constructs, the PAP guided actions for developing content in accordance with educational objectives. It was then edited into a text document with the following items: course title; total course load; menu; module title; module workload; objective; skills covered in the module; authorship; learning objective; contents; activities/tasks; resources; references; how to cite the material; and update date.

Based on the PAP discussed and approved by all members of the executing team, the course’s visual identity was defined with regard to logography, typography, chromography, pictography and iconography. Subsequently, storyboard construction began, organizing the content and establishing the degree of interactivity with participants, including the different resources used and described in PAP(99 Branch RM. Instructional design: the ADDIE approach. New York: Springer; 2009. https://doi.org/10.1007/978-0-387-09506-6
https://doi.org/10.1007/978-0-387-09506-...
,1111 Souza AMC, Oliveira MLG, Lima MAM, Batista BTB. Design de experiência de aprendizagem: avaliação do modelo ADDIE e contribuições para o ensino a distância. Regae: Rev Gest Aval Educ. 2019;8(17):1-9. http://dx.doi.org/10.5902/2318133831922
http://dx.doi.org/10.5902/2318133831922...
-1212 Siega CK, Mendonça ITM, Gruber C, Jora DRJ. Storytelling como estratégia didática na formação de profissionais da enfermagem: relato de experiência. Saberes Plur [Internet]. 2021 [cited 2023 May 21];5(2):15-26. Available from: https://seer.ufrgs.br/index.php/saberesplurais/article/view/114424
https://seer.ufrgs.br/index.php/saberesp...
).

The storyboards were structured in the Microsoft Power Point® visual presentation editor in slide show format (*.ppsx), including images and vectors from public photo banks, licensed and royalty-free images and illustrations, such as such as Canva®, Flaticon® and Freepik®. At the end of the storyboards, references to the images used are described.

The presence of videos in storyboards aimed to make content approach more interactive and dynamic. The educational resources were created using Canva® and Animaker® in the Moving Picture Experts Group (MPEG) 4 Part 14 (*.MP4) format. The videos made available on a research group’s YouTube® channel, under a Creative Commons Attribution 4.0 International license, were indicated in the orderly presentation of the storyboards. The audios were recorded in the Moving Picture Experts Group (MPEG)1/2 Audio Layer 3 (*.MP3) format for the characters created in the Zepeto® and Animaker® applications with the aim of establishing dialogic interaction throughout the course.

The second stage consisted of content adequacy assessment by experts. The process of assessing course content adequacy occurs in the design phase. Between six and 20 experts were stipulated, as recommended in the literature on content assessment processes(1313 Haynes SN, Richard DCS, Kubany ES. Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess. 1995;7(3):238-47. https://doi.org/10.1037/1040-3590.7.3.238
https://doi.org/10.1037/1040-3590.7.3.23...
-1414 Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Coletiva. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006
https://doi.org/10.1590/S1413-8123201100...
). The final sample comprised a committee of experts composed of nine professionals.

The experts could be from any health or education institution in Brazil, as long as they met the inclusion criteria: being a health or administration professional; having specialization in of health management (lato sensu) or master’s or doctoral degree (stricto sensu) in education, administration, nursing or health sciences; having experience of at least one year working in waiting list management; having publications and/or research in health management; and/or having experience as a participant, tutor, lecturer or content writer in a distance education (DE) course.

To assess PAP and storyboards, the Educational Content Validation Instrument in Health (IVCES - Instrumento de Validação de Conteúdo Educativo em Saúde) was used. The instrument consists of 18 questions, in Likert format, organized into three domains: a) objectives; b) structure/presentation; and c) relevance(1515 Leite SS, Áfio ACE, Carvalho LV, Silva JM, Almeida PC, Pagliuca LMF. Construction and validation of an educational content validation instrument in health. Rev Bras Enferm. 2018;71(Suppl 4):1635-41. https://doi.org/10.1590/0034-7167-2017-0648
https://doi.org/10.1590/0034-7167-2017-0...
). To qualitatively assess the content, a descriptive question was added so that it was possible to record criticisms and/or recommendations. Seven questions were included in the instrument, which was edited in Google Forms®.

Expert selection was based on the Curriculum Lattes Platform, which used Fehring criteria (minimum score of five) to recruit potential experts to constitute the committee(1616 Fehring RJ. Methods to validate nursing diagnoses. Heart Lung [Internet]. 1987 [cited 2023 May 21];16:625-9. Available from: https://www.researchgate.net/publication/40505773_Methods_to_Validate_Nursing_Diagnoses
https://www.researchgate.net/publication...
-1717 Galdeano LE, Rossi LA. Validation of a diagnostic content: expert selection criteria. Cien Cuid Saude [Internet]. 2008 [cited 2023 May 21];5(1):60-6. Available from: https://periodicos.uem.br/ojs/index.php/CiencCuidSaude/article/view/5112
https://periodicos.uem.br/ojs/index.php/...
). These criteria were adapted to include professionals who had experience in managing waiting lists. An invitation to participate was sent by email to the 45 selected experts. The email address for accessing the Google Forms® form was made available in the invitation as well as the ICR, the PAP and the storyboards.

Answers were returned every five days, considering that data collection was electronic. The invited experts who did not answer within the first deadline (ten days) received three new messages reinforcing the invitation to participate (except those who notified that they were not interested in participating in the study).

Data collection took place from August to September 2022. Nine experts participated who electronically accepted the ICR and completely filled out the data collection instrument. Answers were stored in a Google Sheets® spreadsheet, which was transferred to Microsoft Excel® spreadsheet format. Each expert received a unique numeric code to compose the database. In this database, no data was observed that would allow identifying experts, which is a measure to protect participant confidentiality and anonymity.

Analysis of results, and statistics

When processing the database, answers from nominal to numerical expression for each variable in coding were considered. Subsequently, the data were imported into the Statistical Package for the Social Sciences® to carry out statistical analysis. The calculation of each item was carried out using the proportion of content adequacy with a 95% Confidence Interval, based on the evaluators’ answers. Therefore, the assessment considered a minimum acceptable value of 0.80 for the overall and general domains of the course modules(1414 Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Coletiva. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006
https://doi.org/10.1590/S1413-8123201100...
). Descriptive data from criticisms and/or recommendations for improvement were organized according to each storyboard and PAP. Each expert was named by the letter “E”, plus the number that appears in the database order (e.g., “E1”, “E2”, ... “E9”). To characterize the experts, descriptive statistics were used. The results were presented in tables.

RESULTS

The results are presented considering, respectively, the two stages of educational technology development.

Educational technology product construction

The pedagogical design of the educational technology “Multidisciplinary Training in Waiting List Management for Elective Surgical and Clinical Patients Course” was based on the online and self-instructional modality, with a workload of 20 hours. It consisted of two PAP and four storyboards of the course. Figure 1 presents the course matrix containing the modules, objectives and workload.

Figure 1
Matrix of multidisciplinary training course in managing patient waiting lists, Porto Alegre, Rio Grande do Sul, Brazil, 2022

The preparation of two PAP that support the development of the contents of modules 2 (http://bit.ly/PAPLista2) and 3 (http://bit.ly/PAPLista3) was based on scientific research in the area of list management expectations and experience of executing team members in the topic and educational objectives of the course. The skills to be covered, learning objectives, content, activities and resources were widely discussed and approved by the executing team. In PAP, the various resources that were used to make this teaching-learning process meaningful, dynamic and interactive are described, such as videos, flowcharts, mind maps, comic books, characters, scientific literature for mandatory reading and/or complementary.

The educational technology visual identity and learning resource map were defined and structured on Canva®. For each course module, a file was generated, called a storyboard. In total, five storyboards were generated, in which content and activities were developed as well as video, audio, characters, vectors, images and illustrations extracted from public databases. The storyboards were stored on Google Drive®, along with the email address for viewing and downloading, but without permission to edit and/or comment.

According to PAP, eight educational resources were planned in different formats to make up the storyboards: four videos; three comic books; a mind map; a playlist on YouTube®. Based on the script, four videos were created, one on Animaker® and the others on Canva®. The comic books and mind map were also made on Canva®. The videos and animated comic books were made available on the research group’s YouTube® channel in a playlist for use in the course or independent access (https://bit.ly/ListaEsperaYouTube), with the playlist being a dynamic and wide-reaching tool, as several people can access it from different places. In addition to the creation of the aforementioned products, the creation and presence of four characters who accompany and present the content to participants stand out. They establish dialogical interaction, which makes the self-instructional course more dynamic and interactive.

In modules 2 and 3, training activities were developed, creating four questions related to theoretical content that were presented at the end of the modules. Modules 1 and 4 are similar in structure. The former contains a diagnostic activity (before content) and the latter has an evaluative activity (after content). These modules do not have PAP for storyboards as they do not include content insertion.

Each of these modules takes one hour to solve three clinical cases that contain seven simple choice questions in four alternatives. Participants can, through clicks, choose the questions to be asked according to their interest. We tried to use different strategies to compose the questions, with a view to diversifying their demands and complexity. The difference between these two modules is in the ordering of clinical cases, fictitious names, geographic location and ordering of correct answers to questions as well as feedback at the end of each question (which did not occur in diagnostic activity). For the purposes of certification of participants in the course, the percentage of correct answers must be equal to or greater than 70% in module 4 assessment activity, in accordance with institutional regulations. Chart 1 presents storyboards of the modules that make up the course as educational technology.

Chart 1
Storyboards of multidisciplinary training course modules on managing patient waiting lists, Porto Alegre, Rio Grande do Sul, Brazil, 2022

These storyboards contain the other learning objects in videos, comic books and mind maps mentioned above. In Chart 1, the “Course presentation” was included, being the fifth storyboard that will be used to customize the virtual learning environment (VLE).

Content adequacy assessment by experts

The next stage involved the process of assessing content adequacy related to the two PAP and four storyboards of the course modules. The committee of expert was made up of nine participants, who assessed the items according to IVCES.

Of the participants, eight (88.8%) were women. The mean age was 42±6.3 years, and the degrees observed among experts were (6; 66.6%) doctoral and (3; 33.3%) master’s. All experts reported working in a public institution, with six (66.6%) working in higher education and three (33.3%) in healthcare services.

Length of professional experience ranged from two to nine years, with a median of 4.5 (2.7-7.5) years. Among the participants, four reported carrying out concomitant duties in their profession. It was observed that seven (77.7%) work as health managers; five (55.5%) work with hospital care; and one (11.1%) works with health education.

Modules 2 and 3 containing PAP and storyboards were assessed by experts independently, whereas, in modules 1 and 4, storyboard assessment, whose content and complexity were equal, was joint. Table 1 presents the results of experts’ assessment of the content of the four course modules.

Table 1
Content assessment of course modules (N=9), Porto Alegre, Rio Grande do Sul, Brazil, 2022

All modules that make up educational technology and were assessed by experts obtained a content adequacy of 0.89 (0.78 - 1.00). This value indicates the quality of adequacy of the course content that will be offered. Modules 1 and 4 were assessed together and obtained an overall evaluation with the same value as module 3, but both have a lower value than that achieved by module 2, which is the most consistent in content and has a greater workload. In relation to the objective and structure/presentation domains, module 2 stood out with the highest value compared to the other modules. In the relevance domain, modules 1 and 4 obtained the best assessment.

Participants described suggestions or recommendations to improve the quality of presentation of thematic content. All of them were welcomed, discussed, identified and adjusted in PAP and storyboards. Some of them are illustrated, such as the one related to didactics, [...] having some brief questions relating the topic to the practice and daily life of services throughout the module with the possibility of answers and feedback so that each student can go reflecting on what you already know about the topic. (E7) and [...] enlightening, interactive and creative, motivating participants to the learning process. All the features (videos, streams and comic books) look fantastic! (E9).

DISCUSSION

Waiting list management must involve the participation of several actors. Multidisciplinary integration results in improved patient care(44 Lisbôa RL, Kruel AJ, Marciniak JB, Paz AA. Actions of a regulatory nurse in the management of surgical waiting lists. Rev Bras Enferm. 2022;75(2):e20201233. https://doi.org/10.1590/0034-7167-2020-1233
https://doi.org/10.1590/0034-7167-2020-1...
,1818 Breda K, Souza MCA. Abordagem multiprofissional do paciente oncológico: revisão da literatura. Rev Pró-UniverSUS. 2020;11(2):33-7. https://doi.org/10.21727/rpu.v11i2.2375
https://doi.org/10.21727/rpu.v11i2.2375...
). Furthermore, managing multidisciplinary waiting lists increases the guarantee of fairness and transparency in the elective patient care process. The existence of the list constitutes an overall problem for public healthcare services indicated by OECD(55 Siciliani L, Hurst J. Tackling excessive waiting times for elective surgery: a comparative analysis of policies in 12 OECD countries. Health Policy. 2005;72(2):201-15. https://doi.org/10.1016/j.healthpol.2004.07.003
https://doi.org/10.1016/j.healthpol.2004...
-66 Lungu DA, Grillo RT, Nuti S. Decision making tools for managing waiting times and treatment rates in elective surgery. BMC Health Serv Res. 2019;19(1):369-77. https://doi.org/10.1186/s12913-019-4199-6
https://doi.org/10.1186/s12913-019-4199-...
,88 Governo do Distrito Federal (BR). Secretaria das Relações Internacionais - SERINTER. Agenda 2030: Objetivos do Desenvolvimento Sustentável [Internet]. Brasília: SERINTER; 2022 [cited 2023 May 21]. Available from: https://www.internacional.df.gov.br/agenda-2030-objetivos-do-desenvolvimento-sustentavel/
https://www.internacional.df.gov.br/agen...
), but not for private services, as they raise financial resources for each hospitalization and/or procedure performed.

Along with the lack of specific legal guidelines, there is the problem of scarcity of literary production on the topic(22 Lippi MC, Flexa RGC, Silva GV, Navarro LLL. Waiting list management as an approach to planning and coordination of elective health services. Rev Gestão Saúde [Internet]. 2018 [cited 2023 May 21];9(1):159-77. Available from: https://periodicos.unb.br/index.php/rgs/article/download/10448/9208/18739
https://periodicos.unb.br/index.php/rgs/...
-33 Lisbôa RL, Rodrigues CGS, Bittencourt CV, Paz AA. Estratégias de gerenciamento em listas de espera cirúrgicas: revisão integrativa. Acervo Saúde. 2022;15(2):e9612. https://doi.org/10.25248/reas.e9612.2022
https://doi.org/10.25248/reas.e9612.2022...
). Thus, it is reflected that, although waiting lists are not a recent problem at a national or even international level in Brazil, negotiations on this issue are still incipient. This further reinforces the need for educational actions for professionals who work in list management.

To truly make sense, professional education must be capable of promoting effective and significant transformations in care practices and in the organization of work processes in healthcare services. Professional education in hospital institutions must be developed in a permanent, active and consolidated manner, contributing to qualifying patient care(1919 Adamy KA, Zocche DAA, Vendruscolo C, Metelski FK, Argenta C, Valentini JS. Weaving permanent health education in the hospital context: experience report. Rev Enferm Cent O Min. 2018;8:e1924. https://doi.org/10.19175/recom.v8i0.1924
https://doi.org/10.19175/recom.v8i0.1924...
-2020 Corrêa CEC, Lopes GP, Silva CB, Paulin JN, Oliveira ND, Graeff MS, et al. Application of empathy map on educational actions carried out by nursing professionals. Rev Bras Enferm. 2022;75(4):e202104778. https://doi.org/10.1590/0034-7167-2021-0478
https://doi.org/10.1590/0034-7167-2021-0...
). Therefore, the need for educational actions is highlighted with the aim of encouraging, monitoring and strengthening the professional qualifications of workers working in the health sector, aiming at transforming healthcare practices based on the SUS fundamental principles.

Educational technology was structured for VLE, which sought to involve collaborative learning principles. It is hoped that participants become involved in their learning, based on the real situations that were created and that the course facilitates articulation of content with the context of participants’ work(2121 Warmling D, Boell JEW, Costa VT, Peres GM, Faust SB, Bolsoni CC, et al. Aproximando saberes e experiências à distância: relato da tutoria de um curso de especialização. Rev Salud pública [Internet]. 2018 [cited 2023 May 21];20(1):132-7. Available from: https://revistas.unal.edu.co/index.php/revsaludpublica/article/view/64480
https://revistas.unal.edu.co/index.php/r...
-2222 Gonçalves LBB, Pinto AGA, Duavy SMP, Alencar APA, Faustino RS, Palácio MAV. O uso das tecnologias digitais de informação e comunicação como recurso educacional no ensino de enfermagem. EaD Foco. 2020;10(1):e939. http://doi.org/10.18264/eadf.v10i1.939
http://doi.org/10.18264/eadf.v10i1.939...
).

Planning was outlined in two PAP that made it possible to define the objectives to be achieved by course participants, the content developed and the learning objects used in each module (including the strategies used to assess users’ progress). Updated scientific literature and target audience experiences are considered as subsidies for defining content in PAP(99 Branch RM. Instructional design: the ADDIE approach. New York: Springer; 2009. https://doi.org/10.1007/978-0-387-09506-6
https://doi.org/10.1007/978-0-387-09506-...
,1111 Souza AMC, Oliveira MLG, Lima MAM, Batista BTB. Design de experiência de aprendizagem: avaliação do modelo ADDIE e contribuições para o ensino a distância. Regae: Rev Gest Aval Educ. 2019;8(17):1-9. http://dx.doi.org/10.5902/2318133831922
http://dx.doi.org/10.5902/2318133831922...
).

It is noteworthy that, in self-instructional and online courses, the elements specific to the distance learning modality must be considered, even during planning, such as the selection of technologies and visual identity that will be used and that must be included in the description in resources in PAP(2323 Guilam MCR, Teixeira CP, Machado MFAS, Fassa AG, Fassa MEG, Gomes MQ, et al. Mestrado Profissional em Saúde da Família (ProfSaúde): uma experiência de formação em rede. Interface (Botucatu). 2020;24(Suppl 1):e200192. https://doi.org/10.1590/interface.200192
https://doi.org/10.1590/interface.200192...
-2424 Kenski VM. Design Instrucional para cursos online. São Paulo: Senac; 2015. 379 p.). For this reason, since the topic of waiting list management is a complex subject, efforts were made to develop learning objects that enable more participant dynamics and engagement in the course.

Thus, scientific literature mentions that storyboards are important in educational technology construction, as they organize and structure content and activities in a logical sequence in the development stage(1010 Parulla CD, Galdino DM, Dal Pai D, Azzolin KO, Cogo ALP. Nursing assessment: the elaboration and development of a massive open online course. Rev Gaúcha Enferm. 2020;41(spe):e20190199. https://doi.org/10.1590/1983-1447.2020.20190199
https://doi.org/10.1590/1983-1447.2020.2...
). All course storyboards were assessed by a committee of experts.

The educational technology proposal covered Analysis, Design and Development stages, according to the ADDIE model, which generated 17 products. These are considered to be learning objects that support the multidisciplinary course’s pedagogical proposal.

It is worth emphasizing that, if in the learning process, content is constructed through words and images that sharpen hearing and vision, it is possible to make learning more meaningful than if there were only a focus on reading on screen(2525 Costa LCS, Freitas LA, Avelino CCV, Costa AS, Nery MA, Goyatá SLT. Desenvolvimento e avaliação de tecnologia educacional sobre administração de vacinas no vasto lateral da coxa. Rev Eletr Enf. 2018;20:2052. https://doi.org/10.5216/ree.v20.54108
https://doi.org/10.5216/ree.v20.54108...
). It is recommended that educational resource production in format of videos designed to form courses does not exceed ten minutes in length(2626 Carvalho EC, Stina APN, Marmol MT, Garbin LM, Braga FTMM, Moreli L, et al. Efeito de vídeo educativo no comportamento de higiene bucal de pacientes hematológicos. Rev Eletr Enf. 2014;16(2):304-11. https://doi.org/10.5216/ree.v16i2.23300
https://doi.org/10.5216/ree.v16i2.23300...
). In consideration of this instruction, none of the four videos and two animated comic books created for the course exceeded this duration. All videos are grouped in a playlist called “Complexo Regulador de Saúde”, available on the research group’s YouTube® channel.

The assessment process of a committee of experts provides careful and careful support for planned educational actions(1010 Parulla CD, Galdino DM, Dal Pai D, Azzolin KO, Cogo ALP. Nursing assessment: the elaboration and development of a massive open online course. Rev Gaúcha Enferm. 2020;41(spe):e20190199. https://doi.org/10.1590/1983-1447.2020.20190199
https://doi.org/10.1590/1983-1447.2020.2...
). It is noteworthy that PAP and course storyboards prepared reached the value of content adequacy recommended by the literature(1414 Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Coletiva. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006
https://doi.org/10.1590/S1413-8123201100...
).

A study that assessed digital educational resources for health and safety at work in Primary Health Care and that also used IVCES found values between 0.88 and 0.96, which demonstrates the quality of the course(2727 Antoniolli SAC, Assenato APR, Araújo BR, Lagranha VEC, Souza LM, Paz AA. Construction and validation of digital education resources for the health and safety of workers. Rev Gaúcha Enferm. 2021;42:e20200032. https://doi.org/10.1590/1983-1447.2021.20200032
https://doi.org/10.1590/1983-1447.2021.2...
). The assessment of the development of a course aimed at using mental health diagnoses and interventions in clinical-surgical hospitalization units obtained values from 0.84 to 1.00(2828 Bard ND, Carazai DR, Maciel AG, Pinehiro KV, Rodrigues NH, Linch GFC, et al. Development and content validation of a course in mental health nursing care. Rev Gaúcha Enferm. 2023;44:e20210294. https://doi.org/10.1590/1983-1447.2023.20210294.en
https://doi.org/10.1590/1983-1447.2023.2...
). Another study concluded that experts who assessed an online course on neonatal pain highlighted the need to construct content and make educational products available independently, allowing users to decide the itinerary of their study(2929 Silva FFF, Costa T, Peres HHC, Duarte ED, Castral TC, Bueno M. Expert assessment of the “Neonatal Pain Assessment Program” online course. Rev Bras Enferm. 2020;73(4):e20180392. http://dx.doi.org/10.1590/0034-7167-2018-0392
http://dx.doi.org/10.1590/0034-7167-2018...
).

However, the items included in the IVCES domains are important, as they provide a basis for various aspects relevant to educational content, ensuring the offering of a product adequate for the target audience(1515 Leite SS, Áfio ACE, Carvalho LV, Silva JM, Almeida PC, Pagliuca LMF. Construction and validation of an educational content validation instrument in health. Rev Bras Enferm. 2018;71(Suppl 4):1635-41. https://doi.org/10.1590/0034-7167-2017-0648
https://doi.org/10.1590/0034-7167-2017-0...
). Thus, experts’ suggestions, criticisms and praise contributed to the quality of the proposed course.

All learning objects produced by this study can be (re)used according to the installed need, in addition to professionals having autonomy over the sequence of content they wish to learn in the course. Furthermore, using technologies in education generates greater cognitive gains for participants compared to conventional teaching(3030 Silva VBS, Backes MTS, Mello JF, Magagnin JS, Brasil JM, Silva CI, et al. Collective construction of a flowchart for follow-up of pregnant women with syphilis in the municipality of São José-SC. Cogitare Enferm. 2020;25:e65361. http://dx.doi.org/10.5380/ce.v25i0.65361
http://dx.doi.org/10.5380/ce.v25i0.65361...
-3131 Bernardes RM, Caliri MH. Construction and validation of a website about pressure injuries. Acta Paul Enferm. 2020;33:eAPE20190130. https://doi.org/10.37689/acta-ape/2020AO01305
https://doi.org/10.37689/acta-ape/2020AO...
).

The study demonstrated relevance when offered to professionals who work in waiting list management, enabling them to understand the concepts, reflect on the impacts and improve operational knowledge related to waiting list management of elective surgical and clinical patients.

Study limitations

As a challenge experienced in this study, we can mention the ADDIE model design stage, in which many hours of work were required to deliver the presented product. This required an organization of the executing team that worked remotely, given the scope of the pandemic and compliance with safe distancing standards during the construction period of the educational technology.

The lack of time to complete all phases of the ADDIE model, which includes the uncompleted execution phase, was another limiting factor. Two other factors contributed to intensifying the level of difficulty of the course proposal: the fact that the issue addressed still presents an incipient scientific literature; and the practice of list management does not have a common organizational process in all healthcare services.

Contributions to nursing and health

Based on the aforementioned limiting and hindering factors, it is important to offer the course to healthcare professionals, as using this educational technology in VLE makes it possible to clarify, update and inspire new practices in managing waiting lists. Thus, this educational technology contributes to the practice of different professional categories, especially regulatory nurses, qualifying skills in the nationwide management of elective patient waiting lists.

The practices of regulating and managing waiting lists for nurses working in IRC are recent. however, it is necessary to discuss this topic during the academic training period, when it comes to nursing and health management. It is understood that nurses have the managerial and leadership competence to mediate the list regulation process, as it strengthens the analysis of indicators and the formulation of strategies in the institution(44 Lisbôa RL, Kruel AJ, Marciniak JB, Paz AA. Actions of a regulatory nurse in the management of surgical waiting lists. Rev Bras Enferm. 2022;75(2):e20201233. https://doi.org/10.1590/0034-7167-2020-1233
https://doi.org/10.1590/0034-7167-2020-1...
). Furthermore, it is noteworthy that educational technologies enable qualifying nurses and other professionals so that these professionals can participate and contribute in sectors in which work is multidisciplinary.

CONCLUSIONS

Educational technology construction and assessment for multidisciplinary training achieved the quality of the content presented, using different strategies to create learning objects that were interrelated in the course’s pedagogical composition. Offering the course in its self-instructional modality favors the expansion of knowledge, as it allows professionals who work in managing waiting lists autonomy in the teaching-learning process. Furthermore, it contributes to developing and improving the work process so that bed regulation is carried out in a more qualified and efficient manner.

The participation of experts in course module assessment was essential to qualify the educational technology as well as scientifically guaranteeing, through a scale, content adequacy associated with learning objects. It is understood that, for improvement and updating to occur, educational technologies based on technical-scientific rigor must be encouraged and available.

It is considered that this educational technology should be aimed at students, residents and professionals, especially those who work in public healthcare institutions. Such institutions may be commonly marked by disparity in management and conditions between regions of Brazil. Hence, the multidisciplinary training course as an educational technology can collaborate with SDGs to reduce inequalities, alleviate differences, in addition to promoting equity in care and good health for patients.

  • FUNDING
    Brazilian National Council for Scientific and Technological Development (CNPq - Conselho Nacional de Desenvolvimento Científico e Tecnológico). Scientific Initiation and Teaching Initiation Program at the Universidade Federal de Ciências da Saúde de Porto Alegre (UFCSPA).

REFERENCES

  • 1
    Lopes F. De volta aos primórdios: em defesa do SUS como uma política antirracista. Bol Anál Político-Instit. 2021;1:9-19. https://doi.org/10.38116/bapi26art1
    » https://doi.org/10.38116/bapi26art1
  • 2
    Lippi MC, Flexa RGC, Silva GV, Navarro LLL. Waiting list management as an approach to planning and coordination of elective health services. Rev Gestão Saúde [Internet]. 2018 [cited 2023 May 21];9(1):159-77. Available from: https://periodicos.unb.br/index.php/rgs/article/download/10448/9208/18739
    » https://periodicos.unb.br/index.php/rgs/article/download/10448/9208/18739
  • 3
    Lisbôa RL, Rodrigues CGS, Bittencourt CV, Paz AA. Estratégias de gerenciamento em listas de espera cirúrgicas: revisão integrativa. Acervo Saúde. 2022;15(2):e9612. https://doi.org/10.25248/reas.e9612.2022
    » https://doi.org/10.25248/reas.e9612.2022
  • 4
    Lisbôa RL, Kruel AJ, Marciniak JB, Paz AA. Actions of a regulatory nurse in the management of surgical waiting lists. Rev Bras Enferm. 2022;75(2):e20201233. https://doi.org/10.1590/0034-7167-2020-1233
    » https://doi.org/10.1590/0034-7167-2020-1233
  • 5
    Siciliani L, Hurst J. Tackling excessive waiting times for elective surgery: a comparative analysis of policies in 12 OECD countries. Health Policy. 2005;72(2):201-15. https://doi.org/10.1016/j.healthpol.2004.07.003
    » https://doi.org/10.1016/j.healthpol.2004.07.003
  • 6
    Lungu DA, Grillo RT, Nuti S. Decision making tools for managing waiting times and treatment rates in elective surgery. BMC Health Serv Res. 2019;19(1):369-77. https://doi.org/10.1186/s12913-019-4199-6
    » https://doi.org/10.1186/s12913-019-4199-6
  • 7
    Ministério da Saúde (BR). Lei nº 8.080, de 19 de setembro de 1990. Dispõe sobre as condições para a promoção, proteção e recuperação da saúde, a organização e o funcionamento dos serviços correspondentes e dá outras providências [Internet]. Brasília: Ministério da Saúde; 1990 [cited 2023 May 21]. Available from: http://www.planalto.gov.br/ccivil_03/leis/L8080.htm
    » http://www.planalto.gov.br/ccivil_03/leis/L8080.htm
  • 8
    Governo do Distrito Federal (BR). Secretaria das Relações Internacionais - SERINTER. Agenda 2030: Objetivos do Desenvolvimento Sustentável [Internet]. Brasília: SERINTER; 2022 [cited 2023 May 21]. Available from: https://www.internacional.df.gov.br/agenda-2030-objetivos-do-desenvolvimento-sustentavel/
    » https://www.internacional.df.gov.br/agenda-2030-objetivos-do-desenvolvimento-sustentavel/
  • 9
    Branch RM. Instructional design: the ADDIE approach. New York: Springer; 2009. https://doi.org/10.1007/978-0-387-09506-6
    » https://doi.org/10.1007/978-0-387-09506-6
  • 10
    Parulla CD, Galdino DM, Dal Pai D, Azzolin KO, Cogo ALP. Nursing assessment: the elaboration and development of a massive open online course. Rev Gaúcha Enferm. 2020;41(spe):e20190199. https://doi.org/10.1590/1983-1447.2020.20190199
    » https://doi.org/10.1590/1983-1447.2020.20190199
  • 11
    Souza AMC, Oliveira MLG, Lima MAM, Batista BTB. Design de experiência de aprendizagem: avaliação do modelo ADDIE e contribuições para o ensino a distância. Regae: Rev Gest Aval Educ. 2019;8(17):1-9. http://dx.doi.org/10.5902/2318133831922
    » http://dx.doi.org/10.5902/2318133831922
  • 12
    Siega CK, Mendonça ITM, Gruber C, Jora DRJ. Storytelling como estratégia didática na formação de profissionais da enfermagem: relato de experiência. Saberes Plur [Internet]. 2021 [cited 2023 May 21];5(2):15-26. Available from: https://seer.ufrgs.br/index.php/saberesplurais/article/view/114424
    » https://seer.ufrgs.br/index.php/saberesplurais/article/view/114424
  • 13
    Haynes SN, Richard DCS, Kubany ES. Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess. 1995;7(3):238-47. https://doi.org/10.1037/1040-3590.7.3.238
    » https://doi.org/10.1037/1040-3590.7.3.238
  • 14
    Alexandre NMC, Coluci MZO. Content validity in the development and adaptation processes of measurement instruments. Ciênc Saúde Coletiva. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006
    » https://doi.org/10.1590/S1413-81232011000800006
  • 15
    Leite SS, Áfio ACE, Carvalho LV, Silva JM, Almeida PC, Pagliuca LMF. Construction and validation of an educational content validation instrument in health. Rev Bras Enferm. 2018;71(Suppl 4):1635-41. https://doi.org/10.1590/0034-7167-2017-0648
    » https://doi.org/10.1590/0034-7167-2017-0648
  • 16
    Fehring RJ. Methods to validate nursing diagnoses. Heart Lung [Internet]. 1987 [cited 2023 May 21];16:625-9. Available from: https://www.researchgate.net/publication/40505773_Methods_to_Validate_Nursing_Diagnoses
    » https://www.researchgate.net/publication/40505773_Methods_to_Validate_Nursing_Diagnoses
  • 17
    Galdeano LE, Rossi LA. Validation of a diagnostic content: expert selection criteria. Cien Cuid Saude [Internet]. 2008 [cited 2023 May 21];5(1):60-6. Available from: https://periodicos.uem.br/ojs/index.php/CiencCuidSaude/article/view/5112
    » https://periodicos.uem.br/ojs/index.php/CiencCuidSaude/article/view/5112
  • 18
    Breda K, Souza MCA. Abordagem multiprofissional do paciente oncológico: revisão da literatura. Rev Pró-UniverSUS. 2020;11(2):33-7. https://doi.org/10.21727/rpu.v11i2.2375
    » https://doi.org/10.21727/rpu.v11i2.2375
  • 19
    Adamy KA, Zocche DAA, Vendruscolo C, Metelski FK, Argenta C, Valentini JS. Weaving permanent health education in the hospital context: experience report. Rev Enferm Cent O Min. 2018;8:e1924. https://doi.org/10.19175/recom.v8i0.1924
    » https://doi.org/10.19175/recom.v8i0.1924
  • 20
    Corrêa CEC, Lopes GP, Silva CB, Paulin JN, Oliveira ND, Graeff MS, et al. Application of empathy map on educational actions carried out by nursing professionals. Rev Bras Enferm. 2022;75(4):e202104778. https://doi.org/10.1590/0034-7167-2021-0478
    » https://doi.org/10.1590/0034-7167-2021-0478
  • 21
    Warmling D, Boell JEW, Costa VT, Peres GM, Faust SB, Bolsoni CC, et al. Aproximando saberes e experiências à distância: relato da tutoria de um curso de especialização. Rev Salud pública [Internet]. 2018 [cited 2023 May 21];20(1):132-7. Available from: https://revistas.unal.edu.co/index.php/revsaludpublica/article/view/64480
    » https://revistas.unal.edu.co/index.php/revsaludpublica/article/view/64480
  • 22
    Gonçalves LBB, Pinto AGA, Duavy SMP, Alencar APA, Faustino RS, Palácio MAV. O uso das tecnologias digitais de informação e comunicação como recurso educacional no ensino de enfermagem. EaD Foco. 2020;10(1):e939. http://doi.org/10.18264/eadf.v10i1.939
    » http://doi.org/10.18264/eadf.v10i1.939
  • 23
    Guilam MCR, Teixeira CP, Machado MFAS, Fassa AG, Fassa MEG, Gomes MQ, et al. Mestrado Profissional em Saúde da Família (ProfSaúde): uma experiência de formação em rede. Interface (Botucatu). 2020;24(Suppl 1):e200192. https://doi.org/10.1590/interface.200192
    » https://doi.org/10.1590/interface.200192
  • 24
    Kenski VM. Design Instrucional para cursos online. São Paulo: Senac; 2015. 379 p.
  • 25
    Costa LCS, Freitas LA, Avelino CCV, Costa AS, Nery MA, Goyatá SLT. Desenvolvimento e avaliação de tecnologia educacional sobre administração de vacinas no vasto lateral da coxa. Rev Eletr Enf. 2018;20:2052. https://doi.org/10.5216/ree.v20.54108
    » https://doi.org/10.5216/ree.v20.54108
  • 26
    Carvalho EC, Stina APN, Marmol MT, Garbin LM, Braga FTMM, Moreli L, et al. Efeito de vídeo educativo no comportamento de higiene bucal de pacientes hematológicos. Rev Eletr Enf. 2014;16(2):304-11. https://doi.org/10.5216/ree.v16i2.23300
    » https://doi.org/10.5216/ree.v16i2.23300
  • 27
    Antoniolli SAC, Assenato APR, Araújo BR, Lagranha VEC, Souza LM, Paz AA. Construction and validation of digital education resources for the health and safety of workers. Rev Gaúcha Enferm. 2021;42:e20200032. https://doi.org/10.1590/1983-1447.2021.20200032
    » https://doi.org/10.1590/1983-1447.2021.20200032
  • 28
    Bard ND, Carazai DR, Maciel AG, Pinehiro KV, Rodrigues NH, Linch GFC, et al. Development and content validation of a course in mental health nursing care. Rev Gaúcha Enferm. 2023;44:e20210294. https://doi.org/10.1590/1983-1447.2023.20210294.en
    » https://doi.org/10.1590/1983-1447.2023.20210294.en
  • 29
    Silva FFF, Costa T, Peres HHC, Duarte ED, Castral TC, Bueno M. Expert assessment of the “Neonatal Pain Assessment Program” online course. Rev Bras Enferm. 2020;73(4):e20180392. http://dx.doi.org/10.1590/0034-7167-2018-0392
    » http://dx.doi.org/10.1590/0034-7167-2018-0392
  • 30
    Silva VBS, Backes MTS, Mello JF, Magagnin JS, Brasil JM, Silva CI, et al. Collective construction of a flowchart for follow-up of pregnant women with syphilis in the municipality of São José-SC. Cogitare Enferm. 2020;25:e65361. http://dx.doi.org/10.5380/ce.v25i0.65361
    » http://dx.doi.org/10.5380/ce.v25i0.65361
  • 31
    Bernardes RM, Caliri MH. Construction and validation of a website about pressure injuries. Acta Paul Enferm. 2020;33:eAPE20190130. https://doi.org/10.37689/acta-ape/2020AO01305
    » https://doi.org/10.37689/acta-ape/2020AO01305

Edited by

EDITOR IN CHIEF: Dulce Barbosa
ASSOCIATE EDITOR: Mitzy Danski

Publication Dates

  • Publication in this collection
    29 July 2024
  • Date of issue
    2024

History

  • Received
    09 Sept 2023
  • Accepted
    14 Apr 2024
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br