Responsible hospital discharge: content validation of nurse’s activitiesABSTRACT
Objective: To develop and validate a list of activities to be performed by the nurse at the responsible hospital discharge.
Method: Content validation study. The 14 generated items were organized on a Likert scale and submitted to judges’ appreciation, using the Delphi Technique. Relevance, explicitness in the statements and the sequential order of execution were evaluated. The consensus for the answers was pre-established at 0.80 and the content validity index was calculated.
Results: Eight professionals participated in the validation of the created list. In Delphi 1, the content validity index ranged from 0.7 (post-discharge contact and home visit scheduling) to 1.0 and in Delphi 2, a range from 0.60 (post-discharge telephone contact) to 1.0.
Conclusion: 13 of the 14 proposed activities were validated. The created list of activities can contribute to the safe discharge process, the continuity and comprehensiveness of care and, also, to the reduction of readmissions.
Keywords: Patient discharge; Continuity of patient care; Process assessment, health care; Nursing assessment; Validation study
RESUMEN
Objetivo: Ejecutar y validar un listado de actividades que deben realizar los enfermeros en el alta hospitalaria responsable.
Método: Estudio de validación de contenido. Los 14 ítems producidos fueron organizados en una escala Likert y sometidos a apreciación de jueces, mediante la Técnica Delphi. Se evaluó relevancia, claridad de los enunciados y orden secuencial de ejecución. El consenso para las respuestas fue preestablecido en 0,80 y calculado el índice de validación de contenido. Resultados: Ocho profesionales participaron en la validación de la lista construida. En Delphi 1, el índice de validación de contenido varió de 0,7 (contacto post-alta y programación de visita domiciliaria) a 1,0 y en Delphi 2, se encontró variación de 0,60 (contacto telefónico post-alta) a 1,0.
Conclusión: Fueron validadas 13 de las 14 actividades propuestas. El listado de actividades obtenido puede contribuir con el proceso de alta segura, con la continuidad e integralidad del cuidado y, también, con la reducción de reingresos en los hospitales.
Palabras clave: Alta del paciente; Continuidad de la atención al paciente; Evaluación de procesos, atención de salud; Evaluación en enfermería; Estudio de validación
RESUMO
Objetivo: Desenvolver e validar uma lista de atividades a serem realizadas pelo enfermeiro na alta hospitalar responsável.
Método: Estudo de validação de conteúdo. Os 14 itens gerados foram organizados em uma escala Likert e submetidos à apreciação de juízes, através da Técnica Delphi. Avaliou-se relevância, clareza nos enunciados e ordem sequencial de execução. O consenso para as respostas foi pré-estabelecido em 0,80 e calculado o índice de validade de conteúdo dos itens.
Resultados: Oito profissionais participaram da validação da listagem construída. Na Delphi 1, o índice de validade de conteúdo variou de 0,70 (contato pós alta e agendamento de visita domiciliar) a 1,0 e, na Delphi 2, encontrou-se variação de 0,60 (contato telefônico pós alta) a 1,0.
Conclusão: Foram validadas 13 das 14 atividades propostas. A listagem de atividades construída pode contribuir para o processo de alta segura, a continuidade e integralidade do cuidado e, ainda, para a redução das readmissões.
Palavras-chave: Alta do paciente; Continuidade da assistência ao paciente; Avaliação de processos em cuidados de saúde; Avaliação em enfermagem; Estudo de validação
INTRODUCTION
Discharge planning has been described as a way to qualify care and minimize the risk of complications after hospitalization1. Its early start is recommended, with an interprofessional and systemic approach, including the patient/family in decisions about care, and electing a coordinator to articulate resources and transfer information between levels of health care2. In addition, a package of measures involving standardized practices, guidelines and home monitoring for the patient/family, educational interventions with health professionals and periodic discussions between services is advocated3.
However, in the practical setting, this plan usually starts near the patient’s discharge date4) and restricted to usual care without connection with a formal process coordinator(1). Patients and family members are often not included in care planning, making it difficult the adherence and maintenance in home care(5).
Responsible discharge is foreseen in Brazilian legislation(6) and can be understood as a process of transition from hospitalized patient care to other levels of health care, especially to Primary Care. This care continuity model considers the participation and development of patient/family autonomy over care; the articulation between the different points of the network and the adoption of de-hospitalization mechanisms(6).
The nurse plays a central role in ensuring the continuity of treatment and patient safety in self-care, leading, and coordinating this process. In this way, he/she acts as a mediator in interprofessional actions, paying attention to the needs and concerns of the patient/family(7). In planning the discharge, this professional manages, together with the interprofessional team, situations that require greater demand for care at home(8), including chronic conditions, palliative care and the use of devices and equipment for health(9).
Although the transition from hospital discharge care (responsible) is legitimized, each hospital institution establishes its own workflow. Thus, the diverse activities performed by nurses during the discharge plan may differ between health institutions. Although there is an international reference(10) regarding the activities performed by nurses in the discharge plan, no studies have been identified, so far, addressing this model (responsible discharge), proposed nationally, for the continuity of care after hospitalization. Therefore, it is necessary to map and obtain expert consensus for the Brazilian reality.
The findings presented here constitute an initial part of a broaden investigation called “Transfer of care at hospital discharge: time dedicated by nursing and process effectiveness”, from a master’s program, and is linked to the research group Management of Health and Nursing Services (Gestão de Serviços de Saúde e de Enfermagem - GESTSAÚDE). The present study seeks to clarify the question: What activities should nurses perform in the responsible discharge process? Are they validated by experts? And for that, it aims to develop and validate a list of activities to be performed by the nurse during the responsible hospital discharge.
METHOD
This study of content validation followed the two stages proposed in the literature(11), that is, the development stage (here called activity mapping) and the judgment and quantification stage. In the first, there was identification of the construct (responsible hospital discharge) with a search in the literature and development of a list of activities/items to be performed by nurses during the discharge process. Next, a group of judges assessed the relevance of the generated items (qualitative part) and the content validity index of items (I-CVI) was calculated (quantitative part) based on the proportion of agreement of experts.
Content validity enables to verify whether the items that compose a scale (activities) adequately represent the construct under analysis(12). Activities, in this study, are considered the specific actions or behaviors of the nursing team, in the unfolding of an intervention, to achieve results(10).
Sources of information for the mapping of discharge activities were: a) Ordinance No. 3390 of the Ministry of Health on guidelines for the organization of the hospital component of the Health Care Network (Rede de Atenção à Saúde - RAS)(6) and the planning manual and management of discharges prepared by the investigated institution; b) the Nursing Interventions Classification (NIC) Discharge Plan (7370)(10); c) international standards and recommendations on discharge planning(2-4); and, d) other scientific production on the subject(5,13-15), among others.
The list created from these multiple sources, removing duplications, followed the chronological order of the stages of responsible discharge. The 14 items generated were organized on a four-point Likert scale, avoiding the neutral point. The scores for each item were: 1. strongly disagree, 2. disagree, 3. agree, and 4. strongly agree.
The items sequentially addressed the identification of eligibility criteria, communication with the physician about the expected discharge date, responsible discharge planning with the interprofessional team, collection of information from the patient and their family, insertion and guidance of these in home care, record in medical records, team coordination, formalization of counter-referral and post-discharge actions to solve identified problems.
The form generated by mapping activities was inserted into the Google Forms application, allowing for auto-completion. In the initial part, after explaining the research objectives, it was used the Free and Informed Consent Form (FICF) to mark acceptance, space for personal and professional data of the participants, ending with 14 activities proposed in the Likert format.
To validate the content of the generated list, the Delphi technique was used. In it, structured questionnaires are presented sequentially to a group of professionals (judges) with specific knowledge on a particular subject, in search of consensus. The number of phases varies in each study, but it is usually between two and four(16).
As eligibility criteria to compose the group of judges, it was considered a performance of at least one year in the process of responsible hospital discharge and/or scientific production related to the subject. The researchers were located on the Lattes Platform on the website of the National Council for Scientific and Technological Development (Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq). As for the other professionals, through referral by peers or managers of nursing services.
The judges were contacted by email with a link to access the online form. Reminders were sent when they exceeded the 15-day filing deadline. Appraisal was requested regarding the relevance of the content and wording of each activity (item) of the responsible discharge, evaluating whether they presented relevance, explicitness in the statements and sequential order of execution(16). Also, that they justified their choice and presented suggestions for improvement, if deemed necessary. Data collection took place between April and August 2020.
Statistical analysis was conducted using the software The SAS System for Windows (Statistical Analysis System), version 9.2 (SAS Institute Inc, 2002-2008, Cary, NC, USA). It included descriptive analysis of categorical variables (absolute frequency and percentage) and numerical (mean (M) and standard deviation (SD), median (MD) and quartile (Q1 and Q3).
In the quantitative analysis of the answers, the I-CVI was evaluated, that is, the proportion of agreement in each of the items (activities) in the list was measured among the evaluators (group of judges). This index is measured considering the number of items that received ratings of 3 and 4 divided by the number of judges(12). These authors advocate that in this process, an ordinal scale becomes a dichotomous scale (valid content x invalid content) and, therefore, the I-CVI must be adjusted using the modified kappa (K*) to avoid random agreement(12).
Thus, for each of the 14 items of the different Delphi phases, the probability of agreement by chance (pc), the item content validity index (I-CVI) and the modified kappa (K*) were calculated. The minimum agreement value of 0.80 was adopted, as recommended(12). For the interpretation of the Kappa, the following values were used: ≤ 0.40 (poor), 0.40 - 0.59 (moderate), 0.60 - 0.74 (good) and >0.74 (excellent)(17).
Anticipating data collection, the project was submitted to the Research Ethics Committee of the study institution - CAAE08412019.4.0000.5415 and opinion No. 3.198.240/2019. Participants were accepted by signing the FICF using the submitted form.
RESULTS
From the invited professionals, eight returned the questionnaires. The evaluators were female, with a mean age of 36.1 (SD=6.9; range 24-43) years and working time (seven clinical nurses and one manager) of 11.2 (SD=6.6; range 1-20) years; five had a specialization and three a master’s degree.
The Delphi application occurred in two phases. In Delphi 1, shown in Table 1, the mean agreement on the nurse’s activities ranged from 3.2 (contact after discharge and scheduling a home visit) to 4.0 (eligibility criteria; information collection; patient-family communication and teaching of equipment handling).
In this same phase, the I-CVI ranged from 0.7 (post-discharge contact and scheduling home visit) to 1.0 (criteria, discharge forecast, therapeutic project, information collection and sharing, documentation, patient/family communication and guidance, equipment handling and team coordination). The K* values ranged from 0.72 to 1.0 - considered excellent (Table 2).
From the answers obtained in the first questionnaire, changes were made in the second version of the list of activities. In view of the justifications pointed out by the judges, some terms were included or revised for better explicitness of the statements. It was opted for the inversion of items 5 and 6, considering that the communication and inclusion of the patient/family in the planning of discharge must precede the registering in medical records or electronically, thus following a chronology in the dynamics of the process. The evaluation of the effectiveness of the discharge plan (item 14) was validated, but with extensive reservations by the judges, and thus, it was decided to reformulate it. In this second moment, only five judges returned the answers to the questionnaires.
In the Delphi phase 2 (Table 3), the mean agreement on the nurse’s activities ranged from 2.8 (post-discharge telephone contact) to 4.0 (discharge forecast, therapeutic project, patient/family guidance and communication, team coordination and scheduling home visit).
As for the results of the I-CVI, from Delphi phase 2 (Table 4), all items received a value of 1.0, except for item 12 related to telephone contact after discharge, which obtained a value of 0.60; The K* values ranged from 0.42 (moderate) -1.0 (excellent).
The final list of the 13 validated activities to be performed by nurses at the responsible hospital discharge is presented in Chart 1.
DISCUSSION
This investigation had the purpose of develop and validate a list of activities performed by the nurse during the responsible hospital discharge. The multiple sources of information used, bringing together international and national, institutional guidelines and recommendations and research findings on the subject allowed the mapping, in sequential order of execution, of 14 activities that are part of this process.
A group of eight professionals, selected using the Delphi technique, participated in the content validation of the created list. This multi-phase interactive method for reaching consensus is considered practical, allowing the inclusion of a large number of experts, eliminating geographic barriers and preserving anonymity(16). Due to the influence of the composition of the group of professionals on the results obtained and the possibility of bias in the research(16), special attention was given to the knowledge and professional experience of the participants, prioritizing those with clinical practice, in public and private institutions, together to patients in palliative care, in a situation of chronicity and care with greater care complexity, in the process of responsible discharge.
In the Delphi 1 phase, mean scores and high I-CVI were obtained for most activities, showing high agreement between the judges. Of the 14 activities listed, ten presented maximum I-CVI and Kappa* (1.0). This highlights aspects such as identification of eligibility criteria; contact with the physician to forecast hospital discharge; establishment of the therapeutic project with the multidisciplinary team, collection of information from the patient to verify the facilitating and restricting factors for the continuation of care at home; patient/family communication and guidance; professional team coordination; documentation, referrals and information sharing with the city of origin and teaching of equipment handling are incorporated in the professional’s daily routine.
Studies have shown(7,15,18) that the nurse is directly linked to the coordination of the responsible discharge process, actively participating in the alignment of the interprofessional team in the elaboration of the therapeutic project. In this way, it searches among the team members, those involved, specifically, in the demand of each patient/family, according to the use of devices and care complexity, for articulation with the city of origin and continuation of care at home. Activities aimed at health education for both the patient and family/caregiver were identified as the most performed by nurses who work in the transition of care(18). The importance of choosing the right time - preferably at admission or in the first days of hospitalization - has been highlighted(2,4,18).
The activities “Post-discharge contact” and “Scheduling home visit”, both with I-CVI of 0.75 and K* of 0.72, did not reach the minimum value of agreement established (I-CVI ≥ 0.80)(12). According to the reports of the judges, these activities are relevant for the continuation of care. However, for some, they should be performed by Primary Health Care (PHC), that is, the city of origin of the patient; for others, only for patients with greater demand for care at hospital discharge.
In the Delphi second round, there was a consensus among the judges regarding the performance by the nurse of “Scheduling home visit” (activity 13) and “Identification of post-discharge problems” (activity 14), both with I-CVI and K* 1.0. The change in the wording and scope of actions seems to have been decisive for agreement. Thus, scheduling and conducting the home visit was limited to the inclusion of patients with greater demand for care needs (use of equipment/devices or care with greater technical complexity).
“Identification of post-discharge problems” originated from the restructuring of the activity “Assessing the effectiveness of the discharge plan”, approved in Delphi phase 1, but with many questions from the judges. Although they agreed with the importance of this assessment as a way to avoid failures in the process and establish improvements, they were concerned about the operationalization. Thus, in the new wording, there was greater specification incorporating actions such as the identification of problems after hospital discharge and the establishment of a care plan for their resolution. Also, the way it could happen - via telephone or on a home visit - and involving the reference PHC unit, when necessary.
It seems contradictory that the home visit reached a consensus among the judges, but not the monitoring of the patient/family through telephone contact, up to seven days after discharge, to clarify doubts and reinforce guidance- I-CVI 0.60 and K*0 .42. This can be explained, in part, by the number of judges being reduced to five in Phase 2, despite several reminders sent. Monitoring the patient/family through telephone contact and home visits greatly contributes to post-discharge care outcomes(14).
The workload and the consequent limitation of time for interprofessional communication makes the discharge process vulnerable, impacting the quality of guidance and information for the transition of care(14,18). To strengthen the articulation between Hospital Care and PHC, some countries such as Canada(19), Spain(15) and Portugal(20) adopted the “liaison nurse” model. This professional coordinates the discharge process, sharing information between the two levels of care, conducting care planning, educational activities and monitoring the patient/family’s care needs(19).
In Brazil, some initiatives in this sense are already emerging(21). They would also be of great value as a way to reduce the workload of nurses in hospitalization units, since the coordination of the senior responsible process takes time and they are already overloaded with care and management actions.
The reduction in the number of judges in the Delphi 2 phase could be considered a limitation of the study. However, there are no established criteria in the literature for the number of professionals in the group composition(16). Three experts are considered as the minimum acceptable number for measuring content validity(12). Interest and commitment are considered aspects that favor the retention of judges during the phases(12).
Also, the non-validation of one of the activities could have led to a third Delphi phase. This did not occur due to the loss of judges given the health situation caused by the COVID-19 pandemic and the time limit for conducting the study. The Delphi 2 phase was conducted during the COVID-19 pandemic, with a major impact on practice scenarios and on the workload, physical and emotional safety of health professionals. The judges were mostly clinical nurses. It is assumed, in this technique, that the number of questionnaire rounds (phases) continues until the group consensus is obtained or the number of questionnaire answers decreases.
The diversity of practice contexts, organization and work dynamics of the judges contributed to a list of activities in accordance with the reality of Brazilian health institutions. The validated mapping, in sequential order of performing the activities, can be used as a checklist to guide the planning and assessment of the hospital discharge system with proposals for improvements. It also allows the assessment of the time dedicated by the nurse in conducting the various stages of responsible discharge and measurement of the workload to adapt the staff. In this way, it contributes to the process of safe and humanized discharge, the continuity and comprehensiveness of care, and also to the reduction of readmissions and hospital expenses.
CONCLUSION
13 of the 14 activities proposed for responsible hospital discharge were validated. “Conduct monitoring of the patient/family through telephone contact within seven days after hospital discharge to clarify doubts and reinforce guidance”, did not obtain a pre-established consensus for the answers. Further research is recommended with a greater number of nurses, active in the responsible discharge process, to study the feasibility of hospital nurse to monitor the patient/family after hospitalization.
REFERENCES
-
1. Gonçalves-Bradley DC, Lannin NA, Clemson LM, Cameron ID, Shepperd S. Discharge planning from hospital. Cochrane Database Syst Rev. 2016;(1):CD000313. doi: https://doi.org/10.1002%2F14651858.CD000313.pub5
» https://doi.org/10.1002%2F14651858.CD000313.pub5 -
2. Mennuni M, Gulizia MM, Alunni G, Amico AF, Bovenzi FM, Caporale R, et al. ANMCO position paper: hospital discharge planning: recommendations and standards. Eur Heart J Suppl. 2017;19(suppl D):D244-D255. doi: https://doi.org/10.1093/eurheartj/sux011
» https://doi.org/10.1093/eurheartj/sux011 -
3. Hesselink G, Zegers M, Vernooij-Dassen M, Barach P, Kalkman C, Flink M, et al. Improving patient discharge and reducing hospital readmissions by using Intervention Mapping. BMC Health Serv Res. 2014;14:389. doi: https://doi.org/10.1186/1472-6963-14-389
» https://doi.org/10.1186/1472-6963-14-389 -
4. Lima MADS, Magalhães AMM, Oelke ND, Marques GQ, Lorenzini E, Weber LAF, et al. Care transition strategies in Latin American countries: an integrative review. Rev Gaúcha Enferm. 2018;39:e20180119. doi: https://doi.org/10.1590/1983-1447.2018.20180119
» https://doi.org/10.1590/1983-1447.2018.20180119 -
5. Hestevik CH, Molin M, Debesay J, Bergland A, Bye A. Older persons’ experiences of adapting to daily life at home after hospital discharge: a qualitative metasummary. BMC Health Serv Res. 2019;19:224.doi: https://doi.org/10.1186/s12913-019-4035-z
» https://doi.org/10.1186/s12913-019-4035-z -
6. Ministério da Saúde (BR. Gabinete do Ministro). Portaria nº 3.390, de 30 de dezembro de 2013. Institui a Política Nacional de Atenção Hospitalar (PNHOSP) no âmbito do Sistema Único de Saúde (SUS), estabelecendo-se as diretrizes para a organização do componente hospitalar da Rede de Atenção à Saúde (RAS) [Internet]. Brasília, DF: Ministério da Saúde; 2013 [cited 2019 Jan 15]. Available from: Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt3390_30_12_2013.html
» http://bvsms.saude.gov.br/bvs/saudelegis/gm/2013/prt3390_30_12_2013.html -
7. Thoma JE, Waite MA. Experiences of nurse case managers within a central discharge planning role of collaboration between physicians, patients and other healthcare professionals: a sociocultural qualitative study. J Clin Nurs. 2019;27:224. doi: https://doi.org/10.1111/jocn.14166
» https://doi.org/10.1111/jocn.14166 -
8. Hayajneh AA, Hweidi IM, Abu Dieh MW. Nurses' knowledge, perception and practice toward discharge planning in acute care settings: a systematic review. Nurs Open. 2020;7(5):1313-20. doi: https://doi.org/10.1002/nop2.547
» https://doi.org/10.1002/nop2.547 -
9. Ministério da Saúde (BR). Gabinete do Ministro. Portaria nº 825, de 25 de abril de 2016. Redefine a atenção domiciliar no âmbito do Sistema Único de Saúde (SUS) e atualiza as equipes habilitadas. Diário Oficial União. 2016 abr 26 [cited 2021 Jul 13];153(78 Seção 1): 33-38. Available from: Available from: https://pesquisa.in.gov.br/imprensa/jsp/visualiza/index.jsp?data=26/04/2016&jornal=1&pagina=33&totalArquivos=112
» https://pesquisa.in.gov.br/imprensa/jsp/visualiza/index.jsp?data=26/04/2016&jornal=1&pagina=33&totalArquivos=112 - 10. Bulechek GM, Butcher HK, Dochterman J, Wagner CM. NIC: Nursing Interventions Classifications [Internet]. 6. Ed. Rio de Janeiro: Elsevier; 2019.
-
11. Lynn MR. Determination and quantification of content validity. Nurs Res.1986;35(6), 382-5. doi: https://doi.org/10.1097/00006199-198611000-00017
» https://doi.org/10.1097/00006199-198611000-00017 -
12. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-67. doi: https://doi.org/10.1002/nur.20199
» https://doi.org/10.1002/nur.20199 -
13. Siqueira TH, Vila VSC, Weiss ME. Cross-cultural adaptation of the instrument readiness for hospital discharge scale - adult form. Rev Bras Enferm. 2018;71(3):983-91. doi: http://doi.org/10.1590/0034-7167-2017-0241
» http://doi.org/10.1590/0034-7167-2017-0241 -
14. Weber LAF, Lima MADS, Acosta AM, Marques GQ. Care transition from hospital to home: integrative review. Cogitare Enferm. 2017;(22)3:e47615. doi: http://doi.org/10.5380/ce.v22i3.47615
» http://doi.org/10.5380/ce.v22i3.47615 -
15. Costa MFBNA, Andrade SR, Soares CF, Ballesteros Pérez EI, Capilla Tomás S, Bernardino E. The continuity of hospital nursing care for primary health care in Spain. Rev Esc Enferm USP. 2019;53:e03477. doi: http://doi.org/10.1590/S1980-220X2018017803477
» http://doi.org/10.1590/S1980-220X2018017803477 -
16. Keeney S, Hasson F, McKenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006;53(2):205-12. doi: https://doi.org/10.1111/j.1365-2648.2006.03716.x.
» https://doi.org/10.1111/j.1365-2648.2006.03716.x. - 17. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. New Jersey: John Wiley & Sons; 2003.
-
18. Acosta AM, Câmara CE, Weber LAF, Fontenele RM. Nurse's activities in care transition: realities and challenges. J Nurs UFPE online. 2018;12(12):3190-7. doi: https://doi.org/10.5205/1981-8963-v12i12a231432p3190-3197-2018
» https://doi.org/10.5205/1981-8963-v12i12a231432p3190-3197-2018 -
19. Aued GK, Bernardino E, Lapierre J, Dallaire C. Liaison nurse activities at hospital discharge: a strategy for continuity of care. Rev Latino-Am Enfermagem. 2019;27:e3162. doi: http://doi.org/10.1590/1518-8345.3069.3162.
» http://doi.org/10.1590/1518-8345.3069.3162. -
20. Martins MM, Aued GK, Ribeiro OMPL, Santos MJ, Lacerda MR, Bernardino E. Discharge management to ensure continuity of care: experience of portuguese liaison nurses. Cogitare Enferm. 2018;(23)3:e58449. doi: http://doi.org/10.5380/ce.v23i3.58449
» http://doi.org/10.5380/ce.v23i3.58449 -
21. Ribas EN, Bernardino E, Larocca LM, Poli Neto P, Aued GK, Silva CPC. Nurse liaison: a strategy for counter-referral. Rev Bras Enferm. 2018;71(Suppl 1):546-53. doi: http://doi.org/10.1590/0034-7167-2017-0490
» http://doi.org/10.1590/0034-7167-2017-0490
Publication Dates
-
Publication in this collection
23 May 2022 -
Date of issue
2022
History
-
Received
18 Feb 2021 -
Accepted
22 Sept 2021
