Acessibilidade / Reportar erro

Translation and cross-cultural adaptation of the MISSCARE Survey-Ped into Brazilian Portuguese

Traducción y adaptación transcultural del MISSCARE Survey-Ped al portugués brasileño

ABSTRACT

Objectives:

to translate and cross-culturally adapt the MISSCARE Survey-Ped for use in Brazil.

Methods:

a methodological study proposed by translation, synthesis of translations, back-translation, assessment by a committee of experts and pre-testing with the target population.

Results:

two direct translations of the instrument were carried out, followed by a consensual version between them. This synthetic version was back-translated and analyzed by a committee of five experts in pediatric nursing and patient safety, obtaining a Content Validity Index (CVI) of 0.95 and Cronbach’s alpha of 0.804. The final version was sent for pre-testing with 254 Brazilian pediatric nurses, with 44 (17.3%) analyzing the instrument for understanding (CVI 0.866; Content Validity Ratio (CVR) 0.773), relevance (CVI 0.931; CVR 0.864) and relevance (CVI 0.977; CVR 0.955).

Conclusions:

the MISSCARE Survey-Ped Brasil was considered suitable for application in pediatric nurses’ clinical practice in the country.

Descriptors:
Pediatric Nursing; Patient Safety; Nursing Care; Validation Study; Workload

RESUMEN

Objetivos:

realizar la traducción y adaptación transcultural del instrumento MISSCARE Survey-Ped para su uso en Brasil.

Métodos:

estudio metodológico propuesto mediante traducción, síntesis de traducciones, retrotraducción, evaluación por comité de expertos y pretest con la población objetivo.

Resultados:

se realizaron dos traducciones directas del instrumento, seguidas de una versión consensuada entre ellas. Esta versión sintética fue retrotraducida y analizada por un comité de cinco expertos en enfermería pediátrica y seguridad del paciente, obteniendo un Índice de Validez de Contenido (IVC) de 0,95 y alfa de Cronbach de 0,804. La versión final fue enviada para prueba previa con 254 enfermeros pediátricos brasileños, y 44 (17,3%) analizaron el instrumento por su comprensión (CVI 0,866; Ratio de Validez de Contenido (CVR) 0,773), relevancia (CVI 0,931; RVC 0,864) y relevancia (CVI 0,977; RVC 0,955).

Conclusiones:

el MISSCARE Survey-Ped fue considerado adecuado para su aplicación en la práctica clínica de los enfermeros pediátricos del país.

Descriptores:
Enfermería Pediátrica; Seguridad del Paciente; Atención de Enfermería; Estudio de Validación; Carga de Trabajo

RESUMO

Objetivos:

realizar a tradução e adaptação transcultural do instrumento MISSCARE Survey-Ped para uso no Brasil.

Métodos:

estudo metodológico proposto por tradução, síntese das traduções, retrotradução, avaliação por comitê de especialistas e pré-teste com a população-alvo.

Resultados:

foram realizadas duas traduções diretas do instrumento, seguidas por uma versão consensual entre as mesmas. Essa versão síntese foi retrotraduzida e analisada por um comitê de cinco especialistas em enfermagem pediátrica e segurança do paciente, obtendo um Índice de Validade de Conteúdo (IVC) de 0,95 e alfa de Cronbach de 0,804. Enviou-se a versão final para pré-teste com 254 enfermeiros pediatras brasileiros, sendo que 44 (17,3%) analisaram o instrumento quanto à sua compreensão (IVC 0,866; Razão de Validade de Conteúdo (RVC) 0,773), pertinência (IVC 0,931; RVC 0,864) e relevância (IVC 0,977; RVC 0,955).

Conclusões:

o MISSCARE Survey-Ped Brasil foi considerado apto para aplicação na prática clínica de enfermeiros pediatras do país.

Descritores:
Enfermagem Pediátrica; Segurança do Paciente; Cuidados de Enfermagem; Estudos de Validação; Carga de Trabalho.

INTRODUCTION

Reducing the possibility of errors and violations capable of generating adverse events for patients during healthcare provision is a pillar for promoting patient safety(11 Alsabri M, Castillo FB, Wiredu S, et al. Assessment of Patient Safety Culture in a Pediatric Department. Cureus. 2021;13(4):e14646. https://doi.org/10.7759/cureus.14646
https://doi.org/10.7759/cureus.14646...
). However, a healthcare system cannot be organized without considering that human beings are prone to error. Instead of seeking perfection, patient safety culture aims to identify errors, manage risks, learn from errors and omissions, aiming to institute prevention measures that promote safety for patients and the system as a whole(11 Alsabri M, Castillo FB, Wiredu S, et al. Assessment of Patient Safety Culture in a Pediatric Department. Cureus. 2021;13(4):e14646. https://doi.org/10.7759/cureus.14646
https://doi.org/10.7759/cureus.14646...
-22 Amalberti R, Vincent C. Managing risk in hazardous conditions: improvisation is not enough. BMJ Qual Saf. 2020;29:60-3. https://doi.org/10.1136/bmjqs-2019-009443
https://doi.org/10.1136/bmjqs-2019-00944...
).

The typology and scope of errors in the healthcare sector are continually being known through research and dissemination of data from notifications encouraged by the World Health Organization and Ministry of Health health security policies(33 Ministério da Saúde (BR). Portaria nº. 529, de 1º de abril de 2013. Institui o Programa Nacional de Segurança do Paciente (PNSP) [Internet]. 2013 [cited 2022 Aug 19];Seção 1:43-4. Available from: https://www.sindhoesg.org.br/dados/publicacoes/pub0000739-e862afa3bc489190b08ec17021d6cefa.pdf
https://www.sindhoesg.org.br/dados/publi...
). Knowledge about situations that compromise patient safety generates opportunities for establishing control and prevention measures that make the healthcare system increasingly reliable, through the remodeling of structures, technologies and interaction processes between the healthcare system, healthcare professionals and patients and families(44 Hoffman JM, Keeling NJ, Forrest CB, Tubbs-Cooley HL, Moore E, Oehler E, et al. Priorities for pediatric patient safety research. Pediatrics. 2019;143(2):e20180496. https://doi.org/10.1542/peds.2018-0496
https://doi.org/10.1542/peds.2018-0496...
).

Errors and adverse events that affect children may differ from those that occur in adults due to characteristics known as 4Ds: demographics; development; dependence; and different health conditions(55 Woods D, Thomas E, Holl J, et al. Adverse events and preventable adverse events in children. Pediatrics. 2005;115(1):155-60. https://doi.org/10.1542/peds.2004-0410
https://doi.org/10.1542/peds.2004-0410...
-66 Miller MR, Mistry KB. Developing pediatric patient safety research priorities. Pediatrics. 2019;143(2):e20182970. https://doi.org/10.1542/peds.2018-2970
https://doi.org/10.1542/peds.2018-2970...
). In the same care environment, healthcare professionals care for newborns to adolescents, with different needs, types of care and service technologies, and may require knowledge of different specialties to care for neurological, respiratory, cardiovascular, gastrointestinal, urological problems, among others, demanding extensive knowledge from the team in an increasingly specialized area(44 Hoffman JM, Keeling NJ, Forrest CB, Tubbs-Cooley HL, Moore E, Oehler E, et al. Priorities for pediatric patient safety research. Pediatrics. 2019;143(2):e20180496. https://doi.org/10.1542/peds.2018-0496
https://doi.org/10.1542/peds.2018-0496...
). Medication errors stand out in pediatrics, with an estimated proportion of 1.8 to 2.96 errors per 100 discharges in the United States(55 Woods D, Thomas E, Holl J, et al. Adverse events and preventable adverse events in children. Pediatrics. 2005;115(1):155-60. https://doi.org/10.1542/peds.2004-0410
https://doi.org/10.1542/peds.2004-0410...

6 Miller MR, Mistry KB. Developing pediatric patient safety research priorities. Pediatrics. 2019;143(2):e20182970. https://doi.org/10.1542/peds.2018-2970
https://doi.org/10.1542/peds.2018-2970...
-77 Mueller BU, Neuspiel DR, Fisher ES, Council on quality improvement and patient safety, committee on hospital care. principles of pediatric patient safety: reducing harm due to medical care pediatrics. 2019;143(2):e20183649. https://doi.org/10.1542/peds.2018-3649
https://doi.org/10.1542/peds.2018-3649...
).

Scientific and ethical nursing care is based on providing the right assistance, in the right way, for the right person and at the right time, based on the best scientific information available to meet the full and individual needs of patients and their family(88 Pedreira MLG. Práticas de enfermagem baseadas em evidências para promover a segurança do paciente. Acta Paul Enferm. 2009;22(n.spe):880-1. https://doi.org/10.1590/S0103-21002009000700007
https://doi.org/10.1590/S0103-2100200900...
). However, the systems’ constant operational failures divert nurses’ actions towards the momentary resolution of difficulties. With such demands, which often go beyond what they are responsible for, nurses are unable to focus on attention to human beings’ individuality and comprehensiveness, delegating excessive activities to the technical level and compromising the ability to assess the nursing care provided(99 Cruz AC, Pedreira MLG. Cuidado centrado no paciente e família e segurança do paciente: reflexões sobre uma proximidade emergente. Rev Bras Enferm. 2020;73(6). https://doi.org/10.1590/0034-7167-2019-0672
https://doi.org/10.1590/0034-7167-2019-0...
).

Therefore, amid multiple demands and limited resources, nurses can shorten care, delay it or even omit it. Concerning errors, there are acts of commission (doing something wrong) and acts of omission (failing to do the right thing). Although errors of omission are more common to be ignored, their consequences can constitute a relevant threat to patient safety(1010 Siqueira LDC, Caliri MHL, Haas VJ, Kalisch B, Dantas RAS. Validation of the MISSCARE-BRASIL survey: a tool to assess missed nursing care. Rev Latino-Am Enfermagem. 2017;25:e2975. https://doi.org/10.1590/1518-8345.2354.2975
https://doi.org/10.1590/1518-8345.2354.2...
-1111 Kalisch BJ. Missed nursing care: a qualitative study. J Nurs Care Qual. 2006;21(4):306-13. https://doi.org/10.1097/00001786-200610000-00006
https://doi.org/10.1097/00001786-2006100...
). In definition, nursing care missed refers to any aspect of patient care that has been omitted (partially or completely) or delayed(1212 Kalisch BJ, Williams RA. Development and psychometric testing of a tool to measure missed nursing care. J Nurs Adm. 2009;39(5):211-9. https://doi.org/10.1097/NNA.0b013e3181a23cf5
https://doi.org/10.1097/NNA.0b013e3181a2...
-1313 Kalisch BJ, Landstrom GL, Hinshaw AS. Missed nursing care: a concept analysis. J Adv Nurs. 2009;65(7);1509-17. https://doi.org/10.1111/j.1365-2648.2009.05027.x
https://doi.org/10.1111/j.1365-2648.2009...
).

To intervene in order to increase safety and, consequently, quality of care, nurses must first identify the factors that predispose the occurrence of nursing care omissions, the barriers that prevent care provision and opportunities for improvement.

Kalisch and Williams(1212 Kalisch BJ, Williams RA. Development and psychometric testing of a tool to measure missed nursing care. J Nurs Adm. 2009;39(5):211-9. https://doi.org/10.1097/NNA.0b013e3181a23cf5
https://doi.org/10.1097/NNA.0b013e3181a2...
) developed an instrument called The Missed Nursing Care Survey, the MISSCARE Survey. The tool is divided into three parts, the first being composed of nurses’ demographic data and job satisfaction. Subsequently, Part A presents items relating to care not performed, and Part B covers the reasons for not carrying out such care, containing 24 and 17 items, respectively. Data is measured using a four-point Likert scale, which in Part A varies from “rarely forgotten” to “always forgotten” and, in Part B, from “not a reason” to “significant reason”. Part A and Part B can be applied independently(1212 Kalisch BJ, Williams RA. Development and psychometric testing of a tool to measure missed nursing care. J Nurs Adm. 2009;39(5):211-9. https://doi.org/10.1097/NNA.0b013e3181a23cf5
https://doi.org/10.1097/NNA.0b013e3181a2...
-1313 Kalisch BJ, Landstrom GL, Hinshaw AS. Missed nursing care: a concept analysis. J Adv Nurs. 2009;65(7);1509-17. https://doi.org/10.1111/j.1365-2648.2009.05027.x
https://doi.org/10.1111/j.1365-2648.2009...
).

In 2012, the MISSCARE Survey was adapted and validated for use in Brazil, under the name MISSCARE-BRASIL(1010 Siqueira LDC, Caliri MHL, Haas VJ, Kalisch B, Dantas RAS. Validation of the MISSCARE-BRASIL survey: a tool to assess missed nursing care. Rev Latino-Am Enfermagem. 2017;25:e2975. https://doi.org/10.1590/1518-8345.2354.2975
https://doi.org/10.1590/1518-8345.2354.2...
). The aim of making this instrument available in Brazil is to use tools capable of assessing nursing care omission, tending to favor the identification of solutions for the phenomenon in question and improving clinical practice(1010 Siqueira LDC, Caliri MHL, Haas VJ, Kalisch B, Dantas RAS. Validation of the MISSCARE-BRASIL survey: a tool to assess missed nursing care. Rev Latino-Am Enfermagem. 2017;25:e2975. https://doi.org/10.1590/1518-8345.2354.2975
https://doi.org/10.1590/1518-8345.2354.2...
). To date, there are no other instruments in nationally that propose to assess this phenomenon empirically. However, the instrument does not cover pediatric specificities, which reveals a gap in knowledge of neglected care within Brazilian pediatric nursing.

In 2015, Tubbs-Cooley et al.(1414 Tubbs -Cooley HL, Pickler RH, Younger JB, Mark BA. A descriptive study of nurse -reported missed care in neonatal intensive care units. J Adv Nurs. 2015;71(4):813-824. https://doi.org/10.1111/jan.12578
https://doi.org/10.1111/jan.12578...
) explored nursing care not provided in the neonatal context. To do this, they needed to adapt the original version of MISSCARE Survey considering specific characteristics of newborns, who require different nursing care as well as their planning when compared to adults. This also applies to pediatric hospitals, which differ from both the adult and neonatal settings, and a new version for this population was developed in Italy in 2018, the MISSCARE Survey-Ped(1515 Bagnasco A, Zanini M, Aleo G, Catania G, Kalisch BJ, Sasso L. Development and validation of the MISSCARE survey: pediatric version. J Adv Nurs. 2018;74(12):2922-34. https://doi.org/10.1111/jan.13837
https://doi.org/10.1111/jan.13837...
).

The process of adapting the instrument ended with 29 pediatric nursing care items in Section A and 17 reasons for omission in Section B, considering specific aspects of a pediatric environment, such as the constant presence of family members or caregivers who are actively involved in the care process(99 Cruz AC, Pedreira MLG. Cuidado centrado no paciente e família e segurança do paciente: reflexões sobre uma proximidade emergente. Rev Bras Enferm. 2020;73(6). https://doi.org/10.1590/0034-7167-2019-0672
https://doi.org/10.1590/0034-7167-2019-0...
,1515 Bagnasco A, Zanini M, Aleo G, Catania G, Kalisch BJ, Sasso L. Development and validation of the MISSCARE survey: pediatric version. J Adv Nurs. 2018;74(12):2922-34. https://doi.org/10.1111/jan.13837
https://doi.org/10.1111/jan.13837...
). The instrument was validated with a good Content Validity Index (CVI) (0.88) and Cronbach’s alpha (0.912; 0.82; 0.807)(1515 Bagnasco A, Zanini M, Aleo G, Catania G, Kalisch BJ, Sasso L. Development and validation of the MISSCARE survey: pediatric version. J Adv Nurs. 2018;74(12):2922-34. https://doi.org/10.1111/jan.13837
https://doi.org/10.1111/jan.13837...
).

Missed care in pediatrics is of particular concern, given the vulnerability and specificities of this population, as they are less capable of promoting their own safety, and negative results can seriously compromise their health. Therefore, this study proposes to translate and cross-culturally adapt the MISSCARE Survey-Ped for use in Brazil.

OBJECTIVES

To translate and cross-culturally adapt the MISSCARE Survey-Ped for use in Brazil.

METHODS

Ethical aspects

Authorization to use the instrument in Brazil as well as its translation and adaptation was obtained from the author who developed the MISSCARE Survey-Ped. The research was approved by the Universidade Federal de São Paulo Research Ethics Committee (UNIFESP-REC), and all study participants signed the Informed Consent Form (ICF).

Study design, period and location

This is a methodological study consisting of five stages, such as translation, synthesis of translations, back-translation, assessment by a committee of experts and pre-testing of cross-cultural adaptation with the target population, based on COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) recommendations(1616 Mokkink LB, Prinsen CAC, Alonso J, et al. COSMIN Study Design checklist for Patient-reported outcome measurement instruments [Internet]. Amsterdam, Netherlands: 2019 [cited 2022 Aug 25]. Available from: https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
https://www.cosmin.nl/wp-content/uploads...
).

Initially, direct translation of the instrument was carried out by two independent translators with knowledge of the original language and the target language. It was decided that one of the translators should be a nurse and be aware of the objectives of the study and the concepts involved (TA), whereas the other should not be a nurse nor aware of the objectives of the study (TB), reflecting the language used in the lay population, as per recommendations of Beaton et al.(1717 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
).

The translations obtained were analyzed by a professional with clinical and research knowledge in pediatric nursing and patient safety as well as advanced knowledge of English. This consensual version was forwarded to the initial translators for agreement on synthesis translation (ST).

Back-translation was implemented with the participation of two bilingual translators (BTA and BTB), native speakers of the original language and non-experts in the area of study, in an attempt to control bias and help find errors or inconsistencies in translation. All translators carried out the activity independently. The BTA and BTB versions were analyzed by the study authors until consensus was reached on identified consistencies.

A committee of five experts, as recommended by Lynn(1818 Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382-5. https://doi.org/10.1097/00006199-198611000-00017
https://doi.org/10.1097/00006199-1986110...
), composed of a team of nurses specializing in pediatric nursing, had to consolidate all the versions obtained (TA, TB, ST, BTA, BTB) and developing the version pre-final of the instrument, considering semantic equivalence (relating to the meaning of words in vocabulary and grammar), idiomatic equivalence (i.e., use of colloquialisms), experimental equivalence (which refers to situations involved in the cultural context) and conceptual equivalence (which explores the different ways a concept can be understood)(1717 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
).

This final version of MISSCARE Survey-Ped in Brazilian Portuguese was analyzed in a cross-cultural adaptation study. Pediatric nurses from Brazil, from different regions and levels of training, were invited to analyze understanding, relevance and relevance to pediatric nursing and patient safety.

All data was collected virtually between November 2021 and July 2022.

Sample and inclusion criteria

The recruitment of nurses participating in the research occurred from a search in curriculums in the Brazilian National Council for Scientific and Technological Development (CNPq - Conselho Nacional de Desenvolvimento Científico e Tecnológico) Lattes Platform, list of members of the Brazilian Society of Pediatric Nurses, contacts of the nursing research group on patient safety, pediatric intensive care and intravenous therapy in pediatrics (SEGTEC - Safety, Technology and Care) at UNIFESP and recognition as an expert in pediatric nursing or patient safety.

The selection of the five members for the committee included Brazilian nursing professionals, with advanced knowledge of English, clinical and/or research experience in pediatric nursing and/or patient safety. It is noteworthy that four (80.0%) nurses held a PhD degree and one (20.0%) hold a postdoctoral degree.

The decision on sample size for applying pre-testing considered the approach of Beaton et al.(1717 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
), suggesting between 20 and 40 people from the target group. In total, 254 Brazilian nurses were invited to apply pre-testing through an invitation letter sent by email, and 44 (17.3%) participated in the research.

Study protocol

Data collection took place virtually and in two stages. The first was developed between November 2021 and May 2022, involving the processes of translation, back-translation and analysis by a committee of experts. For the latter, a form was created in the Research Electronic Data Capture (REDCap)®, containing the ST version of the instrument to fill in semantic, idiomatic, experimental and cultural equivalences, using the Delphi technique for this phase of research. Each item presented could be assessed as “not equivalent”, “undecided” or “equivalent”, generating a Likert scale that scored -1, 0, 1, respectively. In cases of -1 or 0, experts should express suggestions for changes to the assessed item. The other versions (original, TA, TB, BTA and BTB) were also made available to experts for consultation.

The second stage of collection took place between June and July 2022 and began after the instrument was validated by the committee. The form for Brazilian nurses was created on Google Forms®. Each participant was asked to analyze the instrument based on or simulating a shift or a moment in which they carried out, supervised, experienced or reflected on daily nursing practice in the care of newborns, children, adolescents and their families, highlighting nursing care not performed. At the end of Section A and Section B, nurses could make considerations regarding adequacy or improvement. At the end of the two sections of MISSCARE Survey-Ped, an overall assessment was requested, according to a Likert scale that ranged from 1 to 5 points, considering “totally disagree”, “partially disagree”, “neither agree nor disagree”, “partially agree” and “totally agree”. In case of disagreement, nurses were asked to express suggestions for improvement.

Demographic variables to identify study participants were also collected (age, sex, level of academic training, city and state where they work, length of professional experience in years, length of experience in pediatric nursing, area of activity, work in an institution public or private, work shift and daily working hours), in addition to information related to job satisfaction (how satisfied you are and how you feel in the work environment), as proposed in the original MISSCARE.

Analysis of results, and statistics

The results were imported into a Microsoft Excel® spreadsheet and analyzed by the study authors. In order to quantify the degree of agreement between experts, equivalences were measured using CVI(1919 Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciênc Saúde Coletiva. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006
https://doi.org/10.1590/S1413-8123201100...
). The minimum value of CVI was considered 0.80 or 80.0% per item. Items that did not reach the minimum value were subjected to reassessment in a second round using the Delphi technique until consensus was reached by the committee.

Cronbach’s alpha was calculated to analyze internal consistency in the first and second round of expert assessment.

In relation to content analysis in the instrument’s overall assessment, the Content Validity Ratio (CVR) was calculated, which measures the agreement among assessing nurses on the importance of the item assessed(2020 Cohen RJ. Testagem e avaliação psicológica: introdução a testes e medidas. 8ª edição. Porto Alegre, RS: AMGH; 2014. p. 187-188.-2121 Lawshe CH. A quantitative approach to content validity. Personn Psychol. 1975; 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
https://doi.org/10.1111/j.1744-6570.1975...
). In the present study, 44 nurses participated, requiring a minimum CVR value of 0.29(2121 Lawshe CH. A quantitative approach to content validity. Personn Psychol. 1975; 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
https://doi.org/10.1111/j.1744-6570.1975...
-2222 Wilson RF, Pan W, Schumsky DA. Recalculation of the critical values for Lawshe’s content validity ratio. Meas Eval Couns Dev. 2012;45(3):197-210. https://doi.org/10.1177/0748175612440286
https://doi.org/10.1177/0748175612440286...
).

RESULTS

The TA and TB versions achieved close results, and ST was finalized after adjustments. BTA and BTB indicated fidelity to the original content and then ST was sent for analysis by experts. Concerning the instrument title, it was decided to maintain it in English, plus the designation of the translation as “MISSCARE Survey-Ped Brasil”.

Considering the instrument items, titles and subtitles, 50 items were analyzed. In the first round of evaluation by the expert committee, five (10.0%) and seven (14.0%) items relating to Sections A and B, respectively, were modified according to experts’ suggestions, as they obtained CVI<80.0%. The other items obtained CVI > 80.0%, and the instrument’s CVI in the first round was 89.0%, as shown in Tables 1 and 2. Cronbach’s alpha in the first round was 0.826, indicating good consistency.

Table 1
First round of the Delphi technique for assessing the translation of Section A of MISSCARE Survey-Ped into Brazilian Portuguese by a committee of experts according to semantic equivalence, idiomatic equivalence, experimental equivalence, cultural equivalence
Table 2
First round of the Delphi technique for assessing the translation of Section B of MISSCARE Survey-Ped into Brazilian Portuguese by a committee of experts according to semantic equivalence, idiomatic equivalence, experimental equivalence, cultural equivalence

Of the 12 items that required review after the first round, all were validated in the second round of analysis, and the final CVI of the instrument was 0.95. Cronbach’s alpha for the second round was 0.804, indicating acceptable consistency despite decay from one round to another.

After analysis by experts, pre-testing was applied to 44 nurses. All participants were female, with a mean age of 40 years, working in different areas and regions of the country and with different levels of training (Table 3).

Table 3
Data collected in pre-testing with participant characterization

Therefore, 30 nurses (68.1%) work in a public institution; nine (20.4%) work in a private institution; four (9.0%) work in both; and one (2.2%) identified himself as retired/not employed. The majority (68.1%) of participants work during the day and 75.0% of nurses did not report working double shifts. With regard to daily working hours, 21 (47.7%) work eight hours a day; nine (20.0%) selected the option other or not applicable; seven (15.9%) comply with the 12x36 schedule; and seven (15.9%) work six hours or less.

As for job satisfaction, 33 (75.0%) nurses declared to be satisfied; nine (20.4%) are very satisfied; and two (4.5%) are not very satisfied. Thus, 20 (45.5%) participants indicated that they feel more happy/excited/good-humored than sad/discouraged/grumpy at work; four (9.1%) nurses feel more sad/discouraged/grumpy than happy/excited/good-humored; 23 (52.3%) feel more calm/satisfied than tense/stressed; 10 (22.7%) feel more tense/stressed than calm/satisfied.

After presenting the instrument, 42 (95.5%) of nurses identified unperformed nursing care, arranged in Section A. The most frequently highlighted items were “Verificação de segurança dos equipamentos e limpeza concorrente do mobiliário realizadas uma vez por plantão ou segundo protocolo (por exemplo, cama, mesa de cabeceira, dispositivos)”, marked 29 (69.0%) times, “Participação na visita clínica multiprofissional diária à beira leito”, marked 27 (64.3%) times, “Cuidados bucais”, “Solicitações de medicamentos atendidas dentro de 15 minutos” and “Avaliação das atividades atribuídas aos cuidadores”, marked 22 (52.4%) times each.

In Section B, 43 (97.7%) nurses responded that the reasons for omitted nursing care were related to work resources. The most frequently mentioned items were “Número inadequado de técnicos/auxiliares de enfermagem”, with 34 (79.1%) responses, and “Número inadequado de enfermeiros”, with 33 (76.7%).

With respect to the causes related to communication, 41 (93.2%) nurses responded and highlighted mainly the items “Falta de colaboração entre membros da equipe (por exemplo, enfermeiros, técnicos/auxiliares de enfermagem e médicos)”, with 33 (80.5%) responses, and “Inadequada passagem de plantão entre turnos ou na transferência entre unidades”, with 28 (68.3%) responses.

Hence, 40 (90.9%) nurses considered material resources as a reason for omitting nursing care, highlighting in greater numbers the items “Materiais/equipamentos não funcionam corretamente quando necessário”, with 29 (72.5%) responses, and “Materiais/equipamentos não disponíveis quando necessários (por exemplo, bombas de infusão, instrumentais cirúrgicos)”, with 28 (70.0%) responses.

In relation to understanding, 29 (65.9%) of nurses completely agreed that the instrument is clear, intelligible and easy to understand; 10 (22.7%) partially agreed; four (9.1%) partially disagreed; and one (2.3%) neither agreed nor disagreed.

When assessing relevance, 28 (63.6%) nurses completely agreed that the instrument covers situations related to nursing care not provided and reasons for omissions; 13 (29.5%) partially agreed; two (4.5%) neither agreed nor disagreed; and one (2.3%) totally disagreed.

It was found that 32 (72.7%) nurses completely agreed in the analysis that the instrument is relevant for identifying nursing care not performed and the reasons for omissions; 11 (25.0%) partially agreed; and one (2.3%) partially disagreed.

According to Table 4, high CVR and CVI values are noted, indicating consistency in evaluators’ responses to the questionnaire assessment items.

Table 4
Estimates of the Content Validity Ratio and Content Validity Index in the overall assessment of MISSCARE Survey-Ped Brasil regarding understanding, pertinence and relevance

From statistical analysis using the Quasi-Poisson generalized linear model, it was observed that labor resources increased by an average of 1,290 nursing care described as not performed, as there was a significant relationship between reporting nursing care not performed due to work-related causes (p<0.001).

It was also found that the total nursing care mentioned in Section A is not related to sociodemographic variables. The mean number of reasons indicated in Section B is different between those who work six hours or less and those who answered other/not applicable. Nurses who answered other/not applicable indicated more reasons in Section B.

Working at night increased the number of items marked in Section B in labor resources by a mean of 1.6. Being more happy/excited/good-humored than sad/discouraged/grumpy and more calm/satisfied than tense/stressed the number of items marked in Part B in labor resources decreased by a mean of 1.37.

In the cross-cultural adaptation process, suggestions regarding the terms used stood out. A nurse mentioned that “In the item “Resposta à luz de chamada, à solicitação de chamada e alarme”, call light is perhaps more understandable as a bell [...]”. Another suggestion was “In the item “Documentação completa com todos os dados necessários”, it is not very clear in the translation whether this refers to documents in the medical record or shift handover or handoff [...]”. However, these items were not revised, as they were mentioned by only one nurse (2.2%).

Based on suggestions of participating nurses regarding Section A, Section B and the overall assessment of the instrument, the item “Desequilíbrio nas atribuições com pacientes” needed to be revised and changed to “Desequilíbrio no dimensionamento de pacientes”, as this issue was mentioned by two nurses (4.5%) who expressed doubt about the meaning of the phrase, and the suggestion was understood as pertinent. thus, the latest version of MISSCARE Survey-Ped Brasil was finalized, as shown in Chart 1.

Chart 1
Versions of the MISSCARE Survey-Ped Brasil with items changed according to suggestions highlighted in bold

DISCUSSION

Errors of omission are considered phenomena intrinsic to the human cognitive process and are among the most relevant types of incidents in the healthcare system worldwide, due to their frequent occurrence and potential to cause harm to patients. However, there is still little empirical evidence of this phenomenon in pediatric populations(2323 Lake ET, de Cordova PB, Barton S, Singh S, Agosto PD, Ely B, Roberts KE, Aiken LH. Missed nursing care in pediatrics. Hosp Pediatr. 2017;7(7):378-84. https://doi.org/10.1542/hpeds.2016-0141
https://doi.org/10.1542/hpeds.2016-0141...
).

The present study described the process of translating and cross-cultural adapting the MISSCARE Survey-Ped, originally in English, into Brazilian Portuguese, following recommendations in the literature. The process, although complex, is of great importance, because while it preserves the characteristics of the original version, it is adapted considering the heterogeneity of the population and the use of regional terms(2424 Dortas Junior SD, Lupi O, Dias GAC, Guimaraes MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol. 2016;4(1):26-30. https://doi.org/10.5935/2318-5015.20160003
https://doi.org/10.5935/2318-5015.201600...
).

The involvement of experts in pediatric nursing and patient safety favored the development of the study, as, with their proven experience in the area, they suggested adjustments that promoted improvements in the synthesis version (ST). Likewise, the participation of pediatric nurses from all regions of Brazil, except the North, with different levels of training, benefited the identification of differences in aspects of nursing practice, when considering the country’s continental proportions. It is noteworthy, however, that the majority of nurses had graduate academic training, reflecting a portion of nurses with greater academic preparation. This result may be related to the low proportion of nurses who agreed to participate in the research, with graduate professionals being more encouraged to participate in scientific research of this nature.

The relationship between identification of care not performed in adult patients observed in the MISSCARE validity study in Brazil(1010 Siqueira LDC, Caliri MHL, Haas VJ, Kalisch B, Dantas RAS. Validation of the MISSCARE-BRASIL survey: a tool to assess missed nursing care. Rev Latino-Am Enfermagem. 2017;25:e2975. https://doi.org/10.1590/1518-8345.2354.2975
https://doi.org/10.1590/1518-8345.2354.2...
), compared to pediatric patients, is significant in terms of participation in the multidisciplinary clinical visit, as was also observed in the present study. The organization of the multidisciplinary team’s work process in caring for hospitalized children depends on professionals’ conceptions about meaning of work and team, and their importance, aiming to achieve comprehensive care. Communication failures, work overload, health service flows and processes and interruptions are aspects that weaken care dynamics(2525 Machado NA, Nóbrega VM, Silva MEA, França DBL, Reichert APS, Collet N. Doença crônica infantojuvenil: vínculo profissional-família para a promoção do apoio social. Rev Gaúcha Enferm. 2018;39. https://doi.org/10.1590/1983-1447.2018.2017-0290
https://doi.org/10.1590/1983-1447.2018.2...
).

Regarding care not carried out in the pediatric context, in a validity study of MISSCARE Survey-Ped for use in Turkey, the main nursing care activities not carried out during the last shift were: administering medications 30 minutes before or after hours schedules; responding to patient requests for prescribed medications within 15 minutes; and involving parents in child care(2626 Incekar MC, İspir O, Sönmez B, Selalmaz M, Erdost SK. Turkish validation of the MISSCARE survey: pediatric version. J Pediatric Nurs. 2020;53. https://doi.org/10.1016/j.pedn.2020.03.012
https://doi.org/10.1016/j.pedn.2020.03.0...
). The latter, being specific care for pediatric environments, points to Patientand Family-Centered Care (PFCC).

PFCC implementation in care contexts can result in several actions and strategies that contribute to patient safety, promoting the provision of qualified care that results in a better experience for patients and families in contact with the healthcare system. However, the lack of training of healthcare professionals on establishing effective patient relationships is still an obstacle to be overcome(99 Cruz AC, Pedreira MLG. Cuidado centrado no paciente e família e segurança do paciente: reflexões sobre uma proximidade emergente. Rev Bras Enferm. 2020;73(6). https://doi.org/10.1590/0034-7167-2019-0672
https://doi.org/10.1590/0034-7167-2019-0...
,2525 Machado NA, Nóbrega VM, Silva MEA, França DBL, Reichert APS, Collet N. Doença crônica infantojuvenil: vínculo profissional-família para a promoção do apoio social. Rev Gaúcha Enferm. 2018;39. https://doi.org/10.1590/1983-1447.2018.2017-0290
https://doi.org/10.1590/1983-1447.2018.2...
).

Also noteworthy is the item in Section A that was most frequently highlighted by participating Brazilian nurses as care not performed, “Verificação de segurança dos equipamentos e limpeza concorrente do mobiliário realizadas uma vez por plantão ou segundo protocolo (por exemplo, cama, mesa de cabeceira, dispositivos)”, which is directly linked to hospital infection prevention and control. Healthcare-Associated Infections (HAIs) in pediatrics are important adverse events that affect treatment, increasing morbidity, mortality, length of stay, costs and suffering for children and family.

In Section B, which points to the reasons for nursing care omission, the subsection “recursos laborais” presented the highest mean comparison of responses. Likewise, in studies carried out with MISSCARE in the United States(1212 Kalisch BJ, Williams RA. Development and psychometric testing of a tool to measure missed nursing care. J Nurs Adm. 2009;39(5):211-9. https://doi.org/10.1097/NNA.0b013e3181a23cf5
https://doi.org/10.1097/NNA.0b013e3181a2...
), Turkey(2727 Kalisch BJ, Terzioglu F, Duygulu S. The MISSCARE survey-Turkish: psychometric properties and findings. Nurs Econom. 2012;30(1):29-37. https://doi.org/10.1016/j.pedn.2020.03.012
https://doi.org/10.1016/j.pedn.2020.03.0...
) and Brazil(1010 Siqueira LDC, Caliri MHL, Haas VJ, Kalisch B, Dantas RAS. Validation of the MISSCARE-BRASIL survey: a tool to assess missed nursing care. Rev Latino-Am Enfermagem. 2017;25:e2975. https://doi.org/10.1590/1518-8345.2354.2975
https://doi.org/10.1590/1518-8345.2354.2...
), they also obtained higher scores related to labor resources.

The inadequate number of nursing professionals was cited as the main reason for not providing nursing care in pediatrics. This is consistent with national studies that report the precariousness, inadequacies and dissatisfactions experienced in hospitals by these professionals, involving working conditions, dissatisfaction with salary, increased hours worked and burnout. As a result, workers are forced to request leaves of absence and/or resign, a situation that contributes to the lack of professionals in the area(2828 Miranda FMA, Santana LL, Pizzolato AC, Saquis LMM. Condições de trabalho e o impacto na saúde dos profissionais de enfermagem frente a Covid-19. Cogitare Enferm. 2020;25:e72702. https://doi.org/10.5380/ce.v25i0.72702
https://doi.org/10.5380/ce.v25i0.72702...

29 Santos TA, Suto CSS, Santos JM. Condições de trabalho de enfermeiras, técnicas e auxiliares de enfermagem em hospitais públicos. REME - Rev Min Enferm [Internet]. 2020[cited 2022 Aug 25];24:e-1339. Available from: http://www.revenf.bvs.br/pdf/reme/v24/1415-2762-reme-24-e1339.pdf
http://www.revenf.bvs.br/pdf/reme/v24/14...
-3030 Paulino GME, Matta ACG, Camillo NRS, Simões AC, Nishiyama JAP, Oliveira JLC, et al. Professional satisfaction and work environment of the nursing team in Intensive Care Units. REME - Rev Min Enferm [Internet]. 2019[cited 2022 Aug 25];23:e-1271. Available from: https://www.researchgate.net/publication/337957168_PROFESSIONAL_SATISFACTION_AND_WORK_ENVIRONMENT_OF_THE_NURSING_TEAM_IN_INTENSIVE_CARE_UNITS
https://www.researchgate.net/publication...
). Considering that the majority of participating nurses work in public health institutions, this explains the high number of nurses who marked this item.

Both versions, MISSCARE Survey-Ped and MISSCARE Survey-Ped Brasil, presented similar results in the validity process: Cronbach’s alpha values were greater than 0.70, considered acceptable for internal consistency and, similarly, the CVI was greater than 0.80, demonstrating good content validity.

Study limitations

The impossibility of comparing the findings between all Brazilian regions was identified as a limitation of this study, as there was no participation of nurses from the North region. Furthermore, participants’ nursing practice context can modify their assessment of situations that lead to omissions in nursing care. Although carried out in different regions of the country, as the workplace was not a variable considered in this study, nurses allocated to a given location may have contributed more broadly, without necessarily reflecting the reality of that region. Considering that this was a translation and cross-cultural adaptation study, it is also necessary that the MISSCARE Survey-Ped Brasil be applied to a larger sample and with factor analysis. This study is under development for practical assessment of the instrument.

Contributions to nursing, health, or public policies

The advantages of using the instrument are widely described in international literature, highlighting that it can offer information for developing public policies aimed at promoting patient safety, having been assessed by experts. It can also be useful to healthcare institutions in the development of protocols, guidelines or checklists, in order to promote positive professional practice environments, prevent forgetfulness and possible errors of omission during nursing practice. As it is aimed at pediatric nursing, it will cover the specificities of this population, making it possible to improve outcome indicators in the healthcare of children who require hospitalization.

CONCLUSIONS

With this study, it was possible to translate and cross-culturally adapt the MISSCARE Survey-Ped into Brazilian Portuguese, being considered suitable for use in national health institutions, upon achieving adequate levels of content validation by specialists and nurses in clinical practice.

AVAILABILITY OF DATA AND MATERIAL

https://doi.org/10.48331/scielodata.IOBMLO

  • FUNDING
    This work was carried out with the support of the Graduate Program in Nursing at Escola Paulista de Enfermagem, the Coordination for the Improvement of Higher Education Personnel - Brazil (CAPES - Coordenação de Aperfeiçoamento de Pessoal de Nível Superior) - Financing Code 001, the São Paulo Research Support Foundation (FAPESP - Fundação de Amparo à Pesquisa do Estado de São Paulo) - Process 2021/05980-0 and CNPq, Process 308281/2015-2.

REFERENCES

  • 1
    Alsabri M, Castillo FB, Wiredu S, et al. Assessment of Patient Safety Culture in a Pediatric Department. Cureus. 2021;13(4):e14646. https://doi.org/10.7759/cureus.14646
    » https://doi.org/10.7759/cureus.14646
  • 2
    Amalberti R, Vincent C. Managing risk in hazardous conditions: improvisation is not enough. BMJ Qual Saf. 2020;29:60-3. https://doi.org/10.1136/bmjqs-2019-009443
    » https://doi.org/10.1136/bmjqs-2019-009443
  • 3
    Ministério da Saúde (BR). Portaria nº. 529, de 1º de abril de 2013. Institui o Programa Nacional de Segurança do Paciente (PNSP) [Internet]. 2013 [cited 2022 Aug 19];Seção 1:43-4. Available from: https://www.sindhoesg.org.br/dados/publicacoes/pub0000739-e862afa3bc489190b08ec17021d6cefa.pdf
    » https://www.sindhoesg.org.br/dados/publicacoes/pub0000739-e862afa3bc489190b08ec17021d6cefa.pdf
  • 4
    Hoffman JM, Keeling NJ, Forrest CB, Tubbs-Cooley HL, Moore E, Oehler E, et al. Priorities for pediatric patient safety research. Pediatrics. 2019;143(2):e20180496. https://doi.org/10.1542/peds.2018-0496
    » https://doi.org/10.1542/peds.2018-0496
  • 5
    Woods D, Thomas E, Holl J, et al. Adverse events and preventable adverse events in children. Pediatrics. 2005;115(1):155-60. https://doi.org/10.1542/peds.2004-0410
    » https://doi.org/10.1542/peds.2004-0410
  • 6
    Miller MR, Mistry KB. Developing pediatric patient safety research priorities. Pediatrics. 2019;143(2):e20182970. https://doi.org/10.1542/peds.2018-2970
    » https://doi.org/10.1542/peds.2018-2970
  • 7
    Mueller BU, Neuspiel DR, Fisher ES, Council on quality improvement and patient safety, committee on hospital care. principles of pediatric patient safety: reducing harm due to medical care pediatrics. 2019;143(2):e20183649. https://doi.org/10.1542/peds.2018-3649
    » https://doi.org/10.1542/peds.2018-3649
  • 8
    Pedreira MLG. Práticas de enfermagem baseadas em evidências para promover a segurança do paciente. Acta Paul Enferm. 2009;22(n.spe):880-1. https://doi.org/10.1590/S0103-21002009000700007
    » https://doi.org/10.1590/S0103-21002009000700007
  • 9
    Cruz AC, Pedreira MLG. Cuidado centrado no paciente e família e segurança do paciente: reflexões sobre uma proximidade emergente. Rev Bras Enferm. 2020;73(6). https://doi.org/10.1590/0034-7167-2019-0672
    » https://doi.org/10.1590/0034-7167-2019-0672
  • 10
    Siqueira LDC, Caliri MHL, Haas VJ, Kalisch B, Dantas RAS. Validation of the MISSCARE-BRASIL survey: a tool to assess missed nursing care. Rev Latino-Am Enfermagem. 2017;25:e2975. https://doi.org/10.1590/1518-8345.2354.2975
    » https://doi.org/10.1590/1518-8345.2354.2975
  • 11
    Kalisch BJ. Missed nursing care: a qualitative study. J Nurs Care Qual. 2006;21(4):306-13. https://doi.org/10.1097/00001786-200610000-00006
    » https://doi.org/10.1097/00001786-200610000-00006
  • 12
    Kalisch BJ, Williams RA. Development and psychometric testing of a tool to measure missed nursing care. J Nurs Adm. 2009;39(5):211-9. https://doi.org/10.1097/NNA.0b013e3181a23cf5
    » https://doi.org/10.1097/NNA.0b013e3181a23cf5
  • 13
    Kalisch BJ, Landstrom GL, Hinshaw AS. Missed nursing care: a concept analysis. J Adv Nurs. 2009;65(7);1509-17. https://doi.org/10.1111/j.1365-2648.2009.05027.x
    » https://doi.org/10.1111/j.1365-2648.2009.05027.x
  • 14
    Tubbs -Cooley HL, Pickler RH, Younger JB, Mark BA. A descriptive study of nurse -reported missed care in neonatal intensive care units. J Adv Nurs. 2015;71(4):813-824. https://doi.org/10.1111/jan.12578
    » https://doi.org/10.1111/jan.12578
  • 15
    Bagnasco A, Zanini M, Aleo G, Catania G, Kalisch BJ, Sasso L. Development and validation of the MISSCARE survey: pediatric version. J Adv Nurs. 2018;74(12):2922-34. https://doi.org/10.1111/jan.13837
    » https://doi.org/10.1111/jan.13837
  • 16
    Mokkink LB, Prinsen CAC, Alonso J, et al. COSMIN Study Design checklist for Patient-reported outcome measurement instruments [Internet]. Amsterdam, Netherlands: 2019 [cited 2022 Aug 25]. Available from: https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
    » https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
  • 17
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross cultural adaptation of self-report measures. Spine. 2000;25(24):3186-91. https://doi.org/10.1097/00007632-200012150-00014
    » https://doi.org/10.1097/00007632-200012150-00014
  • 18
    Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382-5. https://doi.org/10.1097/00006199-198611000-00017
    » https://doi.org/10.1097/00006199-198611000-00017
  • 19
    Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciênc Saúde Coletiva. 2011;16(7):3061-8. https://doi.org/10.1590/S1413-81232011000800006
    » https://doi.org/10.1590/S1413-81232011000800006
  • 20
    Cohen RJ. Testagem e avaliação psicológica: introdução a testes e medidas. 8ª edição. Porto Alegre, RS: AMGH; 2014. p. 187-188.
  • 21
    Lawshe CH. A quantitative approach to content validity. Personn Psychol. 1975; 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
    » https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
  • 22
    Wilson RF, Pan W, Schumsky DA. Recalculation of the critical values for Lawshe’s content validity ratio. Meas Eval Couns Dev. 2012;45(3):197-210. https://doi.org/10.1177/0748175612440286
    » https://doi.org/10.1177/0748175612440286
  • 23
    Lake ET, de Cordova PB, Barton S, Singh S, Agosto PD, Ely B, Roberts KE, Aiken LH. Missed nursing care in pediatrics. Hosp Pediatr. 2017;7(7):378-84. https://doi.org/10.1542/hpeds.2016-0141
    » https://doi.org/10.1542/hpeds.2016-0141
  • 24
    Dortas Junior SD, Lupi O, Dias GAC, Guimaraes MBS, Valle SOR. Adaptação transcultural e validação de questionários na área da saúde. Braz J Allergy Immunol. 2016;4(1):26-30. https://doi.org/10.5935/2318-5015.20160003
    » https://doi.org/10.5935/2318-5015.20160003
  • 25
    Machado NA, Nóbrega VM, Silva MEA, França DBL, Reichert APS, Collet N. Doença crônica infantojuvenil: vínculo profissional-família para a promoção do apoio social. Rev Gaúcha Enferm. 2018;39. https://doi.org/10.1590/1983-1447.2018.2017-0290
    » https://doi.org/10.1590/1983-1447.2018.2017-0290
  • 26
    Incekar MC, İspir O, Sönmez B, Selalmaz M, Erdost SK. Turkish validation of the MISSCARE survey: pediatric version. J Pediatric Nurs. 2020;53. https://doi.org/10.1016/j.pedn.2020.03.012
    » https://doi.org/10.1016/j.pedn.2020.03.012
  • 27
    Kalisch BJ, Terzioglu F, Duygulu S. The MISSCARE survey-Turkish: psychometric properties and findings. Nurs Econom. 2012;30(1):29-37. https://doi.org/10.1016/j.pedn.2020.03.012
    » https://doi.org/10.1016/j.pedn.2020.03.012
  • 28
    Miranda FMA, Santana LL, Pizzolato AC, Saquis LMM. Condições de trabalho e o impacto na saúde dos profissionais de enfermagem frente a Covid-19. Cogitare Enferm. 2020;25:e72702. https://doi.org/10.5380/ce.v25i0.72702
    » https://doi.org/10.5380/ce.v25i0.72702
  • 29
    Santos TA, Suto CSS, Santos JM. Condições de trabalho de enfermeiras, técnicas e auxiliares de enfermagem em hospitais públicos. REME - Rev Min Enferm [Internet]. 2020[cited 2022 Aug 25];24:e-1339. Available from: http://www.revenf.bvs.br/pdf/reme/v24/1415-2762-reme-24-e1339.pdf
    » http://www.revenf.bvs.br/pdf/reme/v24/1415-2762-reme-24-e1339.pdf
  • 30
    Paulino GME, Matta ACG, Camillo NRS, Simões AC, Nishiyama JAP, Oliveira JLC, et al. Professional satisfaction and work environment of the nursing team in Intensive Care Units. REME - Rev Min Enferm [Internet]. 2019[cited 2022 Aug 25];23:e-1271. Available from: https://www.researchgate.net/publication/337957168_PROFESSIONAL_SATISFACTION_AND_WORK_ENVIRONMENT_OF_THE_NURSING_TEAM_IN_INTENSIVE_CARE_UNITS
    » https://www.researchgate.net/publication/337957168_PROFESSIONAL_SATISFACTION_AND_WORK_ENVIRONMENT_OF_THE_NURSING_TEAM_IN_INTENSIVE_CARE_UNITS

Edited by

EDITOR IN CHIEF: Dulce Barbosa
ASSOCIATE EDITOR: Antonio José de Almeida Filho

Publication Dates

  • Publication in this collection
    19 July 2024
  • Date of issue
    2024

History

  • Received
    02 Mar 2023
  • Accepted
    03 Nov 2023
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br