Open-access Adherence to the cardiac surgery checklist decreased mortality at a teaching hospital: A retrospective cohort study

Abstract

Objectives  To evaluate the impact of adherence to the cardiac surgical checklist on mortality at the teaching hospital.

Methods  A retrospective cohort study after the implementation of the cardiac surgical safety checklist in a reference hospital in Latin America. All patients undergoing coronary artery bypass surgery and/or heart valve surgery from 2013 to 2019 were analyzed. After the implementation of the project InCor-Checklist “Five steps to safe cardiac surgery” in 2015, the correlation between adherence and completeness of this instrument with surgical mortality was assessed. The EuroSCORE II was used as a reference to assess the risk of expected mortality for patients. Cross-sectional questionnaires were during the implementation of the InCor-Checklist. To perform the correlation, Pearson’s coefficient was calculated using R software.

Results  Since 2013, data from 8139 patients have been analyzed. The average annual mortality was 5.98%. In 2015, the instrument was used in only 58% of patients; in contrast, it was used in 100% of patients in 2019. There was a decrease in surgical mortality from 8.22% to 3.13% for the same group of procedures. The results indicate that the greater the checklist use, the lower the surgical mortality (r = 88.9%). In addition, the greater the InCor-Checklist completeness, the lower the surgical mortality (r = 94.1%).

Conclusion  In the formation of the surgical patient safety culture, the implementation and adherence to the InCor-Checklist “Five steps to safe cardiac surgery” was associated with decreased mortality after cardiac surgery.

HIGHLIGHTS 

  • Checklists avoid human errors and are commonly used in high-reliability industries.

  • The “InCor Checklist” was associated with decreased mortality over time.

  • Adherence, completeness, and sustainability within public policies are necessary.

Introduction

In the health system, adverse events cause more deaths annually than road traffic accidents, breast cancer, or acquired immunodeficiency syndrome.1 Global estimates suggest that every year 1 million people die after surgery. A scenario in which 50% of deaths would be preventable.2 Checklists began to be used in aviation in the 1930s to avoid human errors and are currently common in high-risk industries.3

In this way, safety checklists have been incorporated as an essential part of a safety culture.4 However, while surgery has continued to increase, little progress has been made in patient safety.

In 2009, World Health Organization (WHO) led the development of a checklist for surgery.5 The results were striking showing that the instrument was able to reduce mortality by up to 47%.6 The benefits seem to be directly related to an improvement in the team's communication and situation awareness, just before starting the procedure. It did not take long for the American and European Society for Cardio-Thoracic Surgery (EACTS) to consider the checklist as a class I recommendation to be applied in all cardiac surgeries.7, 8

The morbidity and mortality after cardiac surgery decreased over time; however, avoidable errors persisted causing undesirable results. It is a complex scenario that involves sophisticated techniques and equipment, cardiopulmonary bypass, several professionals, and especially, high-risk patients. Thus, adverse events can occur due to both communication failures and lack of teamwork.9

Seeking to build a surgical patient safety culture, the hospital team adapted and structured its safety verification system, the InCor-Checklist “Five steps to safe cardiac surgery”. The aim of this publication is to describe the implementation and adherence of the InCor-Checklist over time, as well as its association with the mortality results after cardiac surgery.

Methods

Study population, inclusion, and exclusion criteria

In this analysis, 8139 patients who underwent coronary artery bypass grafting and/or heart valve surgery from 2013 to 2019 were analyzed. In total, 5 types of procedures were analyzed: coronary artery bypass graft surgery, aortic valve surgery, mitral valve surgery, aortic valve + mitral valve surgery, and coronary + heart valve surgery. Clinical Characteristics and preoperative parameters of the population analyzed are detailed in Table 1. Therefore, most surgeries were analyzed except for congenital diseases, aortic diseases, cardiac tumors, pericardial diseases, heart transplants, catheter therapies, pacemaker implantation, and patients who had salvage cardiac surgery.

Table 1
Characteristics of the population analyzed: clinical and pre-operative parameters.

Details of outcomes and length of hospital stay of the population analyzed between 2013 and 2019 are detailed in Table 2.

Table 2
Characteristics of the population analyzed: outcomes and hospital stay.

Study design

This is a single-center retrospective analysis performed by the Quality and Safety Surgical Unit (UCQSP). The authors complied with the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement.10 In total, 8139 patients were analyzed. It is worth noting that, in 2015, the Continuous Quality Improvement Program in Cardiovascular Surgery (PMCQ) was established. The public and monthly presentation of the results, the monitoring of the mandatory use of the surgical InCor-Checklist, the establishment of the clinical and surgical outpatient clinic, the root-cause analysis of surgical mortality, the development of Quality and Safety Research and the multidisciplinary discussion of the ideal moment to approach emergency patients are among the actions of this program. Therefore, even though the implementation and monitoring of the mandatory use of the InCor-Checklist was the intervention with the greatest impact within the PMCQ, the authors believe that the results may have also been influenced by the other actions oriented during this period. The main outcome was operative mortality defined as when it occurred during the hospitalization in which the operation was performed, even after 30 days; as well as all deaths that occurred after hospital discharge, but before the end of the thirtieth postoperative day. The EuroSCORE II was used as a reference to assess the risk of expected mortality. The flowchart of the study design is shown in Fig. 1. All patients operated on during the study period were included in the analysis and there were no missing regarding the operative mortality.

Fig. 1
Study design flowchart.

Implementation of the InCor-Checklist

In 2014, a questionnaire was applied to assess the need for the use of an InCor-Checklist by the teams (surgeons, anesthetists, perfusionists and nurses) in surgical patients (Table 3), and from this, the InCor-Checklist was built.

Table 3
Questionnaire on the need for implementation of the InCor-Checklist (12/08/2014).

This model was established within an educational program composed of standardized classes, teaching materials, videos and simulations in scenarios set up in the operating room. In 2015, the checklist was implemented in the surgical routine to be used in all cardiac surgeries. The idealized model includes 5 sequential phases: Briefing (team planning in relation to the patient and specific surgery), Sign In (before the patient enters the operating room), Time out (before skin incision), Sign out (before the patient leaves the operating room) and Debriefing (report of what happened and how to improve) (Fig. 2). The detailed flow of the InCor Checklist application is shown as supplementary material.

Fig. 2
InCor-Checklist “Five Steps to Safe Surgery” form.

Training with the teams were carried out every six months. Theoretical and realistic simulation classes were included with the purpose of evaluating its applicability, identifying possible adaptations in the process and/or in the instrument, and avoiding the deterioration of the processes.

Statistical analysis

Regarding the observed mortality, the periods were compared using the two-tailed test to compare proportions. Only the annual average of surgeries performed was analyzed. For the variable number of surgeries, the two-tailed Mann-Whitney test was used. Correlation analyzes of the annual mortality with the level of adherence and the degree of completeness of the instrument were performed. To perform the correlation, Pearson's coefficient was used. The level of significance was set at 0.05. The R software (version 3.5.3) was used for analysis and charts. The Excel program was used to consolidate the original database. As treatment of missing data, the variables “left ventricular ejection fraction”, “CABG time” and “anoxia time” had blank observations filled in with the database mean, similarly, in the analysis of the multiple logistic models as continuous variables were filled in with the observed mean.

Ethics and consent form

This project was approved by the Ethics Committee for Analysis of Research Projects (CAAE: 4141821.9.0000.0068). The analysis was made from the institution's database and validated by UCQSP without identifying the patients. For this reason, informed consent was waived.

Results

The mean age of the study population was 60.31±2.09. A total of 5009 (61.54%) patients were male, and 17.16% of the patients underwent urgent surgery. In adults, the most common type of procedure was isolated coronary artery bypass grafting surgery (4146 procedures = 51%).

The average annual mortality was 5.98% (8.22% in 2013, 6.82% in 2014, 7.49% in 2015, 6.5% in 2016, 5.69% in 2017, 4.66% in 2018, and 3.13% in 2019, as shown in Fig. 3), while the expected mortality calculated by the EuroSCORE was mean 2.54±4.07% (1.98±1.13 in 2013, 1.51±0.53 in 2014, 2.53±2.92 in 2015, 2.72±4.58 in 2016, 2.52±4.22 in 2017, 2.51±4.23 in 2018 and 2.48±4.31 in 2019) When barriers were identified, the processes for the InCor-Checklist use were improved in a cycle of continuous improvement. One of these actions, taken in 2018, was the need to have two surgery representatives in the surgery room to perform the checklist.

Fig. 3
Interventions in the InCor-Checklist use and the association of adherence to the instrument and surgical mortality over time.

Regarding the completeness of the 5 phases of the InCor-Checklist, it evolved from 3.3 in 2015 to 3.9 in 2019 according to sample evaluations year by year (questionnaires). Whenever the InCor-Checklist was used in the operating room, the phases always performed were: Sign-in, Time out, and Sign out, followed by Briefing and finally Debriefing (Table 4). The implementation of the checklist was done gradually among the surgical teams, in a strategic way, aiming to stimulate adherence to the system, avoiding fatigue of those involved in the checking system, until this process became a hospital routine.

Table 4
Adherence to the 5 phases of the InCor-Checklist in the analyzed period.

Over time, the use of InCor-Checklist for these procedures has been progressive, reaching 75% of all cardiac surgeries in 2016 and 100% in 2019 in an institution that performed an average of more than 100 of these cardiac surgeries per month during this period.

Discussion

Studies show that adverse events happen more commonly in the operating room (43%) for patients admitted for surgery procedures, and most of them are preventable.1, 11 The present study’s results show that the use of InCor-Checklist was associated with a 62% reduction in mortality. The InCor-Checklist was adapted from the WHO model5 and follows the guidelines of the cardiac surgery societies,6 and the American Heart Association,12 with the aim of reducing the risk of human errors.

The InCor-Checklist was 37% more effective than the checklist used by the National Patient Safety Program in Scotland,13 and less than that achieved by a Boston group in a randomized, multicenter study in which a reduction of 47%,6 was seen, both in cardiac and non-cardiac surgeries. On the other hand, another study, also performed in non-cardiac surgeries, in hospitals of Ontario, Canada, did not show significance, with a mortality reduction of only 8.5% before and after implementation.14

Perhaps the study most similar to ours in relation to the 5-year period analyzed was conducted in Australia and had a mortality reduction of 23.3% after implementation of the checklist, regardless of the duration of surgery.15 An Italian study showed that after implementation there was a 27% decrease in mortality within 90 days after surgery but no difference in relation to the 30-day mortality.16

However, most of these studies were done in non-cardiac surgeries. In cardiac surgery, little has been published about the impact of the surgical checklist. Perhaps the most influential study is the one recently published, performed in 7 Dutch hospitals, in which the implementation of a checklist was associated with a 43% reduction in mortality up to 120 days after cardiac surgery.17 The decrease in mortality in the present study was associated with the implementation, adherence, and advancement of the 5-year checklist program. The evolution from high mortality values to values similar to those of international reference centers may explain the 58% reduction in mortality.

Regarding the importance of performing a training program, an analysis showed that hospitals in South Carolina (USA) that completed the checklist program (14 hospitals) had a greater reduction in mortality than other hospitals (44 hospitals). There was a 16% mortality reduction before and after implementation of the checklist while there was no difference in the group that did not participate in the program.18

As in the present study, adherence to the checklist was also related to leadership involvement, the commitment of the surgical team, and the improvement of communication.19 Regarding the impact of completeness of the checklist, a study also showed that there is a lower risk of mortality when the 3 main phases (Sign in, Time out and Sign out) were applied.20 Thus, the influence of the use of the checklist was related to risk management before surgery, teamwork, and communication.6

Communication mistakes are the most common cause of adverse health events. These mistakes occur because the information does not reach the right person, is inaccurate, or because the problems remain unsolved until they become critical.21 Therefore, it would not be simply the implantation of one more questionnaire, but the full conviction that the authors are within a system in which the result will depend on the effective communication of the team and between the teams in the different modalities of assistance to the surgical patient.22

The InCor-Checklist includes Briefing and Debriefing within its flow. This was based on a study in which the use of a structured briefing managed to reduce the average number of communication failures by surgery from 3.95 to 1.31 (p < 0.001). A structured briefing is associated with an improvement in situational awareness, decision making, teamwork, and the reliability of clinical interventions.23, 24

The US Veterans Health Administration training program,25 that included briefing and debriefing, in addition to the use of the surgical checklist (Sign in, Time out and Sign out), achieved a 50% greater mortality reduction in the trained group than in the untrained group (p = 0.01). Another study also showed that, after adopting briefing and debriefing as a complement, communication improved. This could be the initial step towards a substantial and sustainable organizational transformation.26

We believe that the construction of a safety culture for surgical patients at the present institution was positive and progressed in a sustainable manner over 5 years, reaching 100% adherence. The impact of the checklist on the formation of the Safety Culture has been positive in previous studies.27, 28, 29

Considering that approximately 30%‒47% of the complications of the patients admitted to surgery are related to the operating room, a more comprehensive checklist strategy may be ideal. This was assessed by the SURPASS study in the Netherlands and published in NEJM in 2010.30 This study not only implemented a perioperative checklist, but also considered all phases of the surgical process and combined it in a uniform way from admission to discharge.

Limitations

One of the limitations of this study is that it is an observational and retrospective study based on the institutional database. However, all data were validated by the Informatics Service, the Hospital Medical Information Unit, and the Quality and Safety Surgical Unit. The second limitation is that other actions were also included in the same period within the quality improvement program at the institution, the same ones that may have influenced the results of surgical mortality.31 For this reason, the authors cannot highlight that there was causality, only association. However, it is undeniable to highlight the correlation between a progressive and sustainable adherence to the checklist and the reduction of mortality. Another limitation of this study is related to the fact that the idealized checklist had no adherence to savage surgery, nor includes crisis situations that may arise during surgeries. A checklist for crisis situations was developed by the Harvard group and resulted in a 6-fold reduction in adherence failure in critical stages in the evaluated scenarios.32 The impact of this model on our practice will be assessed in further studies.

It seems that it is not only the technical skill but also the surgeon's behavioral patterns and non-technical skills (leadership, teamwork, problem-solving, decision making, and situational awareness) that affect the surgical results.33 A multicenter study on congenital heart surgery in the United Kingdom indicated that the results were not solely related to the technical difficulties of the surgery, as there was a strong relationship between the non-technical skills of the surgeon and adverse events, including death.34

Although there are still limitations to the completeness of the 5 phases, the authors can say that the InCor-Checklist achieved your goal: the formation of the safety culture of the surgical patient. Thus, the authors can see that the implantation and sustainability of a surgical checklist are not as simple as it seems; it requires a lot of leadership, humility, and teamwork.35

Conclusion

In the formation of the surgical patient safety culture, the implementation and adherence to the InCor-Checklist “Five steps to safe cardiac surgery” was associated with decreased mortality after cardiac surgery. The authors recommend that hospitals, in addition to implementing a surgical checklist, should develop strategies to encourage adherence and completeness, as well as sustainability within public policies.

  • Funding
    This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

References

  • 1 Kohn LT, Corrigan JM, Donaldson MS. To Err Is Human [Internet] editor. In: POILLON F, ed. The National Academies Press, 1st ed., Washington, D.C.: National Academies Press; 2000. p. 312. http://www.nap.edu/catalog/9728
    » http://www.nap.edu/catalog/9728
  • 2 Weiser TG, Regenbogen SE, Thompson KD, Haynes AB, Lipsitz SR, Berry WR, et al. An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet 2008;372(9633):139–44.
  • 3 Weiser TG, Haynes AB, Lashoher A, Dziekan G, Boorman DJ, Berry WR, et al. Perspectives in quality: designing the WHO surgical safety checklist. Int J Qual Heal Care 2010;22(5):365–70.
  • 4 Clancy CM. Ten years after to err is human. Am J Med Qual 2009;24(6):525–8.
  • 5 Organization WH. WHO Guidelines for Safe Surgery 2009: safe Surgery Saves Lives [Internet]. Vol. 08. WHO Library Cataloguing-In-Publication Data; Available from: http://whqlibdoc.who.int/publications/2009/9789241598552_eng.pdf
    » http://whqlibdoc.who.int/publications/2009/9789241598552_eng.pdf
  • 6 Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-HS, Dellinger EP, et al. A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population. N Engl J Med 2009;360(5):491–9.
  • 7 Sanchez JA, Ferdinand FD, Fann JI. Patient Safety Science in Cardiothoracic Surgery: an Overview. Ann Thorac Surg 2016;101(2):426–33.
  • 8 Clark SC, Dunning J, Alfieri OR, Elia S, Hamilton LR, Kappetein PA, et al. EACTS guidelines for the use of patient safety checklists. Eur J Cardio-thoracic Surg 2012;41 (5):993–1004.
  • 9 Gawande A. The Checklist Manifesto : How to Get Things Right. 1st ed. 215..
  • 10 Ogrinc G, Mooney SE, Estrada C, Foster T, Goldmann D, Hall LW, et al. The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and Elaboration. Qual Saf Heal Care 2008;17 (SUPPL. 1):i13–32.
  • 11 De Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Heal Care 2008;17(3):216–23.
  • 12 Wahr JA, Prager RL, Abernathy JH, Martinez EA, Salas E, Seifert PC, et al. Patient safety in the cardiac operating room: human factors and teamwork: a scientific statement from the american heart association. Circulation 2013;128(10):1139–69.
  • 13 Ramsay G, Haynes AB, Lipsitz SR, Solsky I, Leitch J, Gawande AA, et al. Reducing surgical mortality in Scotland by use of the WHO Surgical Safety Checklist. Br J Surg 2019;106(8):1005–11.
  • 14 Urbach DR, Govindarajan A, Saskin R, Wilton AS, Baxter NN. Introduction of Surgical Safety Checklists in Ontario, Canada. N Engl J Med 2014;370(11):1029–38.
  • 15 de Jager E, Gunnarsson R, Ho YH. Implementation of the World Health Organization surgical safety checklist correlates with reduced surgical mortality and length of hospital admission in a high-income country. World J Surg 2019;43(1):117–24.
  • 16 Bock M, Fanolla A, Segur-Cabanac I, Auricchio F, Melani C, Girardi F, et al. A comparative effectiveness analysis of the implementation of surgical safety checklists in a tertiary care hospital. JAMA Surg 2016;151(7):639–46.
  • 17 Spanjersberg AJ, Ottervanger JP, Nierich AP, Speekenbrink RGH, Stooker W, Hoogendoorn M, et al. Implementation of a specific safety check is associated with lower postoperative mortality in cardiac surgery. J Thorac Cardiovasc Surg 2020;159(5):1882–90. e2.
  • 18 Haynes AB, Edmondson L, Lipsitz SR, Molina G, Neville BA, Singer SJ, et al. Mortality Trends after a Voluntary Checklist-based Surgical Safety Collaborative. Ann Surg 2017;266(6):923–9.
  • 19 Singer SJ, Molina G, Li Z, Jiang W, Nurudeen S, Kite JG, et al. Relationship Between Operating Room Teamwork, Contextual Factors, and Safety Checklist Performance. J Am Coll Surg 2016;223(4):568–80. e2.
  • 20 Mayer EK, Sevdalis N, Rout S, Caris J, Russ S, Mansell J, et al. Surgical Checklist Implementation Project: the impact of variable WHO Checklist compliance on risk-adjusted clinical outcomes following national implementation. A longitudinal study. Ann Surg 2016;44(0):58–63.
  • 21 Lingard L, Espin S, Whyte S, Regehr G, Baker GR, Reznick R, et al. Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Heal Care 2004;13(5):330–4.
  • 22 Russ S, Rout S, Sevdalis N, Moorthy K, Darzi A, Vincent C. Do safety checklists improve teamwork and communication in the operating room? A systematic review. Ann Surg 2013;258(6):856–71.
  • 23 Lingard L, Regehr G, Orser B, Reznick R, BakeR GR, Doran D, et al. Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch Surg 2008;143(1):18.
  • 24 Lingard L, Regehr G, Cartmill C, Orser B, Espin S, Bohnen J, et al. Evaluation of a preoperative team briefing: a new communication routine results in improved clinical practice. BMJ Qual Saf 2011;20(6):475–82.
  • 25 Neily J, Young-xu Y, Carney BT, West P, Berger DH, Mazzia LM, et al. Association between implementation of a medical team training program and surgical mortality. JAMA - J Am Med Assoc 2014;304(15):1693–700.
  • 26 Papaspyros SC, Javangula KC, Adluri RKP, O’Regan DJ. Analysis of impact on theatre team attitude and patient safety. Interact Cardiovasc Thorac Surg 2010;10(1):43–7.
  • 27 Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AHS, Dellinger EP, et al. Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Qual Saf 2011;20(1):102–7.
  • 28 Kawano T, Taniwaki M, Ogata K, Sakamoto M, Yokoyama M. Improvement of teamwork and safety climate following implementation of the WHO surgical safety checklist at a university hospital in Japan. J Anesth 2014;28(3):467–70.
  • 29 Hill MR, Roberts MJ, Alderson ML, Gale TCE. Safety culture and the 5 steps to safer surgery: an intervention study. Br J Anaesth 2015;114(6):958–62.
  • 30 de Vries EN, Prins HA, Crolla RMPH, den Outer AJ, van Andel G, van Helden SH, et al. Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med 2010;363(20):1928–37.
  • 31 Mejia OAV, Lisboa LAF, Arita ET, Brandão CM de A, Dias RR, Costa R, et al. Analysis of >100,000 cardiovascular surgeries performed at the heart institute and a new era of outcomes. Arq Bras Cardiol 2020;114(4):603–12.
  • 32 Ziewacz JE, Arriaga AF, Bader AM, Berry WR, Edmondson L, Wong JM, et al. Crisis checklists for the operating room: development and pilot testing. J Am Coll Surg 2011;213(2):212–7. e10.
  • 33 De Leval MR, Carthey J, Wright DJ, Farewell VT, Reason JT. Human factors and cardiac surgery: a multicenter study. J Thorac Cardiovasc Surg 2000;119(4 I):661–72.
  • 34 Flin R. Training in non-technical skills to improve patient safety. Br Med J 2009;339 (7728):984–7.
  • 35 Marsteller JA, Wen M, Hsu YJ, Bauer LC, Schwann NM, Young CJ, et al. Safety culture in cardiac surgical teams: data from five programs and national surgical comparison. Ann Thorac Surg 2015;100(6):2182–9.

Publication Dates

  • Publication in this collection
    06 July 2022
  • Date of issue
    2022

History

  • Received
    26 Oct 2021
  • Accepted
    09 Mar 2022
location_on
Faculdade de Medicina / USP Rua Dr Ovídio Pires de Campos, 225 - 6 and., 05403-010 São Paulo SP - Brazil, Tel.: (55 11) 2661-6235 - São Paulo - SP - Brazil
E-mail: clinics@hc.fm.usp.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Acessibilidade / Reportar erro