Abstract
Objectives: This study aimed to evaluate the predictive validity of the day-1 PELOD-2 and day-1 "quick" PELOD-2 (qPELOD-2) scores for in-hospital mortality in children with sepsis in a pediatric intensive care unit (PICU) of a developing country.
Methods: The data of 516 children diagnosed as sepsis were retrospectively analyzed. The children were divided into survival group and non-survival group, according to the clinical outcome 28 days after admission. Day-1 PELOD-2, day-1 qPELOD-2, pediatric SOFA (pSOFA), and P-MODS were collected and scored. Receiver operating characteristic (ROC) curves were plotted, and the efficiency of the day-1 PELOD-2, day-1 qPELOD-2 score, pSOFA, and P-MODS for predicting death were evaluated by the area under the ROC curve (AUC).
Results: The day-1 PELOD-2 score, day-1 qPELOD-2 score, pSOFA, and P-MODS in the non-survivor group were significantly higher than those in the survivor group. ROC curve analysis showed that the AUCs of the day-1 PELOD-2 score, day-1 qPELOD-2 score, pSOFA, and P-MODS for predicting the prognosis of children with sepsis in the PICU were 0.916, 0.802, 0.937, and 0.761, respectively (all p < 0.05).
Conclusions: Both the day-1 PELOD-2 score and day-1 qPELOD-2 score were effective and able to assess the prognosis of children with sepsis in a PICU of a developing country. Additionally, the day-1 PELOD-2 score was superior to the day-1 qPELOD-2 score. Further studies are needed to verify the usefulness of the day-1 qPELOD-2 score, particularly outside of the PICU.
KEYWORDS PELOD-2 score; "Quick" PELOD-2 score; Sepsis; Prognosis; Children
Resumo
Objetivos: A finalidade de nosso estudo foi avaliar a validade preditiva dos escores PELOD-2 no dia 1 e "quick" PELOD-2 no dia 1 com relação à mortalidade hospitalar em crianças com sepse em uma UTIP de um país em desenvolvimento.
Métodos: Foram analisados retrospectivamente os dados de 516 crianças diagnosticadas com sepse. As crianças foram divididas em grupo sobrevida e grupo não sobrevida de acordo com o desfecho clínico de 28 dias após internação. Foram coletadas e pontuadas as variáveis PELOD-2 no dia 1, qPELOD-2 no dia 1, pediatric Sequential Organ Failure Assessment (pSOFA) e Pediatric Multiple Organ Dysfunction Score (P-MODS). A curva da característica de operação do receptor (ROC) foi plotada e a eficiência preditiva do PELOD-2 no dia 1, o escore qPELOD-2 no dia 1, pSOFA, P-MODS com relação a óbito foram avaliados pela área abaixo da curva (AUC) da curva ROC.
Resultados: O escore PELOD-2 no dia 1, escore qPELOD-2 no dia 1, pSOFA e P-MODS no grupo não sobrevida foram significativamente maiores do que os no grupo sobrevida. A análise preditiva da curva ROC mostrou que as AUCs do escore PELOD-2 no dia 1, escore qPELOD-2 no dia 1, pSOFA e P-MODS com relação ao prognóstico de crianças com sepse na UTIP foi 0,916, 0,802, 0,937 e 0,761, respectivamente (todas p < 0,05).
Conclusões: Tanto o escore PELOD-2 no dia 1 e o escore qPELOD-2 no dia 1 foram válidos e conseguiram avaliar o prognóstico de crianças com sepse em uma UTIP de um país em desenvolvimento. Além disso, o escore PELOD-2 no dia 1 foi superior ao escore qPELOD-2 no dia 1. São necessários estudos adicionais para verificar a utilidade do escore qPELOD-2 no dia 1, principalmente fora da UTIP.
PALAVRAS-CHAVE Escore PELOD-2; Escore "quick"PELOD-2; Sepse; Prognóstico; Crianças
Introduction
Sepsis is a leading cause of death in adults 1 and children. 2- 5 In the recent Third International Consensus statement, 6 the Sepsis Definitions Task Force defined sepsis as a life-threatening organ dysfunction that occurs due to a deregulated host response to infection, and this definition has aroused heated discussions in the critical medicine field. 7 The Sepsis-3 task force has put forth the use of the Sequential Organ Failure Assessment (SOFA) score to grade organ dysfunction in adult patients with suspected infection. Furthermore, the Sepsis-3 task force has acknowledged that the new criteria are not designed for children and that future studies should consider age-specific physiology and risk stratification.
Leclerc et al. 8 performed a secondary analysis of the database used for the development and validation of the Pediatric Logistic Organ Dysfunction Score-2 (PELOD-2). 9 The authors concluded that the PELOD-2 score on day 1 was highly predictive of in-hospital mortality among children admitted to the pediatric intensive care unit (PICU) with suspected infection, which suggested its promising use to standardize definitions and diagnostic criteria for pediatric sepsis. Moreover, the authors investigated the predictive performance of a quick Pediatric Logistic Organ Dysfunction Score-2 (qPELOD-2) score (Glasgow coma scale <11, tachycardia, and systemic hypotension; Table S1 Appendix A Supplementary data Supplementary material related to this article can be found, in the online version, at doi:https://doi.org/10.1016/j.jped.2019.07.007. ) that was inspired by the quick Sequential Organ Failure Assessment (qSOFA) score (altered mentation, tachypnea, and hypotension). The predictive performance of the qPELOD-2 score compared favorably with studies that validated the qSOFA score in adults (area under the curve [AUC]: 0.82; 95% CI: 0.76-0.87). 10 The purpose of the present study was to evaluate the predictive validity of day-1 PELOD-2, day-1 qPELOD-2 for in-hospital mortality in children with sepsis in a PICU of a developing country.
Methods
A cross-sectional study was conducted in the Pediatric Intensive Care Unit of the first Affiliated Hospital of Guangdong Medical University in Zhanjiang City, Guangdong Province, China from June 1, 2016 to June 1, 2018. Several data were collected retrospectively for the day-1 PELOD-2 score, day-1 qPELOD-2 score, pediatric Sequential Organ Failure Assessment (pSOFA), and Pediatric Multiple Organ Dysfunction Score (P-MODS) calculation. If a variable was measured more than once in the first day, the worst value of the variable was used to calculate the day-1 PELOD-2, day-1 qPELOD-2, pSOFA, and P-MODS. Sex, age, site of infection, length of PICU stay, total hospitalization time, need for mechanical ventilation, duration of ventilatory support, and need for vasoactive drugs were recorded on a data collection form designed for the study.
The inclusion criteria were as follows: (1) meeting the diagnostic criteria of the 2005 International Pediatric Sepsis Conference 11 (2) length of PICU stay ≥24 h; (3) patient's age was between 1 month and 14 years; and (4) complete clinical data available. The exclusion criteria were as follows: (1) length of PICU stay <24 h or death within the first 24 h of admission; (2) patients younger than 1 month old or older than 14 years old; (3) transfer to another hospital; or (4) incomplete clinical data (Fig. 1).
This study met the standards of medical ethics and was approved by the Ethics Committee of the first Affiliated Hospital of Guangdong Medical University (2018-027). The need for an informed consent was waived due to the observational nature of the study.
Statistical analysis
Statistical analysis was performed using SPSS 21.0 and MedCalc 15.2.2. The results were expressed as median and interquartile ranges (IQRs) for continuous variables and as frequencies and percentages for categorical variables. The Kolmogorov-Smirnov test was used to test the normality of the qualitative data. T-tests were used for quantitative data with normal distribution. The Mann-Whitney U-test was used for quantitative data that did not present a normal distribution. Categorical variables were compared using the χ2 test. A two-sided p < 0.05 was considered statistically significant.
The performance of the scores to discriminate in-hospital mortality was evaluated using the AUC. Comparisons between scores were performed using the DeLong 12 methoday-1 to compare AUCs and the Integrated Discrimination Improvement Index 13 to evaluate the reclassification of predicted probabilities between survivors and non-survivors. The Youden J statistic 14 was used to evaluate the optimal cutoff values of the PELOD-2 and qPELOD-2 scores to discriminate in-hospital mortality.
Sample size estimation
The main evaluation index of this study was the AUC of the ROC curve. We aimed to evaluate the performance of the day-1 PELOD-2 and day-1 qPELOD-2 scores to discriminate in-hospital mortality. A related research showed that the AUCs of day-1 PELOD-2 and day-1 qPELOD-2 scores were 0.91 and 0.82, respectively. 8 The ratio between survivors and non-survivors was 37. 15 The significance level was 0.05, the efficacy was 0.8, and the allocation ratio between samples was 50. As the study was a retrospective observational study, the abscission rate was 0%. The sample size was estimated by the software PASS 11.0, and a total of 306 children with sepsis were needed. Finally, 516 children with sepsis in the PICU were included in the study.
Results
A total of 516 patients met the inclusion criteria. Among them, 238 (46.1%) met the criteria for sepsis, 262 (50.8%) met the criteria for severe sepsis, and 16 (3.1%) met the criteria for septic shock. Of the 488 survivors of hospital encounters, 311 (63.7%) were male, and the median (IQR) age was 8 (2-36) months. Among the 28 non-survivors, 16 (57.1%) were male, with a median (IQR) age of 12 (3-36) months. There were no significant differences in sex, age, site of infection, or length of PICU stay between the two groups (all p > 0.05). The demographic and clinical characteristics of the survivors and non-survivors are shown in Table 1.
The day-1 PELOD-2 score, day-1 qPELOD-2 score, pSOFA, and P-MODS in the non-survivor group were significantly higher than those in the survivor group (day-1 PELOD-2 score: 6.5 [4-8] vs. 0 [0-2], day-1 qPELOD-2 score: 1 [1-2] vs. 0 [0-1]; pSOFA score: 7.5 [6-11] vs. 3 [2-4]; P-MODS: 3 [2-6] vs. 1 [1-2]; all p < 0.05; Table 1). ROC curve analysis showed that the AUCs of the day-1 PELOD-2 score, day-1 qPELOD-2 score, pSOFA and P-MODS for predicting the prognosis of children with sepsis in the PICU were 0.916 (0.888-0.938), 0.802 (0.765-0.836), 0.937 (0.913-0.957), and 0.761 (0.722-0.798), respectively (all p < 0.05; Table 2; Fig. 2). This indicates that the day-1 PELOD-2 score shows excellent discrimination for in-hospital mortality. The optimal PELOD-2 cutoff to discriminate mortality was a score higher than 2 points. There was no significant difference in the AUC between the day-1 PELOD-2 score and pSOFA (P > 0.05). However, a significant difference was observed in the AUC of the day-1 PELOD-2 score and that of the day-1 qPELOD-2 and P-MODS (both p < 0.05).
Receiver operating characteristic curves of PELOD-2, qPELOD-2, pSOFA, and P-MODS for predicting in-hospital mortality.
Discussion
The 2005 Consensus definition for pediatric sepsis maintained the requirement for SIRS and provided further explanation on organ failure definitions. 11 The validity of SIRS criteria to identify and evaluate severity of patients diagnosed with sepsis has been challenged in adults due to the lack of sensitivity (SE) and specificity (SP). 10, 16 The Sepsis-3 criteria is based on the SOFA score. 17 However, the SOFA score is not adapted for children. Therefore, the current pediatric sepsis definitions remain essentially based on Sepsis-2, which is not adequate for clinical research. 18 The PELOD-2 score was used to grade organ dysfunction in pediatric patients with suspected infection. Multiple studies have shown that the PELOD-2 score has excellent discrimination for in-hospital mortality. 19- 22 The present research demonstrated that day-1 PELOD-2 score shows excellent discrimination for in-hospital mortality in a PICU of a developing country, which suggested its promising use to standardize definitions and diagnostic criteria for pediatric sepsis. Furthermore, the day-1 qPELOD-2 score has good predictive validity for in-hospital mortality (AUC: 0.802; 95% CI: 0.765-0.836). In conclusion, the present study indicates that both day-1 PELOD-2 and day-1 qPELOD-2 have good predictive validity for in-hospital mortality in children with sepsis in a PICU of a developing country, which has been seldomly reported.
The SOFA score was developed to evaluate the condition and prognosis of a patient's illness based on the degree of organ dysfunction. Additionally, the usefulness of the SOFA score has been previously validated in large cohorts of critically ill patients 10, 23, 24 Matics and Sanchez-Pinto published a pediatric version of the SOFA score (pSOFA), which was developed by adapting the original SOFA score with age-adjusted cutoffs for the cardiovascular and renal systems and by expanding the respiratory criteria to include noninvasive surrogates of lung injury. 15 Those authors concluded that the maximum pSOFA score had excellent predictive validity for in-hospital mortality (AUC: 0.94; 95% CI: 0.92-0.95), but further research was warranted. In the present study, it was concluded that the pSOFA score (AUC: 0.937; 95% CI: 0.913-0.957) is effective and has the ability to assess the prognosis of children with sepsis in a PICU of a developing country, which is conducive to the promotion of pSOFA in developing countries. In the present study, it was observed that the optimal pSOFA cutoff to differentiate in-hospital mortality was a score higher than 5 points, which was different from the cutoff found by Matics and Sanchez-Pinto in children with sepsis in a PICU of a developed country. This observation requires further validation.
The present study has several limitations. Firstly, as a retrospective observation study, not enough data was available to allow the daily calculation of all scores daily, which in turn would allow a dynamic assessment of the patients' condition. Secondly, the relatively small sample size might have resulted in a less precise estimation of the accuracy of day-1 PELOD-2 and day-1 qPELOD-2 scores. Thirdly, only children admitted to the PICU were included, and therefore, children at different phases of acute care (out-of-hospital, emergency department, and hospital ward) were not assessed. These limitations reduce the generalizability of the present findings and highlight the need for future prospective multicenter studies.
Both the day-1 PELOD-2 and day-1 qPELOD-2 scores are effective and have the ability to assess the prognosis of children with sepsis in the PICU of a developing country. Moreover, the PELOD-2 score is superior to the qPELOD-2 score. Further studies are needed to determine the usefulness of the qPELOD-2 score, particularly outside of the PICU.
-
☆
Please cite this article as: Zhong M, Huang Y, Li T, Xiong L, Lin T, Li M, et al. Day-1 PELOD-2 and day-1 "quick" PELOD-2 scores in children with sepsis in the PICU. J Pediatr (Rio J). 2020;96:660-5.
-
Ethics approval and consent to participateThis study met the standards of medical ethics and was approved by the Ethics Committee of the Affiliated Hospital of Guangdong Medical University (2018-027). In addition, the need for informed consent was waived due to the observational nature of the study.
Acknowledgements
The authors gratefully acknowledge all of the physicians, nurses, and patients of the Children's Medical Center of the Affiliated Hospital of Guangdong Medical University.
Appendix A Supplementary data
Supplementary material related to this article can be found, in the online version, at doi:https://doi.org/10.1016/j.jped.2019.07.007.
References
- 1 Liu V, Escobar GJ, Greene JD, Soule J, Whippy A, Angus DC, et al. Hospital deaths in patients with sepsis from 2 independent cohorts. JAMA. 2014;312:90-2.
- 2 Ruth A, McCracken CE, Fortenberry JD, Hall M, Simon HK, Hebbar KB. Pediatric severe sepsis: current trends and outcomes from the Pediatric Health Information Systems database. Pediatr Crit Care Med. 2014;15:828-38.
- 3 Giuliano JS, Markovitz BP, Brierley J, Levin R, Williams G, Lum LC, et al. Sepsis Prevalence, I. Therapies Study, I. Pediatric Acute Lung and N. Sepsis Investigators. Comparison of pediatric severe sepsis managed in U.S. and European ICUs. Pediatr Crit Care Med. 2016;17:522-30.
- 4 Tan B, Wong JJ, Sultana R, Koh J, Jit M, Mok YH, et al. Global case-fatality rates in pediatric severe sepsis and septic shock: a systematic review and meta-analysis. JAMA Pediatr. 2019;11:E1-10.
- 5 Fleischmann-Struzek C, Goldfarb DM, Schlattmann P, Schlapbach LJ, Reinhart K, Kissoon N. The global burden of paediatric and neonatal sepsis: a systematic review. Lancet Respir Med. 2018;6:223-30.
- 6 Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:801-10.
- 7 Singer M. The new sepsis consensus definitions (Sepsis-3): the good, the not-so-bad, and the actually-quite-pretty. Intensive Care Med. 2016;42:2027-9.
- 8 Leclerc F, Duhamel A, Deken V, Grandbastien B, Leteurtre S. Can the Pediatric Logistic Organ Dysfunction-2 score on day 1 be used in clinical criteria for sepsis in children?. Pediatr Crit Care Med. 2017;18:758-63.
- 9 Leteurtre S, Duhamel A, Salleron J, Grandbastien B, Lacroix J, Leclerc F. PELOD-2: an update of the Pediatric Logistic Organ Dysfunction score. Crit Care Med. 2013;41:1761-73.
- 10 Raith EP, Udy AA, Bailey M, McGloughlin S, Mac Isaac C, Bellomo R, et al. New Zealand Intensive Care Society Centre for and E. Resource. Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit. JAMA. 2017;317:290-300.
- 11 Goldstein B, Giroir B, Randolph A. International Consensus Conference on Pediatric Sepsis. International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med. 2005;6:2-8.
- 12 DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837-45.
- 13 Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157-72, discussion 207-112.
- 14 Fluss R, Faraggi D, Reiser B. Estimation of the Youden Index and its associated cutoff point. Biom J. 2005;47:458-72.
- 15 Matics TJ, Sanchez-Pinto LN. Adaptation and validation of a pediatric sequential organ failure assessment score and evaluation of the Sepsis-3 definitions in critically ill children. JAMA Pediatr. 2017;171:e172352.
- 16 Kaukonen KM, Bailey M, Pilcher D, Cooper DJ, Bellomo R. Systemic inflammatory response syndrome criteria in defining severe sepsis. N Engl J Med. 2015;372:1629-38.
- 17 Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, et al. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315:762-74.
- 18 Schlapbach LJ. Time for Sepsis-3 in Children?. Pediatr Crit Care Med. 2017;18:805-6.
- 19 Leteurtre S, Duhamel A, Deken V, Lacroix J, Leclerc F. Daily estimation of the severity of organ dysfunctions in critically ill children by using the PELOD- 2 score. Crit Care. 2015;19:324.
- 20 Goncalves JP, Severo M, Rocha C, Jardim J, Mota T, Ribeiro A. Performance of PRISM III and PELOD-2 scores in a pediatric intensive care unit. Eur J Pediatr. 2015;174:1305-10.
- 21 Zhang L, Huang H, Cheng Y, Xu L, Huang X, Pei Y, et al. Predictive value of four pediatric scores of critical illness and mortality on evaluating mortality risk in pediatric critical patients. Zhonghua Wei Zhong Bing Ji Jiu Yi Xue. 2018;30:51-6.
- 22 Schlapbach LJ, Straney L, Bellomo R, MacLaren G, Pilcher D. Prognostic accuracy of age-adapted SOFA, SIRS, PELOD-2, and qSOFA for in-hospital mortality among children with suspected infection admitted to the intensive care unit. Intensive Care Med. 2018;44:179-88.
- 23 Rodrigues-Filho EM, Fernandes R, Garcez A. SOFA in the first 24 hours as an outcome predictor of acute liver failure. Rev Bras Ter Intensiva. 2018;30:64-70.
- 24 Jentzer JC, Bennett C, Wiley BM, Murphree DH, Keegan MT, Gajic O, et al. Predictive value of the Sequential Organ Failure Assessment Score for mortality in a contemporary cardiac intensive care unit population. J Am Heart Assoc. 2018;7:E1-15.
Publication Dates
-
Publication in this collection
11 Nov 2020 -
Date of issue
Sep-Oct 2020
History
-
Received
13 Jan 2019 -
Accepted
18 July 2019 -
Published
30 Sept 2019