ABSTRACT
Background:
Although most coronavirus disease 2019 (COVID-19) infections are mild, some patients have severe clinical conditions requiring hospitalization. Data on the severity of COVID-19 in Brazil are scarce and are limited to public databases. This study aimed to investigate the clinical and laboratory factors associated with the severity of COVID-19 in a cohort of hospitalized adults from two hospitals in Northeast Brazil.
Methods:
Patients over 18 years of age who were hospitalized between August 2020 and July 2021 with a confirmed diagnosis of COVID-19 were included. The patients were classified into two groups: moderate and severe. Clinical, laboratory and imaging parameters were collected and compared between the groups. A multivariate logistic regression model was used to determine the predictors of COVID-19 severity.
Results:
This study included 495 patients (253 moderate and 242 severe). A total of 372 patients (75.2%) were between 18 and 65 years of age, and the majority were male (60.6%; n = 300). Patients with severe disease had higher levels of leukocytes, neutrophils, platelets, neutrophil-to-lymphocyte ratio, monocyte-to-lymphocyte ratio, blood glucose, C-reactive protein, ferritin, D-dimer, aspartate aminotransferase, creatinine, and urea (p < 0.05). In multivariate logistic regression, the following variables were significant predictors of COVID-19 severity: leukocytes (odds ratio [OR] 3.27; 95% confidence interval [CI] 2.12-5.06), international normalized ratio (INR) (OR 0.22, 95% CI 0.14-0.33), and urea (OR 4.03; 95% CI 2.21-7.35).
Conclusions:
The present study identified the clinical and laboratory factors associated with the severity of COVID-19 in hospitalized Brazilian individuals.
Keywords:
Coronavirus; Predictors; Risk factors; SARS-CoV-2; Severity
INTRODUCTION
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the virus responsible for causing coronavirus disease 2019 (COVID-19). The first case was reported in December 2019 in Wuhan, China11. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497-506.. Due to its rapid transmission, the disease has spread to several countries, and on January 30, 2020, it was declared a public health emergency of international interest. On March 11, 2020, the World Health Organization (WHO) classified COVID-19 as a pandemic22. World Health Organization. WHO announces outbreak of COVID-19 as a pandemic. March. 2020. p. 13-5. Available from: https://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic
https://www.euro.who.int/en/health-topic...
.
There have been 538,524,689 million cases worldwide, with 6,327,653 confirmed deaths33. COVID Live - Coronavirus Statistics - Worldometer [Internet]. [cited 2022 Jun 8]. Available from: https://www.worldometers.info/coronavirus/#countries
https://www.worldometers.info/coronaviru...
. In Brazil, the first confirmed case was reported in February 2020 in São Paulo in a man with a history of international travel44. Rodriguez-Morales AJ, Gallego V, Escalera-Antezana JP, Méndez CA, Zambrano LI, Franco-Paredes C, et al. COVID-19 in Latin America: The implications of the first confirmed case in Brazil. Travel Med Infect Dis. 2020;35:101613.. Less than a month later, the country registered the first death. The disease quickly spread to large urban centers and reached the smallest and most distant municipalities, strongly influenced by the flow of people through air and road networks55. Carmo RF, Nunes BEBR, Machado MF, Armstrong AC, Souza CDF. Expansion of COVID-19 within Brazil: the importance of highways. J Travel Med. 2020;27(5):taaa106.,66. De Souza CDF, Machado MF, Gonçalves SJA, Bastos RNBE, Feliciano do Carmo R. Airports, highways and COVID-19: An analysis of spatial dynamics in Brazil. J Transp Health. 2021;21:101067.. Brazil currently ranks third in the number of cases worldwide, with approximately 31 million confirmed cases and more than 667,000 deaths as of June 202233. COVID Live - Coronavirus Statistics - Worldometer [Internet]. [cited 2022 Jun 8]. Available from: https://www.worldometers.info/coronavirus/#countries
https://www.worldometers.info/coronaviru...
.
Most COVID-19 infections are mild, with symptoms or clinical features that generally include fever and cough, with recovery in 2-3 weeks11. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497-506.. However, some patients have severe clinical conditions requiring hospitalization, which can rapidly progress to acute respiratory distress syndrome, septic shock, refractory metabolic acidosis, coagulation disorders, multiple organ failure, and death77. Guan WJIE, Ni ZYI, Hu Y, Liang WHUA, Ou CQUAN, He JX, et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N Engl J Med. 2020;382(18):1708-20.. Among the disease's most characteristic signs and symptoms are fatigue, cough, headache, myalgia, fever, and respiratory distress88. Popov GT, Baymakova M, Vaseva V, Kundurzhiev T, Mutafchiyski V. Clinical Characteristics of Hospitalized Patients with COVID-19 in Sofia, Bulgaria. Vector Borne Zoonotic Dis. 2020;20(12):910-5.,99. Docherty AB, Harrison EM, Green CA, Hardwick HE, Pius R, Norman L, et al. Features of 20 133 UK patients in hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: prospective observational cohort study. BMJ. 2020;369:m1985..
The following subgroups are considered at higher risk: having obesity, hypertension, diabetes, or heart disease; smokers; high-risk pregnant women; immunocompromised patients; patients with advanced-stage renal disease; people aged 60 years or over; and patients with malignant neoplasms, severe lung diseases, and chromosomal diseases1010. BRASIL. Ministério da Saúde. Diretrizes para diagnóstico e tratamento Da COVID-19 [Internet]. 2020 [cited 2021 Jun 14]. Available from: Available from: https://saude.rs.gov.br/upload/arquivos/202004/14140600-2-ms-diretrizes-covid-v2-9-4.pdf
https://saude.rs.gov.br/upload/arquivos/...
. Furthermore, some laboratory markers have been associated with disease severity, including troponin I, natriuretic peptide (BNP), D-dimer, C-reactive protein (CRP), albumin, interleukin-6, and ferritin1111. Al Mutair A, Alhumaid S, Alhuqbani WN, Zaidi ARZ, Alkoraisi S, Al-Subaie MF, et al. Clinical, epidemiological, and laboratory characteristics of mild-to-moderate COVID-19 patients in Saudi Arabia: an observational cohort study. Eur J Med Res. 2020;25(1):61.
12. Ducastel M, Chenevier-Gobeaux C, Ballaa Y, Meritet JF, Brack M, Chapuis N, et al. Oxidative Stress and Inflammatory Biomarkers for the Prediction of Severity and ICU Admission in Unselected Patients Hospitalized with COVID-19. Int J Mol Sci. 2021;22(14):7462.-1313. Li C, Jiang J, Wang F, Zhou N, Veronese G, Moslehi JJ, et al. Longitudinal correlation of biomarkers of cardiac injury, inflammation, and coagulation to outcome in hospitalized COVID-19 patients. J Mol Cell Cardiol. 2020;147:74-87..
Although factors related to the severity of COVID-19 have been described in several studies in European, Asian, and Latin American countries1414. Al Mutair A, Elhazmi A, Alhumaid S, Ahmad GY, Rabaan AA, Alghdeer MA, et al. Examining the Clinical Prognosis of Critically Ill Patients with COVID-19 Admitted to Intensive Care Units: A Nationwide Saudi Study. Medicina (Kaunas). 2021;57(9):878.
15. Vial MR, Peters A, Pérez I, Spencer-Sandino M, Barbé M, Porte L, et al. Covid-19 in South America: clinical and epidemiological characteristics among 381 patients during the early phase of the pandemic in Santiago, Chile. BMC Infect Dis. 2020;20(1):1-9.-1616. Dorjee K, Kim H, Bonomo E, Dolma R. Prevalence and predictors of death and severe disease in patients hospitalized due to COVID-19: A comprehensive systematic review and meta-analysis of 77 studies and 38,000 patients. PLoS One. 2020;15(12):e0243191., published studies from Brazil are limited to data available in public databases, with little clinical and laboratory information1717. de Souza FSH, Hojo-Souza NS, de Oliveira BBD, da Silva CM, Guidoni DL. On the analysis of mortality risk factors for hospitalized COVID-19 patients: A data-driven study using the major Brazilian database. PLoS One . 2021;16(3):e0248580.
18. Baqui P, Bica I, Marra V, Ercole A, van der Schaar M. Ethnic and regional variations in hospital mortality from COVID-19 in Brazil: a cross-sectional observational study. Lancet Glob Health. 2020;8(8):e1018-26.-1919. Sousa GJB, Garces TS, Cestari VRF, Florêncio RS, Moreira TMM, Pereira MLD. Mortality and survival of COVID-19. Epidemiol Infect. 2020;148:e123..
The identification of risk factors associated with the development of severe COVID-19 may provide subsidies for the early identification of risk groups, allowing better clinical management by the medical team, longer patient survival, and lower expenses related to the hospitalization and rehabilitation of these patients.
Therefore, this study aimed to investigate the clinical, laboratory, and imaging parameters associated with the severity of COVID-19 in a cohort of hospitalized adults from two hospitals in the city of Petrolina, located in the northeast region of Brazil.
METHODS
Design, population, and period
This observational cohort study was conducted in two hospitals in Petrolina, Northeast Brazil. Both hospitals serve as references for the treatment of COVID-19 in this region. The Monte Carmelo Field Hospital has 100 beds for intermediate care, and the University Hospital of the Federal University of Vale do São Francisco has 20 intensive care unit (ICU) beds dedicated to patients with COVID-19.
We included all patients older than 18 years who were hospitalized between August 2020 and July 2021 with suspected COVID-19. The diagnosis of COVID-19 was confirmed by reverse transcription followed by quantitative polymerase chain reaction (RT-qPCR) or a rapid swab test for viral antigens.
Patients included in the study were divided into 2 groups and classified according to the criteria established by the World Health Organization2020. Marshall JC, Murthy S, Diaz J, Adhikari N, Angus DC, Arabi YM, et al. A minimal common outcome measure set for COVID-19 clinical research. Lancet Infect Dis. 2020;20(8):e192-7., with modifications, as follows: I) Moderate cases: hospitalized, without requiring oxygen therapy or oxygen supplementation by means of a mask or nasal cannula; and II) Severe cases: hospitalized and required ventilatory support by non-invasive mechanical ventilation, high-flow devices, intubation, and mechanical ventilation, or mechanical ventilation with additional support (vasopressors, dialysis/hemodialysis, and extracorporeal oxygenation membrane).
This study was approved by the Ethics and Research Committee of the Estácio de Sá University (CEP/UNESA, acronym in Portuguese) under the protocol CAAE:36613520.0.0000.5640 CEP/UNESA and was conducted in accordance with the provisions of the Declaration of Helsinki and the guidelines for good clinical practice.
Data collection
Demographic, clinical, laboratory, and imaging parameters were obtained through data collection from electronic medical records.
Laboratory tests performed within 24h of admission were considered, including the following: complete blood count; activated partial thromboplastin time (APTT); D-dimer; aspartate aminotransferase (AST); alanine aminotransferase (ALT); total, direct, and indirect bilirubin; creatinine; ferritin; c-reactive protein (CRP); troponin T; urea; prothrombin time; international normalized ratio (INR); and gamma-glutamyl transferase (GGT). In addition, the neutrophil-to-lymphocyte ratio (NLR) and the monocyte-to-lymphocyte ratio (MLR) were calculated by dividing the absolute value of neutrophils by lymphocytes for NLR and the absolute value of monocytes by lymphocytes for MLR. The results of imaging tests such as radiography and computed tomography were also obtained.
We also collected data related to the period of hospitalization, such as maximum body temperature, highest respiratory rate, highest heart rate, lowest O2 saturation, mean blood pressure (mean blood pressure = diastolic blood pressure + [(systolic blood pressure − diastolic blood pressure)/3]), complications, drug treatment, outcome, length of hospital stay, and time between the onset of symptoms and hospitalization.
Statistical analysis
Data were analyzed using SPSS Statistics (version 22.0; SPSS, Inc., Chicago, IL, USA). GraphPad Prism version 8.0 (GraphPad, San Diego, CA, USA) was used to build the graphs. Categorical data were expressed as absolute frequencies and percentages. Continuous variables were presented as medians with interquartile ranges. The Kolmogorov-Smirnov test was used to verify the normal distribution of continuous variables. Comparisons between two groups were performed using the Student's t-test or the Mann-Whitney test for parametric or non-parametric approaches, respectively. Pearson's chi-squared test and Fisher's exact test were used for categorical variables.
To determine the predictors of severity associated with COVID-19, a multivariate logistic regression model using the backward method was applied. Clinical and laboratory variables collected at admission, with a p-value < 0.01 in univariate analysis, were included in the model. We decided to use a more conservative criterion for variable selection to obtain a simpler model with fewer parameters that can be more easily applied in clinical practice. The model was corrected according to sex and age. Logistic regression was followed by an a priori multicollinearity test using the tolerance test and variance inflation factor. The MissForest package in the R statistical program was used to impute laboratory data with up to 35% missing values. This program is based on machine learning and comprises an algorithm responsible for assigning lost data of multiple variables2121. Stekhoven DJ, Buhlmann P. MissForest-non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28(1):112-8..
Before insertion into the model, laboratory test results were transformed into binary data according to their respective reference values (Supplementary Table 1). Next, the odds ratio (OR) with a 95% confidence interval (CI) was estimated, and p-values < 0.05 were considered significant. Finally, the model's performance was evaluated using the area under the receiver operating characteristic curve (AUROC) analysis and 95% CI.
RESULTS
Clinical and demographic characteristics
A total of 600 patients with suspected COVID-19 were recruited; 105 patients were excluded because they tested negative for COVID-19 or did not agree to participate in the study. In total, 495 patients were included in this study. The cases were subsequently classified as moderate (n = 253) or severe (n = 242) (Figure 1).
Flowchart of the patients included in the study and classified according to the severity criteria.
Table 1 describes the clinical and demographic characteristics of the patients included in the study, according to severity. Of the total cases, 372 patients (75.2%) were between 18 and 65 years of age, and the majority were male (60.6%; n = 300). The most frequently observed symptoms were dyspnea (74.9%; n = 371), dry cough (72.3%; n = 358), fever (66.9%; n = 331), and O2 saturation < 95% (51.9%; n = 257). The most common comorbidities were systemic arterial hypertension (48.7%; n = 241), diabetes mellitus (29.1%; n = 144), and obesity (23.6%; n = 117).
Dry cough, fever, headache, muscle pain, anosmia/dysgeusia, asthenia, diarrhea, and vomiting were most often reported by individuals with moderate disease (p < 0.05). Regarding comorbidities, diabetes, hypertension and chronic kidney disease were related to the severity of COVID-19 (p < 0.05) (Table 1).
Clinical data on hospitalization
Table 2 describes the clinical data on hospitalization, treatment, and outcomes, including moderate and severe cases. It was observed that severe cases had higher values of body temperature, respiratory rate, heart rate, and a fraction of inspired oxygen when compared to the group of moderate cases (p < 0.0001). In addition, the O2 saturation levels and mean arterial pressure were lower in the severe group (p < 0.0001).
Of the 134 (27.0%) patients who underwent imaging tests, bilateral alveolar infiltrate (23.1%; n = 31) and the ground-glass pattern (23.1%; n = 31) were the most prevalent. Among the findings, only pneumothorax was significantly more frequent in the severe COVID-19 group (p = 0.005) (Table 2).
Regarding oxygen support, the severe group predominantly used invasive mechanical ventilation (76.9%) and non-invasive ventilation (23.1%), whereas the moderate group used mainly nasal catheters (89.2%) and non-rebreathing masks (10.8%) (Table 2).
During hospitalization, a greater number of complications were observed in severe cases. Cardiorespiratory arrest, sepsis, shock, myocardial failure, and acute kidney injury were significantly more common in the severe group when compared to the moderate COVID-19 group (p < 0.01) (Table 2).
Regarding the use of prescription drugs, in the total number of patients, anticoagulants (99.0%; n = 490), corticosteroids (95.8%; n = 474), bronchodilators (85.7%; n = 424), and antibiotics (46.9%; n = 232) were the most used (Table 2).
Regarding the length of hospital stay, a median of 6 days was observed for the total number of hospitalized patients, with a longer duration in the severe group than in the moderate group (12 days vs. 4 days, p < 0.0001). There was no significant difference between the symptom onset and hospitalization date between the two groups (p = 0.942). In the severe COVID-19 group, 36.0% (n = 87) of patients died, while in the moderate group, 95.3% (n = 241) of patients recovered and 4.7% (n = 12) were transferred (p < 0.0001) (Table 2).
Laboratory data
Regarding laboratory findings, it was observed that severe patients had higher levels of leukocytes, neutrophils, platelets, NLR, MLR, blood glucose, CRP, ferritin, D-dimer, AST, creatinine, and urea (p < 0.05). In contrast, patients with moderate COVID-19 had higher levels of lymphocytes, APTT, prothrombin time, INR, and indirect bilirubin (p < 0.05) (Figure 2).
Laboratory data of COVID-19 patients associated with severity. Results were presented as the median and interquartile range (IQR). Mann-Whitney test was used for comparison between groups.
Multivariate logistic regression
Multivariate logistic regression using the backward method was used to identify the predictors of severity associated with COVID-19. The model initially included the following variables: glucose, leukocyte, C-reactive protein (CRP), ferritin, INR, AST, and urea levels. The other variables were excluded because they had p-value > 0.01, had more than 35% absent values, or were redundant. After excluding the variables using the backward regression method and adjusting according to sex and age, the following variables remained in the model: leukocytes > 10,000 cells/μl (p < 0.0001; OR 3.27; 95% CI 2.12 to 5.06), INR > 1.2 (p < 0.0001; OR 0.22; 95% CI 0.14 to 0.33), and urea > 48.5 mg/dL (p < 0.0001; OR 4.03; 95% CI 2.21 to 7.35) (Table 3). The AUROC was 0.78 (95% CI 0.74 to 0.82).
DISCUSSION
Due to the challenging behaviors of COVID-19, understanding the reasons contributing to aggravation is extremely important. They are a priority when facing a rapidly spread public health emergency such as this one.
Early identification of risk factors can contribute to better care for patients with a greater chance of developing severe disease. Thus, this study analyzed the risk factors associated with the severity of COVID-19 in hospitalized patients in Northeast Brazil.
Diabetes, hypertension, and chronic kidney disease were associated with severe COVID-19 compared to patients with a moderate form of the disease. These findings are consistent with previous results that demonstrated a higher risk of hospitalization in older male patients with comorbidities1616. Dorjee K, Kim H, Bonomo E, Dolma R. Prevalence and predictors of death and severe disease in patients hospitalized due to COVID-19: A comprehensive systematic review and meta-analysis of 77 studies and 38,000 patients. PLoS One. 2020;15(12):e0243191.,2222. Izcovich A, Ragusa MA, Tortosa F, Marzio MAL, Agnoletti C, Bengolea A, et al. Prognostic factors for severity and mortality in patients infected with COVID-19: A systematic review. PLoS One . 2020;15(11):e0241955.,2323. Benjamin GM, Aghagoli G, Lavine K, Yang L, Siff EJ, Chiang SS, et al. Predictors of COVID-19 severity: A literature review. Rev Med Virol. 2021;31(1):1-10.. A meta-analysis including 77 studies and 38,000 patients demonstrated an increased risk of death in patients with the following risk factors: age > 60 years (summary relative risk [SRR] = 3.6), male sex (SRR = 1.3), history of smoking (SRR = 1.3), COPD (SRR = 1.7), heart disease (SRR = 2.1), chronic kidney disease (SRR = 2.5), hypertension (SRR = 1.8) and diabetes (SRR = 1.5)1616. Dorjee K, Kim H, Bonomo E, Dolma R. Prevalence and predictors of death and severe disease in patients hospitalized due to COVID-19: A comprehensive systematic review and meta-analysis of 77 studies and 38,000 patients. PLoS One. 2020;15(12):e0243191.. A study in the United States, including 10,131 veterans, showed that older age, male sex, diabetes, hypertension, chronic kidney disease, cirrhosis, and alcohol dependence were associated with the risk of hospitalization2424. Ioannou GN, Locke E, Green P, Berry K, O’Hare AM, Shah JA, et al. Risk Factors for Hospitalization, Mechanical Ventilation, or Death among 10131 US Veterans with SARS-CoV-2 Infection. JAMA Netw Open. 2020;3(9):1-18.. Fever, dyspnea, nausea, and diarrhea were significantly associated with the risk of hospitalization2424. Ioannou GN, Locke E, Green P, Berry K, O’Hare AM, Shah JA, et al. Risk Factors for Hospitalization, Mechanical Ventilation, or Death among 10131 US Veterans with SARS-CoV-2 Infection. JAMA Netw Open. 2020;3(9):1-18.. The present study's findings corroborate previous work carried out by our group using 59,695 cases of COVID-19 in Northeast Brazil registered in a public database, which demonstrated a higher risk of death associated with age, sex, and presence of comorbidities2525. Baggio JAO, Machado MF, Carmo RF, Armstrong AC, Santos AD, de Souza CDF. COVID-19 in Brazil: spatial risk, social vulnerability, human development, clinical manifestations and predictors of mortality - a retrospective study with data from 59 695 individuals. Epidemiol Infect . 2021;149:e100.. Other Brazilian studies have reported similar results1717. de Souza FSH, Hojo-Souza NS, de Oliveira BBD, da Silva CM, Guidoni DL. On the analysis of mortality risk factors for hospitalized COVID-19 patients: A data-driven study using the major Brazilian database. PLoS One . 2021;16(3):e0248580.
18. Baqui P, Bica I, Marra V, Ercole A, van der Schaar M. Ethnic and regional variations in hospital mortality from COVID-19 in Brazil: a cross-sectional observational study. Lancet Glob Health. 2020;8(8):e1018-26.-1919. Sousa GJB, Garces TS, Cestari VRF, Florêncio RS, Moreira TMM, Pereira MLD. Mortality and survival of COVID-19. Epidemiol Infect. 2020;148:e123..
In total, 76.9% of severe patients received invasive mechanical ventilation in our cohort. In a prospective study conducted at two Presbyterian hospitals in New York, 79% of hospitalized patients received invasive mechanical ventilation2626. Cummings MJ, Baldwin MR, Abrams D, Jacobson SD, Meyer BJ, Balough EM, et al. Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study . Lancet. 2020;395(10239):1763-70.. Another study in the United Kingdom with 742 patients in 36 ICUs showed that 66.4% of patients in the severe group received invasive mechanical ventilation. Thus, despite the wide use of glucocorticoids such as dexamethasone to modulate inflammation-mediated lung injury and thereby minimize the progression of the disease to respiratory failure and death, mechanical ventilation remains the basis of clinical management of COVID-19 in severe cases, and the use of this resource is already expected for this profile of patients2727. RECOVERY Collaborative Group, Horby P, Lim WS, Emberson JR, Mafham M, Bell JL, et al. Dexamethasone in Hospitalized Patients with Covid-19. N Engl J Med . 2021;384(8):693-704.
28. Lim ZJ, Subramaniam A, Reddy MP, Blecher G, Kadam U, Afroz A, et al. Case Fatality Rates for Patients with COVID-19 Requiring Invasive Mechanical Ventilation. A Meta-analysis. Am J Respir Crit Care Med. 2021;203(1):54-66.-2929. Sanders JM, Monogue ML, Jodlowski TZ, Cutrell JB. Pharmacologic Treatments for Coronavirus Disease 2019 (COVID-19): A Review. JAMA. 2020;323(18):1824-36..
Reported rates of acute kidney injury vary in COVID-19; however, evidence suggests that it likely affects > 20% of hospitalized patients and > 50% of patients in the ICU3030. Nadim MK, Forni LG, Mehta RL, Connor MJ, Liu KD, Ostermann M, et al. COVID-19-associated acute kidney injury: consensus report of the 25th Acute Disease Quality Initiative (ADQI) Workgroup. Nat Rev Nephrol. 2020;16(12):747-64.. In our cohort, 31.8% of severe cases developed acute kidney injury during hospitalization. This frequency is similar to that reported by Cumming et al. (2020), who observed a rate of 31% in hospitalized patients2626. Cummings MJ, Baldwin MR, Abrams D, Jacobson SD, Meyer BJ, Balough EM, et al. Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study . Lancet. 2020;395(10239):1763-70.. Another study in the United States with 5,449 patients infected with SARS-CoV-2 admitted to the ICU observed a 36.6% incidence of acute kidney injury associated with respiratory failure, hypertension, and vasopressor medications3131. Hirsch JS, Ng JH, Ross DW, Sharma P, Shah HH, Barnett RL, et al. Acute kidney injury in patients hospitalized with COVID-19. Kidney Int. 2020;98(1):209-18.. The mechanisms of acute kidney injury in COVID-19 are not yet clear, but they likely involve multiple factors, such as direct viral infection, cytokine-mediated injury, and ischemic/hypoxic injury3232. Cheng Y, Luo R, Wang K, Zhang M, Wang Z, Dong L, et al. Kidney disease is associated with in-hospital death of patients with COVID-19. Kidney Int . 2020;97(5):829-38.
33. Zhou H, Zhang Z, Fan H, Li J, Li M, Dong Y, et al. Urinalysis, but not blood biochemistry, detects the early renal-impairment in patients with COVID-19. Diagnostics (Basel). 2022;12(3):602.-3434. Su H, Yang M, Wan C, Yi LX, Tang F, Zhu HY, et al. Renal histopathological analysis of 26 postmortem findings of patients with COVID-19 in China. Kidney Int . 2020;98(1):219-27..
Previous studies reported in-hospital mortality rates in severe patients admitted to the ICU, ranging from 40% to 60% at the beginning of the pandemic3535. Armstrong RA, Kane AD, Cook TM. Outcomes from intensive care in patients with COVID-19: a systematic review and meta-analysis of observational studies. Anaesthesia. 2020;75(10):1340-9., with a declining trend by the end of 20203636. Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, et al. Clinical Characterization and Prediction of Clinical Severity of SARS-CoV-2 Infection among US Adults Using Data from the US National COVID Cohort Collaborative. JAMA Netw Open . 2021;4(7):1-15.. In our study, the mortality rate in the severe group was 36.0%, whereas 95.3% survived in the moderate group. The period of inclusion of patients in the present study coincided with the introduction and spread of the P1 variant of concern in the country, which was responsible for an increase in the demand for ICU beds in the country, as well as an increase in the in-hospital mortality rate to values equivalent to the beginning of the pandemic3737. Zeiser FA, Donida B, da Costa CA, Ramos G de O, Scherer JN, Barcellos NT, et al. First and second COVID-19 waves in Brazil: A cross-sectional study of patients’ characteristics related to hospitalization and in-hospital mortality. Lancet Reg Health Am. 2022;6:100107.,3838. Sabino EC, Buss LF, Carvalho MPS, Prete CA, Crispim MAE, Fraiji NA, et al. Resurgence of COVID-19 in Manaus, Brazil, despite high seroprevalence. Lancet. 2021;397(10273):452-5..
Among the imaging findings, a total of 15.2% of severe patients developed pneumothorax. Although these findings are fragile, given that few patients underwent imaging exams in our study, retrospective studies of patients with COVID-19 have suggested that pneumothorax may occur in 1% of those requiring hospital admission, 2% of patients requiring ICU admission, and 1% of patients who die from infection3939. Martinelli AW, Ingle T, Newman J, Nadeem I, Jackson K, Lane ND, et al. COVID-19 and pneumothorax: a multicentre retrospective case series. Eur Respir J. 2020;56(5):2002697.
40. Chen N, Zhou M, Dong X, Qu J, Gong F, Han Y, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. Lancet. 2020;395(10223):507-13.-4141. Yang X, Yu Y, Xu J, Shu H, Xia J, Liu H, et al. Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study. Lancet Respir Med. 2020;8(5):475-81.. More recently, the rate of barotrauma, comprising pneumothorax and pneumomediastinum, in ventilated patients was 15%4242. McGuinness G, Zhan C, Rosenberg N, Azour L, Wickstrom M, Mason DM, et al. Increased Incidence of Barotrauma in Patients with COVID-19 on Invasive Mechanical Ventilation. Radiology. 2020;297(2):E252-62.. Although it occurs more frequently in patients who have received invasive mechanical ventilation, studies have also shown the development of pneumothorax in patients receiving non-invasive ventilation or high-flow nasal cannulas3939. Martinelli AW, Ingle T, Newman J, Nadeem I, Jackson K, Lane ND, et al. COVID-19 and pneumothorax: a multicentre retrospective case series. Eur Respir J. 2020;56(5):2002697.,4343. Al-Shokri SD, Ahmed AOE, Saleh AO, AbouKamar M, Ahmed K, Mohamed MFH. Case Report: COVID-19-Related Pneumothorax-Case Series Highlighting a Significant Complication. Am J Trop Med Hyg. 2020;103(3):1166-9.. Although not yet established, the mechanisms underlying the development of COVID-19-associated pneumothorax may be related to the high airway pressures provided by these respiratory support modalities and the spontaneous rupture of small, fragile airways infected with the virus4444. Nunna K, Braun AB. Development of a large spontaneous pneumothorax after recovery from mild COVID-19 infection. BMJ Case Rep. 2021;14(1):e238863..
Regarding the treatment regimen, a higher frequency of corticosteroids, antibiotics, and vasopressor medication use was observed in patients with severe disease than in those with moderate. Although there is no evidence regarding the beneficial effects of ivermectin in the treatment of COVID-194545. dos Santos WG. Natural history of COVID-19 and current knowledge on treatment therapeutic options. Biomed Pharmacother. 2020;129:110493., this drug was used in 11.1% of cases, with no significant difference between groups. The frequency of medication use differed in most of the studies. These differences can be explained mainly by the period in which the studies were conducted since different treatment regimens were implemented throughout the pandemic as new clinical trials were published. The use of drugs such as ivermectin and hydroxychloroquine is mainly reported in studies published in 2020 4646. Choudhary R, Sharma AK. Potential use of hydroxychloroquine, ivermectin and azithromycin drugs in fighting COVID-19: trends, scope and relevance. New Microbes New Infect. 2020;35:100684.,4747. Patrì A, Fabbrocini G. Hydroxychloroquine and ivermectin: A synergistic combination for COVID-19 chemoprophylaxis and treatment? J Am Acad Dermatol. 2020;82(6):e221.; as our study largely involved cases hospitalized in 2021, a high frequency of use of these drugs was not observed. On the other hand, our study revealed the primary use of corticosteroid drugs (95.8%), in contrast to a French study carried out in March 2020, where this class of drugs was used in only 3.6% of hospitalized cases4848. Both L, Botgros R, Cavaleri M. Analysis of licensed over-the-counter (OTC) antibiotics in the European Union and Norway, 2012. Euro Surveill. 2015;20(34):30002.. On the other hand, in a cohort of patients from the United States hospitalized up to December 2020, it was reported that 41.5% of hospitalized patients received at least one immunomodulatory drug3636. Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, et al. Clinical Characterization and Prediction of Clinical Severity of SARS-CoV-2 Infection among US Adults Using Data from the US National COVID Cohort Collaborative. JAMA Netw Open . 2021;4(7):1-15..
Regarding laboratory data, our findings confirm those previously published in the literature, where severe patients had greater abnormalities in hematological markers and markers related to liver and kidney function2424. Ioannou GN, Locke E, Green P, Berry K, O’Hare AM, Shah JA, et al. Risk Factors for Hospitalization, Mechanical Ventilation, or Death among 10131 US Veterans with SARS-CoV-2 Infection. JAMA Netw Open. 2020;3(9):1-18.. After multivariate logistic regression analysis, leukocyte count > 10,000 cells/l (OR 3.27), INR > 1.2 (OR 0.22), and urea > 48.5 mg/dL (OR 4.03) were independently associated with severe COVID-19. A study from the United States of 2,511 hospitalized patients with COVID-19 demonstrated that lymphocytopenia, eosinopenia, neutrophilia, and increased renal function markers, such as urea and creatinine, were able to predict severe COVID-19 in a prediction model using logistic regression (AUROC = 0.80)4949. Castro VM, Mccoy TH, Perlis RH. Laboratory Findings Associated with Severe Illness and Mortality among Hospitalized Individuals with Coronavirus Disease 2019 in Eastern Massachusetts. JAMA Netw Open . 2020;3(10):1-9.. In a 2020 study, Kaeuffer et al.5050. Kaeuffer C, Hyaric LC, Fabacher T, Mootien J, Dervieux B, Ruch Y, et al. Clinical characteristics and risk factors associated with severe COVID-19: Prospective analysis of 1,045 hospitalised cases in North-Eastern France, March 2020. Euro Surveill . 2020;25(48):2000895. demonstrated a significant association between CRP, neutrophil counts, and lymphopenia and the severity of COVID-19 in a multivariate regression model that included 1,045 patients hospitalized in two French hospitals. In addition, a recent meta-analysis including 32 studies with 10,491 patients with COVID-19 demonstrated lymphopenia, thrombocytopenia, CRP, procalcitonin, D-dimer, creatine kinase, lactate dehydrogenase, AST, ALT, and creatinine levels were associated with the severity of COVID-195151. Malik P, Patel U, Mehta D, Patel N, Kelkar R, Akrmah M, et al. Biomarkers and outcomes of COVID-19 hospitalisations: systematic review and meta-analysis. BMJ Evid Based Med. 2021;26(3):107-8.. Leukocytes, INR, and urea are frequently used laboratory parameters in clinical practice. Using these markers at the time of hospitalization could assist in the identification of patients with worse prognosis, thus favoring the design of strategies for the clinical management of these patients.
The study design, recruitment period, circulation of different variants of the new coronavirus, and quality of the extracted data may explain the differences in the factors associated with the severity of COVID-19 in different studies. Our study has limitations, among which we can highlight the fact that the study was carried out in only two public hospitals in Northeast Brazil, which may limit the generalization of the results to other centers due to differences in the socioeconomic and demographic characteristics of the population. Second, excluding some variables from the regression model due to incomplete information may have compromised the development of a more robust prediction model.
However, this study has several strengths. First, our study is one of the first in Brazil to investigate hospitalized patients using a large number of analyzed variables. Second, there are few published studies, including patients who became infected during the second wave of the pandemic when the P1 variant was mainly circulating in Brazil. Third, we used robust analyses to identify the potential predictors of COVID-19 severity, which may be useful in clinical practice.
This study identified the clinical and laboratory factors associated with the severity of COVID-19 using data from patients hospitalized in two reference centers in Northeast Brazil. Altered laboratory parameters of leukocytes, INR, and urea can predict the risk of severe COVID-19 in hospitalized patients. These parameters may be potential markers for the early identification of patients at a higher risk of complications, which may contribute to better management of these patients and improve survival.
ACKNOWLEDGMENTS
To the University Hospital of the Universidade Federal do Vale do São Francisco (HU-UNIVASF/EBSERH) and the Municipal Government of Petrolina for their support in the development of the study.
REFERENCES
-
1Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497-506.
-
2World Health Organization. WHO announces outbreak of COVID-19 as a pandemic. March. 2020. p. 13-5. Available from: https://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic
» https://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic -
3COVID Live - Coronavirus Statistics - Worldometer [Internet]. [cited 2022 Jun 8]. Available from: https://www.worldometers.info/coronavirus/#countries
» https://www.worldometers.info/coronavirus/#countries -
4Rodriguez-Morales AJ, Gallego V, Escalera-Antezana JP, Méndez CA, Zambrano LI, Franco-Paredes C, et al. COVID-19 in Latin America: The implications of the first confirmed case in Brazil. Travel Med Infect Dis. 2020;35:101613.
-
5Carmo RF, Nunes BEBR, Machado MF, Armstrong AC, Souza CDF. Expansion of COVID-19 within Brazil: the importance of highways. J Travel Med. 2020;27(5):taaa106.
-
6De Souza CDF, Machado MF, Gonçalves SJA, Bastos RNBE, Feliciano do Carmo R. Airports, highways and COVID-19: An analysis of spatial dynamics in Brazil. J Transp Health. 2021;21:101067.
-
7Guan WJIE, Ni ZYI, Hu Y, Liang WHUA, Ou CQUAN, He JX, et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N Engl J Med. 2020;382(18):1708-20.
-
8Popov GT, Baymakova M, Vaseva V, Kundurzhiev T, Mutafchiyski V. Clinical Characteristics of Hospitalized Patients with COVID-19 in Sofia, Bulgaria. Vector Borne Zoonotic Dis. 2020;20(12):910-5.
-
9Docherty AB, Harrison EM, Green CA, Hardwick HE, Pius R, Norman L, et al. Features of 20 133 UK patients in hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: prospective observational cohort study. BMJ. 2020;369:m1985.
-
10BRASIL. Ministério da Saúde. Diretrizes para diagnóstico e tratamento Da COVID-19 [Internet]. 2020 [cited 2021 Jun 14]. Available from: Available from: https://saude.rs.gov.br/upload/arquivos/202004/14140600-2-ms-diretrizes-covid-v2-9-4.pdf
» https://saude.rs.gov.br/upload/arquivos/202004/14140600-2-ms-diretrizes-covid-v2-9-4.pdf -
11Al Mutair A, Alhumaid S, Alhuqbani WN, Zaidi ARZ, Alkoraisi S, Al-Subaie MF, et al. Clinical, epidemiological, and laboratory characteristics of mild-to-moderate COVID-19 patients in Saudi Arabia: an observational cohort study. Eur J Med Res. 2020;25(1):61.
-
12Ducastel M, Chenevier-Gobeaux C, Ballaa Y, Meritet JF, Brack M, Chapuis N, et al. Oxidative Stress and Inflammatory Biomarkers for the Prediction of Severity and ICU Admission in Unselected Patients Hospitalized with COVID-19. Int J Mol Sci. 2021;22(14):7462.
-
13Li C, Jiang J, Wang F, Zhou N, Veronese G, Moslehi JJ, et al. Longitudinal correlation of biomarkers of cardiac injury, inflammation, and coagulation to outcome in hospitalized COVID-19 patients. J Mol Cell Cardiol. 2020;147:74-87.
-
14Al Mutair A, Elhazmi A, Alhumaid S, Ahmad GY, Rabaan AA, Alghdeer MA, et al. Examining the Clinical Prognosis of Critically Ill Patients with COVID-19 Admitted to Intensive Care Units: A Nationwide Saudi Study. Medicina (Kaunas). 2021;57(9):878.
-
15Vial MR, Peters A, Pérez I, Spencer-Sandino M, Barbé M, Porte L, et al. Covid-19 in South America: clinical and epidemiological characteristics among 381 patients during the early phase of the pandemic in Santiago, Chile. BMC Infect Dis. 2020;20(1):1-9.
-
16Dorjee K, Kim H, Bonomo E, Dolma R. Prevalence and predictors of death and severe disease in patients hospitalized due to COVID-19: A comprehensive systematic review and meta-analysis of 77 studies and 38,000 patients. PLoS One. 2020;15(12):e0243191.
-
17de Souza FSH, Hojo-Souza NS, de Oliveira BBD, da Silva CM, Guidoni DL. On the analysis of mortality risk factors for hospitalized COVID-19 patients: A data-driven study using the major Brazilian database. PLoS One . 2021;16(3):e0248580.
-
18Baqui P, Bica I, Marra V, Ercole A, van der Schaar M. Ethnic and regional variations in hospital mortality from COVID-19 in Brazil: a cross-sectional observational study. Lancet Glob Health. 2020;8(8):e1018-26.
-
19Sousa GJB, Garces TS, Cestari VRF, Florêncio RS, Moreira TMM, Pereira MLD. Mortality and survival of COVID-19. Epidemiol Infect. 2020;148:e123.
-
20Marshall JC, Murthy S, Diaz J, Adhikari N, Angus DC, Arabi YM, et al. A minimal common outcome measure set for COVID-19 clinical research. Lancet Infect Dis. 2020;20(8):e192-7.
-
21Stekhoven DJ, Buhlmann P. MissForest-non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28(1):112-8.
-
22Izcovich A, Ragusa MA, Tortosa F, Marzio MAL, Agnoletti C, Bengolea A, et al. Prognostic factors for severity and mortality in patients infected with COVID-19: A systematic review. PLoS One . 2020;15(11):e0241955.
-
23Benjamin GM, Aghagoli G, Lavine K, Yang L, Siff EJ, Chiang SS, et al. Predictors of COVID-19 severity: A literature review. Rev Med Virol. 2021;31(1):1-10.
-
24Ioannou GN, Locke E, Green P, Berry K, O’Hare AM, Shah JA, et al. Risk Factors for Hospitalization, Mechanical Ventilation, or Death among 10131 US Veterans with SARS-CoV-2 Infection. JAMA Netw Open. 2020;3(9):1-18.
-
25Baggio JAO, Machado MF, Carmo RF, Armstrong AC, Santos AD, de Souza CDF. COVID-19 in Brazil: spatial risk, social vulnerability, human development, clinical manifestations and predictors of mortality - a retrospective study with data from 59 695 individuals. Epidemiol Infect . 2021;149:e100.
-
26Cummings MJ, Baldwin MR, Abrams D, Jacobson SD, Meyer BJ, Balough EM, et al. Epidemiology, clinical course, and outcomes of critically ill adults with COVID-19 in New York City: a prospective cohort study . Lancet. 2020;395(10239):1763-70.
-
27RECOVERY Collaborative Group, Horby P, Lim WS, Emberson JR, Mafham M, Bell JL, et al. Dexamethasone in Hospitalized Patients with Covid-19. N Engl J Med . 2021;384(8):693-704.
-
28Lim ZJ, Subramaniam A, Reddy MP, Blecher G, Kadam U, Afroz A, et al. Case Fatality Rates for Patients with COVID-19 Requiring Invasive Mechanical Ventilation. A Meta-analysis. Am J Respir Crit Care Med. 2021;203(1):54-66.
-
29Sanders JM, Monogue ML, Jodlowski TZ, Cutrell JB. Pharmacologic Treatments for Coronavirus Disease 2019 (COVID-19): A Review. JAMA. 2020;323(18):1824-36.
-
30Nadim MK, Forni LG, Mehta RL, Connor MJ, Liu KD, Ostermann M, et al. COVID-19-associated acute kidney injury: consensus report of the 25th Acute Disease Quality Initiative (ADQI) Workgroup. Nat Rev Nephrol. 2020;16(12):747-64.
-
31Hirsch JS, Ng JH, Ross DW, Sharma P, Shah HH, Barnett RL, et al. Acute kidney injury in patients hospitalized with COVID-19. Kidney Int. 2020;98(1):209-18.
-
32Cheng Y, Luo R, Wang K, Zhang M, Wang Z, Dong L, et al. Kidney disease is associated with in-hospital death of patients with COVID-19. Kidney Int . 2020;97(5):829-38.
-
33Zhou H, Zhang Z, Fan H, Li J, Li M, Dong Y, et al. Urinalysis, but not blood biochemistry, detects the early renal-impairment in patients with COVID-19. Diagnostics (Basel). 2022;12(3):602.
-
34Su H, Yang M, Wan C, Yi LX, Tang F, Zhu HY, et al. Renal histopathological analysis of 26 postmortem findings of patients with COVID-19 in China. Kidney Int . 2020;98(1):219-27.
-
35Armstrong RA, Kane AD, Cook TM. Outcomes from intensive care in patients with COVID-19: a systematic review and meta-analysis of observational studies. Anaesthesia. 2020;75(10):1340-9.
-
36Bennett TD, Moffitt RA, Hajagos JG, Amor B, Anand A, Bissell MM, et al. Clinical Characterization and Prediction of Clinical Severity of SARS-CoV-2 Infection among US Adults Using Data from the US National COVID Cohort Collaborative. JAMA Netw Open . 2021;4(7):1-15.
-
37Zeiser FA, Donida B, da Costa CA, Ramos G de O, Scherer JN, Barcellos NT, et al. First and second COVID-19 waves in Brazil: A cross-sectional study of patients’ characteristics related to hospitalization and in-hospital mortality. Lancet Reg Health Am. 2022;6:100107.
-
38Sabino EC, Buss LF, Carvalho MPS, Prete CA, Crispim MAE, Fraiji NA, et al. Resurgence of COVID-19 in Manaus, Brazil, despite high seroprevalence. Lancet. 2021;397(10273):452-5.
-
39Martinelli AW, Ingle T, Newman J, Nadeem I, Jackson K, Lane ND, et al. COVID-19 and pneumothorax: a multicentre retrospective case series. Eur Respir J. 2020;56(5):2002697.
-
40Chen N, Zhou M, Dong X, Qu J, Gong F, Han Y, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. Lancet. 2020;395(10223):507-13.
-
41Yang X, Yu Y, Xu J, Shu H, Xia J, Liu H, et al. Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study. Lancet Respir Med. 2020;8(5):475-81.
-
42McGuinness G, Zhan C, Rosenberg N, Azour L, Wickstrom M, Mason DM, et al. Increased Incidence of Barotrauma in Patients with COVID-19 on Invasive Mechanical Ventilation. Radiology. 2020;297(2):E252-62.
-
43Al-Shokri SD, Ahmed AOE, Saleh AO, AbouKamar M, Ahmed K, Mohamed MFH. Case Report: COVID-19-Related Pneumothorax-Case Series Highlighting a Significant Complication. Am J Trop Med Hyg. 2020;103(3):1166-9.
-
44Nunna K, Braun AB. Development of a large spontaneous pneumothorax after recovery from mild COVID-19 infection. BMJ Case Rep. 2021;14(1):e238863.
-
45dos Santos WG. Natural history of COVID-19 and current knowledge on treatment therapeutic options. Biomed Pharmacother. 2020;129:110493.
-
46Choudhary R, Sharma AK. Potential use of hydroxychloroquine, ivermectin and azithromycin drugs in fighting COVID-19: trends, scope and relevance. New Microbes New Infect. 2020;35:100684.
-
47Patrì A, Fabbrocini G. Hydroxychloroquine and ivermectin: A synergistic combination for COVID-19 chemoprophylaxis and treatment? J Am Acad Dermatol. 2020;82(6):e221.
-
48Both L, Botgros R, Cavaleri M. Analysis of licensed over-the-counter (OTC) antibiotics in the European Union and Norway, 2012. Euro Surveill. 2015;20(34):30002.
-
49Castro VM, Mccoy TH, Perlis RH. Laboratory Findings Associated with Severe Illness and Mortality among Hospitalized Individuals with Coronavirus Disease 2019 in Eastern Massachusetts. JAMA Netw Open . 2020;3(10):1-9.
-
50Kaeuffer C, Hyaric LC, Fabacher T, Mootien J, Dervieux B, Ruch Y, et al. Clinical characteristics and risk factors associated with severe COVID-19: Prospective analysis of 1,045 hospitalised cases in North-Eastern France, March 2020. Euro Surveill . 2020;25(48):2000895.
-
51Malik P, Patel U, Mehta D, Patel N, Kelkar R, Akrmah M, et al. Biomarkers and outcomes of COVID-19 hospitalisations: systematic review and meta-analysis. BMJ Evid Based Med. 2021;26(3):107-8.
-
Financial Support: Fundação de Amparo à Ciência e Tecnologia do Estado de Pernambuco - FACEPE (IBPG-0010-2.02/20, IBPG-1384-2.02/20, APQ-0422-2.02/19), Coordenação de Aperfeiçoamento de Pessoal de Nível Superior CAPES (Código 001) and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq).
SUPPLEMENTARY MATERIAL
Publication Dates
-
Publication in this collection
26 Sept 2022 -
Date of issue
2022
History
-
Received
21 Feb 2022 -
Accepted
01 July 2022