Abstract
Background
Literature is scarce on echocardiographic characteristics of COVID-19 patients admitted to the intensive care unit (ICU).
Objectives
To describe echocardiographic characteristics of ICU COVID-19 patients and associate them with clinical signals/symptoms, laboratory findings and outcomes.
Methods
Patients with RT-PCR-confirmed COVID-19, admitted to the ICU, who underwent echocardiography were included. Clinical characteristics associated with an abnormal echocardiogram (systolic ventricular dysfunction of any degree — left and/or right ventricle — and/or high filling pressures and/or moderate to severe pericardial effusion) were analyzed. Groups were compared using the Student’s t-test, chi-square, and logistic regression. A p < 0.05 was considered statistically significant.
Results
A total of 140 patients met inclusion criteria, and 74 (52.9%) had an abnormal echocardiogram. A low number of left and right ventricular systolic dysfunction was observed, and 35% of the population had a normal diastolic function. In the univariate analysis, characteristics associated with abnormal echocardiogram were age, chronic kidney disease, elevated troponin, previous heart failure, and simplified acute physiology score 3 (SAPS 3). In the regression model, troponin and SAPS3 score were independent markers of abnormal echocardiogram. An abnormal echocardiogram was associated with a higher prevalence of in-hospital death (RR 2.10; 95% CI 1.04-4.24) and orotracheal intubation (RR 2.3; 95% CI 1.14-4.78).
Conclusions
COVID-19 has little effect on ventricular function, but it is common to find increased filling pressures. Elevated serum troponin level and SAPS3 score were the independent markers of an abnormal echocardiogram. In addition, the prevalence of in-hospital death and need for mechanical ventilation were higher in patients with abnormal echocardiogram.
COVID-19, Critical Care; Troponin/therapeutic use; Echocardiography/methods; Diagnostic, Imaging
Introduction
Cardiovascular risk factors are common in hospitalized patients with COVID-19, particularly hypertension and diabetes. In a Chinese study, the prevalence of coronary artery disease and cerebrovascular disease was 6.0% and 2.3%, respectively.11. Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708-20. doi: 10.1056/NEJMoa2002032. Myocardial injury (22.2%), shock (30.6%), and arrhythmias (44.4%) are also frequent, especially in patients admitted to an intensive care unit (ICU).22. Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA. 2020;323(11):1061-9. doi: 10.1001/jama.2020.1585. In addition, cardiovascular disease and myocardial injury are associated with a higher mortality rate from COVID-19.33. Wu Z, McGoogan JM. Characteristics of and important lessons from the Coronavirus Disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese Center for Disease Control and Prevention. JAMA. 2020;323(13):1239-42. doi: 10.1001/jama.2020.2648.
Cardiovascular complications are more common in critically ill patients. Wei et al.,44. Wei JF, Huang F-Y, Xiong T-Y, Liu Q, Chen H, Wang H, et al. Acute myocardial injury is common in patients with covid-19 and impairs their prognosis. Heart. 2020;106(15):1154-9. doi: 10.1136/heartjnl-2020-317007. demonstrated that myocardial injury was present in 15.8% of patients and, in half of them, troponin levels were elevated more than five times the upper limit of normal. In this study, the increase in troponin was associated with higher mortality.44. Wei JF, Huang F-Y, Xiong T-Y, Liu Q, Chen H, Wang H, et al. Acute myocardial injury is common in patients with covid-19 and impairs their prognosis. Heart. 2020;106(15):1154-9. doi: 10.1136/heartjnl-2020-317007.
Echocardiography is a cardiovascular imaging method widely available in ICUs that can provide valuable information on cardiac function in patients with COVID-19. Dweck et al.,55. Dweck MR, Bularga A, Hahn RT, Bing R, Lee KK, Chapman AR, et al. Global evaluation of echocardiography in patients with COVID-19. Eur Heart J Cardiovasc Imaging. 2020;21(9):949-58. doi: 10.1093/ehjci/jeaa178. found that 55% of COVID-19 patients had an abnormal echocardiogram using only ventricular dysfunction as a criterion. However, despite being a valuable method, echocardiographic assessment was associated with an increased risk of contamination of healthcare workers.66. Sociedade Brasileira de Cardiologia. Departamento de Imagem Cardiovascular. Recomendações DIC/SBC para a realização de exames de imagem cardiovascular durante a pandemia pela COVID-19. [Internet] [Cited in 2020 Apr 14]. Available at: http://departamentos.cardiol.br/dic/pdf/2020/Recomendacoes-DICSBC-COVID-19-final.pdf.
http://departamentos.cardiol.br/dic/pdf/...
,77. Centers for Disease Control and Prevention: Steps Healthcare Facilities Can Take Now to Prepare for COVID-19. [Internet] [Cited 2020 Jul 20] Available at: https://www.cdc.gov/coronavirus/2019-ncov/hcp/steps-to-prepare.html.
https://www.cdc.gov/coronavirus/2019-nco...
The objective of our study was to describe echocardiographic characteristics in patients admitted to an ICU for COVID-19 and to identify clinical, laboratory findings and outcomes associated with an abnormal echocardiogram, to better identify patients who would most benefit from this method.
Methods
This was a retrospective study that used a convenience sample that included all patients hospitalized in an adult ICU of a private tertiary hospital, who had a RT-PCR-confirmed COVID-19 and underwent transthoracic echocardiography (TTE) during hospitalization. The criteria for admission in this unit were based on institutional protocols and clinical judgment. Echocardiography was ordered at the discretion of the medical team. For patients who underwent more than one exam, the first exam was considered for analysis. Patients with dementia, advanced and terminal illnesses, patients in palliative treatment, and those less than 48 hours in ICU were excluded.
TTE was performed at bedside within 48 hours of hospitalization. The following characteristics were evaluated according to the recommendations of the American Society of Echocardiography:88. Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, et al. Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2015;28(1):1-39.e14. doi: 10.1016/j.echo.2014.10.003. systolic function, ejection fraction, diastolic function, right ventricular function, pulmonary artery systolic pressure (PASP), left atrial size, E/e’ ratio, pericardial effusion and right atrial pressure (RAP) estimated by inferior vena cava analysis.
Besides, we evaluated clinical characteristics (age, gender, history of heart failure, hypertension, diabetes, renal failure, obesity, and atrial fibrillation) and laboratory data (ultrasensitive troponin and d-dimer serum levels) of the patients.
The echocardiogram was defined as abnormal when it demonstrated systolic ventricular dysfunction of any degree (left and/or right ventricle) and/or high filling pressures (E/E' ratio> 16; PASP> 40mmHg, RAP> 15mmHg or diastolic dysfunction ≥ grade 2) and/or moderate to severe pericardial effusion (Figure 1).
Statistical Analysis
Continuous variables were described as mean and standard deviation (when there was a normal distribution) or median and interquartile range (when there was not a normal distribution). The normality test used was the Kolmogorov-Smirnov test. Categorical variables were expressed as percentage.
Echocardiographic characteristics were assessed in the entire population and subgroups (hypertensive, diabetic, patients with elevated troponin, and mechanic ventilated patients). For continuous variables, we used the unpaired Student's t-test and for categorical variables, the chi-square test. We also analyzed patients’ clinical characteristics associated with an abnormal echocardiogram.
Clinical variables were also assessed using the classification tree,99. Hothorn T, Zeileis A. partykit: A Modular Toolkit for Recursive Partytioning in R. JMLR: Journal of Machine Learning Research. 05;118:3905-9. Available at: http://jmlr.org/papers/v16/hothorn15a.html.
http://jmlr.org/papers/v16/hothorn15a.ht...
a machine learning statistical technique, to identify variables that could predict an abnormal echocardiogram. Finally, binary logistic regression was performed with variables that showed p<0.01 in the univariate analysis (Student’s t-test or chi-square test). P<0.05 was considered significant. For statistical analysis, the SPSS version 26 program was used.
Results
During the study period, 272 admissions to ICU for COVID-19 were identified. Of these, 159 patients underwent echocardiography (58.5%) and 19 were excluded because they had incomplete demographic data (Figure 2).
We found 74 abnormal echocardiograms (52.9%) according to pre-established criteria. The median time to perform echocardiography was one day after admission. Characteristics of the study population are summarized in Table 1.
Echocardiographic parameters were assessed in the entire population and pre-defined subgroups. The results are shown in Table 2.
A low occurrence of left and right ventricular systolic dysfunction was observed, and 35.0% of the population had a normal diastolic function. In the subgroup analysis, we found a lower proportion of normal left ventricular systolic function, normal diastolic function, and left atrial enlargement in patients with elevated troponin (above the 99th percentile). There was also a lower prevalence of diastolic dysfunction among hypertensive and diabetic patients, and a higher prevalence of left atrial enlargement in hypertensive patients. Furthermore, we found three cases of Takotsubo cardiomyopathy that showed complete recovery after 10 days (Figure 3).
Univariate analysis of the clinical characteristics and outcomes associated with an abnormal echocardiogram are available in Table 3.
In the univariate analysis, characteristics associated with an abnormal echocardiogram were age, elevated troponin, chronic kidney disease, previous heart failure, mechanical ventilation and SAPS3 score. In the binary logistic regression model, variables with p<0.01 were included, except for previous heart failure, since all patients with this previous condition had an abnormal echocardiogram. The regression model is shown in Table 4.
In this regression model, troponin elevation and SAPS3 score were independent markers of abnormal echocardiogram in patients admitted to the ICU for COVID19. In the classification tree, elevated troponin was the main marker of abnormal echocardiogram (Figure 4).
Regarding the outcomes, the abnormal echocardiogram was associated with a higher prevalence of in-hospital death (RR 2.10; 95% CI 1.04-4.24) and orotracheal intubation (RR 2.3; 95% CI 1.14-4.78).
Discussion
The new coronavirus disease (COVID-19) is highly transmissible and can cause a severe inflammatory response that affects several organs.1010. Shereen MA, Khan S, Kazmi A, Bashir N, Siddique R. COVID-19 infection: Origin, transmission, and characteristics of human coronaviruses. J Adv Res. 2020;24:91-8. doi:10.1016/j.jare.2020.03.005. Because of this high transmissibility, several measures were taken to reduce the population's exposure to the virus. Healthcare workers demand special care due to the exposure during the care of these patients,1111. Brewer N, Huang G, Kwon Y. Sonographer safety issues during the COVID-19 pandemic. J Echocardiogr. 2020;18(3):197-8. https://doi.org/10.1007/s12574-020-00474-w.
https://doi.org/10.1007/s12574-020-00474...
and hence strategies to reduce this exposure are welcome.
Echocardiogram is a very useful tool in the ICU that can provide information in several clinical settings, such as hemodynamic instability, ventricular dysfunction, acute coronary syndrome, hypovolemia, acute valve dysfunction, infectious endocarditis, cardiac tamponade, pulmonary embolism, and aortic dissection.1212. Longobardo L, Zito C, Carerj S, Caracciolo G, Khandheria BK. Role of Echocardiography in the Intensive Care Unit: Overview of the Most Common Clinical Scenarios. J Patient Cent Res Rev. 2018;5(3):239-43. doi:10.17294/2330-0698.1631. Few echocardiographic data of patients admitted by COVID-19, however, are available.
In our study, echocardiographic changes were present in 52.9% of echocardiograms. The prevalence of ventricular dysfunction was low, and main changes were related to high filling pressures. The prevalence of ventricular dysfunction was similar to that found by Szekely et al.,1313. Szekely Y, Lichter Y, Taieb P, et al. The Spectrum of Cardiac Manifestations in Coronavirus Disease 2019 (COVID-19) - a Systematic Echocardiographic Study. Circulation. 2020;42(4):342-53. doi:10.1161/CIRCULATIONAHA.120.047971. where 10% of patients had systolic ventricular dysfunction. Also, 20% of these patients had high filling pressures. The high number of patients with dysfunction or enlargement of the right ventricle (39%) in this study1313. Szekely Y, Lichter Y, Taieb P, et al. The Spectrum of Cardiac Manifestations in Coronavirus Disease 2019 (COVID-19) - a Systematic Echocardiographic Study. Circulation. 2020;42(4):342-53. doi:10.1161/CIRCULATIONAHA.120.047971. was noteworthy. However, the authors do not specify the occurrence of right systolic dysfunction alone. Right ventricular dilation can happen for a variety of conditions, including hypervolemia and mechanical ventilation. In our study, right ventricular dilation was not evaluated, but systolic right ventricular dysfunction was uncommon.
Dweck et al.,55. Dweck MR, Bularga A, Hahn RT, Bing R, Lee KK, Chapman AR, et al. Global evaluation of echocardiography in patients with COVID-19. Eur Heart J Cardiovasc Imaging. 2020;21(9):949-58. doi: 10.1093/ehjci/jeaa178. studied echocardiographic variables in patients with a presumed diagnosis of COVID-19 using a questionnaire answered by echocardiographers around the world.55. Dweck MR, Bularga A, Hahn RT, Bing R, Lee KK, Chapman AR, et al. Global evaluation of echocardiography in patients with COVID-19. Eur Heart J Cardiovasc Imaging. 2020;21(9):949-58. doi: 10.1093/ehjci/jeaa178. In this study, 1,216 patients were included and 61% of these patients had a normal systolic left ventricular function. Of these, 60% required intensive care and 73% had confirmed diagnosis of COVID-19. The prevalence of hypertension in this study was low and may point to a population with lower cardiovascular risk. As its data were obtained through a questionnaire from several countries, we can expect great variability of data since the echocardiogram is an operator-dependent method.
In the analysis of parameters associated with an abnormal echocardiogram, myocardial injury, previous heart failure, mechanic ventilated patients, age, and SAPS3 stood out. Only two studies performed a similar analysis. Szekely et al.,1313. Szekely Y, Lichter Y, Taieb P, et al. The Spectrum of Cardiac Manifestations in Coronavirus Disease 2019 (COVID-19) - a Systematic Echocardiographic Study. Circulation. 2020;42(4):342-53. doi:10.1161/CIRCULATIONAHA.120.047971. used broader criteria for abnormal echocardiogram (any degree of systolic and/or diastolic dysfunction, valve changes, and right ventricular dilation and dysfunction). Variables that were associated with this outcome in this study were: B-type natriuretic peptide (BNP) > 80pg/mL, C-reactive protein> 5mg/L, and systolic blood pressure. However, patients were less severe, as only 10% of them required mechanical ventilation, and only 3% used vasopressors.
Yuan et al.,1414. Yuan N, Wu S, Rader F, Siegel RJ. Determining which hospitalized COVID-19 patients require an urgent echocardiogram. J Am Soc Echocardiogr. 2021;34(8):831-8. doi: 10.1016/j.echo.2021.03.010. analyzed 434 patients hospitalized for COVID-19, who underwent echocardiography within 14 days, aiming to identify the variables related to the presence of an urgent echocardiographic finding (left ventricular ejection fraction ≤35%, wall motion score index ≥1.5, ≥moderate right ventricular dysfunction, ≥moderate pericardial effusion, intracardiac thrombus, PASP> 50mmHg, or ≥moderate-severe valvular disease).1414. Yuan N, Wu S, Rader F, Siegel RJ. Determining which hospitalized COVID-19 patients require an urgent echocardiogram. J Am Soc Echocardiogr. 2021;34(8):831-8. doi: 10.1016/j.echo.2021.03.010. In this study,1414. Yuan N, Wu S, Rader F, Siegel RJ. Determining which hospitalized COVID-19 patients require an urgent echocardiogram. J Am Soc Echocardiogr. 2021;34(8):831-8. doi: 10.1016/j.echo.2021.03.010. troponin and BNP were associated with urgent echocardiographic findings, data similar to that found in our study. However, in their study, many patients who were not admitted to the ICU were included, resulting in a less severe profile, in addition to using other criteria to define an abnormal echocardiogram. Anyway, the similarity of results brings robustness to our findings.
Troponin is a marker of worse prognosis in several clinical conditions, including in COVID-19. Lala et al.,1515. Lala A, Johnson KW, Januzzi JL, Russak A, Paranype I, Richter F, et al. Prevalence and Impact of Myocardial Injury in Patients Hospitalized with COVID-19 Infection. J Am Coll Cardiol. 2020;76(5):533-46. doi:10.1016/j.jacc.2020.06.007. showed that 36% of patients had elevated troponin levels and this biomarker was associated with higher mortality. Additionally, troponin elevation was more common in patients with cardiovascular disease.1515. Lala A, Johnson KW, Januzzi JL, Russak A, Paranype I, Richter F, et al. Prevalence and Impact of Myocardial Injury in Patients Hospitalized with COVID-19 Infection. J Am Coll Cardiol. 2020;76(5):533-46. doi:10.1016/j.jacc.2020.06.007.
Few studies have evaluated the association of an abnormal echocardiogram with adverse outcomes. In our study, an abnormal echocardiogram was associated with increased hospital mortality and the need for mechanical ventilation. The few studies published on this topic only pointed to the prognostic value of right ventricular dysfunction in patients with COVID-19.1616. Martha JW, Pranata R, Wibowo A, Lim MA. Tricuspid annular plane systolic excursion (TAPSE) measured by echocardiography and mortality in COVID-19: A systematic review and meta-analysis. Int J Infect Dis. 2021;105:351-6. doi: 10.1016/j.ijid.2021.02.029.,1717. Zhang Y, Sun W, Wu C, Zhang Y, Cui L, Xie Y, et al. Prognostic Value of Right Ventricular Ejection Fraction Assessed by 3D Echocardiography in COVID-19 Patients. Front Cardiovasc Med. 2021;8:641088. doi: 10.3389/fcvm.2021.641088.
The main limitations of our study are the fact that it was a retrospective study, and the echocardiographic analysis was not performed in ideal conditions. All examinations were performed at the bedside in unfavorable scenarios (patients on mechanical ventilation, with multiple devices that made the access for the echocardiographer difficult), in addition to the need for a fast examination to reduce the exposure of the healthcare professional. For this reason, many parameters were assessed subjectively but covering all the main information. Echocardiograms were carried out by examiners fully certified by the Brazilian Cardiology Society. Despite the limitations, no study published to date has exclusively studied patients admitted to intensive care, which brings originality to these data.
Conclusions
In patients admitted to intensive care with COVID-19, the echocardiogram showed a low prevalence of myocardial dysfunction and a high prevalence of increased filling pressures. An elevated serum troponin level was an independent marker of abnormal echocardiogram. An abnormal echocardiogram was associated with increased hospital mortality and the need for mechanical ventilation.
References
-
1Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708-20. doi: 10.1056/NEJMoa2002032.
-
2Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA. 2020;323(11):1061-9. doi: 10.1001/jama.2020.1585.
-
3Wu Z, McGoogan JM. Characteristics of and important lessons from the Coronavirus Disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese Center for Disease Control and Prevention. JAMA. 2020;323(13):1239-42. doi: 10.1001/jama.2020.2648.
-
4Wei JF, Huang F-Y, Xiong T-Y, Liu Q, Chen H, Wang H, et al. Acute myocardial injury is common in patients with covid-19 and impairs their prognosis. Heart. 2020;106(15):1154-9. doi: 10.1136/heartjnl-2020-317007.
-
5Dweck MR, Bularga A, Hahn RT, Bing R, Lee KK, Chapman AR, et al. Global evaluation of echocardiography in patients with COVID-19. Eur Heart J Cardiovasc Imaging. 2020;21(9):949-58. doi: 10.1093/ehjci/jeaa178.
-
6Sociedade Brasileira de Cardiologia. Departamento de Imagem Cardiovascular. Recomendações DIC/SBC para a realização de exames de imagem cardiovascular durante a pandemia pela COVID-19. [Internet] [Cited in 2020 Apr 14]. Available at: http://departamentos.cardiol.br/dic/pdf/2020/Recomendacoes-DICSBC-COVID-19-final.pdf
» http://departamentos.cardiol.br/dic/pdf/2020/Recomendacoes-DICSBC-COVID-19-final.pdf -
7Centers for Disease Control and Prevention: Steps Healthcare Facilities Can Take Now to Prepare for COVID-19. [Internet] [Cited 2020 Jul 20] Available at: https://www.cdc.gov/coronavirus/2019-ncov/hcp/steps-to-prepare.html
» https://www.cdc.gov/coronavirus/2019-ncov/hcp/steps-to-prepare.html -
8Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, et al. Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2015;28(1):1-39.e14. doi: 10.1016/j.echo.2014.10.003.
-
9Hothorn T, Zeileis A. partykit: A Modular Toolkit for Recursive Partytioning in R. JMLR: Journal of Machine Learning Research. 05;118:3905-9. Available at: http://jmlr.org/papers/v16/hothorn15a.html
» http://jmlr.org/papers/v16/hothorn15a.html -
10Shereen MA, Khan S, Kazmi A, Bashir N, Siddique R. COVID-19 infection: Origin, transmission, and characteristics of human coronaviruses. J Adv Res. 2020;24:91-8. doi:10.1016/j.jare.2020.03.005.
-
11Brewer N, Huang G, Kwon Y. Sonographer safety issues during the COVID-19 pandemic. J Echocardiogr. 2020;18(3):197-8. https://doi.org/10.1007/s12574-020-00474-w
» https://doi.org/10.1007/s12574-020-00474-w -
12Longobardo L, Zito C, Carerj S, Caracciolo G, Khandheria BK. Role of Echocardiography in the Intensive Care Unit: Overview of the Most Common Clinical Scenarios. J Patient Cent Res Rev. 2018;5(3):239-43. doi:10.17294/2330-0698.1631.
-
13Szekely Y, Lichter Y, Taieb P, et al. The Spectrum of Cardiac Manifestations in Coronavirus Disease 2019 (COVID-19) - a Systematic Echocardiographic Study. Circulation. 2020;42(4):342-53. doi:10.1161/CIRCULATIONAHA.120.047971.
-
14Yuan N, Wu S, Rader F, Siegel RJ. Determining which hospitalized COVID-19 patients require an urgent echocardiogram. J Am Soc Echocardiogr. 2021;34(8):831-8. doi: 10.1016/j.echo.2021.03.010.
-
15Lala A, Johnson KW, Januzzi JL, Russak A, Paranype I, Richter F, et al. Prevalence and Impact of Myocardial Injury in Patients Hospitalized with COVID-19 Infection. J Am Coll Cardiol. 2020;76(5):533-46. doi:10.1016/j.jacc.2020.06.007.
-
16Martha JW, Pranata R, Wibowo A, Lim MA. Tricuspid annular plane systolic excursion (TAPSE) measured by echocardiography and mortality in COVID-19: A systematic review and meta-analysis. Int J Infect Dis. 2021;105:351-6. doi: 10.1016/j.ijid.2021.02.029.
-
17Zhang Y, Sun W, Wu C, Zhang Y, Cui L, Xie Y, et al. Prognostic Value of Right Ventricular Ejection Fraction Assessed by 3D Echocardiography in COVID-19 Patients. Front Cardiovasc Med. 2021;8:641088. doi: 10.3389/fcvm.2021.641088.
-
Study Association
-
This study is not associated with any thesis or dissertation work.
-
Ethics Approval and Consent to Participate
-
This study was approved by the Ethics Committee of the IDOR - Instituto D'Or de Pesquisa e Ensino under the protocol number CAAE 33206620.0.0000.5249. All the procedures in this study were in accordance with the 1975 Helsinki Declaration, updated in 2013. As this is a retrospective study, the informed consent term was waived by the ethics committee.
-
Sources of Funding
-
There were no external funding sources for this study.
Publication Dates
-
Publication in this collection
03 Apr 2023 -
Date of issue
2023
History
-
Received
28 Apr 2021 -
Reviewed
13 June 2022 -
Accepted
10 Aug 2022