ABSTRACT
OBJECTIVE
To build and validate a logical model of the line of care for people with chronic kidney disease.
METHODS
This is a descriptive study with a qualitative approach, with documentary research and analysis of primary data collected in interviews with key informants, carried out from May to September 2019, in the Guarani Aquifer Health Region, belonging to the Regional Health Department 13. Based on the theoretical framework proposed by McLaughlin and Jordan, five stages were followed: collection of relevant information; description of the problem and context; defining the elements of the logical model; construction and validation.
RESULTS
The logical model was organized into three care dimensions – primary health care, specialized care and high complexity care – composed of structure, process and result components.
CONCLUSION
The constructed logical model has the potential to contribute to the assessment of the line of care for people with chronic kidney disease, in order to achieve better results in the management of this disease, something that favors both the patient and the health system.
Renal Insufficiency, Chronic, therapy; Disease Management; Healthcare Models; Outcome and Process Assessment, Health Care
RESUMO
OBJETIVO
Construir e validar um modelo lógico da linha de cuidado da pessoa com doença renal crônica.
MÉTODOS
Trata-se de um estudo de caráter descritivo e com abordagem qualitativa, sendo feitas pesquisa documental e análise de dados primários coletados em entrevistas com informantes-chave, realizadas de maio a setembro de 2019, na Região de Saúde do Aquífero Guarani, pertencente ao Departamento Regional de Saúde 13. A partir do referencial teórico proposto por McLaughlin e Jordan, foram seguidas cinco etapas: a coleta de informações relevantes; a descrição do problema e do contexto; a definição dos elementos do modelo lógico; e a construção e validação.
RESULTADOS
O modelo lógico foi organizado em três dimensões assistenciais – atenção primária à saúde, atenção especializada e atenção de alta complexidade – compostas pelos componentes de estrutura, processo e resultado.
CONCLUSÃO
O modelo lógico construído tem potencial para contribuir com a avaliação da linha de cuidado da pessoa com doença renal crônica, ao visar o alcance de melhores resultados no manejo dessa doença, o que favorece tanto o seu portador quanto o sistema de saúde.
Insuficiência Renal Crônica, terapia; Gerenciamento Clínico; Modelos de Assistência à Saúde; Avaliação de Processos e Resultados em Cuidados de Saúde
INTRODUCTION
Chronic kidney disease (CKD) is recognized as one of the main public health problems in the world, with an estimated global prevalence of 13.4%11.Lv JC, Zhang LX. Prevalence and disease burden of chronic kidney disease. In: Liu BC, Lan HY, Lv LL, editors. Renal fibrosis: mechanisms and therapies. Singapore: Springer; 2019. (Advances in Experimental Medicine and Biology; vol.1165). https://doi.org/10.1007/978-981-13-8871-2_1
https://doi.org/10.1007/978-981-13-8871-...
. The worldwide increase in this disease is mainly driven by the increase in the prevalence of diabetes mellitus, arterial hypertension, obesity and aging11.Lv JC, Zhang LX. Prevalence and disease burden of chronic kidney disease. In: Liu BC, Lan HY, Lv LL, editors. Renal fibrosis: mechanisms and therapies. Singapore: Springer; 2019. (Advances in Experimental Medicine and Biology; vol.1165). https://doi.org/10.1007/978-981-13-8871-2_1
https://doi.org/10.1007/978-981-13-8871-...
. In Brazil, the estimated prevalence of CKD – in stages 3 to 5 – in adults is 6.7%, and 21.4% in people over 60 years of age22.Malta DC, Machado IE, Pereira CA, Figueiredo AW, Aguiar LK, Almeida WS, et al. Avaliação da função renal na população adulta brasileira, segundo critérios laboratoriais da Pesquisa Nacional de Saúde. Rev Bras Epidemiol. 2019;22 Supl 2:E190010. https://doi.org/10.1590/1980-549720190010.supl.2
https://doi.org/10.1590/1980-54972019001...
.
Between 2000 and 2012, approximately 280 thousand patients were identified in dialysis programs in the Unified Health System (SUS) network, which corresponded to 85% of dialysis performed in the country33.Moura L, Prestes IV, Duncan BB, Schmidt MI. Construção de base de dados nacional de pacientes em tratamento dialítico no Sistema Único de Saúde, 2000-2012. Epidemiol Serv Saude. 2014;23(2):227-38. https://doi.org/10.5123/S1679-49742014000200004
https://doi.org/10.5123/S1679-4974201400...
. In 2015, expenses with renal replacement therapy (RRT) represented more than 2 billion reais, corresponding to 5% of SUS expenses with medium and high complexity services, consumed by the partial management of a single disease. Furthermore, its incidence is increasing, which ratifies prevention as an action of interest and importance for public health, highlighting the role of primary health care (PHC)44.Alcalde PR, Kirsztajn GM. Gastos do Sistema Único de Saúde brasileiro com doença renal crônica. J Bras Nefrol. 2018;40(2):122-9. https://doi.org/10.1590/2175-8239-jbn-3918
https://doi.org/10.1590/2175-8239-jbn-39...
.
In 2017, there were 1.2 million deaths due to CKD, placing it in the 12th position in causes of death in the world, while, in Brazil, this disease was responsible for 35,000 deaths, occupying the 10th position55.Institute for Health Metrics and Evaluation. Global Burden of Disease (GBD) 2017. GBD compare: Viz Hub. Seattle, WA: IHME; 2019 [cited 2021 Jul 3]. Available from: http://vizhub.healthdata.org/gbd-compare
http://vizhub.healthdata.org/gbd-compare...
.
Although the prevalence of CKD is high, the first guideline for its diagnosis and treatment was only issued in 2002, by the National Kidney Foundation, in the document Kidney Disease Outcomes Quality Initiative (K/DOQI)66.National Kidney Foundation. K/DOQI clinical practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Am J Kidney Dis. 2002;39(2 Suppl 1):S14-6. https://doi.org/10.1053/ajkd.2002.30939
https://doi.org/10.1053/ajkd.2002.30939...
. In Brazil, the National Policy for Attention to Patients with Kidney Disease (PNAPDR) was only published in 200477.Ministério da Saúde (BR). Portaria Nº 1.168, de 15 de junho de 2004. Institui a Política Nacional de Atenção ao Portador de Doença Renal, a ser implantada em todas as unidades federadas, respeitadas as competências das três esferas de gestão. Diário Oficial da União. 17 jun 2004 [cited 2022 Dec 15]; Seção 1:56. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt1168_15_06_2004.html
http://bvsms.saude.gov.br/bvs/saudelegis...
.
In 2014, the clinical guidelines for the care of patients with CKD in the SUS and the criteria for organizing the line of care for people with CKD were published – contained in the health care network (HCN) for people with chronic diseases88.Ministério da Saúde (BR). Portaria Nº 483, de 1º de abril de 2014. Redefine a Rede de Atenção à Saúde das Pessoas com Doenças Crônicas no âmbito do Sistema Único de Saúde (SUS) e estabelece diretrizes para a organização das suas linhas de cuidado. Diário Oficial da União. 2 abr 2014 [cited 2022 Dec 15]; Seção 1: 50. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0483_01_04_2014.html
http://bvsms.saude.gov.br/bvs/saudelegis...
,99.Ministério da Saúde (BR). Portaria Nº 389, de 13 de março de 2014. Define os critérios para a organização da linha de cuidado da Pessoa com Doença Renal Crônica (DRC) e institui incentivo financeiro de custeio destinado ao cuidado ambulatorial pré-dialítico. Diário Oficial da União. 14 mar 2014 [cited 2022 Dec 15]; Seção 1:34. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0389_13_03_2014.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. In order to organize the care network and the financing of actions related to the approach to CKD, the line of care presents the following attributions of the HCN care points, according to the components: PHC and specialized outpatient care, the latter subdivided into Specialized Unit in CKD, High Complexity Care Unit in Nephrology and Specialized Unit in CKD with RRT/Dialysis99.Ministério da Saúde (BR). Portaria Nº 389, de 13 de março de 2014. Define os critérios para a organização da linha de cuidado da Pessoa com Doença Renal Crônica (DRC) e institui incentivo financeiro de custeio destinado ao cuidado ambulatorial pré-dialítico. Diário Oficial da União. 14 mar 2014 [cited 2022 Dec 15]; Seção 1:34. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0389_13_03_2014.html
http://bvsms.saude.gov.br/bvs/saudelegis...
. These guidelines marked a step forward in the country’s public policy, since they systematized this line of care based on comprehensiveness – mainly with PHC – and defining early diagnosis and timely treatment of CKD as one of the attributions of its team.
Thus, there are legal subsidies that favor changes in the work processes of the PHC teams and, also, that establish quality indicators for the monitoring and evaluation of care for people with CKD1010.Silva PAB, Silva LB, Santos JFG, Soares SM. Política pública brasileira na prevenção da doença renal crônica: desafios e perspectivas. Rev Saude Publica. 2020;54:86. https://doi.org/10.11606/s1518-8787.2020054001708
https://doi.org/10.11606/s1518-8787.2020...
. In this sense, a strategy that can contribute to this evaluation is the development of a logical model, as it allows visually and systematically presenting the relationships between the necessary resources, interventions and effects – products, results and impact – that a program/intervention intends to achieve1111.Bezerra LCA, Cazarin G, Alves CKdeA. Modelagem de programas: da teoria à operacionalização. In: Samico I, Felisberto E, Figueiró AC, Frias PG, organizadores. Avaliação em saúde: bases conceituais e operacionais. Rio de Janeiro: MedBook; 2010. p. 65-78.,1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
.
Health evaluation has the potential to present logical arguments of how and why a program is or is not meeting the specific needs for which it was created. In turn, the logical model presents itself as an evaluative tool by detailing characteristics of a program, establishing the logical relationship between its components and the expected results in the short, medium and long term1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
. Modeling an intervention makes it possible to explain the links between the intervention and its effects, through a schematic representation that reveals its structure, processes and results. Modeling must, therefore, explain the logical path of the intervention and reveal its objectives and, for this reason, it must be done in interaction with the actors who operate it, making it possible to improve the intelligibility of a complex system1313.Hartz Z. Modelizar as intervenções. In. Brousselle A, Champagne F, Contandriopoulos AP, Hartz Z, organizadores. Avaliação conceitos e métodos. Rio de Janeiro: Editora Fiocruz; 2011. p. 61-74. Among the advantages of using the logical model are: building a common understanding of the program and resource expectations, the number of customers reached and their results; its usefulness for program design or improvement; presenting the program’s place within the organization, and presenting a balanced set of key performance measurement and evaluation questions that improve data collection and the program’s usefulness1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
.
Thus, the objectives of this study were to develop and validate the logical model of the line of care for CKD patients.
METHODS
In order to build and validate the logical model, a descriptive study with a qualitative approach was carried out, from May to September 2019, in the Guarani Aquifer Health Region – which comprises 10 municipalities, with a total of 945,738 inhabitants –, belonging to the Regional Health Department (DRS) 13 – Ribeirão Preto-SP1414.Instituto Brasileiro de Geografia e Estatística. Estimativas da população residente no Brasil e Unidades da Federação com data de referência em 1º de julho de 2020. Rio de Janeiro: IBGE; 2020 [cited 2022 Dec 15]. Available from: https://ftp.ibge.gov.br/Estimativas_de_Populacao/Estimativas_2020/estimativa_dou_2020.pdf
https://ftp.ibge.gov.br/Estimativas_de_P...
. The line of care for people with CKD for this Health Region was drawn up by a multidisciplinary working group representing all parts of the HCN, but its monitoring had not yet started. There was, then, a manifestation of the DRS 13 to the researchers about the interest in carrying out an investigation that would help the evaluation process, considering the worrying rates of this Region regarding the prevalence of CKD. Finally, this condition justified the choice of this field of study.
The logical model was built according to the five stages proposed by McLaughlin and Jordan1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
: 1) Collecting relevant information; 2) Describing the problem and context; 3) Defining the elements of the logical model; 4) Building the logical model; and 5) Validating the logical model.
In the development of steps 1, 2, 3 and 4, documentary research was carried out. The criteria used to select the documents were: 1) authenticity, that is, the document is of unquestionable origin; 2) credibility, it is an original and undistorted document; 3) representativeness, within its typology – in this case, legal documents –, which present the content to be analyzed; and 4) meaning, that is, whether the document was clear and comprehensible1515.Kripka RML, Scheller M, Bonotto DL. Pesquisa documental na pesquisa qualitativa: conceitos e caracterização. Rev Investig UNAD. 2015;14(2):55-73..
In stages 1 and 2, the documentary research sought to understand the theory and legislation at the federal, state and regional levels of the SUS, which supported the development of the line of care for people with CKD; the survey of information on the estimate of the number of cases in the different stages of CKD – IBGE population estimate –, the parameters of Ordinance GM/MS no. 1.631/GM/20151616.Ministério da Saúde (BR). Portaria Nº 1.631, de 1º de outubro de 2015. Aprova critérios e parâmetros para o planejamento e programação de ações e serviços de saúde no âmbito do SUS. Diário Oficial da União. 2 out 2015 [cited 2022 Dec 15]; Seção 1:38. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2015/prt1631_01_10_2015.html
https://bvsms.saude.gov.br/bvs/saudelegi...
, and the identification of the prevalence rate of patients on dialysis in the Guarani Aquifer Health Region. At this stage, the primary information obtained from the interviewees was also considered (Box).
In the development of steps 3 and 4, the documents analyzed were: the PNAPDR77.Ministério da Saúde (BR). Portaria Nº 1.168, de 15 de junho de 2004. Institui a Política Nacional de Atenção ao Portador de Doença Renal, a ser implantada em todas as unidades federadas, respeitadas as competências das três esferas de gestão. Diário Oficial da União. 17 jun 2004 [cited 2022 Dec 15]; Seção 1:56. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt1168_15_06_2004.html
http://bvsms.saude.gov.br/bvs/saudelegis...
, the guidelines for organizing the HCN and for the Care of CKD Patients in the SUS1717.Ministério da Saúde (BR). Portaria Nº 4.279, de 30 de dezembro de 2010. Estabelece diretrizes para a organização da Rede de Atenção à Saúde no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União. 31 dez 2010 [cited 2022 Dec 15]; Seção 1:88. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2010/prt4279_30_12_2010.html
https://bvsms.saude.gov.br/bvs/saudelegi...
,1818.Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Diretrizes Clínicas para o Cuidado ao paciente com Doença Renal Crônica – DRC no Sistema Único de Saúde. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_clinicas_cuidado_paciente_renal.pdf
https://bvsms.saude.gov.br/bvs/publicaco...
, the criteria for organizing the line of care for people with CKD99.Ministério da Saúde (BR). Portaria Nº 389, de 13 de março de 2014. Define os critérios para a organização da linha de cuidado da Pessoa com Doença Renal Crônica (DRC) e institui incentivo financeiro de custeio destinado ao cuidado ambulatorial pré-dialítico. Diário Oficial da União. 14 mar 2014 [cited 2022 Dec 15]; Seção 1:34. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0389_13_03_2014.html
http://bvsms.saude.gov.br/bvs/saudelegis...
, the Instructional Guide for local organization of the line of care for people with CKD1919.Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Organização local da linha de cuidado da pessoa com Doença Renal Crônica – DRC: guia instrutivo. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://www.conasems.org.br/wp-content/uploads/2014/08/images_Instrutivo_DRC_Gestor.pdf
https://www.conasems.org.br/wp-content/u...
, the regulations on the care of people with CKD2020.Ministério da Saúde (BR). Portaria Nº 1.675, de 7 de junho de 2018. Altera a Portaria de Consolidação nº 3/GM/MS, de 28 de setembro de 2017, e a Portaria de Consolidação nº 6/GM/MS, de 28 de setembro de 2017, para dispor sobre os critérios para a organização, funcionamento e financiamento do cuidado da pessoa com Doença Renal Crônica - DRC no âmbito do Sistema Único de Saúde - SUS. Diário Oficial da União. 8 jun 2018 [cited 2022 Dec 30]; Seção 1:148. Available from: https://www.in.gov.br/materia/-/asset_publisher/Kujrw0TZC2Mb/content/id/21054948/do1-2018-06-08-portaria-n-1-675-de-7-de-junho-de-2018-21054736
https://www.in.gov.br/materia/-/asset_pu...
, and the line of care for people with CKD of the HCN for people with chronic diseases of DRS 13. Information about this line of care was organized in the logical model, according to the care dimensions – PHC, specialized care and high complexity care –, in the form of a color diagram. Each color represented, in the rows, the care dimensions and, in the columns, the components of the “line of care” intervention: inputs/resources, actions/activities, product, intermediate result and final result/impact.
The initial model was appreciated by three health professionals: a nephrologist, Master in Health Sciences and PhD student in Public Health, and two nurses working in PHC, a Master and the other a PhD in Public Health. These professionals, chosen intentionally, contributed to checking the components of the logical model and complementing the information, characterizing it as a preliminary analysis. After that, step 5 began, carried out in person by one of the researchers and which aimed to present to the key informants the elements of the logical model, its concepts and its purpose – before the validation process – and, subsequently, to verify whether the proposed components and organization represented the logic of the line of care for people with CKD.
The logical model was validated by six key informants, intentionally selected: a member of the planning team of a municipality in DRS 13, a PHC coordinator from the Guarani Aquifer Health Region, a nurse from a dialysis service, two professionals from the management/planning team of DRS 13 – these professionals who participated in the preparation of the line of care for people with CKD of DRS13 –, and a professional from the management/planning team of the São Paulo State Department of Health (SES -SP), also coordinator of the non-communicable chronic diseases (NCDs) steering group. Finally, a semi-structured interview was carried out with key informants, following the questions pointed out by MClauglin and Jordan1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
(Box), and the study was approved by the Research Ethics Committee (CAAE: 58545116.3.000.5414).
RESULTS
Context Characterization
CKD is recognized as a complex disease that requires multiple approaches in its treatment. It is even associated with high morbidity and mortality rates, prevalence and incidence rates still unknown in many countries, and a great socioeconomic impact, becoming a challenge for global public health2121.Aguiar LK, Prado RR, Gazzinelli A, Malta DC. Fatores associados à doença renal crônica: inquérito epidemiológico da Pesquisa Nacional de Saude. Rev Bras Epidemiol. 2020;23:e200044. https://doi.org/10.1590/1980-549720200044
https://doi.org/10.1590/1980-54972020004...
. In Brazil, according to the National Health Survey (PNS, 2013), the prevalence of self-reported CKD is 1.42%, that is, approximately two million individuals, which reveals the dimension of the disease in the country2121.Aguiar LK, Prado RR, Gazzinelli A, Malta DC. Fatores associados à doença renal crônica: inquérito epidemiológico da Pesquisa Nacional de Saude. Rev Bras Epidemiol. 2020;23:e200044. https://doi.org/10.1590/1980-549720200044
https://doi.org/10.1590/1980-54972020004...
. Early diagnosis, immediate referral, and implementation of measures to reduce/stop the progression of CKD are among the key strategies to improve its outcomes2121.Aguiar LK, Prado RR, Gazzinelli A, Malta DC. Fatores associados à doença renal crônica: inquérito epidemiológico da Pesquisa Nacional de Saude. Rev Bras Epidemiol. 2020;23:e200044. https://doi.org/10.1590/1980-549720200044
https://doi.org/10.1590/1980-54972020004...
.
The PNAPDR proposed the organization of the comprehensive care line – promotion, prevention, treatment and recovery –, permeating all points of care, such as expanding the coverage of care for patients with arterial hypertension and diabetes mellitus, the qualification of assistance and the promotion of continuing education for health professionals77.Ministério da Saúde (BR). Portaria Nº 1.168, de 15 de junho de 2004. Institui a Política Nacional de Atenção ao Portador de Doença Renal, a ser implantada em todas as unidades federadas, respeitadas as competências das três esferas de gestão. Diário Oficial da União. 17 jun 2004 [cited 2022 Dec 15]; Seção 1:56. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt1168_15_06_2004.html
http://bvsms.saude.gov.br/bvs/saudelegis...
.
In 2010, the ordinance that established the guidelines for the organization of HCN in SUS was published; it aimed to promote the systemic integration of health actions and services, with the provision of continuous, comprehensive, quality, responsible and humanized care, in addition to increasing SUS’s performance in terms of access, equity, clinical and health efficacy and economic efficiency1717.Ministério da Saúde (BR). Portaria Nº 4.279, de 30 de dezembro de 2010. Estabelece diretrizes para a organização da Rede de Atenção à Saúde no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União. 31 dez 2010 [cited 2022 Dec 15]; Seção 1:88. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2010/prt4279_30_12_2010.html
https://bvsms.saude.gov.br/bvs/saudelegi...
. This regulation highlighted that, although the advances were representative, the fragmentation of health actions and the need to qualify care management was still evident. Thus, the development of HCN was presented as an innovative organizational process, with the potential to positively impact health indicators.
In this logic, in the years 2013 and 2014, the HCN of People with NCDs was established, which established guidelines for the organization of its Care Lines, for its principles and objectives and for the competences of each federal entity. The Care Lines must express the assistance flows that must be guaranteed to the user, in order to meet the health needs related to a chronic condition and define the actions and services that will be offered by each component of the HCN of People with NCDs, based on clinical guidelines and the reality of each Health Region88.Ministério da Saúde (BR). Portaria Nº 483, de 1º de abril de 2014. Redefine a Rede de Atenção à Saúde das Pessoas com Doenças Crônicas no âmbito do Sistema Único de Saúde (SUS) e estabelece diretrizes para a organização das suas linhas de cuidado. Diário Oficial da União. 2 abr 2014 [cited 2022 Dec 15]; Seção 1: 50. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0483_01_04_2014.html
http://bvsms.saude.gov.br/bvs/saudelegis...
.
In turn, the criteria for organizing the line of care for people with CKD, and the clinical guidelines for care, were published in 2014, defining the attributions of PHC, specialized outpatient care, and high complexity care1818.Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Diretrizes Clínicas para o Cuidado ao paciente com Doença Renal Crônica – DRC no Sistema Único de Saúde. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_clinicas_cuidado_paciente_renal.pdf
https://bvsms.saude.gov.br/bvs/publicaco...
.
From the publication of the ordinance of the line of care for people with CKD, the health regions began the process of regional discussion about it. According to key informants, a steering group was formed with representatives from the three health regions of the DRS 13 territory, from the hemodialysis service providers and from the DRS 13 planning group. The group met to develop the line of care based on the organization of services, which was approved by the Regional Interagency Commissions (CIR) of the three regions of DRS 13 and by the Bipartite Interagency Commission (Deliberation CIB/SP – 47/2015). However, according to the interviewees, until the date of the interview, in May 2019, there had been no monitoring of the line of care within the PHC scope, while the quality indicators of medium and high complexity services were monitored, since they were related to qualification and remuneration of specialized services1818.Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Diretrizes Clínicas para o Cuidado ao paciente com Doença Renal Crônica – DRC no Sistema Único de Saúde. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_clinicas_cuidado_paciente_renal.pdf
https://bvsms.saude.gov.br/bvs/publicaco...
.
“A regional steering group was formed with participants from the municipalities, representatives of management and services, approved in CIR, and we followed the steps set out in the ordinance … The Care Line was approved in the CIR, we await publication by the Ministry of Health which, due to the release of financial resources, took more than two years”. (Interviewee No. 1)
The estimated number of cases in the different stages of CKD in the Guarani Aquifer Health Region (Table 1) indicates that approximately 79,070 people – 8.36% of the total population – should be followed up by the PHC services in stages 1, 2 or 3 of CKD, while 1,336 people – 0.14% of the total population – would be monitored in specialized services in stages 4 or 5, with or without dialysis. The prevalence of patients on dialysis in this Region has been increasing over the years (Table 2). The difficulty in accessing data from the Health Information Systems (SIS), to confirm these estimates, points to one of the critical nodes of health management and, mainly, those referring to the care provided in PHC. Therefore, the lack of reliable and timely information hinders the monitoring of the line of care and care planning.
“Today what you have in the official systems, for example, the exams carried out, you can pull, in what the Care Line proposes, the exams of each phase that we have to follow. So, as a production, it can be surveyed. What is more complicated, I think, is precisely in relation to Primary Care, how many patients I am following, how many hypertensive patients there are, what stage they are in…”. (Interviewee No. 6)
“These hypertensive patients are difficult, we don’t have a tool to assess this. Hiperdia is over. It was good when it was there, you know, and the municipalities used it and it was linked to the distribution of medicine…”. (Interviewee No. 2)
When asked about the factors they considered to influence the effective implementation of the line of care, the interviewees pointed out conditions related to the work process, care models, professional qualification and the quality of PHC.
“The factors that make it difficult are the work processes, they (the professionals) do not understand what a network is, each one does a little bit. Truly understanding why there are so many patients is also lacking. When we went to do the Care Line, we did not find much data, the municipalities do not have this data, it was necessary to use references from studies”. (Interviewee No. 1)
“I’m critical of the performance. I think we have the right structures, we are in a privileged region in terms of support and technology, but we have a lot to do with the way it is organized, the model of assistance, training and qualification of professionals, I think this hinders”. (Interviewee No. 2)
“The specialized [care] and discharge work well, they play their role, I think we have to intervene in Primary Care”. (Interviewee No. 1)
Preparation and Validation of the Logical Model
The logical model, built using a diagram (Figure), presents the activities and expected results by the HCN care dimension, in addition to identifying its necessary inputs and resources. The definition of each dimension, presented in the model, was based on the criteria for organizing the line of care for people with CKD99.Ministério da Saúde (BR). Portaria Nº 389, de 13 de março de 2014. Define os critérios para a organização da linha de cuidado da Pessoa com Doença Renal Crônica (DRC) e institui incentivo financeiro de custeio destinado ao cuidado ambulatorial pré-dialítico. Diário Oficial da União. 14 mar 2014 [cited 2022 Dec 15]; Seção 1:34. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0389_13_03_2014.html
http://bvsms.saude.gov.br/bvs/saudelegis...
, which subdivide the guidelines and responsibilities according to the level of technological density of the HCN services. Likewise, the actions that must be performed were based on the activities already foreseen by the SUS norms, and, based on them, the inputs for carrying out the planning as a whole were established. The logical model was improved based on its prior appreciation, by which information was complemented and verified before validation. During validation, the model was presented to six key informants, who participated in the development of the care line for people with CKD or worked at some point in the HCN. The semi-structured questionnaire (Box), proposed by McLaughlin and Jordan1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
, was applied to participants in step 5, who answered affirmatively to the questions. Key informants explained the context in which the line of care was developed and validated the model1212.McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
https://doi.org/10.1016/S0149-7189(98)00...
, not suggesting the inclusion of any new information.
DISCUSSION
CKD has received attention from the international and national scientific community, and its high prevalence is demonstrated in recent studies2323.Bastos MG, Kirsztajn GM. Doença renal crônica: importância do diagnóstico precoce, encaminhamento imediato e abordagem interdisciplinar estruturada para melhora do desfecho em pacientes ainda não submetidos à diálise. J Bras Nefrol. 2011;33(1):93-108. https://doi.org/10.1590/S0101-28002011000100013
https://doi.org/10.1590/S0101-2800201100...
, as well as the increase in the estimated incidence rate, which, in 2018, was 20% higher than that observed in 2013. In Brazil, arterial hypertension remains the main underlying cause of CKD, followed by the renal disease caused by diabetes2424.Neves PDMM, Sesso RCC, Thomé FS, Lugon JR, Nascimento MM. Censo Brasileiro de Diálise: análise de dados da década 2009-2018. J Bras Nefrol. 2020;42(2):191-200. https://doi.org/10.1590/2175-8239-jbn-2019-0234
https://doi.org/10.1590/2175-8239-jbn-20...
.
SUS has had the PNAPDR since 2004, but it was only almost ten years later, in 2013, that the CKD care line and clinical guidelines were published. However, data from the Brazilian Census of Dialysis, up to 2018, showed a growing increase in the rates of incidence and prevalence of patients on dialysis2424.Neves PDMM, Sesso RCC, Thomé FS, Lugon JR, Nascimento MM. Censo Brasileiro de Diálise: análise de dados da década 2009-2018. J Bras Nefrol. 2020;42(2):191-200. https://doi.org/10.1590/2175-8239-jbn-2019-0234
https://doi.org/10.1590/2175-8239-jbn-20...
, indicating the need to strengthen policies to prevent this condition.
The line of care for people with CKD establishes the attributions of the HCN care points, guiding the organization of the work of professionals and services. However, its monitoring and evaluation basically cover indicators aimed at high complexity1919.Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Organização local da linha de cuidado da pessoa com Doença Renal Crônica – DRC: guia instrutivo. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://www.conasems.org.br/wp-content/uploads/2014/08/images_Instrutivo_DRC_Gestor.pdf
https://www.conasems.org.br/wp-content/u...
, ignoring PHC.
In this study, the preparation of the logical model, based on the analysis of official documents, enabled to build a first diagram of the relationship between structure, process and result. The interview with professionals who worked at different points in the care line detailed the components of this model, making it more complete and enabling the identification of factors in the internal context that could interfere with its implementation.
With regard to the care dimensions of the logical model, we highlight the attention to PHC given by key informants. All of them commented on its fundamental role in organizing the line of care, but also on its weaknesses related to the work process, training, team qualification and the lack of information for monitoring and evaluation.
The first block of activities of the PHC dimension encompasses a large part of the actions foreseen by the National Primary Care Policy2525.Ministério da Saúde (BR). Portaria Nº 2.436, de 21 de setembro de 2017. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes para a organização da Atenção Básica, no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União. 22 set 2017 [cited 2022 Dec 15]; Seção 1:68. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
https://bvsms.saude.gov.br/bvs/saudelegi...
. In this sense, territorialization is the first stage of planning. Through it, the area in which the health service operates and its socio-environmental conditions is recognized, the population and its health problems are characterized, as well as the dynamics of its interaction with adjacent social equipment and with other sectors, in order to identify needs and propose health promotion and protection actions, in addition to disease prevention2525.Ministério da Saúde (BR). Portaria Nº 2.436, de 21 de setembro de 2017. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes para a organização da Atenção Básica, no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União. 22 set 2017 [cited 2022 Dec 15]; Seção 1:68. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
https://bvsms.saude.gov.br/bvs/saudelegi...
.
Therefore, it is essential to guarantee multidisciplinary teams and infrastructure in the territory that allow knowledge of the problems/needs and potential of the community, fundamental conditions to subsidize the planning, monitoring and evaluation of health actions.
In the second block, whose input is the carrying out of educational activities, the absence of popular health education as an action is related to the fact that it is not included in the item “health education”, the norms consulted and the experience of key informants about the theme. However, we understand that it is important for user empowerment and consequent participation in decision-making.
The following blocks are related to the guarantee of care in specialized care, transport and referral and counter-referral system. Regarding the use of electronic medical records, although it could be considered as an input, given the availability of the PEC e-SUS by the Ministry of Health, it was considered as an action, whether the PEC e-SUS itself or any other system of that type. The electronic medical record allows the optimization of clinical care, accessibility to data on care and procedures performed, integration of information, registration of households, in addition to supporting teaching and research. In addition, this record favors communication in the HCN, for example, through a reference and counter-reference system, contributing to the coordination and continuity of care and linking the user to the teams.
Regarding PHC products, although they are difficult to measure, they refer to what is expected from the proposed activities. It is believed that the logical model provokes reflections on them and, consequently, the election of structure, process and result indicators by dimension of the line of care.
The dimension of specialized care was referred to as the part of the care line that “works best”, with well-defined monitoring indicators, as well as high complexity. It is noteworthy that, among the interviewees, there were no highly complex professionals, which may be a limitation of the study, considering that they could propose modifications and/or additions to the model.
The logical model, although it was elaborated in an SR, which may represent a limitation, includes the three dimensions of health care: primary, secondary and tertiary. Its use by professionals and managers, compared with the different realities, can collaborate with the monitoring/evaluation of the line of care, and with the identification of potentialities and challenges, helping in planning and decision-making2626.Valentim RS, Dantas THM, Machado FCA, Araújo CM, Silva MS, Castaneda L, et al. Construção e validação de modelo lógico para Centros Especializados em Reabilitação. Rev Saude Publica. 2021;55:54. https://doi.org/10.11606/s1518-8787.2021055002976
https://doi.org/10.11606/s1518-8787.2021...
.
Final Consideration
There is recognition that, in the country, the approach to patients with CKD in the SUS needs to be improved. The line of care for the person with CKD, when detailing the attributions by the HCN care dimensions, is characterized as a guide for organizing the work process of professionals and services, with emphasis on PHC, a component that is still little explored and valued.
In the context of health assessment, the presented logical model helps in proposing performance indicators applicable to the three care dimensions, but mainly to PHC, because, although it is recognized as a network organizer and care coordinator, it has several organizational weaknesses, and, therefore, it has been underprivileged in discussions and investments. Also, the indicators to be developed from this line of care for the person with NCDs can be used in other Lines of the type, contributing to the improvement of the management action and enabling the effective implementation of this care organization strategy.
It is admitted that the suggested logical model has the potential to contribute to processes of evaluating the line of care for the person with CKD, with a view to achieving better results in the management of this disease, both for the patient and for the health system.
REFERENCES
-
1Lv JC, Zhang LX. Prevalence and disease burden of chronic kidney disease. In: Liu BC, Lan HY, Lv LL, editors. Renal fibrosis: mechanisms and therapies. Singapore: Springer; 2019. (Advances in Experimental Medicine and Biology; vol.1165). https://doi.org/10.1007/978-981-13-8871-2_1
» https://doi.org/10.1007/978-981-13-8871-2_1 -
2Malta DC, Machado IE, Pereira CA, Figueiredo AW, Aguiar LK, Almeida WS, et al. Avaliação da função renal na população adulta brasileira, segundo critérios laboratoriais da Pesquisa Nacional de Saúde. Rev Bras Epidemiol. 2019;22 Supl 2:E190010. https://doi.org/10.1590/1980-549720190010.supl.2
» https://doi.org/10.1590/1980-549720190010.supl.2 -
3Moura L, Prestes IV, Duncan BB, Schmidt MI. Construção de base de dados nacional de pacientes em tratamento dialítico no Sistema Único de Saúde, 2000-2012. Epidemiol Serv Saude. 2014;23(2):227-38. https://doi.org/10.5123/S1679-49742014000200004
» https://doi.org/10.5123/S1679-49742014000200004 -
4Alcalde PR, Kirsztajn GM. Gastos do Sistema Único de Saúde brasileiro com doença renal crônica. J Bras Nefrol. 2018;40(2):122-9. https://doi.org/10.1590/2175-8239-jbn-3918
» https://doi.org/10.1590/2175-8239-jbn-3918 -
5Institute for Health Metrics and Evaluation. Global Burden of Disease (GBD) 2017. GBD compare: Viz Hub. Seattle, WA: IHME; 2019 [cited 2021 Jul 3]. Available from: http://vizhub.healthdata.org/gbd-compare
» http://vizhub.healthdata.org/gbd-compare -
6National Kidney Foundation. K/DOQI clinical practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Am J Kidney Dis. 2002;39(2 Suppl 1):S14-6. https://doi.org/10.1053/ajkd.2002.30939
» https://doi.org/10.1053/ajkd.2002.30939 -
7Ministério da Saúde (BR). Portaria Nº 1.168, de 15 de junho de 2004. Institui a Política Nacional de Atenção ao Portador de Doença Renal, a ser implantada em todas as unidades federadas, respeitadas as competências das três esferas de gestão. Diário Oficial da União. 17 jun 2004 [cited 2022 Dec 15]; Seção 1:56. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt1168_15_06_2004.html
» http://bvsms.saude.gov.br/bvs/saudelegis/gm/2004/prt1168_15_06_2004.html -
8Ministério da Saúde (BR). Portaria Nº 483, de 1º de abril de 2014. Redefine a Rede de Atenção à Saúde das Pessoas com Doenças Crônicas no âmbito do Sistema Único de Saúde (SUS) e estabelece diretrizes para a organização das suas linhas de cuidado. Diário Oficial da União. 2 abr 2014 [cited 2022 Dec 15]; Seção 1: 50. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0483_01_04_2014.html
» http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0483_01_04_2014.html -
9Ministério da Saúde (BR). Portaria Nº 389, de 13 de março de 2014. Define os critérios para a organização da linha de cuidado da Pessoa com Doença Renal Crônica (DRC) e institui incentivo financeiro de custeio destinado ao cuidado ambulatorial pré-dialítico. Diário Oficial da União. 14 mar 2014 [cited 2022 Dec 15]; Seção 1:34. Available from: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0389_13_03_2014.html
» http://bvsms.saude.gov.br/bvs/saudelegis/gm/2014/prt0389_13_03_2014.html -
10Silva PAB, Silva LB, Santos JFG, Soares SM. Política pública brasileira na prevenção da doença renal crônica: desafios e perspectivas. Rev Saude Publica. 2020;54:86. https://doi.org/10.11606/s1518-8787.2020054001708
» https://doi.org/10.11606/s1518-8787.2020054001708 -
11Bezerra LCA, Cazarin G, Alves CKdeA. Modelagem de programas: da teoria à operacionalização. In: Samico I, Felisberto E, Figueiró AC, Frias PG, organizadores. Avaliação em saúde: bases conceituais e operacionais. Rio de Janeiro: MedBook; 2010. p. 65-78.
-
12McLaughlin JA, Jordan GB. Logic models: a tool for telling your program’s performance story. Eval Program Plann. 1999;22(1):65-72. https://doi.org/10.1016/S0149-7189(98)00042-1
» https://doi.org/10.1016/S0149-7189(98)00042-1 -
13Hartz Z. Modelizar as intervenções. In. Brousselle A, Champagne F, Contandriopoulos AP, Hartz Z, organizadores. Avaliação conceitos e métodos. Rio de Janeiro: Editora Fiocruz; 2011. p. 61-74
-
14Instituto Brasileiro de Geografia e Estatística. Estimativas da população residente no Brasil e Unidades da Federação com data de referência em 1º de julho de 2020. Rio de Janeiro: IBGE; 2020 [cited 2022 Dec 15]. Available from: https://ftp.ibge.gov.br/Estimativas_de_Populacao/Estimativas_2020/estimativa_dou_2020.pdf
» https://ftp.ibge.gov.br/Estimativas_de_Populacao/Estimativas_2020/estimativa_dou_2020.pdf -
15Kripka RML, Scheller M, Bonotto DL. Pesquisa documental na pesquisa qualitativa: conceitos e caracterização. Rev Investig UNAD. 2015;14(2):55-73.
-
16Ministério da Saúde (BR). Portaria Nº 1.631, de 1º de outubro de 2015. Aprova critérios e parâmetros para o planejamento e programação de ações e serviços de saúde no âmbito do SUS. Diário Oficial da União. 2 out 2015 [cited 2022 Dec 15]; Seção 1:38. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2015/prt1631_01_10_2015.html
» https://bvsms.saude.gov.br/bvs/saudelegis/gm/2015/prt1631_01_10_2015.html -
17Ministério da Saúde (BR). Portaria Nº 4.279, de 30 de dezembro de 2010. Estabelece diretrizes para a organização da Rede de Atenção à Saúde no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União. 31 dez 2010 [cited 2022 Dec 15]; Seção 1:88. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2010/prt4279_30_12_2010.html
» https://bvsms.saude.gov.br/bvs/saudelegis/gm/2010/prt4279_30_12_2010.html -
18Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Diretrizes Clínicas para o Cuidado ao paciente com Doença Renal Crônica – DRC no Sistema Único de Saúde. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_clinicas_cuidado_paciente_renal.pdf
» https://bvsms.saude.gov.br/bvs/publicacoes/diretrizes_clinicas_cuidado_paciente_renal.pdf -
19Ministério da Saúde (BR), Secretaria de Atenção à Saúde, Departamento de Atenção Especializada e Temática, Coordenação Geral de Média e Alta Complexidade. Organização local da linha de cuidado da pessoa com Doença Renal Crônica – DRC: guia instrutivo. Brasília, DF; 2014 [cited 2022 Dec 30]. Available from: https://www.conasems.org.br/wp-content/uploads/2014/08/images_Instrutivo_DRC_Gestor.pdf
» https://www.conasems.org.br/wp-content/uploads/2014/08/images_Instrutivo_DRC_Gestor.pdf -
20Ministério da Saúde (BR). Portaria Nº 1.675, de 7 de junho de 2018. Altera a Portaria de Consolidação nº 3/GM/MS, de 28 de setembro de 2017, e a Portaria de Consolidação nº 6/GM/MS, de 28 de setembro de 2017, para dispor sobre os critérios para a organização, funcionamento e financiamento do cuidado da pessoa com Doença Renal Crônica - DRC no âmbito do Sistema Único de Saúde - SUS. Diário Oficial da União. 8 jun 2018 [cited 2022 Dec 30]; Seção 1:148. Available from: https://www.in.gov.br/materia/-/asset_publisher/Kujrw0TZC2Mb/content/id/21054948/do1-2018-06-08-portaria-n-1-675-de-7-de-junho-de-2018-21054736
» https://www.in.gov.br/materia/-/asset_publisher/Kujrw0TZC2Mb/content/id/21054948/do1-2018-06-08-portaria-n-1-675-de-7-de-junho-de-2018-21054736 -
21Aguiar LK, Prado RR, Gazzinelli A, Malta DC. Fatores associados à doença renal crônica: inquérito epidemiológico da Pesquisa Nacional de Saude. Rev Bras Epidemiol. 2020;23:e200044. https://doi.org/10.1590/1980-549720200044
» https://doi.org/10.1590/1980-549720200044 -
22Instituto Brasileiro de Geografia e Estatística, Diretoria de Pesquisas, Coordenação de Trabalho e Rendimento. Pesquisa Nacional de Saúde, 2013: percepção do estado de saúde, estilos de vida e doenças crônicas: Brasil, grandes regiões e unidades de federação. Rio de Janeiro: IBGE; 2014.
-
23Bastos MG, Kirsztajn GM. Doença renal crônica: importância do diagnóstico precoce, encaminhamento imediato e abordagem interdisciplinar estruturada para melhora do desfecho em pacientes ainda não submetidos à diálise. J Bras Nefrol. 2011;33(1):93-108. https://doi.org/10.1590/S0101-28002011000100013
» https://doi.org/10.1590/S0101-28002011000100013 -
24Neves PDMM, Sesso RCC, Thomé FS, Lugon JR, Nascimento MM. Censo Brasileiro de Diálise: análise de dados da década 2009-2018. J Bras Nefrol. 2020;42(2):191-200. https://doi.org/10.1590/2175-8239-jbn-2019-0234
» https://doi.org/10.1590/2175-8239-jbn-2019-0234 -
25Ministério da Saúde (BR). Portaria Nº 2.436, de 21 de setembro de 2017. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes para a organização da Atenção Básica, no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União. 22 set 2017 [cited 2022 Dec 15]; Seção 1:68. Available from: https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html
» https://bvsms.saude.gov.br/bvs/saudelegis/gm/2017/prt2436_22_09_2017.html -
26Valentim RS, Dantas THM, Machado FCA, Araújo CM, Silva MS, Castaneda L, et al. Construção e validação de modelo lógico para Centros Especializados em Reabilitação. Rev Saude Publica. 2021;55:54. https://doi.org/10.11606/s1518-8787.2021055002976
» https://doi.org/10.11606/s1518-8787.2021055002976
-
Funding:Fundação de Amparo ao Ensino, Pesquisa e Assistência do Hospital das Clínicas da Faculdade de Medicina de Ribeirão Preto (Faepa - process 758/2022).
Publication Dates
-
Publication in this collection
14 Apr 2023 -
Date of issue
2023
History
-
Received
13 Nov 2021 -
Accepted
07 Apr 2022