Acessibilidade / Reportar erro

Effectiveness of the Mobile Emergency Medical Services (SAMU): use of interrupted time series

ABSTRACT

OBJECTIVE

To evaluate the performance of the Mobile Emergency Medical Services (SAMU) in the ABC Region, using myocardial infarction as tracer condition.

METHODS

The analysis of interrupted time series was the approach chosen to test immediate and gradual effects of the intervention on the study population. The research comprised adjusted monthly time series of the hospital mortality rate by myocardial infarction in the period between 2000 and 2011. Data were extracted from the Mortality Information System (SIM), using segmented regression analysis to evaluate the level and trend of the intervention before and after its implementation. To strengthen the internal validity of the study, a control region was included.

RESULTS

The analysis of interrupted time series showed a reduction of 0.04 deaths per 100,000 inhabitants in the mortality rate compared to the underlying trend since the implementation of the Emergency Medical Services (p = 0.0040; 95%CI: −0.0816 – −0.0162) and a reduction in the level of 2.89 deaths per 100,000 inhabitants (p = 0.0001; 95%CI: −4.3293 – −1.4623), both with statistical significance. Regarding the control region, Baixada Santista, the difference in the result trend between intervention outcome and post-intervention control of −0.0639 deaths per 100,000 inhabitants was statistically significant (p = 0.0031; 95%CI: −0.1060 – −0.0219). We cannot exclude confounders, but we limited their presence in the study by including control region series.

CONCLUSIONS

Although the analysis of interrupted time series has limitations, this modeling can be useful for analyzing the performance of policies and programs. Even though the intervention studied is not a condition that in itself implies effectiveness, the latter would not be present without the former, which, integrated with other conditions, generates a positive result. SAMU is a strategy that must be expanded when formulating and consolidating policies focusing on emergency care.

Mobile Health Units; Myocardial Infarction; Hospital Mortality; Efficacy-Effectiveness Evaluation of Interventions; Interrupted Time Series Analysis

RESUMO

OBJETIVO

Avaliar o desempenho do serviço de atendimento móvel de urgência (Samu) na região do Grande ABC, utilizando como condição traçadora o infarto agudo do miocárdio.

MÉTODOS

A análise de séries temporais interrompidas foi a abordagem de escolha para testar efeitos imediatos e graduais da intervenção na população de estudo. A pesquisa compreendeu séries temporais mensais ajustadas da taxa de mortalidade hospitalar por infarto agudo do miocárdio no período entre 2000 e 2011. Os dados foram extraídos do Sistema de Informações sobre Mortalidade, usando a análise de regressão segmentada para avaliar o nível e tendência da intervenção antes e após sua implementação. Para fortalecer a validade interna do estudo, foi incluída uma região controle.

RESULTADOS

A análise de séries temporais interrompidas mostrou redução de 0,04 mortes por 100.000 habitantes na taxa de mortalidade em relação à tendência subjacente desde a implantação do serviço de atendimento médico de urgência (p = 0,0040; IC95% -0,0816 – -0,0162) e uma redução no nível de 2,89 mortes por 100.000 habitantes (p = 0,0001; IC95% -4,3293 – -1,4623), ambos com significância estatística. Em relação à região controle, a Baixada Santista, a diferença da tendência do resultado entre desfecho de intervenção e controle pós-intervenção de -0,0639 mortes por 100.000 habitantes mostrou-se estatisticamente significativa (p = 0,0031; IC95% -0,1060 – -0,0219). Não podemos excluir confundimentos, mas limitamos sua presença no estudo incluindo séries de região controle.

CONCLUSÕES

Embora a análise de séries temporais interrompidas tenha limitações, essa modelagem pode ser útil para a análise de desempenho de políticas e programas. Apesar de a intervenção estudada não ser uma condição que por si só implica na efetividade, a efetividade não estaria presente sem essa intervenção, que, integrada a outras condições, gera um resultado positivo. O Samu é uma estratégia cuja expansão precisa ser levada em consideração ao formular e consolidar políticas com foco nas urgências e emergências.

Unidades Móveis de Saúde; Infarto do Miocárdio; Mortalidade Hospitalar; Avaliação de Eficácia-Efetividade de Intervenções; Análise de Séries Temporais Interrompida

INTRODUCTION

Prehospital emergency care has been increasingly relevant in our society, because of the need to structure emergency care, ensuring a shorter response time and better regulation of care flows. Countries that organized their emergency care systems focusing on prehospital care, regardless of the model adopted, achieved good results in terms of survival, time, and cost of care, especially for traumas and chronic degenerative diseases11. O’Dwyer G, Konder MT, Reciputti, LP, Macedo C, Lopes MGM, O processo de implantação do Serviço de Atendimento Móvel de Urgência no Brasil: estratégias de ação e dimensões estruturais. Cad Saude Publica. 2017;33(7):e00043716. https://doi.org/10.1590/0102-311x00043716
https://doi.org/10.1590/0102-311x0004371...
, 22. Minayo MCS, Deslandes SF. Análise da implantação do sistema de atendimento pré-hospitalar móvel em cinco capitais brasileiras. Cad Saude Publica. 2008;24(8):1877-86. https://dx.doi.org/10.1590/S0102-311X200800080001
https://dx.doi.org/10.1590/S0102-311X200...
.

In Brazil, mobile emergency prehospital care has been offered since 2003, by the Mobile Emergency Medical Services (SAMU). Inspired by the French model, but with features of the American model, its main objectives are to reduce the number of deaths, length of hospitalization, and sequelae resulting from the lack of timely care. It is operated by the emergency regulation demanded by the user, and the conduct can take place by telephone or by dispatch of basic or advanced life support teams, for the severe cases that require a more complex intervention22. Minayo MCS, Deslandes SF. Análise da implantação do sistema de atendimento pré-hospitalar móvel em cinco capitais brasileiras. Cad Saude Publica. 2008;24(8):1877-86. https://dx.doi.org/10.1590/S0102-311X200800080001
https://dx.doi.org/10.1590/S0102-311X200...
, 33. Machado CV, Salvador FGF, O’Dwyer G. Serviço de Atendimento Móvel de Urgência: análise da política brasileira, Rev Saude Publica. 2011;45(3):519-28. https://doi.org/10.1590/s0034-89102011005000022
https://doi.org/10.1590/s0034-8910201100...
.

Recent reviews have found evidence of the beneficial effect of prehospital emergency care on the prognosis of important problems, such as traumas and stroke, for which the response time to start treatment is greatly important44. Geue C, Lewsey JD, MacKay DF, Antony G, Fischbacher CM, Muirie J, et al. Scottish Keep Well health check programme: an interrupted time series analysis, J Epidemiol Community Health. 2016;70(9):924-9. https://doi.org/10.1136/jech-2015-206926
https://doi.org/10.1136/jech-2015-206926...

5. Artac M, Dalton ARH, Majeed A, Car J, Millett C. Effectiveness of a national cardiovascular disease risk assessment program (NHS Health Check): results after one year. Prev Med. 2013;57(2):129-34. https://doi.org/10.1016/j.ypmed.2013.05.002
https://doi.org/10.1016/j.ypmed.2013.05....
- 66. Taljaard MT, McKenzie JE, Ramsay CR, Grimshaw JM. The use of segmented regression in analysing interrupted time series studies: an example in pre-hospital ambulance care. Implement Sci. 2014;9:77. https://doi.org/10.1186/1748-5908-9-77
https://doi.org/10.1186/1748-5908-9-77...
. Some authors involved in this topic in Brazil emphasize that SAMU promotes, in addition to the prehospital start of treatment at the site of the event, the immediate removal of the patient to the tertiary center, when indicated by protocol based on the best evidence77. Sawaya Neto M, Menezes Neto ASM. Avaliação do impacto do SAMU sobre indicadores de urgência: o caso das proporções de mortes hospitalares por infarto agudo do miocárdio em municípios de médio e grande porte. In: Resende GM, organizador. Avaliação de políticas públicas no Brasil: uma análise de seus impactos regionais. Brasília, DF: IPEA; 2014. v.2 , 88. Avezun A, Carvalho ACC, Mansur AP, Timerman A, Guimarães AC, Bozza AEZ, et al. III Diretriz sobre tratamento do infarto agudo do miocárdio. Arq Bras Cardiol. 2004;83 Supl 4:3-86. https://doi.org/10.1590/S0066-782X2004002200001
https://doi.org/10.1590/S0066-782X200400...
.

Myocardial infarction has been pointed out as a problem especially indicated for studies evaluating the performance of prehospital emergency care, given its magnitude, sensitivity to hospital medical technologies, and impact on mortality and hospital lethality. Early diagnosing myocardial infarction and carrying out prehospital care increase the patient’s chance of survival99. Brasileiro ALS. SAMU/192 e a abordagem pré-hospitalar do infarto agudo do miocárdio no Brasil: esperança para o paciente ou mais uma oportunidade perdida? Arq Bras Cardiol. 2007;88(2):e44-6. https://doi.org/10.1590/S0066-782X2007000200023
https://doi.org/10.1590/S0066-782X200700...
.

Rigorous methods to assess the outcomes of interventions within policies and programs are required to determine their effectiveness. One of the study designs recommended to evaluate the effect of an intervention is the interrupted time series analysis, a quasi-experimental method used when randomized studies are not feasible1010. Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr. 2013;13(6 Suppl):S38-44. https://doi.org/10.1016/j.acap.2013.08.002
https://doi.org/10.1016/j.acap.2013.08.0...
. In this design, a series of observations of the same outcome is performed at multiple points in time, before and after the intervention (“interruption”) is implemented. This method controls the baseline level and trend when estimating the expected changes resulting from the implementation of the program1111. Panagiotoglou D, Law MR, McGrail K. Effect of hospital closures on acute care outcomes in British Columbia, Canada: an interrupted time series study. Med Care. 2017;55(1):50-6. https://doi.org/10.1097/MLR.0000000000000619
https://doi.org/10.1097/MLR.000000000000...
, 1212. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299-309. https://doi.org/10.1046/j.1365-2710.2002.00430.x
https://doi.org/10.1046/j.1365-2710.2002...
.

This study used interrupted time series to evaluate the effectiveness of the mobile emergency medical services on the hospital mortality rate by myocardial infarction in a region of Brazil.

METHODS

This is an ecological study with interrupted time series analysis, considered one of the most effective quasi-experimental designs to evaluate the longitudinal effect of interventions1010. Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr. 2013;13(6 Suppl):S38-44. https://doi.org/10.1016/j.acap.2013.08.002
https://doi.org/10.1016/j.acap.2013.08.0...
, 1111. Panagiotoglou D, Law MR, McGrail K. Effect of hospital closures on acute care outcomes in British Columbia, Canada: an interrupted time series study. Med Care. 2017;55(1):50-6. https://doi.org/10.1097/MLR.0000000000000619
https://doi.org/10.1097/MLR.000000000000...
. In this type of study, the time series of a result of interest, that is, the continuous sequence of observations of a given outcome repeatedly taken (usually at equal intervals) over time, is used to establish an underlying trend that is “interrupted” by an intervention at a known moment. The hypothetical scenario occurs considering that the intervention was not implemented and the trend remains unchanged, which is called “counterfactual” (“expected” trend in the absence of the intervention given the preexisting trend). The counterfactual scenario allows evaluating the effectiveness of the intervention by examining the path of the trend in the post-intervention period1010. Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr. 2013;13(6 Suppl):S38-44. https://doi.org/10.1016/j.acap.2013.08.002
https://doi.org/10.1016/j.acap.2013.08.0...
, 1313. Zhang F, Wagner AK, Ross-Degnan D. Simulation-based power calculation for design in interrupted time series analyses of health policy interventions. J Clin Epidemiol. 2011;64(11):1252-61. https://doi.org/10.1016/j.jclinepi.2011.02.007
https://doi.org/10.1016/j.jclinepi.2011....
, 1414. Antunes JLF, Cardoso MRA. Uso da análise de séries temporais em estudos epidemiológicos. Epidemiol Serv Saude. 2015;24(3):565-76. https://doi.org/10.5123/S1679-49742015000300024
https://doi.org/10.5123/S1679-4974201500...
.

The research was developed in the ABC Region, located in the state of São Paulo, comprising seven municipalities and a population of about 2,719,580 inhabitants. SAMU started to be implemented in 2004, in the municipality of Santo André, and expanded to the others between 2004 and 2005. Since some cities at the time were not big enough to constitute a regulation center of SAMU, agreements were held for the regional installation. Therefore, the center of Mauá is a reference for Rio Grande da Serra and Ribeirão Pires, the one of Santo André is interconnected with São Caetano, and Diadema and São Bernardo have their own centers. SAMU covers all localities with basic and advanced life support ambulances, as well as motorcycle ambulances.

The rate of hospital mortality by myocardial infarction (MI) was evaluated based on the diagnosis of death with the codes I20 to I24 in the 10th revision of the International Classification of Diseases (ICD-10). The monthly data were extracted from the Sistema de Informações sobre Mortalidade (SIM – Mortality Information System) of the Departamento de Informática do Sistema Único de Saúde (DATASUS – Informatics Department of the Brazilian Unified Health System), which captures about 90% of all deaths in the country, referring to public and private hospitals.

The numerator corresponded to the number of deaths by MI in the population aged 40 years or older living in the municipalities that compose the ABC Region. The denominator referred to the estimated population, according to the census of the Brazilian Institute of Geography and Statistics (IBGE), for the same age group, region, and period of the study. To allow comparison over time and between regions, the values were converted into rates per 100,000 inhabitants and standardized by the direct method.

To strengthen the internal validity of the study, a control region was included (group not exposed to the intervention), using the same outcome and observation period. This strategy is particularly valuable when there are other changes over time, unrelated to the intervention studied, but that can affect the results of the outcome1414. Antunes JLF, Cardoso MRA. Uso da análise de séries temporais em estudos epidemiológicos. Epidemiol Serv Saude. 2015;24(3):565-76. https://doi.org/10.5123/S1679-49742015000300024
https://doi.org/10.5123/S1679-4974201500...

15. England E. How interrupted time series analysis can evaluate guideline implementation. Pharm J. 2005;275:344-7.
- 1616. Lopez Bernal J, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46(1):348-55. https://doi.org/10.1093/ije/dyw098
https://doi.org/10.1093/ije/dyw098...
.

For the selection of the control region, we analyzed the localities in the state of São Paulo whose municipalities had not implemented SAMU before 2011, according to a document provided by the Brazilian Ministry of Health. Then, to find comparable controls, those with p-value greater than 0.05 were identified for the covariates that measure the difference in level and trend during the pre-intervention period, included in the final model. The pre-intervention trend does not need to have exactly the same values as a randomized trial, but it must have a similar trend for the control group to be sustainable. Further methodological details can be found in Linden and Adams1717. Linden A. Conducting interrupted time-series analysis for single- and multiple group comparisons. Stata J. 2015:480-500. https://doi.org/10.1177/1536867X1501500208
https://doi.org/10.1177/1536867X15015002...
.

To compare the regions, the following aspects were selected: socioeconomic indicators (illiteracy rate of the population aged 15 years or older; average income, in R$; and total public health expenditure per inhabitant, in R$); and primary, secondary, and tertiary health care indicators (estimated population coverage of primary health care teams, family health doctors, or community physicians per 100,000 inhabitants; percentage of hospitalizations due to conditions sensitive to primary health care; total hospitalization beds of SUS per 1,000 inhabitants; total adult or coronary intensive care unit beds per 100,000 inhabitants; angioplasty rate standardized by sex and age per 100,000 inhabitants aged 20 years or older; percentage of the population covered by supplementary health care plans and insurance). The data sources for these indicators were the website of the project Regiões e Redes (Regions and Networks) and the website of the Projeto Avaliação do Desempenho do Sistema de Saúde (PROADESS – Project Health System Performance Assessment) of Fundação Oswaldo Cruz. For the comparative analysis of the regions, the years 2000 (start of the study) and 2010 (close to the study completion) were chosen. Because of the unavailability of socioeconomic and organizational regional information of health care in the public databases for 2011, we decided to use 2010 for comparison.

The study comprised monthly time series between 2000 and 2011, divided into three segments: pre-intervention period (January 2000 to December 2003), implementation phase of the intervention (January 2004 to December 2004), and post-intervention period (January 2005 to December 2011). It is worth noting that this study was completed in 2011 because of the inclusion of the control region in the analysis. As the largest expansion of prehospital emergency care occurred from 2012 onward, when the Política Nacional de Atenção às Urgências (National Emergency Care Policy) was reformulated, giving rise to the urgency and emergency network, it would not be possible to identify after that a control region similar to the intervention region for evaluating possible concurrent explanations.

The rate of hospital mortality by myocardial infarction was analyzed by adjusting the segmented regression model, including as covariates the time, the indicator variable equal to one after the intervention and zero before the intervention (and the interaction between these two variables), to evaluate the effects of change on level and trend in the period before and after the intervention. Seasonality was corrected, including month indicator variables (with January as reference)11. O’Dwyer G, Konder MT, Reciputti, LP, Macedo C, Lopes MGM, O processo de implantação do Serviço de Atendimento Móvel de Urgência no Brasil: estratégias de ação e dimensões estruturais. Cad Saude Publica. 2017;33(7):e00043716. https://doi.org/10.1590/0102-311x00043716
https://doi.org/10.1590/0102-311x0004371...
.

The graphs of residue and sample and partial autocorrelation function (ACF and partial ACF) were used to verify autocorrelation in the residue and properties of stationarity and normality, to select the most appropriate and statistically parsimonious models. The Ljung-Box test indicated that the model is appropriate to describe the linear dependence between successive repetitions1818. Morettin PA, Toloi CM. Análise de séries temporais. São Paulo: Blucher; 2006. .

RESULTS

In the ABC Region, myocardial infarction was the main isolated cause of death in recent years. Between 2000 and 2011, 12,559 deaths of individuals aged 40 years or older were registered. Table 1 shows the monthly data of the standardized monthly hospital mortality rate for this period.

Table 1
Adjusted rate of monthly hospital mortality by myocardial infarction. ABC Region, SP, 2000-2011.

In this study, the statistical analysis empirically tested the hypothesis of significant reduction in the trend and level of the hospital mortality rate by MI in adults older than 40 years after the implementation of prehospital emergency care that took place in 2004. Since in a time series analysis the terms of error of consecutive observations can be correlated, the portions of the model residue were inspected as a function of time to ensure that no pattern suggesting autocorrelation was evident.

Figure 1 shows the graph of the outcome estimated and predicted effect, considering the period before and after the intervention was implemented in the ABC Region. The analysis of interrupted time series showed a reduction of 0.04 deaths per 100,000 inhabitants in the monthly rate of hospital mortality by MI compared to the underlying trend (p = 0.0040; 95%CI: 0.0816 – −0.0162) and a reduction in the level of 2.89 deaths per 100,000 inhabitants in the monthly rate of hospital mortality by MI (p = 0.0001; 95%CI: −4.3293 – −1.4623), with statistical significance. The findings indicate that, from 2005 onward, an immediate drop in the rate of hospital mortality by myocardial infarction and reduction of the trend took place, gradually remaining this way over the period of analysis.

Figure 1
Estimated and predicted effect of the hospital mortality rate by myocardial infarction for the period before and after the mobile emergency medical services were implemented. ABC Region, SP, 2000-2011.

To reduce the possibility of confounding, we chose to work with a control group comparable to the intervention group. The only region in the state of São Paulo that met the established criteria, that is, not having SAMU implemented during the analysis period and presenting covariates similar to those of the ABC Region, was the region of Baixada Santista.

Table 2 presents demographic and economic indicators, as well as primary, secondary, and tertiary care indicators, to compare both regions of analysis for the years of 2000 and 2010. Considering that the rate of angioplasty (standardized by sex and age per 100,000 inhabitants aged 20 years or older) presented increasing values in both regions between 2000 and 2010, we decided to include the annual trend of this indicator, as Table 3 shows.

Table 2
Socioeconomic and organizational indicators of Baixada Santista and ABC Region, SP, 2000 and 2010.

Table 3
Rate of angioplasty standardized by sex and age per 100,000 inhabitants aged 20 years or older. ABC Region and Baixada Santista, state of São Paulo, Southeast Region, 2000-2011.

Figure 2 shows the change in level and trend of the hospital mortality due rate by myocardial infarction in individuals aged 40 years or older for the ABC Region and Baixada Santista, highlighting the control region as counterfactual. All results refer to changes after the adjustment for seasonal variation and autocorrelation. Compared to the control region, the ABC Region presented an ascending trend in the period before the implementation of SAMU, corresponding to 2.3 deaths per 100,000 inhabitants. The difference of −0.0639 in the trend of the post-intervention result between the intervention and control group was statistically significant (p = 0.0031; 95%CI: −0.1060 – −0.0219). A statistically significant change in level (degree) was not identified in the transition from the first to the second segment (p = 0.257), when comparing the two regions. These results suggest a change of trend between the two groups, which can strengthen the hypothesis of the study regarding the effect of the intervention implemented in the region from 2004.

Figure 2
Estimated and predicted effect of the hospital mortality rate by myocardial infarction for the period before and after the mobile emergency medical services were implemented. ABC Region and Baixada Santista, SP, 2000-2011.

DISCUSSION

The design of interrupted time series involves estimating the effect of an intervention evaluating whether there is immediate impact (change in level) or progressive impact (change in trend) in the values of the series1212. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299-309. https://doi.org/10.1046/j.1365-2710.2002.00430.x
https://doi.org/10.1046/j.1365-2710.2002...
, 1313. Zhang F, Wagner AK, Ross-Degnan D. Simulation-based power calculation for design in interrupted time series analyses of health policy interventions. J Clin Epidemiol. 2011;64(11):1252-61. https://doi.org/10.1016/j.jclinepi.2011.02.007
https://doi.org/10.1016/j.jclinepi.2011....
. In the ABC Region, the statistically significant change in the trend observed in the hospital mortality rate by myocardial infarction, mainly from 2004, suggests some hypotheses, among which a possible effect of the prehospital emergency care.

The V Diretriz da Sociedade Brasileira de Cardiologia sobre Tratamento do Infarto Agudo do Miocárdio (Fifth Guideline of the Brazilian Society of Cardiology on the Treatment of Myocardial Infarction) (2015)1919. Piegas LS, Timerman A, Feitosa GS, Nicolau JC, Mattos LAP, Andrade MD, et al. V Diretriz da Sociedade Brasileira de Cardiologia sobre Tratamento do Infarto Agudo do Miocárdio com Supradesnível do Segmento ST. Arq Bras Cardiol. 2015;105(2):1-105. considers prehospital services as one of the main mechanisms for the reduction of deaths resulting from this disease, because they favor early diagnosis and ensure the referral of patients. However, there are few studies showing the effectiveness of this intervention in the country2020. Luz CC, Junger WL, Cavalini LT. Análise da atenção pré-hospitalar ao acidente vascular cerebral e ao infarto agudo do miocárdio na população idosa de Minas Gerais. Rev Assoc Med Bras. 2010;56(4):452-7. https://doi.org/10.1590/S0104-42302010000400019
https://doi.org/10.1590/S0104-4230201000...
, 2121. Cabral APS, Souza WV. Serviço de Atendimento Móvel de Urgência (SAMU): análise da demanda e sua distribuição espacial em uma cidade do Nordeste brasileiro, Rev Bras Epidemiol. 2008;11(4):530-40. https://doi.org/10.1590/S1415-790X2008000400002
https://doi.org/10.1590/S1415-790X200800...
.

The reduction in the hospital mortality rate by MI after the introduction of prehospital emergency care is consistent with results from previous studies, which reported beneficial effects on the time of response66. Taljaard MT, McKenzie JE, Ramsay CR, Grimshaw JM. The use of segmented regression in analysing interrupted time series studies: an example in pre-hospital ambulance care. Implement Sci. 2014;9:77. https://doi.org/10.1186/1748-5908-9-77
https://doi.org/10.1186/1748-5908-9-77...
, 2020. Luz CC, Junger WL, Cavalini LT. Análise da atenção pré-hospitalar ao acidente vascular cerebral e ao infarto agudo do miocárdio na população idosa de Minas Gerais. Rev Assoc Med Bras. 2010;56(4):452-7. https://doi.org/10.1590/S0104-42302010000400019
https://doi.org/10.1590/S0104-4230201000...
, 2222. Perkins-Porras L, Whitehead PC, Steptoe A. Pre-hospital delay in patients with acute coronary syndrome: factors associated with patient decision time and home-to-hospital delay. Eur J Cardiovasc Nurs. 2009;8(1):26-33. https://doi.org/10.1016/j.ejcnurse.2008.05.001
https://doi.org/10.1016/j.ejcnurse.2008....
. In the United States, even with the advances in the treatment of MI within hospitals, several studies highlight the importance of resuscitation and defibrillation in prehospital treatment, because they reduce the time elapsed between the onset of symptoms and the start of treatment2323. Kurz MC, Schmicker RH, Leroux B, Nichol G, Aufderheide TP, Cheskes S, et al. Advanced vs. basic life support in the treatment of out-of-hospital cardiopulmonary arrest in the resuscitation outcomes consortium. Resuscitation. 2018;128:132-137 .

In a study conducted in Rwanda, it was observed that a well-structured mobile prehospital care can lead to a gradual and sustained decrease in the mortality rate by the disease2424. Scott JW, Nyinawankusi JD, Enumah S, Maine R, Uwitonze E, Hu Y, et al. Improving prehospital trauma care in Rwanda through continuous quality improvement: an interrupted time series analysis. Injury. 2017;48(7):1376-81. https://doi.org/10.1016/j.injury.2017.03.050
https://doi.org/10.1016/j.injury.2017.03...
. A research conducted in Canada on mobile emergency units, with interrupted time series, suggested that mobile prehospital care can improve the quality of care in the cases of stroke and MI; however, clinically potential effects need to be better studied66. Taljaard MT, McKenzie JE, Ramsay CR, Grimshaw JM. The use of segmented regression in analysing interrupted time series studies: an example in pre-hospital ambulance care. Implement Sci. 2014;9:77. https://doi.org/10.1186/1748-5908-9-77
https://doi.org/10.1186/1748-5908-9-77...
. Other studies, however, pointed out little or no effect of this modality of care on hospital mortality, even by MI, suggesting that it may have different effects in diverse situations and that its impact cannot be considered unquestionable2525. Aboueljinane L, Sahin E, Jemai Z, Marty J. A simulation study to improve the performance of an emergency medical service: application to the French Val-de-Marne department. Simul Model Pract Theory. 2014;47(1):46-59. https://doi.org/10.1016/j.simpat.2014.05.007
https://doi.org/10.1016/j.simpat.2014.05...
.

Although in Brazil there are no researches with the interrupted time series method for SAMU, the effect of mobile prehospital care was identified in some publications. An ecological study with longitudinal design observed a beneficial effect of SAMU for mortality by stroke in men and mortality by MI in women in the elderly population of the state of Minas Gerais2020. Luz CC, Junger WL, Cavalini LT. Análise da atenção pré-hospitalar ao acidente vascular cerebral e ao infarto agudo do miocárdio na população idosa de Minas Gerais. Rev Assoc Med Bras. 2010;56(4):452-7. https://doi.org/10.1590/S0104-42302010000400019
https://doi.org/10.1590/S0104-4230201000...
.

Results of a research conducted in the state of Rio de Janeiro, also with time series, showed that SAMU can reduce the mean length of hospital stay, especially for stroke, in both sexes, and trauma, for men2626. Cardoso SS. Metodologia de avaliação da política nacional de atendimento às urgências para o estado do Rio de Janeiro [dissertação]. Niterói: Universidade Federal Fluminense; 2011. . A study produced by the Instituto de Pesquisa Econômica e Aplicada (Ipea – Institute of Economic and Applied Research) stressed that the rate of hospital deaths by MI is higher in municipalities without units of SAMU, compared with those with them, although the difference is not expressive77. Sawaya Neto M, Menezes Neto ASM. Avaliação do impacto do SAMU sobre indicadores de urgência: o caso das proporções de mortes hospitalares por infarto agudo do miocárdio em municípios de médio e grande porte. In: Resende GM, organizador. Avaliação de políticas públicas no Brasil: uma análise de seus impactos regionais. Brasília, DF: IPEA; 2014. v.2 .

Even considering that SAMU represents a prehospital mobile emergency equipment, which can contribute to the health status in which patients reach hospitals, several other factors that improve patient survival must be considered when interpreting results. Thus, the implementation of preventive measures, focusing on risk factors related to MI, as well as advances in medical care, such as the use of beta-blockers and stent angioplasty, may substantially affect the rate of hospital admission and mortality77. Sawaya Neto M, Menezes Neto ASM. Avaliação do impacto do SAMU sobre indicadores de urgência: o caso das proporções de mortes hospitalares por infarto agudo do miocárdio em municípios de médio e grande porte. In: Resende GM, organizador. Avaliação de políticas públicas no Brasil: uma análise de seus impactos regionais. Brasília, DF: IPEA; 2014. v.2 , 2424. Scott JW, Nyinawankusi JD, Enumah S, Maine R, Uwitonze E, Hu Y, et al. Improving prehospital trauma care in Rwanda through continuous quality improvement: an interrupted time series analysis. Injury. 2017;48(7):1376-81. https://doi.org/10.1016/j.injury.2017.03.050
https://doi.org/10.1016/j.injury.2017.03...
.

The incorporation of a control group, using the same outcome in a group not exposed to the intervention, adds legitimacy when seeking to control possible biases, such as those mentioned above1616. Lopez Bernal J, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46(1):348-55. https://doi.org/10.1093/ije/dyw098
https://doi.org/10.1093/ije/dyw098...
, 1717. Linden A. Conducting interrupted time-series analysis for single- and multiple group comparisons. Stata J. 2015:480-500. https://doi.org/10.1177/1536867X1501500208
https://doi.org/10.1177/1536867X15015002...
. The statistical analysis of time series, along with the analysis of threat to validity, may provide useful information about the effectiveness of the intervention2525. Aboueljinane L, Sahin E, Jemai Z, Marty J. A simulation study to improve the performance of an emergency medical service: application to the French Val-de-Marne department. Simul Model Pract Theory. 2014;47(1):46-59. https://doi.org/10.1016/j.simpat.2014.05.007
https://doi.org/10.1016/j.simpat.2014.05...
. In this study, in the pre-intervention period, the difference in trend between the ABC Region and Baixada Santista was very close: 0.001. This suggests that, without intervention, the post-2004 trend in the ABC Region would probably have been similar to that of the Baixada Santista.

Considering that the different regions of the state are heterogeneous regarding socioeconomic and organizational characteristics, we sought regional variables that describe important aspects possibly related to the behavior of the hospital mortality rate by MI. In this context, we also selected indicators of provision of primary, secondary, and tertiary care in both regions of study2727. Shadish WR, Cook TD, Campbell DT. Experimental and quasi experimental designs for generalized causal inference, Boston, MA: Houghton Mifflin; 2002. .

Between 2000 and 2010, the average income improved in both regions, and the illiteracy rate decreased in both as well. The coverage of supplementary health care plans and insurance increased significantly in Baixada Santista, from 29.5% to 39.7%, and had a slight increase from 51.7% to 53.6% in the ABC Region.

The estimated population coverage of primary care teams and family doctors increased in both regions between 2000 and 2010. However, the percentage of hospitalization due to conditions sensitive to primary health care increased in the intervention region and had a slight decrease in the control region. This indicator is used as a measure of effectiveness of primary health care, assuming that a more satisfactory performance of this level of care could result in a decrease in the risk of hospitalization for a set of diseases that includes hypertension and diabetes, important risk factors for MI.

The availability of beds in the ABC Region was higher in 2000 and 2010 than in the Baixada Santista, but still insufficient to meet the demands of the population. The lack of beds in hospitals tends to worsen the articulation between hospital and prehospital care, revealing important inequalities in the access to care.

Still during this period, although the rate of hospitalization beds of SUS per 1,000 inhabitants decreased in both regions, the total of adult or coronary intensive care unit beds per 100,000 inhabitants increased, as well as the values of the angioplasty rate standardized by sex and age per 100,000 inhabitants aged 20 years or older, which reflects the availability of cardiological care in the regions.

To better monitor this scenario, we analyzed the annual behavior of the angioplasty rate standardized by sex and age per 100,000 inhabitants aged 20 years or older, considering the same period of study. Both regions presented an important increase in the rate of cardiac surgeries between 2001 and 2003, period before the implementation of SAMU in the intervention region. From 2004, the rate of angioplasty reduces, a pattern that remains up to 2007, when this rate starts to increase over the subsequent years. However, in Baixada Santista, a downward trend starts from 2009 on.

Considering in the analysis other interventions that may have been introduced in the same period of study, it is worth highlighting the implementation of the Unidades de Pronto Atendimento (UPA – Emergency Care Units), which have been important in the diagnosis of emergencies in the care of cardiovascular diseases, especially myocardial infarction, because they are intermediate units between primary health care and hospital emergencies. However, although formulated in 2008, its large-scale implementation in the country took place between 2011 and 2016, interval not included in this study2828. Konder MT, O’Dwyer G. A integração das Unidades de Pronto Atendimento (UPA) com a rede assistencial no município do Rio de Janeiro, Brasil. Interface (Botucatu). 2016;20(59):879-92. https://doi.org/10.1590/1807-57622015.0519
https://doi.org/10.1590/1807-57622015.05...
.

Concerning the adoption of the anti-smoking law formulated in 2007, its implementation in fact occurred in the state of São Paulo in 2009 with Law no. 13,5412929. SÃO PAULO. Lei 13.541, de 07 de maio de 2009. . This measure emphasized the prohibition of the use of cigarettes in public and private environments, except residences and places of religious worship and intended for the consumption of tobacco products, aiming to reduce mortality from chronic diseases, with emphasis on cancer and cardiovascular disease3030. Abe TMO. Internação e mortalidade por doença cardiovascular e cerebrovascular no período anterior e posterior à lei antitabaco na cidade de São Paulo [tese]. São Paulo: Faculdade de Saúde Pública da Universidade de São Paulo; 2016. .

The greatest strength of this study was, besides using the quasi-experimental design of time series with control group, controlling differences in both the pre-existing level and trend. However, one of the limitations of our study is its low power of generalization; therefore, its conclusions should only be applied to populations with a similar profile. Conflicting results may be part of the differences in the local context. Furthermore, one must consider the role of SAMU within the other components of the emergency network in the different territories that compose the ABC Region. In this sense, in community-based studies, the use of a quasi-experimental design will often request both quantitative and qualitative approaches to reach a broader conclusion about the effects of the intervention under study2727. Shadish WR, Cook TD, Campbell DT. Experimental and quasi experimental designs for generalized causal inference, Boston, MA: Houghton Mifflin; 2002. ,, 3030. Abe TMO. Internação e mortalidade por doença cardiovascular e cerebrovascular no período anterior e posterior à lei antitabaco na cidade de São Paulo [tese]. São Paulo: Faculdade de Saúde Pública da Universidade de São Paulo; 2016. , 3131. Togher FJ, Zowie D, Siriwardena, AN. Patients’ and ambulance service clinician’s experiences of prehospital care for acute myocardial infarction and stroke: a qualitative study. Emerg Med J. 2013;30(11):942-8. https://doi.org/10.1136/emermed-2012-201507
https://doi.org/10.1136/emermed-2012-201...
.

Finally, the unexpressive result (although statistically significant) in the post-intervention trend of the hospital mortality rate by MI in the ABC Region may lead to an interpretation that the effect was of low impact. However, in the case of ecological studies, the effects occur equally in the population as a whole. Thus, findings with minor effects are expected, and this does not mean a low real effect on the studied phenomenon. In addition, the studied intervention may be a condition that in itself does not imply effectiveness, but without which this same effectiveness would not be present, integrating a set of conditions that, put together, generate a positive result.

CONCLUSION

The complexity of seeking to establish the effect of a given intervention lies in the fact that almost all observed phenomena have multiple causes. From this perspective, the proposal of quasi-experimental designs by tracer conditions or marker events has been a recurring practice, since it is difficult, in many situations, to isolate the causes and effects of the phenomena of interest.

This study reinforces the usefulness of the quasi-experimental approach of interrupted series, making it a viable option for intervention analysis in health policies when randomized studies are not feasible. The results suggest that, although the effectiveness of SAMU cannot be considered as acquired, it is a strategy whose expansion needs to considered in the formulation and consolidation of policies focusing on emergency care.

REFERENCES

  • 1
    O’Dwyer G, Konder MT, Reciputti, LP, Macedo C, Lopes MGM, O processo de implantação do Serviço de Atendimento Móvel de Urgência no Brasil: estratégias de ação e dimensões estruturais. Cad Saude Publica. 2017;33(7):e00043716. https://doi.org/10.1590/0102-311x00043716
    » https://doi.org/10.1590/0102-311x00043716
  • 2
    Minayo MCS, Deslandes SF. Análise da implantação do sistema de atendimento pré-hospitalar móvel em cinco capitais brasileiras. Cad Saude Publica. 2008;24(8):1877-86. https://dx.doi.org/10.1590/S0102-311X200800080001
    » https://dx.doi.org/10.1590/S0102-311X200800080001
  • 3
    Machado CV, Salvador FGF, O’Dwyer G. Serviço de Atendimento Móvel de Urgência: análise da política brasileira, Rev Saude Publica. 2011;45(3):519-28. https://doi.org/10.1590/s0034-89102011005000022
    » https://doi.org/10.1590/s0034-89102011005000022
  • 4
    Geue C, Lewsey JD, MacKay DF, Antony G, Fischbacher CM, Muirie J, et al. Scottish Keep Well health check programme: an interrupted time series analysis, J Epidemiol Community Health. 2016;70(9):924-9. https://doi.org/10.1136/jech-2015-206926
    » https://doi.org/10.1136/jech-2015-206926
  • 5
    Artac M, Dalton ARH, Majeed A, Car J, Millett C. Effectiveness of a national cardiovascular disease risk assessment program (NHS Health Check): results after one year. Prev Med. 2013;57(2):129-34. https://doi.org/10.1016/j.ypmed.2013.05.002
    » https://doi.org/10.1016/j.ypmed.2013.05.002
  • 6
    Taljaard MT, McKenzie JE, Ramsay CR, Grimshaw JM. The use of segmented regression in analysing interrupted time series studies: an example in pre-hospital ambulance care. Implement Sci. 2014;9:77. https://doi.org/10.1186/1748-5908-9-77
    » https://doi.org/10.1186/1748-5908-9-77
  • 7
    Sawaya Neto M, Menezes Neto ASM. Avaliação do impacto do SAMU sobre indicadores de urgência: o caso das proporções de mortes hospitalares por infarto agudo do miocárdio em municípios de médio e grande porte. In: Resende GM, organizador. Avaliação de políticas públicas no Brasil: uma análise de seus impactos regionais. Brasília, DF: IPEA; 2014. v.2
  • 8
    Avezun A, Carvalho ACC, Mansur AP, Timerman A, Guimarães AC, Bozza AEZ, et al. III Diretriz sobre tratamento do infarto agudo do miocárdio. Arq Bras Cardiol. 2004;83 Supl 4:3-86. https://doi.org/10.1590/S0066-782X2004002200001
    » https://doi.org/10.1590/S0066-782X2004002200001
  • 9
    Brasileiro ALS. SAMU/192 e a abordagem pré-hospitalar do infarto agudo do miocárdio no Brasil: esperança para o paciente ou mais uma oportunidade perdida? Arq Bras Cardiol. 2007;88(2):e44-6. https://doi.org/10.1590/S0066-782X2007000200023
    » https://doi.org/10.1590/S0066-782X2007000200023
  • 10
    Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr. 2013;13(6 Suppl):S38-44. https://doi.org/10.1016/j.acap.2013.08.002
    » https://doi.org/10.1016/j.acap.2013.08.002
  • 11
    Panagiotoglou D, Law MR, McGrail K. Effect of hospital closures on acute care outcomes in British Columbia, Canada: an interrupted time series study. Med Care. 2017;55(1):50-6. https://doi.org/10.1097/MLR.0000000000000619
    » https://doi.org/10.1097/MLR.0000000000000619
  • 12
    Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299-309. https://doi.org/10.1046/j.1365-2710.2002.00430.x
    » https://doi.org/10.1046/j.1365-2710.2002.00430.x
  • 13
    Zhang F, Wagner AK, Ross-Degnan D. Simulation-based power calculation for design in interrupted time series analyses of health policy interventions. J Clin Epidemiol. 2011;64(11):1252-61. https://doi.org/10.1016/j.jclinepi.2011.02.007
    » https://doi.org/10.1016/j.jclinepi.2011.02.007
  • 14
    Antunes JLF, Cardoso MRA. Uso da análise de séries temporais em estudos epidemiológicos. Epidemiol Serv Saude. 2015;24(3):565-76. https://doi.org/10.5123/S1679-49742015000300024
    » https://doi.org/10.5123/S1679-49742015000300024
  • 15
    England E. How interrupted time series analysis can evaluate guideline implementation. Pharm J. 2005;275:344-7.
  • 16
    Lopez Bernal J, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46(1):348-55. https://doi.org/10.1093/ije/dyw098
    » https://doi.org/10.1093/ije/dyw098
  • 17
    Linden A. Conducting interrupted time-series analysis for single- and multiple group comparisons. Stata J. 2015:480-500. https://doi.org/10.1177/1536867X1501500208
    » https://doi.org/10.1177/1536867X1501500208
  • 18
    Morettin PA, Toloi CM. Análise de séries temporais. São Paulo: Blucher; 2006.
  • 19
    Piegas LS, Timerman A, Feitosa GS, Nicolau JC, Mattos LAP, Andrade MD, et al. V Diretriz da Sociedade Brasileira de Cardiologia sobre Tratamento do Infarto Agudo do Miocárdio com Supradesnível do Segmento ST. Arq Bras Cardiol. 2015;105(2):1-105.
  • 20
    Luz CC, Junger WL, Cavalini LT. Análise da atenção pré-hospitalar ao acidente vascular cerebral e ao infarto agudo do miocárdio na população idosa de Minas Gerais. Rev Assoc Med Bras. 2010;56(4):452-7. https://doi.org/10.1590/S0104-42302010000400019
    » https://doi.org/10.1590/S0104-42302010000400019
  • 21
    Cabral APS, Souza WV. Serviço de Atendimento Móvel de Urgência (SAMU): análise da demanda e sua distribuição espacial em uma cidade do Nordeste brasileiro, Rev Bras Epidemiol. 2008;11(4):530-40. https://doi.org/10.1590/S1415-790X2008000400002
    » https://doi.org/10.1590/S1415-790X2008000400002
  • 22
    Perkins-Porras L, Whitehead PC, Steptoe A. Pre-hospital delay in patients with acute coronary syndrome: factors associated with patient decision time and home-to-hospital delay. Eur J Cardiovasc Nurs. 2009;8(1):26-33. https://doi.org/10.1016/j.ejcnurse.2008.05.001
    » https://doi.org/10.1016/j.ejcnurse.2008.05.001
  • 23
    Kurz MC, Schmicker RH, Leroux B, Nichol G, Aufderheide TP, Cheskes S, et al. Advanced vs. basic life support in the treatment of out-of-hospital cardiopulmonary arrest in the resuscitation outcomes consortium. Resuscitation. 2018;128:132-137
  • 24
    Scott JW, Nyinawankusi JD, Enumah S, Maine R, Uwitonze E, Hu Y, et al. Improving prehospital trauma care in Rwanda through continuous quality improvement: an interrupted time series analysis. Injury. 2017;48(7):1376-81. https://doi.org/10.1016/j.injury.2017.03.050
    » https://doi.org/10.1016/j.injury.2017.03.050
  • 25
    Aboueljinane L, Sahin E, Jemai Z, Marty J. A simulation study to improve the performance of an emergency medical service: application to the French Val-de-Marne department. Simul Model Pract Theory. 2014;47(1):46-59. https://doi.org/10.1016/j.simpat.2014.05.007
    » https://doi.org/10.1016/j.simpat.2014.05.007
  • 26
    Cardoso SS. Metodologia de avaliação da política nacional de atendimento às urgências para o estado do Rio de Janeiro [dissertação]. Niterói: Universidade Federal Fluminense; 2011.
  • 27
    Shadish WR, Cook TD, Campbell DT. Experimental and quasi experimental designs for generalized causal inference, Boston, MA: Houghton Mifflin; 2002.
  • 28
    Konder MT, O’Dwyer G. A integração das Unidades de Pronto Atendimento (UPA) com a rede assistencial no município do Rio de Janeiro, Brasil. Interface (Botucatu). 2016;20(59):879-92. https://doi.org/10.1590/1807-57622015.0519
    » https://doi.org/10.1590/1807-57622015.0519
  • 29
    SÃO PAULO. Lei 13.541, de 07 de maio de 2009.
  • 30
    Abe TMO. Internação e mortalidade por doença cardiovascular e cerebrovascular no período anterior e posterior à lei antitabaco na cidade de São Paulo [tese]. São Paulo: Faculdade de Saúde Pública da Universidade de São Paulo; 2016.
  • 31
    Togher FJ, Zowie D, Siriwardena, AN. Patients’ and ambulance service clinician’s experiences of prehospital care for acute myocardial infarction and stroke: a qualitative study. Emerg Med J. 2013;30(11):942-8. https://doi.org/10.1136/emermed-2012-201507
    » https://doi.org/10.1136/emermed-2012-201507
  • Funding: HMDN is recipient of scholarship CNPq (Research Scholarship no. 306536 / 2015–3) and CCMO is recipient of scholarship CNPq (Research Scholarship no 2015 / 02713–0). Both are researchers of the Instituto Nacional de Ciência e Tecnologia para Avaliação de Tecnologias em Saúde (IATS – National Institute of Science and Technology for Health Technology Assessment).

Publication Dates

  • Publication in this collection
    02 Dec 2019
  • Date of issue
    2019

History

  • Received
    17 Dec 2018
  • Accepted
    9 Feb 2019
Faculdade de Saúde Pública da Universidade de São Paulo Avenida Dr. Arnaldo, 715, 01246-904 São Paulo SP Brazil, Tel./Fax: +55 11 3061-7985 - São Paulo - SP - Brazil
E-mail: revsp@usp.br