Abstract
Objective: Due to the high cost and short term of passive immunization against the respiratory syncytial virus, the main virus causing acute viral bronchiolitis, predicting epidemic regions and epidemic months is extremely important. The objective of this study is to identify both the month when the seasonal peak begins and Brazilian regions and states with the highest incidence of monthly hospitalizations due acute viral bronchiolitis.
Methods: Based on data obtained from DATASUS, monthly hospitalization rates due acute viral bronchiolitis were calculated for every 10,000 live births to children under 12 months of age in all Brazilian states and the Federal District between 2000 and 2019. Seasonal autoregressive integrated moving average models were estimated to forecast monthly hospitalization rates in 2020.
Results: A higher incidence of hospitalizations was found for male children, especially under six months of age. As for Brazilian regions, between 2000 and 2019, the South region registered the highest incidence of hospitalizations, followed by the Southeast, Midwest, North and Northeast regions, in this order. Considering the seasonal peak, the period between March and July 2020 comprised the highest expected hospitalization rates.
Conclusions: Palivizumab is suggested to be started between February/March and June/July for most Brazilian states, with the exception of Rio Grande do Sul, which, in addition to presenting the highest rates of hospitalizations for acute viral bronchiolitis per 10,000 live births, has the longest seasonal peak between May and September.
Keywords: Bronchiolitis viral; Respiratory syncytial virus infections; Palivizumab; Time series
RESUMO
Objetivo: Em razão do alto custo e do curto prazo da imunização passiva contra o vírus sincicial respiratório, principal vírus causador de bronquiolite viral aguda, a previsão das regiões e meses epidêmicos é extremamente importante. Objetiva-se identificar o mês de início do pico sazonal e as regiões e Estados brasileiros de maior incidência de hospitalizações mensais por bronquiolite viral aguda.
Métodos: Com dados obtidos no Departamento de Informática do Sistema Único de Saúde do Brasil, foram calculadas as taxas mensais de hospitalizações por bronquiolite viral aguda a cada 10 mil nascidos vivos de crianças com idade inferior a 12 meses, em todos os Estados brasileiros e no Distrito Federal, no período entre 2000 e 2019. Modelos sazonais autorregressivos integrados e de médias móveis foram estimados para a previsão das taxas mensais de hospitalizações em 2020.
Resultados: Verificou-se maior incidência de hospitalizações em crianças do sexo masculino, principalmente naquelas com idade inferior a seis meses. Em relação às regiões brasileiras, entre 2000 e 2019, a Região Sul apresentou a maior incidência de hospitalizações, seguida pelas Regiões Sudeste, Centro-Oeste, Norte e Nordeste, respectivamente. Quanto ao pico sazonal, o período entre março e julho de 2020 compreende as maiores taxas de hospitalizações previstas.
Conclusões: Sugere-se o início da administração do Palivizumab entre fevereiro/março e junho/julho para a maioria dos Estados brasileiros, com exceção do Rio Grande do Sul, que, além de apresentar as maiores taxas de hospitalizações por bronquiolite viral aguda a cada 10.000 nascidos vivos, possui o pico sazonal de maior duração entre maio e setembro.
Palavras-chave: Bronquiolite viral; Infecções por vírus sincicial respiratório; Palivizumab; Séries temporais
INTRODUCTION
Acute viral bronchiolitis (AVB) is the result of inflammation and obstruction of the bronchioles, caused by respiratory viruses. Among viruses that cause AVB, the most common are: respiratory syncytial virus (RSV), adenovirus (ADV), influenza virus types A and B and parainfluenza virus (PIV) types 1, 2 and 3.1,2 AVB can also be caused by Mycoplasma pneumoniae, rhinovirus, Chlamydia pneumoniae, human metapneumovirus and coronavirus viruses.3 In Brazil, RSV is considered the main cause of mortality of children under 12 months of age4, being responsible for 60 to 75% of all cases of AVB.5
AVB has a low mortality rate (<1%), although it can be higher (30%) in high-risk groups of children such as premature infants younger than 32 weeks and/or with bronchopulmonary dysplasia, children under two years with congenital heart disease and/or immunocompromised, malnourished,3,6 considering that these groups present with prolonged illness and greater risk of death. Other risk factors include early weaning, exposure to cigarette smoke, age below six months, school-aged sibling living in the same household, socioeconomic status, being black and male.7
Incidence of viral infections may vary depending on local climatic conditions. AVB, in particular, is a seasonal disease that coincides with epidemics of secondary infections and viral respiratory pathogens.8 In this sense, periods with low temperatures contribute to the higher incidence of AVB cases related to RSV infections.2,9 Studies report the occurrence of a seasonal peak of RSV infection in the city of Rio de Janeiro from March to May,10 in the city of São Paulo from April/May to July/August11,12 and, in Salvador, between May and July.13 The seasonal peak of RSV infections in Porto Alegre occurs from June to September.2,14 Despite knowing the seasonal behavior of BVA in some Brazilian capitals, we lack a mapping covering the entire national territory, with the purpose of indicating AVB seasonal peak periods in each state.
RSV transmission takes place through eye or nasal contact with contaminated secretions, and the virus can be recovered after more than one hour on infected surfaces.3 The incubation period can last five days, and viral infection varies according to disease intensity and the child’s immune status.15 In addition to preventive measures to avoid contagion, there is a drug for the prevention of AVB,16 Palivizumab. It is not a vaccine, but an immunoglobulin—an antibody—that induces specific passive immunization against RSV. Immunization with Palivizumab is made in monthly intramuscular doses of 15 mg/kg/dose during epidemic months.3 Usually, this medication is administered in five doses during the five months of highest incidence of the virus, as it lasts for 30 days.5 The effectiveness of passive immunization is 1/200, reducing hospitalization rates for AVB by 55%.3
Due to the high costs, Palivizumab is restricted to greater risk cases.5,17 Therefore, it is essential to carry out studies that identify the period of the year in which the highest incidence of AVB cases occurs in each Brazilian state and/or region, with the purpose of indicating the best month to start medication according to local characteristics, enabling an efficient funding in the fight against AVB.
That being said, this study aims to identify the AVB seasonal period by analyzing a time series of hospitalization rates between 2000 and 2019 in each Brazilian state and the Federal District, in order to suggest the best month to start immunization with Palivizumab. Classic time series models were adjusted and used to predict monthly rates of hospitalizations for AVB in 2020.
METHOD
This time series consists of children younger than 12 months, born between January 2000 and December 2019 and diagnosed with AVB, distributed across 26 Brazilian states and the Federal District. The number of hospitalizations for AVB and the number of live births between 2000 and 2019 were obtained from the website of the Department of Informatics of the Unified Health System in Brazil (DATASUS). Then, the monthly rates of hospitalizations for AVB per 10,000 children were calculated based on the ratio between monthly hospitalizations for AVB and annual live births. Rates were multiplied by 10,000 to facilitate interpretation of results. Data on AVB hospitalization were accessed with the International Classification of Diseases, 10th revision — ICD J21.0, J21.8 and J21.9, which comprise AVB caused by RSV, other specified microorganisms, and unspecified cases.
To assess the significance of the monotonous linear trend of hospitalizations for AVB from 2000 to 2019 in different Brazilian regions, the Cox-Stuart trend test was applied. In addition, the incidence (in %) of hospitalizations for AVB between 2000 and 2019 was calculated for each Brazilian region based on the ratio between total hospitalizations for AVB and total live births in the region. The result was multiplied by 100 to obtain the percentage incidence. Thus, considering the incidences (in %), two-proportion comparison tests were used to verify the possible influence of children’s biological sex on the rates of hospitalizations for AVB in each region. Furthermore, the test of comparison of multiple proportions by the method of Benjamini and Yekutieli24 was conducted to compare incidences of hospitalizations for AVB in different Brazilian regions.
Then, the time series modeling process based on the Autoregressive and Moving Average (ARMA) class models and their extensions was carried out on the series of hospitalization rates by AVB in the 26 Brazilian states and the Federal District, to predict the behavior of the series for the months of 2020.
The ARMA class models, proposed by Box and Jenkins (1970), are capable of modeling stationary time series, that is, series that do not show behavioral patterns over time and develop randomly around a constant average.19 ARMA models are a cautious alternative to describe time series involving a minimum number of parameters.
In general, real time series present in non-stationarity form, such as a trend. In order to model a trended time series, an extension of the ARMA model class is used, the Autoregressive Integrated Moving Average (ARIMA) models.19 The difference of ARIMA models is the “integration” of a step in which successive differences occur in the series of interest, transforming it in a stationary series. In addition to a graphic analysis of the time series, it allows to identify the behavior of an increasing or decreasing linear trend through hypothesis tests such as the Cox-Stuart test (signal test).18
Another form of recurrent non-stationarity in real series is seasonality. To model time series with seasonality, another extension of the ARMA model class is used: the Seasonal Autoregressive Integrated Moving Average (SARIMA) models.19 In addition to simple successive differences intended to remove a trend, these also create seasonal differences in order to remove seasonality and obtain stationarity. The process of modeling time series with models of the ARMA class and its extensions occurs firstly by identifying a SARIMA model for each location, following the usual procedure by Box and Jenkins (1970).
The number of simple differentiations d and seasonal differentiations D (s=12) is selected to obtain a stationary series. Once the series become stationary, the sample autocorrelation (SAC) and partial sample autocorrelation (PSAC) functions are used to specify the order p of the polynomial of autoregressive terms and the order q of the polynomial of terms of moving-averages, necessary for the adequate representation of the time series being modeled.17,18 The next step is to estimate the parameters by the maximum likelihood method, since the εtεt are normally distributed.20 The model selection was aided by information such as Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC), likelihood ratio test, lower error variance and parsimony. To verify the adequacy of the model, the Ljung-Box tests were used to detect autocorrelation and the Jarque-Bera tests to verify the normality of residuals. Finally, a prediction was made.18,19 This study took place as recommended by Resolution 466/2012 of the National Health Council. The project was approved by the Research Ethics Committee of Universidade Estadual de Maringá (Opinion 739.422/2014), and the Free and Informed Consent Term was not used, since data were obtained from secondary sources. The analysis was performed using R language21. In preparing data, the packages read.dbc, dplyr, data.table, Hmisc and tidyr were used; For the adjustment and forecasting of the series, the forecast package was used; maps were designed through XML packages, RCurl, maptools, RColorBrewer, maptools and Maps.
RESULTS
The study cohort comprised 615,657 children under 12 months of age diagnosed with AVB. Of these, 367,580 (60%) were males and 248,077 (40%) were females. In addition, 449,395 (73%) children were younger than six months and, 98,442 (16%) being boys and 67,820 (11%) being girls. On the other hand, 166,262 (27%) children were older than six months, of which 269,138 (44%) were boys and 180,257 (29%) were girls. The children diagnosed with AVB were distributed according to the five regions of Brazil. Of the total, 51,524 (8%) lived in the North Region, 107,237 (18%) in the Northeast Region, 288,715 (47%) in the Southeast Region, 125,331 (20%) in the South Region and 41,954 (7%) in the Midwest Region.
After categorizing the interval between 2000 and 2019 into four periods (2000 to 2004, 2005 to 2009, 2010 to 2014 and 2015 to 2019), we could see the increase in hospitalizations for AVB over the periods, both in terms of percentage and of estimated annual trends, which were statistically significant (p<0.0001) in all Brazilian regions, as shown in Table 1. In the South Region, there was an increase of approximately one case every three years per 10,000 live births.
Number of cases and proportion by period, age group and sex compared to the total number of cases per Brazilian region. Total cases, annual trend and incidence by region from 2000 to 2019.
Using the two-proportion comparison test to examine the incidence of AVB hospitalizations according to sex, a statistically significant difference was found for all regions (p<0.0001), with a higher incidence among males. According to Table 1, this occurs mainly in children younger than six months of age and, over the periods, this percentage shown an upward trend. Regarding the incidence of hospitalizations due to AVB between 2000 and 2019 in different Brazilian regions, statistical significance was also found by the multiple proportion comparison test with the Benjamini and Yekutieli24 method (p<0.0001), noting that the South region has the highest incidence, followed by the Southeast, Midwest, North and Northeast regions.
In identifying the model to be adjusted, given the general presence of seasonal effect, seasonal differentiation was adopted for the 27 series of monthly rates of hospitalizations by AVB, transforming them into stationary series and providing access to their autocorrelation in the SAC and PSAC. After identifying a model for each series, the parameters were estimated, the suitability of the model was verified and the behavior of the time series was predicted for the months of 2020.
The adjustment and forecast of SARIMA models in the series of the 26 Brazilian States and the Federal District are shown in Figure 1. The vertical dashed line separates the adjustment (red) and forecast (blue) periods, composed of 12 steps forward. In addition, the numbering on the left side of each graph corresponds to the identification of States from Chart 1.
Original series (black), fitted models (red) and forecast (blue) with 12 steps ahead for each Brazilian state and the Federal District. The numbers on the left side of each graph correspond to the identification of States (black) and the average monthly rates of hospitalizations for AVB between January 2000 and December 2019 (blue).
The number that follows the horizontal dotted line, in blue and also located on the left side of each graph, refers to the average monthly rates of hospitalizations for AVB between January 2000 and December 2019.
The monthly rates of hospitalizations for AVB per 10,000 live births in Brazil for 2020 are shown in Table 2. In order to highlight the months with the highest rates and facilitate the identification of the best time of year for immunization with Palivizumab, the shaded region in Table 2 indicates the five highest expected hospitalization rates for each state and the Federal District. In general, the period between March and July 2020 had the highest predicted rates of hospitalizations for AVB, indicating the temporal location of the seasonal peak.
Forecast of monthly rates of hospitalizations for acute viral bronchiolitis for 2020 in the 26 Brazilian states and the Federal District. The five highest predicted rates for each state and the Federal District are highlighted in gray.
The expected AVB hospitalization rates for 2020 were categorized into seven hierarchical intervals: up to 5, >5 and ≤10, >10 and ≤20, >20 and ≤30, >30 and ≤40, >40 and ≤ 50 and finally >50. The intervals are represented in Figure 2 by blue scales that darken as the rates of hospitalizations for AVB go up. Figure 2 is a spatial representation of the rates of hospitalizations by AVB predicted for 2020, from Table 2. The spatial representation helps one view and identify Brazilian states to be more or less affected by the AVB in 2020.
Map of monthly rates of hospitalizations for acute viral bronchiolitis predicted for 2020 in each Brazilian state.
The darkest scales are concentrated between March and July 2020, like in Table 2, temporally locating the peak of hospitalization rates for AVB in Brazil in 2020. In addition, the South Region had the highest rates of hospitalizations for AVB predicted for 2020, while the States of the Northeast Region had the lowest rates.
In the South Region, the State of Rio Grande do Sul stood out with the highest rates of hospitalizations for AVB predicted for 2020. Its seasonal peak had the longest duration among all States, with high rates from May to October 2020, during fall, winter and part of the spring. Its rates range from 35.46 to 68.82 hospitalizations for AVB per 10,000 live births. In the Northeast Region, the State of Alagoas had the lowest rates predicted for 2020, reaching a maximum of 3.74 hospitalizations per 10,000 live births. Furthermore, the states of Amazonas and Pernambuco showed predicted rates of hospitalizations for AVB lower than 22 hospitalizations per 10,000 live births.
DISCUSSION
This study verified the increase in incidence of hospitalizations for AVB over 2000 through 2019 in all Brazilian regions. The South Region had the highest rates of hospitalizations for AVB predicted for 2020. The seasonal peak of hospitalizations expected for 2020 in the State of Rio Grande do Sul comprised the fall, winter and part of the spring, with rates ranging from 35.46 to 68.82 hospitalizations per 10,000 live births.
In all Brazilian regions, male children aged less than six months had a higher incidence of hospitalizations for AVB. Studies show that boys develop respiratory tract infections more often than girls, with the exception of sinusitis, otitis externa, and probably tonsillitis. Anatomy and behavioral/socioeconomic characteristics may explain this difference between genders. There is evidence that the peripheral airways are disproportionately narrower during the first few years of life in boys, which may predispose them to lower respiratory tract infections.
It is worth mentioning that this research is naturally subject to some limitations, since it works with secondary data. One of them is the non-immediate updating and possible incompleteness of the data available on the DATASUS platform.22 There is also a lack of coverage of all hospitalizations in the country, as the data stored in the Hospital Information System refer to hospitalizations funded by the Unified Health System in public or private hospitals. Another limitation stems from the possible underreporting of hospital admissions, which depend on each federative unit.23
In France, hospital records from 2009 were analyzed in search of cases of hospitalizations for AVB of children under one year of age and factors associated with death. Cases were described based on the variables: age, sex, underlying conditions (including bronchopulmonary dysplasia, cystic fibrosis, and congenital heart disease), length of hospital stay, recurrent hospitalizations, intensive care unit (ICU) admission, and use of assisted ventilation. The hospitalization rate was 35.8 per 1,000 children under one year of age in 2009. Approximately 10% of hospitalized children required treatment in ICU.24
In Brazil, an analysis of the seasonality of hospitalization rates for bronchiolitis and pneumonia resulting from RSV between 2005 and 2012 suggests the beginning of Palivizumab prophylaxis in January for the North, Midwest and Southeast regions, in February for the Northeast region, and in March for the South Region.5
Studies addressing the prevalence and circulation of RSV in children with acute respiratory diseases in different states point to a greater circulation of the virus from April to May in the Southeast, North, Northeast and Midwest regions.5,24,25 In the South Region, the peak of RSV infections occurs later, between June and July,5 concomitant to the influenza season. In this study, coincidentally, the forecast for the peak of hospitalization rates for AVB in Brazil in 2020 was between March and July, starting with fall, in March, and covering part of the winter in the months of June and July.
It is important to consider that the public data available on DATASUS is delayed by up to two years. Thus, the use of 2020 data is not suitable because they are partial and still being entered into the system. Even if they were available, it would be necessary to develop an interrupted series analysis or intervention analysis, since an external event (pandemic) influenced the occurrences and records of the outcome. After two years of the pandemic, with daycare centers and schools open again and the relaxation of social isolation, the previous pattern of RSV tends to establish itself again over time. Anticipating occurrences is of great importance, especially for public management. The present study is not limited to a forecast for 2020, but indicates the historical pattern of regions and periods/months of the year at greatest risk. If a period/month was identified, it means the pattern has become evident over the years. The most critical months are different in each region—another reason for attention and more accurate decision-making, enabling optimization and cost reduction with the administration of the monoclonal antibody and with hospitalizations.
An epidemiological surveillance system to monitor RSV activity is of utmost importance for the implementation and maintenance of passive immunization programs with monoclonal antibodies in risk groups. Since there is a well-defined pattern of viral circulation, knowing local epidemiological data, considering regional climatic characteristics and paying attention to eventual changes over the years and the emergence of new pathogens, leads to better management of RSV prevention programs.
REFERENCES
-
1. Monteiro AI, Bellei NC, Sousa AR, Santos AM, Weckx LY. Respiratory infections in children up to two years of age on prophylaxis with palivizumab. Rev Paul Pediatr. 2014;32:152-8. https://doi.org/10.1590/0103-0582201432214813
» https://doi.org/10.1590/0103-0582201432214813 - 2. Freitas AR. Impact of influenza and respiratory syncytial virus on mortality and hospitalizations and Implications for Public Policies in Brazil [tese]. Campinas: Universidade Estadual de Campinas; 2014.
-
3. Carvalho WB, Johnston C, Fonseca MC. Acute bronchiolitis, an updated review. Rev Assoc Med Bras (1992). 2007;53:182-8. https://doi.org/10.1590/s0104-42302007000200027
» https://doi.org/10.1590/s0104-42302007000200027 -
4. Albernaz EP, Menezes AM, César JA, Victora CG, Barros FC, Halpern R. Risk factors associated with hospitalization for bronchiolitis in the post-neonatal period. Rev Saude Publica. 2003;37:485-93. https://doi.org/10.1590/s0034-89102003000400014
» https://doi.org/10.1590/s0034-89102003000400014 -
5. Freitas AR, Donalisio MR. Respiratory syncytial virus seasonality in Brazil: implications for the immunisation policy for at-risk populations. Mem Inst Oswaldo Cruz. 2016;111:294-301. https://doi.org/10.1590/0074-02760150341
» https://doi.org/10.1590/0074-02760150341 - 6. Sociedade Brasileira de Pediatria. Diretrizes para o manejo da infecção causada pelo Virus Sincicial Respiratório (VSR). Rio de Janeiro: SBP; 2011.
-
7. Farhat CK, Cintra OA, Tregnaghi MW. Vaccination and the respiratory tract--what should we know? J Pediatr (Rio J). 2002;78 Suppl 2:S195-204. https://doi.org/10.2223/jped.898
» https://doi.org/10.2223/jped.898 -
8. Leader S, Kimmie K. Recent trends in severe respiratory syncytial virus (RSV) among US infants, 1997 to 2000. J Pediatr. 2003;143(5 Suppl):S127-32. https://doi.org/10.1067/s0022-3476(03)00510-9
» https://doi.org/10.1067/s0022-3476(03)00510-9 -
9. Calegari T, Queiroz DA, Yokosawa J, Silveira HL, Costa LF, Oliveira TF, et al. Clinical-epidemiological evaluation of respiratory syncytial virus infection in children attended in a public hospital in midwestern Brazil. Braz J Infect Dis. 2005;9:156-61. https://doi.org/10.1590/s1413-86702005000200006
» https://doi.org/10.1590/s1413-86702005000200006 -
10. Nascimento JP, Siqueira MM, Sutmoller F, Krawczuk MM, Farias V, Ferreira V, et al. Longitudinal study of acute respiratory diseases in Rio de Janeiro: occurrence of respiratory viruses during four consecutive years. Rev Inst Med Trop Sao Paulo. 1991;33:287-96. https://doi.org/10.1590/s0036-46651991000400008
» https://doi.org/10.1590/s0036-46651991000400008 -
11. Vieira SE, Stewien KE, Queiroz DA, Durigon EL, Török TJ, Anderson LJ, et al. Clinical patterns and seasonal trends in respiratory syncytial virus hospitalizations in São Paulo, Brazil. Rev Inst Med Trop S Paulo. 2001;43:125-31. https://doi.org/10.1590/s0036-46652001000300002
» https://doi.org/10.1590/s0036-46652001000300002 -
12. Freitas AR, Francisco PM, Donalisio MR. Mortality associated with influenza in tropics, state of São Paulo, Brazil, from 2002 to 2011: the pre-pandemic, pandemic, and post-pandemic periods. Influenza Res Treat. 2013;2013:696274. https://doi.org/10.1155/2013/696274
» https://doi.org/10.1155/2013/696274 -
13. Moura FE, Borges LC, Souza LS, Ribeiro DH, Siqueira MM, Ramos EA. Hospital study of acute respiratory infections in children of Northeast Brazil. J Bras Patol Med Lab. 2003;39:275-82. https://doi.org/10.1590/S1676-24442003000400003
» https://doi.org/10.1590/S1676-24442003000400003 -
14. Straliotto SM, Siqueira MM, Machado V, Maia TM. Respiratory viruses in the pediatric intensive care unit: prevalence and clinical aspects. Mem Inst Oswaldo Cruz. 2004;99:883-7. https://doi.org/10.1590/s0074-02762004000800017
» https://doi.org/10.1590/s0074-02762004000800017 - 15. Collier L, Oxford J, Kellam P. Human virology. Oxford: Oxford University Press; 2016.
- 16. Toma TS, Venancio SI, Martins PN, Sato HK. Uso profilático de palivizumabe na prevenção de infecção pelo vírus sincicial respiratório em crianças de alto risco. Boletim do Instituto de Saúde. 2013;14:213-20.
- 17. Franco J, Costa C, Queiroz AM, Dias Alves A, Virella D, Jorge A. Estimativa da eficiência do uso de Palivizumab na prevenção de hospitalizações por infecção por vírus sincicial respiratório numa coorte de prematuros. Repositórios Científicos de Acesso ABerto de Portugal. 2006;1:15-22.
- 18. Morettin PA, Toloi C. Análise de séries temporais. São Paulo: Blucher; 2006.
- 19. Vandaele W. Applied time series and Box-Jenkins models. New York: Academic Press; 1983.
- 20. Gottman JM. Time-series analysis: a comprehensive introduction for social scientists. Cambridge: Cambridge University Press; 1981.
-
21. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2020. [cited 2022 Jul. 26]. Available from: http://www.r-project.org/index.html
» http://www.r-project.org/index.html -
22. Machado JP, Martins ML, Leite IC. Quality of hospital databases in Brazil: some elements. Rev Bras Epidemiol. 2016;19:567-81. https://doi.org/10.1590/1980-5497201600030008
» https://doi.org/10.1590/1980-5497201600030008 -
23. Correia LO, Padilha BM, Vasconcelos SM. Methods for assessing the completeness of data in health information systems in Brazil: a systematic review. Cienc Saude Colet. 2014;19:4467-78. https://doi.org/10.1590/1413-812320141911.02822013
» https://doi.org/10.1590/1413-812320141911.02822013 -
24. Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann Statist. 2001;4:1165-88. https://doi.org/10.1214/aos/1013699998
» https://doi.org/10.1214/aos/1013699998 -
25. Bezerra PG, Britto MC, Correia JB, Duarte MC, Fonceca AM, Rose K, et al. Viral and atypical bacterial detection in acute respiratory infection in children under five years. PLoS One. 2011;6:e18928. https://doi.org/10.1371/journal.pone.0018928
» https://doi.org/10.1371/journal.pone.0018928
Publication Dates
-
Publication in this collection
13 Mar 2023 -
Date of issue
2023
History
-
Received
30 Aug 2021 -
Accepted
30 Jan 2022