Health profile differences between recipients and non-recipients of the Brazilian Income Transfer Program in a low-income populationAbstract:
We investigated the relationship between living in a household that receives the Brazilian Income Transfer Program (Bolsa Família, in Portuguese - BF), a Brazilian conditional cash transfer program, and aspects of health and whether these relationships are heterogeneous across the 27 Brazilian states. According to data from the 2013 Brazilian National Health Survey, 18% of households participated in BF. Among households with household per capita income below BRL 500, many aspects of health differed between people living in BF and non-BF houses. For example, BF households were less likely to have medical coverage but more likely to have visited the doctor in the last 12 months as well as being more likely to smoke and less likely to do exercise. They ate nearly one less serving of fruits and vegetables a week but were less likely to substitute junk food for a meal. They reported worse self-rated health but did not differ importantly on reporting illnesses. Moderate amounts of heterogeneity in the difference in health characteristics were found for some variables. For instance, medical coverage had an I2 value of 40.7% and the difference in coverage between BF and non-BF households ranged from -0.09 to -0.03. Some illnesses differed qualitatively across states such as high cholesterol, asthma and arthritis. This paper is the first to outline the health profile of people living in households receiving payments from a cash transfer program. It is also the first to find geographic heterogeneity in the relationship between a cash transfer program and health variables. These results suggest the possibility that the effect of cash transfer programs may differ based on the population on which it is implemented.
Keywords: Health Policy; Population Characteristics; Government Programs
Resumo:
Os autores investigaram a relação entre pertencimento a uma família beneficiária do programa Bolsa Família (BF) e características de saúde, e se tais relações são heterogêneas, comparando os 26 estados e Distrito Federal, Brasil. De acordo como dados da Pesquisa Nacional de Saúde de 2013, 18% dos domicílios brasileiros participavam do BF. Entre as famílias com renda per capita abaixo de R$ 500,00, havia diferenças entre diversas características de saúde, comparando pessoas de famílias beneficiárias e não beneficiárias do BF. Por exemplo, pessoas de famílias matriculadas no BF mostraram menor probabilidade de ter cobertura médica, mas maior probabilidade de haverem consultado um médico nos últimos 12 meses, além de maior probabilidade de serem fumantes e menor probabilidade de serem fisicamente ativas. Consumiam quase uma porção a menos de frutas e verduras por semana, mas tinham menor probabilidade de substituir refeições com lanches. Apresentavam pior percepção da própria saúde, mas não mostravam diferenças importantes no relato de doenças. Houve uma heterogeneidade moderada nas características de saúde em relação a algumas variáveis. Por exemplo, a cobertura de saúde mostrou um valor de I2 de 40,7%, enquanto a diferença de cobertura entre famílias com e sem BF variou entre 0,09 e -0,03. Houve diferenças qualitativas entre estados em relação a algumas doenças, tais como hipercolesterolemia, asma e artrite. Este estudo foi o primeiro a definir o perfil de saúde de pessoas em famílias beneficiárias do BF. Também é o primeiro a encontrar uma heterogeneidade geográfica na relação entre o programa e variáveis de saúde. Os resultados sugerem que o efeito de um programa de renda mínima pode variar de acordo com a população na qual é implementado.
Palavras-chave: Política de Saúde; Características da População; Programas Governamentais
Resumen:
Investigamos la relación entre vivir en un hogar que recibe ayudas del programa Bolsa Familia (BF), programa brasileño de transferencia monetaria condicionada, y aspectos de salud, además de estudiar si estas relaciones son heterogéneas entre los 27 estados brasileños. De acuerdo con los datos de 2013 en la Encuesta Nacional de Salud brasileña, un 18% de los hogares participaron en BF. Entre los hogares con unos ingresos per cápita por debajo de BRL 500, muchos aspectos de salud difirieron entre la gente que vivía en hogares con BF y sin BF. Por ejemplo, los hogares con BF fueron menos propensos a contar cobertura médica, pero era más probable que hubieran visitado al doctor en los últimos 12 meses, al igual que más probabilidad de fumar y menos propensos a hacer ejercicio. Comían frutas y verduras menos de casi una vez a la semana y eran menos propensos a sustituir la comida basura por una comida. Informaban de una peor salud autoevaluada, pero no difieren significativamente respecto a las enfermedades relatadas. Se encontraron algunas variables de heterogeneidad en cantidades moderadas, respecto a la diferencia en las características de salud. Por ejemplo, la cobertura médica tenía una cobertura con un valor I2 de 40,7% y la diferencia en la cobertura entre hogares con BF y no-BF oscilaba en un rango de -0.09 a -0.03. Algunas enfermedades se diferenciaban cualitativamente entre estados como el colesterol alto, asma y artritis. Este trabajo es el primero en resaltar el perfil de salud de la gente que vive en hogares que reciben pagos del programa brasileño de transferencia monetaria condicionada. Asimismo, es el primero en encontrar una heterogeneidad geográfica en la relación entre el programa brasileño de transferencia monetaria condicionada y variables de salud. Estos resultados sugieren la posibilidad de que el efecto del programa brasileño de transferencia monetaria condicionada puede ser diferente en función de la población en la que se implementa.
Palabras-clave: Política de Salud; Características de la Población; Programas de Gobierno
Introduction
In 2004, Brazil implemented a conditional cash transfer program (CCT) called Bolsa Família (BF; Brazilian Income Transfer Program). The program has grown to be the biggest in the world, paying over USD 9 billion to 14 million households in 2016 alone (Brazilian Comptroller General of the Union. http://www.portaltransparencia.gov.br, accessed on 14/Jan/2017). Most studies of BF have understandably focused on child health because the conditions of the program are targeted toward them. Little research has been conducted on adults. One study found that people receiving BF had a higher TB cure rate than those not receiving BF 1. An ecological study found that increased coverage by BF was associated with a decrease in leprosy detection rates 2. Another study examined the nutritional status in adults receiving BF but did not have a control group 3. To our knowledge, no other study has either investigated the effect of BF in adults or described how people receiving BF differ from non-BF recipients.
While the relationship between CCTs and child health has been well-studied, results have been inconsistent 4. Some results suggest a reduction in growth/nutritional status 5, some no difference 6 and some suggest an increase in growth/nutritional status 7. One possible explanation is that all these studies are estimating the same quantity but obtain different results due to the methods used and random variation. Though the methods employed and chance variation certainly influence all results, another explanation is that there is important geographic heterogeneity in the causal effect or association of BF with child growth. Therefore, studies in different settings are estimating different quantities. Effect heterogeneity could also partially explain the wide range of results found in a recent meta-analysis of the effect of different CCT programs on child growth in a number of different countries 4.
Brazil is well-suited for the investigation of geographic heterogeneity because its 27 states have stark differences in socioeconomic and demographic characteristics. For example, the state with the highest per capita gross domestic product 8 has a value higher than many European countries including Portugal and the Czech Republic, but the state with the lowest per capita gross domestic product is closer to Guatemala or Nigeria (World Bank. http://data.worldbank.org/indicator/NY.GDP.PCAP.CD, accessed on 24/Feb/2017). Brazil is not only economically but also racially diverse. In the northern region, about 80% of the population identify themself as black or mixed, while in the southern region, 80% identify themself as white (Brazilian Institute of Geography and Statistics - IBGE. http://www.ibge.gov.br/home/estatistica/populacao/condicaodevida/indicadoresminimos/sinteseindicsociais2016/default_tab_xls.shtm, accessed on 16/Dec/2016). Brazil’s three other regions fall somewhere in between.
The following description of BF is drawn from the law that established the BF 9 and the Brazilian Federal Savings Bank website (http://www.caixa.gov.br/programas-sociais/bolsa-familia/Paginas/default.aspx, accessed on 14/Jan/2017). In 2013, all households with a household per capita income (HPCI) below BRL 70 were eligible to receive a monthly BRL 70 payment, the unconditional component of BF. Households with children under 18 years with a HPCI below BRL 140 were also available for an additional payment as longs as the child met specific conditions. For every child under 16 years (to a maximum of five children) who attended yearly health check-ups, adhered to the vaccine schedule and maintained a school attendance of 85% or above, a monthly payment of BRL 32 was made. For every child of either 16 or 17 years (to a maximum of two children) who maintained a school attendance of 85% or above, a monthly payment of BRL 38 was made. For families who, after adding all BF payments to their income, still had a HPCI below BRL 70, a complementary payment was made to bring their HPCI up to BRL 70.
This manuscript has two main objectives. The first is to determine whether Brazilians receiving BF have a different health profile than Brazilians not receiving BF. This will provide policy makers more knowledge about the health status of BF recipients as well as provide knowledge about potential confounders for future researchers. The second objective is to see whether, given the socioeconomic and demographic heterogeneity seen across Brazil’s 27 states, there is corresponding geographic heterogeneity in the association between BF and health indicators across states. Evidence of this type of heterogeneity would suggest that research on BF in one part of Brazil may not be transportable to another part or that transportability would require conditioning on some ecological or compositional covariates. Furthermore, heterogeneity within Brazil would make it more difficult to use evidence on the effectiveness of a conditional cash transfer in one country to justify its implementation in another country.
Methods
Data source
We used data from the 2013 Brazilian National Health Survey (PNS, acronym in Portuguese). It was a household-based, national survey that interviewed 205,546 people in 64,348 households and included an extended interview with 60,202 people 10. The purpose of the survey was to get an overall picture of the multiple facets of Brazilians’ health, health-service use and medical care. It was conducted between August 2013 and February 2014 by trained fieldworkers. It was composed of 21 modules covering household and community characteristics, general health and socioeconomic characteristics of household members and more specific modules such as exposure to accidents and women’s health. The first two modules describe the household, the next nine modules are applied to every household member, and the last nine more specific health modules are applied to one household member above 18 years selected at random.
The sample was drawn from the Master Sample of the IBGE’ Integrated System of Household Surveys which is a sampling strategy used to ensure national representativeness 10. The sampling is conducted at three levels. At the first level, census sectors are selected through proportional probability by random sampling. Within each selected sector, a random sample of households is chosen. At this stage, all household members complete the nine modules asked of all household members. The last stage selected one household member at random to complete the extended survey.
BF definition
Though the survey specifically asked about household income received from BF, when the data were made public, this value was combined with the values from questions on “interest from savings accounts and other financial investments, dividends, social programs, unemployment insurance, secured insurance or other income?”. This created the difficulty of disentangling the values received from BF and from other sources in this combined variable. Firstly, we assumed that among poor Brazilians, very few would have payments from financial dividends. Secondly, the minimum monthly payout from unemployment insurance is the minimum wage (BRL 678), therefore we eliminated any values from the combined variable that were equal to or over that value. We downloaded a database of all the payments made by BF in July 2013 and found that 99.5% of the payments made were under BRL 500. We retained only values in the combined variable that matched payment amounts from the BF database and compared the resulting distribution to the distribution found in the BF databases. Lastly, we eliminated all payments of BRL 300 made in the PNS data to avoid misclassification with another cash transfer program, Garantia-Safra (GS; Crop-Guarantee), that paid farmers who lost crops to drought. We preferred to remove payments of this value because in the BF data from the national database BRL 300 payments accounted for 0.003% of all BF payments while GS made up 5% of all cash transfer payments by the Federal Government.
Measures
All variables except weight, height and body mass index (BMI) were obtained via questionnaire. Trained field employees that worked in the IBGE, administered the questionnaires and recorded the responses on a personal digital assistant 11. Nutritional questions regarding numbers of servings per week were measured by asking the respondents how many times a week they ate a specific food item and how often each day they ate it. An electronic scale was used to measure weight and a portable stadiometer was used to measure height. Education was classified as low for people with 9 years of school or less, medium for people with more than 9 years but less than or equal to 12 years of schooling and high for people with a higher degree to be consistent with the Brazilian education system 12.
Statistical analysis
The main statistics of interest were differences in health and health behaviors between households receiving BF and households not receiving BF as well as the heterogeneity between states in these measures. For the purposes of this analysis, only people who answered the extended survey were used because most variables of interest were only assessed in the extended interview. We estimated the prevalence of BF in every state to compare to the values reported by the government. In the main analysis the sample was restricted to households with a HPCI below BRL 500. Prevailing differences were estimated for binary outcomes and simple differences for count or continuous outcomes both crude and adjusted for basic demographic variables (sex, household per capita income, number of people living in the household, age, race, education and whether the household was in an urban or rural area). For binary outcomes, we estimated logistic regression models and subsequently calculated the difference in marginal predicted probabilities when setting those that received BF and those that did not receive BF, both in the entire country and in each state, where the covariates were set to their observed values. Rather than using these estimated differences, we chose to use empirical Bayes to shrink the estimates toward the grand mean. This introduces bias into the estimates but reduces the overall mean square error 13. For the count and continuous outcomes we repeated this procedure but with Poisson and linear regression, respectively. The degree of heterogeneity in the associations between the Brazilian states was quantified using Cochran’s Q 14 and I-squared statistics 15. In order to incorporate the complex sampling design used for the PNS and to get the appropriate standard errors, we used the survey package in R. All data analyses were performed in R (http://www.r-project.org). The code for running the entire analysis (including downloading the data) can be found at https://github.com/jerbreck/BF_hetereogeneity.
The data were publicly available and therefore their use did not require ethics approval.
Results
The PNS survey visited 81,357 households and found 11,363 (14%) to be unoccupied 11. Among occupied households, 64,348 (92%) agreed to the short questionnaire applied to all household members. After selection of a household member for the long questionnaire, 4,146 (6%) declined to answer the long questionnaire. The percentage of those that declined varied by state from 1% to 18%. Among occupied households, the response rate for the long questionnaire was 86%.
The distribution of the payments received from social programs was very similar to the distribution of payments made by BF (Figure 1). The three largest spikes in the histograms are at the same locations and have very similar relative magnitudes. Also, the tail of the distributions above BRL 150 are similar. A few notable differences between the distributions can be found between BRL 75-100 and BRL 175-200. The differences may be due to the rounding of payment amounts.
Histogram of distribution of the Brazilian Income Transfer Program (Bolsa Família - BF) payments as reported by respondents in the Brazilian National Health Survey (1a) and according to the Brazilian Transparency Portal (1b).
Table 1 shows the proportion of people receiving BF in different demographic and socioeconomic groups in households with a monthly per capita income below BRL 500. White Brazilians are nearly half as likely to live in a BF household as black or mixed race people. Around 40% of people between 18 and 30 years of age live in BF households but BF participation decreases strongly after 50 years likely because of a lack of children in the household and because Brazil offers a pension to all elderly who live in a household earning under one-quarter of the minimum monthly wage per capita. HPCI is also highly related to receiving BF although households with a reported HPCI below BRL 100 were less likely to receive BF than households between BRL 100-300. This demonstrates that either households are not reporting the same income to the PNS than they did to the Brazilian Ministry of Social Development or they are staying on BF even after their HPCI improves. BF participation increases monotonically with the number of people in the household. BF participation in rural areas is nearly the double of the participation in urban areas. Those with less than a high school degree were 8% more likely to be BF participants than those with a high school degree or higher.
According to data from the Brazilian Ministry of Social Development, 23% of households in Brazil participated in BF in 2016 (http://aplicacoes.mds.gov.br/sagi/RIv3/geral/index.php?relatorio=153&file=entrada, accessed on 02/Feb/2016). According to estimates derived from the 2013 PNS data, the participation rate was 18%. These differences may be due to the changing BF participation rates from 2013 to 2016.
Overall, the associations between living in a BF household and the health indicators investigated here tend to show they have poorer health indicators and behaviors (Table 2). In terms of medical services use, people living in households that receive BF were less likely to be hospitalized or to have seen a doctor in the previous year. However, when adjusted for basic demographic and socioeconomic variables, residents of BF households were more likely to have seen a doctor in the previous year. They were also less likely to have any type of private health insurance and more likely to have had contact with a community health worker. People from BF households were approximately a half-centimeter shorter and had an equal or higher BMI than people from non-BF households. People from BF households also had riskier health behaviors being slightly more likely to smoke and less likely to exercise compared to non-recipients of BF. Nutritionally, people from BF households ate one less serving of fruits and vegetables per week but were also less likely to report substituting junk food for a meal. With regard to health problems, no large differences emerged between people from BF and non-BF households with the exception of self-rated health where they were 4% less likely to say their health was good or very good.
Next, we examined the heterogeneity in associations between states. Brazil has 27 states that differ markedly in their economic situation, demographics and medical systems. These differences can be seen in the heterogeneity between states in health indicators (Table 3). The association between being from a BF household and both private health insurance and having visited a community health worked both has an I-squared value above 40% indicating that between state variation accounted for over 40% of the overall variance. This can be seen in the difference between the state with the lowest difference and high difference in Table 3. For example, being from a BF household was not related to whether someone had had contact with a community health worker in Sergipe; in Acre however, people from BF households were 13% more likely to have had contact with a community health worker. Only small differences were seen between states with regard to hospitalization and having visited a doctor in the previous 12 months. Differences in both height and weight showed moderate heterogeneity across states as well ranged from large negative differences to positive differences. Very little heterogeneity existed between states when considering health behaviors. Exercise had the highest I-squared value; however, in absolute terms, the difference between the lowest and highest state was only 3%. Nutrition also did not show much heterogeneity. Of interest, although not many differences were observed by BF status for health problems when all the data was pooled, there was moderate to large amounts of heterogeneity by state. The most important heterogeneity was found for high cholesterol, in which the variability between states was 63% of the total variability. This heterogeneity can be seen in the difference between Mato Grosso, where people from BF households were 10% more likely to have been diagnosed with high cholesterol, and Pernambuco, where people from BF households were 3% more likely to be diagnosed with high cholesterol. Strong heterogeneity such as this was found for diabetes, asthma, arthritis, mental illness, cancer and having any type of handicap. Although the differences reported between the lowest and highest difference states for mental illness and cancer seem small, the small risk differences still exhibit moderate heterogeneity.
Lastly, we inspected the state-by-state differences in four variables with high I-squared values to assess whether these were similar between states (Figure 2). There did not appear to be a strong overall pattern demonstrating that the four selected variables showed similar patterns between states. In all states, private health insurance was lower among people receiving BF. In two states, Amazonas and São Paulo, the differences between people from BF households and non-BF households were negative for all variables. There were no states where the pattern of differences between BF households and non-BF households went in different directions across variables. Also of note, we saw no geographical pattern in the data. That is, there was no apparent similarity within states that were close geographically.
Difference between households receiving and those not receiving payments from the Brazilian Income Transfer Program (Bolsa Família - BF) in four variables that demonstrated moderate to large heterogeneity between states.
Discussion
We found that the association between BF status and many health indicators did not indicate that people receiving BF, or living in households that receive BF, had universally worse health indicators. People with BF had much lower rates of health insurance but were simultaneously more likely to have visited a doctor in the previous 12 months, suggesting that this lack of coverage was not preventing them from accessing health services. The increased frequency with which people with BF visit the doctor could indicate that they have more health problems than non-BF people but when examining health problems, despite people with BF reporting worse self-rated health, they do not report higher rates of any important health problem. In fact, they report lower rates for most conditions.
We also observed moderate to large heterogeneity across Brazilian states in health services use, anthropometrics and health problems. This heterogeneity is seen both in the I-squared statistics and in the magnitude of the difference when comparing states at the extremes of the distributions. For a number of health problems such as diabetes, high cholesterol, asthma, arthritis and having a handicap, there was a qualitative difference between some states; meaning that in some states the BF recipients had higher rates of these health problems and lower rates in other states. This may be because different types of people are either targeted for receiving BF or different types of people are self-selected to receive BF.
This study was the first to examine general health characteristics in terms of medical services use, anthropometrics, health behaviors, nutrition and health problems of people who live in the households that receive BF. This information will benefit policy makers by showing which aspects of their health lack the most among families who receive BF. This study is also the only one that describes whether the relationships between receiving BF and health differ from state to state. This has many important consequences. Firstly, knowledge of which states are doing particularly poorly on certain indicators can be used to target BF households with certain additional programs. Many Brazilian states already have programs that offer BF recipients additional cash transfers or programs. These programs could incorporate state-level knowledge of health issues among BF recipients that need to be addressed. For instance, in the state of Mato Grosso do Sul, BF households had a higher BMI and ate one less serving of fruits and vegetables per week. The state has its own cash transfer program that targets poor families, including BF recipients, whose HPCI still falls under half a minimum wage per capita even after receiving money from BF. The state may consider targeting these groups with nutritional education as well as additional cash transfer. Another example is the state of Goiás whose BF recipients were 1.8% more likely to smoke and 3.4% less likely to do exercise. Similar to the previous example, the state could consider additional programs that target health behaviors of BF recipients.
A second important consequence of the heterogeneity between states is that it lends support to the idea that the effects of a cash transfer are sensitive to the setting in which they are implemented. Although only associations were estimated in this study, not causal effects, we demonstrate that there are important differences in the health indicators of people who receive cash transfer within one country. Given that many important health characteristics of participating households, health services use and health problems in particular, differ from state to state, causal effects of the same policy may also differ from the state to state. This has important policy implications as this type of heterogeneity makes it difficult to apply the results from one population to another population.
The most important limitation of our study was the misclassification of BF participation. Although BF status as well as money received from BF was included as a separate question in the survey, when the data were released by the IBGE, this variable was combined with other variables regarding the money received from financial dividends, other social programs and other income sources. While some amount of misclassification is inevitable, we took careful steps to eliminate as much misclassification as possible and to verify that the resulting distribution of payments from the combined variable resembled the distribution observed from the actual BF data. Any misclassification that occurred was most likely misclassification with other cash transfer programs. At the federal level, only two other cash transfers exist. We eliminated one, GS program, by removing BRL 300 payments. The second is a program to prevent child labor and makes up less than 0.1% of all cash transfer payments in Brazil and therefore is unlikely to influence the results (http://downloads.ibge.gov.br/downloads_estatisticas.htm, accessed on 09/Jan/2017). Some states offer their own cash transfer programs either as a complement to BF or as a target to other disadvantaged groups not covered by BF. In our study, people receiving money from these programs would have been classified as BF as well. Because most of these programs share a lot of similarities with BF, classifying people receiving these benefits as having received BF is unlikely to have an appreciable impact on the results. Alternatively, this group could simply be considered as “exposed to a cash transfer”.
Conclusion
In conclusion, we observed heterogeneity between Brazilian states indicating important differences in use of health services, anthropometrics and illnesses among households that earn less than BRL 500 per month. The possibility of heterogeneous effects of social programs should therefore be taken into consideration in future research.
Acknowledgments
We would like to thank Dr. Djalma Pessoa and Anthony Damico for the creation of the R package, which greatly facilitated the analysis of PNS data. We also thank the Canadian Institutes for Health Research through the Frederick Banting and Charles Best Canada Graduate Scholarship, for the financial support.
References
- 1 Torrens AW, Rasella D, Boccia D, Maciel EL, Nery JS, Olson ZD, et al. Effectiveness of a conditional cash transfer programme on TB cure rate: a retrospective cohort study in Brazil. Trans R Soc Trop Med Hyg 2016; 110:199-206.
- 2 Nery JS, Pereira SM, Rasella D, Penna ML, Aquino R, Rodrigues LC, et al. Effect of the Brazilian conditional cash transfer and primary health care programs on the new case detection rate of leprosy. PLoS Negl Trop Dis 2014; 8:e3357.
- 3 de Lima FEL, Rabito EI, Dias MRMG. Nutritional status of the adult population in the Bolsa Família Program in Curitiba, State of Paraná, Brazil. Rev Bras Epidemiol 2011; 14:198-206.
- 4 Manley J, Gitter S, Slavchevska V. How effective are cash transfers at improving nutritional status? World Dev 2013; 48:133-55.
- 5 Morris SS, Olinto P, Flores R, Nilson EA, Figueiró AC. Conditional cash transfers are associated with a small reduction in the rate of weight gain of preschool children in northeast Brazil. J Nutr 2004; 134:2336-41.
- 6 Fernald LCH, Hidrobo M. Effect of Ecuador's cash transfer program (Bono de Desarrollo Humano) on child development in infants and toddlers: a randomized effectiveness trial. Soc Sci Med 2011; 72:1437-46.
- 7 Paes-Sousa R, Santos LMP, Miazaki ÉS. Effects of a conditional cash transfer programme on child nutrition in Brazil. Bull World Health Organ 2011; 89:496-503.
-
8 Instituto Brasileiro de Geografia e Estatística. Contas regionais 2014: cinco estados responderam por quase dois terços do PIB do país. https://agenciadenoticias.ibge.gov.br/agencia-sala-de-imprensa/2013-agencia-de-noticias/releases/9460-contas-regionais-2014-cinco-estados-responderam-por-quase-dois-tercos-do-pib-do-pais (accessed on 24/Nov/2016).
» https://agenciadenoticias.ibge.gov.br/agencia-sala-de-imprensa/2013-agencia-de-noticias/releases/9460-contas-regionais-2014-cinco-estados-responderam-por-quase-dois-tercos-do-pib-do-pais - 9 Brasil. Decreto nº 5.209, de 17 de setembro de 2004. Regulamenta a Lei nº 10.836, de 9 de janeiro de 2004, que cria o Programa Bolsa Família, e dá outras providências. Diário Oficial da União 2004; 20 sep.
- 10 Souza-Júnior PRB, Freitas MPS, Antonaci GA, Szwarcwald CL. Desenho da amostra da Pesquisa Nacional de Saúde 2013. Epidemiol Serv Saúde 2015; 24:207-16.
- 11 Szwarcwald CL, Malta DC, Pereira CA, Vieira MLFP, Conde WL, Souza Júnior PRB, et al. Pesquisa Nacional de Saúde no Brasil: concepção e metodologia de aplicação. Ciênc Saúde Colet 2014; 19:333-42.
-
12 Brasil. Saiba como é a divisão do sistema de educação brasileiro. http://www.brasil.gov.br/educacao/2014/05/saiba-como-e-a-divisao-do-sistema-de-educacao-brasileiro/view (accessed on 14/Jan/2017).
» http://www.brasil.gov.br/educacao/2014/05/saiba-como-e-a-divisao-do-sistema-de-educacao-brasileiro/view - 13 Efron B, Morris C. Stein's paradox in statistics. Sci Am 1977; 236:119-27.
- 14 Cochran WG. The combination of estimates from different experiments. Biometrics 1954; 10:101-29.
- 15 Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002; 21:1539-58.
Publication Dates
-
Publication in this collection
04 July 2019 -
Date of issue
2019
History
-
Received
20 July 2018 -
Reviewed
18 Jan 2019 -
Accepted
31 Jan 2019
