Calibration of the dietary data obtained from the Brazilian center of the Natural History of HPV Infection in Men study: the HIM Study

Calibração dos dados dietéticos obtidos no centro Brasileiro do estudo Natural History of HPV Infection in Men: o Estudo HIM

ARTICLE ARTIGO

Calibration of the dietary data obtained from the Brazilian center of the Natural History of HPV Infection in Men study: the HIM Study

Calibração dos dados dietéticos obtidos no centro Brasileiro do estudo Natural History of HPV Infection in Men: o Estudo HIM

Juliana Araujo Teixeira^I; Maria Luiza Baggio^II; Regina Mara Fisberg^I; Dirce Maria Lobo Marchioni^I

^IFaculdade de Saúde Pública, Universidade de São Paulo, São Paulo, Brasil

^IIInstituto Ludwig de Pesquisa sobre o Câncer, São Paulo, Brasil

^{Correspondence}

ABSTRACT

The objective of this study was to estimate the regressions calibration for the dietary data that were measured using the quantitative food frequency questionnaire (QFFQ) in the Natural History of HPV Infection in Men: the HIM Study in Brazil. A sample of 98 individuals from the HIM study answered one QFFQ and three 24-hour recalls (24HR) at interviews. The calibration was performed using linear regression analysis in which the 24HR was the dependent variable and the QFFQ was the independent variable. Age, body mass index, physical activity, income and schooling were used as adjustment variables in the models. The geometric means between the 24HR and the calibration-corrected QFFQ were statistically equal. The dispersion graphs between the instruments demonstrate increased correlation after making the correction, although there is greater dispersion of the points with worse explanatory power of the models. Identification of the regressions calibration for the dietary data of the HIM study will make it possible to estimate the effect of the diet on HPV infection, corrected for the measurement error of the QFFQ.

Diety Surveys; Questionnaires; Cohort Studies

RESUMO

O objetivo foi estimar as regressões de calibração dos dados dietéticos mensurados pelo questionário quantitativo de freqüência alimentar (QQFA) utilizado no Natural History of HPV Infection in Men: o Estudo HIM. Uma amostra de 98 indivíduos do estudo HIM respondeu, por meio de entrevista, a um QQFA e três recordatórios de 24 horas (R24h). A calibração foi feita por meio de análise de regressão linear, tendo os R24h como variável dependente e o QQFA como variável independente. Idade, índice de massa corporal, atividade física, renda e escolaridade foram utilizadas como variáveis de ajuste nos modelos. As médias geométricas dos R24h e do QQFA corrigido pela calibração são estatisticamente iguais. Os gráficos de dispersão entre os instrumentos demonstraram aumento da correlação após a correção dos dados, porém observa-se maior dispersão dos pontos de acordo com a piora do poder explicativo dos modelos. A identificação das regressões de calibração dos dados dietéticos do estudo HIM permitirá a estimativa do efeito da dieta sobre a infecção por HPV, corrigida pelo erro de medida do QQFA.

Inquéritos sobre Dietas; Questionários; Estudos de Coorte

Introduction

Quantitative food frequency questionnaires (QFFQ) are one of the most commonly used methods for evaluating habitual dietary intake in large-scale epidemiological studies, given their low cost and ease of application ^1,2. However, the errors present in the measurements of the questionnaire may attenuate the estimates of the relative risks that are found, and thus diminish the statistical power of studies evaluating the relationship between diet and disease ^2,3.

Knowing that error is inherent in food intake measurements, methodological strategies have been developed in an attempt to make the measurements obtained through the QFFQ closer to the quantities actually consumed, which are estimated through reference methods that are supposedly error-free ^4,5. This methodology is called calibration and it basically can be seen as a scale adjustment to the questionnaire measurements ⁶. Among parametric methods, calibration by means of linear regression is considered to be the standard ⁷. Through this methodology, the consumption measured using the reference method is modeled as a function of the QFFQ measurement ^3,7. The linear regression models obtained through calibration studies can be used to estimate food intake that is closer to reality, taking the QFFQ values as the basis ⁸.

Twenty-four-hours recall (24HR) is the primary instrument used in dietary surveillance ⁹ and is commonly used as the reference method in calibration studies. When it is assumed that the random errors in the questionnaire and in the reference method are independent from each other [Cov(ε_R,ε_Q) = 0], it is not expected that the errors in the reference method will cause erroneous estimates for calibration coefficients ¹⁰. However, studies have shown that energy intake on these self-reported instruments is underreported and this fact appears to be selective according to personal characteristics ^9,11,12,13.

The Natural History of HPV Infection in Men study (the HIM Study) is a prospective multicenter cohort study that analyzes, among other factors, participants' diets by seeking to identify nutrients and/or foods that are involved in the evolution of human papillomavirus (HPV) infection in men and in the development of diseases related to HPV. The QFFQ was the method chosen for measuring the food intake of the Brazilian population of the HIM study.

This study aimed to estimate the regressions calibration for the QFFQ used in the HIM study in Brazil through multiple linear regression models, taking three 24HR as the reference. As part of the objective, the effect of calibration was verified by comparing the calibrated data of QFFQ with the reference method.

Methods

Study population

The design of the HIM study, funded by the National Institutes of Health (NIH), was presented in a more detailed manner in a previous paper ¹⁴. For the HIM study, conducted from 2005 to 2013, around 1,427 men from Tampa, USA; 1,429 from Cuernavaca, Mexico and 1,443 from São Paulo, Brazil, aged between 18 and 70 years were selected using convenience sampling.

Out of the 153 participants who performed the visit between January and September 2007 for the Brazilian cohort, the first 120 individuals who agreed to participate in the calibration study comprised the sub-sample. Individuals with energy consumption less than 500kcal or greater than 4,000kcal were excluded and thus 98 men were included in the sub-sample for the calibration study ¹⁶.

Assessment of food consumption

The sub-sample answered one 24HR and one QFFQ in the baseline. After six months another 24HR and QFFQ was answered. One year later than the first interview the participants answered a last 24HR and QFFQ, all of them by personal interview. This study used three 24HR and the last QFFQ. The dietary methods were completed on the same day, the QFFQ first and then the 24HR ¹⁷. The interviews last for approximately 35-45 minutes per person. For each dietary method, a manual of standardized procedures was developed.

• QFFQ: test method

The methodology for developing the QFFQ that was used in the HIM study in Brazil is available in a previously published paper ¹⁸. This questionnaire was developed based on the dietary intake of a representative sample in the city of São Paulo that had been identified in a population-base study ¹⁹. In the HIM study in Brazil, the questionnaires were answered during an interview and, for each of the 54 food items listed, the participants indicated their frequency of consumption (from 0-10 times a day, week, month or year) and the portion consumed (small, medium, large or extra large). A spreadsheet containing the nutritional composition of each food item, created using the Nutrition Data System for Research (NDSR) software, 2007 version (University of Minnesota, Minneapolis, USA), was used for calculating the energy and nutrient intake.

• 24HR: reference method

The three 24HR were answered by means of face-to-face interviews, using a standard form that was filled out using the multiple-pass method ^20,21. This method consists of three elements: rapid listing, detailed description and review. In the HIM study in Brazil, the subjects were asked to describe all the foods and drinks consumed during the preceding day, from the first to the last item consumed before going to bed. After the foods consumed had been reported, the subjects were asked about the times and quantities. The data were critically reviewed by a nutritionist and undergraduate nutrition students in order to identify any discrepancies related to the descriptions of the foods or preparations consumed, or their portioning and quantification. The energy and nutrient intakes were calculated using the NDSR software. The distribution of the consumption was adjusted for within-person variability (deattenuation) by means of the method proposed by Iowa State University, using the PC-SIDE software (personal computer version of the Software for Intake Distribution Estimation, version 1.0, Department of Statistics, Iowa State University, Ames, USA).

Variables tested in the linear regression models

It is well accepted that some personal characteristics have influence in the report of dietary intake ^9,11,12,13. In this study there was an attempt to minimize these effects with the inclusion of socio-demographic variables in the models. The variables tested as adjustments in the multiple linear regression models that were developed for energy and each of the nutrients were: body mass index (BMI; calculated as the weight in kilograms divided by the square of the height in meters); age (years); income, schooling and physical activity (categorized).

BMI and age were tested in the regression models as continuous quantitative variables. Income and schooling were transformed into dichotomous variables. Income was categorized as "0" when the total family income was less than $ 1,608 and "1" when greater than or equal to this value. The variable schooling was categorized as "0" when the participant had less than 12 years of study and "1" when greater than or equal to this value.

The study participants answered the International Physical Activity Questionnaire (IPAQ; short version) ²². From the data thus obtained, they were classified as "sedentary", "insufficiently active B", "insufficiently active A", "active" or "very active" ²³.

To the physical activity variable were created two dummy variables. Physical activity I representing the active level of physical activity in relation to sedentary/insufficiently active A and B and physical activity II representing the very active level of physical activity in relation to sedentary/insufficiently active A and B.

Statistical analysis

• Linear regression models

The data on the nutrients measured by the QFFQ and 24HR were transformed into natural logarithms and adjustments for energy were made using the residuals method ²⁴.

Taking to be the independent random errors presented by the QFFQ measurements (Q) and assuming a linear relationship between the questionnaire measurements and the true intake levels (24HR), an estimate was made for the intake level predicted by the reference measurement in relation to the measurement QFFQ (E[R|Q]), in which R was the dependent variable (Y) and Q was the independent variable (X) ¹⁰.

, which is the slope of the straight line estimated from the regression analysis, is called the calibration coefficient and is known as λ. The literature suggests that calibration using linear regression models should be done with adjustments for possible variables (C_i) that would influence the R measurements ^9,11,12,13.

In this study, the variables of BMI, age, income, schooling and physical activity were selected to be tested in the multiple models. For energy and each nutrient within the R measurement, univariate linear regression analysis was performed and, from the above variables, the ones that presented p < 0.20 in the multiple models were selected. Next, a regression function between the R and Q measurements was produced and the selected variables were included in multiple models.

Interactions between the variables that remained in the final model were tested, but no significant interaction was observed. The assumed linear relationship between the variables was evaluated by means of the graphs on the residuals, and these showed that the models were adequate.

The QFFQ data were calibrated using the equations estimated from the regression analyses. The geometric means and respective 95% confidence intervals (95%CI) were calculated for the QFFQ data after adjustment for energy and after calibration. Likewise, they were calculated for the 24HR after deattenuation and adjustment for energy. The Mann-Whitney U test was used to identify differences between the means of the 24HR and of the QFFQ calibrated and non-calibrated.

Dispersion graphs between the 24HR and QFFQ measurements corrected by the calibration were produced in order to assess whether there was any increase in the correlation between the instruments, with regard to protein, thiamin and phosphorous. These nutrients were chosen because of the increase in statistical power observed with the inclusion of adjustment variables in the multiple models used for the calibration.

P values < 0.05 were considered statistically significant, and all analyses were performed using the Stata software release 10 (Stata Corp., College Station, USA).

Ethical issues

This study was approved by the Research Ethics Committees of the Reference and Training Center in Sexually Transmitted Diseases and in Acquired Immune Deficiency Syndrome (CRT-DST/AIDS) and of the School of Public Health of the University of São Paulo. Participation in the study was conditional on signing the free and informed consent statement.

Results

Representativeness and characterization of the sample

The participants in the calibration study presented characteristics that resembled those of the participants in the Brazilian cohort. There were no differences between the groups regarding age. Within the subsample, the mean age was 35.8 ± 10.0 years, compared with 37.7 ± 11.9 for the sample of the whole cohort (p = 0.27). The BMI was similar between the groups, with a mean of 25.6 ± 4.4kg/m² for the subsample and a mean of 26.1 ± 3.6kg/m² for the whole cohort (p = 0.10). The participants in the subsample and whole cohort presented equivalent schooling and income levels (p = 0.84 and p = 0.54, respectively). This group had a mean BMI indicating overweight and most had attended school for more than 12 years and had a family income of between R$ 1,001 and R$ 3,000 (between US$ 543 and US$ 1,627) per month. In relation to levels of physical activity, 52.2% of participants were considered active, 33.7% sedentary, insufficiently active B or A, and 14.1% very active.

Calibration of the nutrient intake data

The regression coefficients (), in simple linear regression analysis, ranged from 0.06 for total fat to 0.45 for fiber. In the regressions calibration, the variable of income was the one associated with the greatest number of nutrients, followed by physical activity and age. The power of the multiple models (R²a) ranged from 0.02 for monounsaturated and polyunsaturated fat to 0.33 for phosphorous and these models presented better explanatory power in relation to simple analyses (Table 1).

The geometric means and 95%CI for energy and nutrients measured using 24HR and QFFQ are presented in Table 2. Comparing the data from the 24HR (deattenuated and adjusted for energy) with the data from the QFFQ (adjusted for energy), the means are statistically equal for saturated fat, trans fat, cholesterol, vitamin C and calcium. The geometric means for the deattenuated and energy-adjusted 24HR measurements and for the calibration-corrected QFFQ measurements were statistically equal for energy and all the nutrients studied.

The dispersion graphs (Figure 1) between the QFFQ and 24HR values demonstrate increased correlation between the instruments after making the correction for the data calibration, although there is greater dispersion of the points with worse explanatory power of the multiple linear regression models (R²a).

Discussion

The HIM study is the first cohort study in Brazil for which regressions calibration were calculated to enable correction of the estimated effect measurements. Although there is debate in the current literature regarding the performance of the food frequency questionnaire ^25,26,27, thereby indicating that calibration studies are needed, studies using calibration methodology are not common. The stimulus for conducting calibration studies is that they generate deattenuation factors for the relative risk (RR) estimates that are found in studies evaluating the relationship between diet and disease ²⁵, particularly in the case of questionnaires that have been developed and are being used for the first time, as is the case of the Brazilian QFFQ of the HIM study ²⁸.

The models for calibrating the QFFQ for use in the HIM study in Brazil were estimated by means of multiple linear regression, in which regression was performed on three 24HR as a function of QFFQ and specific adjustment variable for each nutrient. According to Rosner et al. ³, the ideal would be for the intercepts (β₀) to be close to zero and for the straight-line slope (β₁) to be close to one, in order to be able to affirm that bias was absent from the questionnaire. Since bias is known to be present in the questionnaire, the straight-line slope of the regression is, in practice, less than one. It was observed that the slopes of the straight lines estimated by the simple linear regression in the Brazilian HIM study were between 0.06 for total fat and 0.45 for fibers. Similar intercept values were observed by other authors in international cohort studies, in relation to calcium, iron and fiber, although for the other nutrients, the values obtained in these studies were closer to one. In the European Prospective Investigation into Cancer and Nutrition (EPIC), the values of the calibration coefficients ranged from 0.30 to 0.59 for Swiss men and from 0.23 to 0.56 for Norwegian women, for the same nutrients investigated ^{29, 30}. Direct comparison of the data obtained in calibration studies such as the current study on the QFFQ for the HIM study in Brazil, with data from previous investigations, should be done cautiously because of the variations in the data analysis methodology. The EPIC studies cited above used the same instrument as the reference method (24HR), but the number of repetitions, the sample sizes and the nature of the population groups differed ^29,30,31.

The models obtained in the multiple regression analyses can be applied to correct the RR obtained in the main study ³². The observed attenuation of the regression coefficients values (β₁) may have been a reflection of the presence of random errors in the QFFQ measurements used in the HIM study in Brazil ³³. This attenuation may also have occurred through violation of the theoretical assumptions of the calibration method ¹⁶. For the calibration coefficients, considered in this study as the regressions calibration (the complete model), to provide a valid correction of the relative risk estimates, it needs to be assumed that the errors in the reference method (in this case, 24HR) and in the QFFQ are not correlated ^3,29,32,34. However, the errors in the two instruments probably do have a positive correlation, and this causes diminishment of the correlation coefficients ²⁹. To estimate the regressions calibration in the HIM study in Brazil, data from the 24HR and QFFQ were used with adjustments for energy as a means of reducing the correlation between the errors ^16,29.

When there is a strong correlation between the consumption of a nutrient and energy, the true relationship between this nutrient and a given disease cannot be identified from analysis of the results obtained ³⁵. The adjustment for energy is made with the aim of estimating the consumed quantity of a specific nutrient, independent of the quantity of energy consumed. As expected, after adjustment for energy in the present study, it was observed that there was no change in the geometric mean consumption: only the confidence interval decreased, thereby suggesting that the precision in estimating the value increased (data not presented).

The method used as the reference for calibrating the QFFQ for the HIM study in Brazil has the characteristic of high within-person variability, because of the unstable nature of individuals' diets. Nonetheless, it is commonly used in this type of study ¹⁰. The variability may be diminished through increasing the number of repetitions of the reference method and the sample size ^10,36. One precaution taken in the present calibration study was to make the measurements of the reference method as close as possible to the habitual intake, before including them in the model. By using the 24HR three times, it was possible to adjust the energy and nutrient consumption for the within-person variability. These adjustments were made in an attempt to minimize the errors through correcting for the distribution of the consumption. The method used for this adjustment has been indicated as one of the most efficient methods for estimating habitual intake ³⁷. Therefore, it was assumed that the number of repetitions of the 24HR that were performed, together with the deattenuation of the data, was sufficient to diminish the within-person variation.

Some studies have shown that personal and socioeconomic characteristics have an influence on food consumption reports. Underreporting has been shown to be more prevalent among women, rather than men and seems to be more common among older people than among younger. Overweight is also associated with underreporting ^9,38,39,40 as well as year of study and education appear to be independent predictors of underreporting ³⁸. When comparing underreporters with those people with report accurately, underreporters tend to report being less physically active ⁴⁰. Because of these factors it was decided to test and include adjustment variables in the multiple linear regressions, thereby enabling better estimates of the regression calibration and increasing the explanatory power of the models ^41,42,43,44. One example can be given by the correction of the protein consumption data of the QFFQ through the calibration: the simple linear regression between the deattenuated 24HR data and the energy-adjusted QFFQ data produced an estimated regression coefficient of 0.15 (95%CI: 0.04-0.26), with an explanatory power for the model of 0.07 (R²). When other variables were included the power of the model increased to 0.24 (R²a). When the equation from multiple regression on the QFFQ data was applied, it was seen from the dispersion graph that a clear adjustment of the data had occurred in relation to the 24HR. The inclusion of other variables in the model made it possible for the QFFQ values to be brought close to those of the reference model, thereby indicating the importance of evaluating the model in its entirety, in interpreting the data, and not just the regression coefficients or calibration factors. However, the explanatory power of the models was not presented in other calibration studies, which made comparisons impossible.

Both for energy and for all the nutrients evaluated, the confidence interval of the QFFQ data decreased after the correction according to the calibration, while statistical differences between calibrated data and data from the reference method disappear. Just as in studies in other countries, the same behavior in relation to standard deviations was described in a study on adolescents in Brazil ^45,46,47. This adjustment of the distribution occurred through correction of the classification errors among individuals. Extreme values were especially affected because this was a linear regression to which the instruments were subjected ⁵.

A limitation that can be pointed is that the sample of the calibration study was selected by convenience. The principal problem of this kind of sampling is that it can lead to a group that is not representative of the population under study. The representativeness of the sub-sample was tested and the participants of the calibration study represent the population of the HIM study as they do not show statistical differences regarding age, body mass index, education and income.

The use of dietary data generated by the QFFQ in epidemiological studies without any type of correction may explain the conflicting results or inconsistencies presented in some of them ^3,16, including studies that evaluated the influence of diet on the process of infection by HPV and the development of lesions relating to the virus. However, after correction of QFFQ data based on linear regression analyses in which the reference method is as much based on reports as the QFFQ is, and is subject to similar errors, the relative risks may be biased ^48,49. Biomarkers can be used to make consumption measurements more accurate and consequently also the relative risk estimates. However, only a limited number of biomarkers are known and, even so, their use in large-scale studies is not viable because of the high costs involved ⁵⁰. In any event, the use of reference methods based on reports for calibrating dietary data is still more attractive than using the crude data in studies that evaluate the relationship between diet and disease ³².

Conclusion

In the present study, the results from the calibration of the QFFQ that was used in the HIM study in Brazil were presented. The minimization of the measurement errors through correcting the data according to the calibration was expected. However, to analyze the relationships between dietary factors and the history of HPV infection in men, data with and without correction by the calibration should be used comparatively.

Contributors

J. A. Teixeira participated in the analysis and interpretation of the data, and in the write up of the article. M. L. Baggio collaborated on the project and conception of the article. R. M. Fisberg contributed towards the project and article conception and approved the final version for publication. D. M. L. Marchioni also participated in the project and article conception, data interpretation and critical review of the relevant content.

Acknowledgments

We are grateful to the principal investigator from the Natural History of HPV Infection in Men: the HIM Study, Anna Giuliano, and to the co-investigator Luisa Lina Villa for making available the data, as well as making important contributions. We wish to thank the Reference Center in STD/AIDS where the data were collected. We would also like to thank Lenice Galan, Filomena Cernicchiaro, Vera L. Souza, Elisa Brito, Birgit Fietzek, Raquel Hessel, Keny Seiji Kawamura, Bruna Lourenço Januario e Uerá Chechia for their contribution in the data collection and data input.

Submitted on 10/Sep/2009

Final version resubmitted on 10/May/2010

Approved on 21/May/2010

• 1. Bingham SA, Luben R, Welch A, Wareham N, Khaw K, Day N. Are imprecise methods obscuring a relation between fat and breast cancer? Lancet 2003; 362:212-4.
• 2. Kaaks R, Ferrari P. Dietary intake assessment in epidemiology: can we know what we are measuring? Ann Epidemiol 2006; 16:377-80.
• 3. Rosner B, Willett WC, Spiegelman D. Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Stat Med 1989; 8:1051-69.
• 4. Beaton GH. Approaches to analysis of dietary data: relationship between planned analyses and choice of methodology. Am J Clin Nutr 1994; 59 (1 Suppl):253S-61S.
• 5. Kynast-Wolf G, Becker N, Kroke A, Brandstetter BR, Wahrendorf J, Boeing H. Linear regression calibration: theoretical framework and empirical results in EPIC, Germany. Ann Nutr Metab 2002; 46:2-8.
• 6. Riboli E, Kaaks R. Invited commentary: the challenge of multi-center cohort studies in the search for diet and cancer links. Am J Epidemiol 2000; 151:371-4.
• 7. Stram DO, Hankin JH, Wilkens LR, Pike MC, Monroe KR, Park S, et al. Calibration of the dietary questionnaire for a multiethnic cohort in Hawaii and Los Angeles. Am J Epidemiol 2000; 151:358-70.
• 8. Ferrari P, Day NE, Boshuizen HC, Roddmam A, Hoffmann K, Thiébaut A, et al. The evaluation of the diet/disease relation in the EPIC study: considerations for the calibration and the disease models. Int J Epidemiol 2008; 37:368-78.
• 9. Tooze JA, Subar AF, Thompson FE, Troiano R, Schatzkin A, Kipnis V. Psychosocial predictors of energy underreporting in a large doubly labeled water study. Am J Clin Nutr 2004; 79:795-804.
• 10. Kaaks R, Riboli E. Validation and calibration of dietary intake measurements in the EPIC project: methodological considerations. European Prospective Investigation into Cancer and Nutrition. Int J Epidemiol 1997; 26 Suppl 1:S15-25.
• 11. Macdiarmid J, Blundell J. Assessing dietary intake: who, what and why of under-reporting. Nutr Res Rev 1998; 11:231-53.
• 12. Hill RJ, Davies PS. The validity of self-reported energy intake as determined using the doubly labelled water technique. Br J Nutr 2001; 85:415-30.
• 13. Trabulsi J, Schoeller DA. Evaluation of dietary assessment instruments against doubly labeled water, a biomarker of habitual energy intake. Am J Physiol Endocrinol Metab 2001; 281:E891-9.
• 14. Giuliano AR, Lazcano-Ponce E, Villa LL, Flores R, Salmeron J, Lee JH, et al. The human papillomavirus infection in men study: human papillomavirus prevalence and typo distribution among men residing in Brazil, Mexico, and United States. Cancer Epidemiol Biomarkers Prev 2008; 17:2036-43.
• ¹⁵
  Instituto Brasileiro de Geografia e Estatística. Censo demográfico 2000: características da população e dos domicílios. Rio de Janeiro: Instituto Brasileiro de Geografia e Estatística; 2001.
• 16. Willett WC. Nutritional epidemiology. 2^nd Ed. New York: Oxford University Press; 1998.
• 17. Cade J, Thompson R, Burley V, Warm D. Development, validation and utilization of food-frequency questionnaires: a review. Public Health Nutr 2002; 5:567-87.
• 18. Fisberg RM, Colucci ACA, Morimoto JM, Marchioni DML. Questionário de freqüência alimentar para adultos com base em estudo populacional. Rev Saúde Pública 2008; 42:550-4.
• 19. César CLG, Carandina L, Alves MCGP, Barros MBA, Goldbaum. Saúde e condição de vida em São Paulo. Inquérito multicêntrico de saúde no estado de São Paulo - ISA-SP. São Paulo: Faculdade de Saúde Pública, Universidade de São Paulo; 2005.
• 20. Johnson RK, Driscoll P, Goran MI. Comparison of multiple-pass 24-hour recall estimates of energy intake with total energy expenditure determined by doubly labeled water method in young children. J Am Diet Assoc 1996; 96:1140-4.
• 21. Guenther PM, Cleveland LE, Ingwersen LA, Berline M. Questionnaire development and data collection procedures. In: Tippett KS, Cypel YS, editors. Design and operation: the continuing survey of food intakes by individuals and the Diet and Health Knowledge Survey, 1994-1996. Beltsville: United States Department of Agriculture; 1998. p. 42-63. (Nationwide Food Surveys Report, 96-1).
• 22. Craig CL, Marshall AL, Sjöström M, Bauman AE, Booth ML, Ainsworth BE, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc 2003; 35:1381-95.
• 23. Matsudo S, Araújo T, Matsudo V, Andrade D, Oliveira L, Braggion G. Nível de atividade física da população do Estado de São Paulo: análise de acordo com o gênero, idade, nível sócio-econômico, distribuição geográfica e de conhecimento. Rev Bras Ciênc Mov 2002; 10:44-50.
• 24. Willett W, Stampfer MJ. Total energy intake: implications for epidemiological analyses. Am J Epidemiol 1986; 124:17-27.
• 25. Willett W. Invited commentary: OPEN questions. Am J Epidemiol 2003; 158:22-4.
• 26. Subar AF, Kipnis V, Troiano RP, Midthune D, Schoeller DA, Bingham S, et al. Using intake biomarkers to evaluate the extent of dietary misreporting in a large sample of adults: The OPEN Study. Am J Epidemiol 2003; 158:1-13.
• 27. Kipnis V, Subar AF, Midthune D, Freedman LS, Ballard-Barbash R, Troiano RP, et al. The structure of dietary measurement error: Results of the OPEN biomarker study. Am J Epidemiol 2003; 158:14-21.
• 28. Shai I, Rosner BA, Shahar DR, Vardi H, Azrad AB, Kanfi A, et al. Dietary evaluation and attenuation of relative risk: multiple comparisons between blood and urinary biomarkers, food frequency, and 24-hour recall questionnaires: the DEARR Study. J Nutr 2005; 135:573-9.
• 29. Johansson I, Hallmans G, Wikman A, Biessy C, Riboli E, Kaaks R. Validation and calibration of food-frequency questionnaire measurements in the Northern Sweden Health and Disease cohort. Public Health Nutr 2002; 5:487-96.
• 30. Hjartaker A, Andersen LF, Lund E. Comparison of diet measures from a food-frequency questionnaire with measures from repeated 24-hour dietary recalls. The Norwegian Women and Cancer Study. Public Health Nutr 2007; 10:1094-103.
• 31. Subar AF, Thompson FE, Kipnis V, Midthune D, Hurwitz P, McNutt S, et al. Comparative validation of the Block, Willett, and National Cancer Institute food frequency questionnaire. Am J Epidemiol 2001; 154:1089-99.
• 32. Thiébaut ACM, Freedman LS, Carroll RJ, Kipnis V. Is it necessary to correct for measurement error in nutritional epidemiology? Ann Intern Med 2007; 146:65-7.
• 33. Kaaks R, Riboli E, Staveren WV. Calibration of dietary intake measurement in prospective cohort studies. Am J Epidemiol 1995; 142:548-56.
• 34. Kipnis V, Midthune D, Freedman LS, Bingham S, Schatzkin A, Subar A, et al. Empirical evidence of correlated biases in dietary assessment instruments and its implications. Am J Epidemiol 2001; 153:394-403.
• 35. Thompson FE, Byers T. Dietary assessment resource manual. J Nutr 1994; 124(11 Suppl):2245S-317S.
• 36. Beaton GH, Milner J, Corey P, McGuire V, Cousins M, Stewart E, et al. Sources of variance in 24-hour dietary recall data: implications for nutrition study design and interpretation. Am J Clin Nutr 1979; 32:2546-59.
• 37. Hoffmann K, Boeing H, Dufour A, Volatier JL, Telman J, Virtanen M, et al. Estimating the distribution of usual dietary intake bay short-term measurements. Eur J Clin Nutr 2002; 56 Suppl 2:S53-62.
• 38. Hirvonen T, Männistö S, Roos E, Pietinen P. Increasing prevalence of underreporting does not necessarily distort dietary surveys. Eur J Clin Nutr 1997; 51:297-301.
• 39. Johnson RK, Soultanakis RP, Matthews DE. Literacy and body fatness are associated with underreporting of energy intake in US low-income women using the multiple-pass 24-hour recall: a doubly labeled water study. J Am Diet Assoc 1998; 98: 1136-40.
• 40. Krebs-Smith SM, Graubard BI, Kahle LL, Subar AF, Cleveland LE, Ballard-Barbash R. Low energy reporters vs. others: a comparison of reported food intakes. Eur J Clin Nutr 2000; 54:281-7.
• 41. Crispim SP, Ribeiro RCL, Silva MMS, Rosado LEFP, Rosado GP. The influence of education in the validation process of a food frequency questionnaire for adults in Viçosa, Minas Gerais, Brazil. Eur J Clin Nutr 2006; 60:1311-6.
• 42. Marks GC, Hughes MC, van der Pols JC. The effect of personal characteristics on the validity of nutrient intakes estimates using a food-frequency questionnaire. Public Health Nutr 2006; 9:394-402.
• 43. Olafsdottir AS, Thorsdottir I, Gunnarsdottir I, Thorgeirsdottir H, Steingrimsdottir L. Comparison of women's diet assessed by FFQs and 24-hour recalls with and without underreporters: associations with biomarkers. Ann Nutr Metab 2006; 50:450-60.
• 44. Paalanen L, Männistö S, Virtanen MJ, Knekt P, Räsänen L, Montonen J, et al. Validity of a food frequency questionnaire varied by age and body mass index. J Clin Epidemiol 2006; 59:994-1001.
• 45. Sempos CT, Looker AC, Johnson CL, Woteki CE. The importance of within-person variability in estimating prevalence. In: MacDonald I, editor. Monitoring dietary intakes. New York: Springer-Verlag; 1991. p. 99-109.
• 46. Kipnis V, Midthune D, Freedman L, Bingham S, Day NE, Riboli E, et al. Bias in dietary-report instruments and its implications for nutritional epidemiology. Public Health Nutr 2002; 5:915-23.
• 47. Slater B, Marchioni DML, Voci SM. Aplicação de regressão linear para correção de dados dietéticos. Rev Saúde Pública 2007; 41:190-6.
• 48. Wacholder S, Armstrong B, Hartge P. Validation studies using an alloyed gold standard. Am J Epidemiol 1993; 137:1251-8.
• 49. Kipnis V, Carroll RJ, Freedman LS, Li L. Implications of a new dietary measurement error model for estimation of relative risk: application to four calibration studies. Am J Epidemiol 1999; 150:642-51.
• 50. Kaaks R, Ferrari P, Ciampi A, Plummer M, Riboli E. Uses and limitations of statistical accounting for random error correlations, in the validation of dietary questionnaire assessments. Public Health Nutr 2002; 5:969-76.

Publication Dates

• Publication in this collection
  06 Jan 2011
• Date of issue
  Dec 2010

History

• Reviewed
  10 May 2010
• Received
  10 Sept 2009
• Accepted
  21 May 2010