Sensitivity and specificity of criteria for classifying body mass index in adolescents

Abstracts

OBJETIVO: Estimar a prevalência de excesso de peso em adolescentes conforme critérios de classificação do índice de massa corporal (IMC) e respectivas sensibilidade e especificidade. MÉTODOS: Foram realizadas medidas de peso, estatura e dobras cutâneas, subescapular e triciptal, em 934 adolescentes (masculino= 462 e feminino= 472) de 14 a 18 anos de idade (média= 16,2; dp= 1,0) da cidade de Florianópolis (SC), em 2001. O percentual de gordura estimado a partir das dobras cutâneas (e"25% no masculino e e"30% no feminino) foi utilizado como critério padrão-ouro para determinar a sensibilidade e especificidade dos critérios de classificação do IMC em adolescentes. RESULTADOS: A aplicação de diferentes pontos de corte de classificação do IMC, em geral, resultou em prevalências de excesso de peso similares (p>0,05). A sensibilidade dos critérios avaliados foi elevada nos adolescentes do sexo masculino (85,4% a 91,7%) e baixa nas do sexo feminino (33,8% a 52,8%). A especificidade foi elevada em todos os critérios, para ambos os sexos (83,6% a 98,8%). CONCLUSÕES: As estimativas de prevalência de excesso de peso pelos critérios de classificação do IMC em adolescentes foram similares e apresentaram especificidade elevada para ambos os sexos, mas baixa sensibilidade nos adolescentes do sexo feminino.

Adolescente; Índice de Massa Corporal; Sensibilidade e Especificidade; Sobrepeso; Obesidade; Estado Nutricional

ORIGINAL ARTICLES

José Cazuza de Farias Júnior^I; Lisandra Maria Konrad^II; Fabiana Maluf Rabacow^II; Susane Grup^II; Valbério Candido Araújo^II

^IDepartamento de Educação Física. Centro de Ciências da Saúde. Universidade Federal da Paraíba. João Pessoa, PB, Brasil

^IICentro de Desportos. Universidade Federal de Santa Catarina. Florianópolis, SC, Brasil

Correspondence

ABSTRACT

OBJECTIVE: To estimate the prevalence of overweight among adolescents using different body mass index (BMI) classification criteria, and to determine sensitivity and specificity values for these criteria.

METHODS: Weight, height, and tricipital and subscapular skinfolds in 934 adolescents (462 males and 472 females) aged 14-18 years (mean age 16.2; SD=1.0) of the city of Florianópolis, Southern Brazil, in 2001. Percent fat estimated based on skinfold measurements (e"25% in males and e"30% in females) was used as a gold-standard for determining specificity and sensitivity of BMI classification criteria among adolescents.

RESULTS: The different cutoff points used for classifying BMI in general resulted in similar prevalence of overweight (p>0.05). Sensitivity of the evaluated criteria was high for males (85.4% to 91.7%) and low for females (33.8 to 52.8%). Specificity of all criteria was high for both sexes (83.6% to 98.8%).

CONCLUSIONS: Estimates of prevalence of obesity among adolescents using different BMI classification criteria were similar and highly specific for both sexes, but sensitivity for females was low.

Descriptors: Adolescent. Body Mass Index. Sensitivity and Specificity. Overweight, diagnosis. Obesity, diagnosis. Nutritional Status.

RESUMEN

OBJETIVO: Estimar la prevalencia de exceso de peso en adolescentes conforme criterios de clasificación del índice de masa corporal (IMC) y respectivas sensibilidad y especificidad.

MÉTODOS: Fueron realizadas medidas de peso, estatura y pliegues cutáneos, subescapular y triciptal, en 934 adolescentes (masculino= 462 y femenino= 472) de 14 a 18 años de edad (promedio= 16,2; dp=1,0) de la ciudad de Florianópolis (Sur de Brasil), en 2001. El porcentaje de gordura estimado a partir de los pliegues cutáneos (?25% en el masculino y ?30% en el femenino) fue utilizado como criterio estándar-oro para determinar la sensibilidad y especificidad de los criterios de clasificación del IMC en adolescentes.

RESULTADOS: La aplicación de diferentes puntos de corte de clasificación del IMC, en general, resultó en prevalencias de exceso de peso similares (p>0,05).La sensibilidad de los criterios evaluados fue elevada en los adolescentes del sexo masculino (85,4% a 91,7%) y baja en las del sexo femenino (33,8% a 52,8%). La especificidad fue elevada en todos los criterios, para ambos sexos (83,6% a 98,8%).

CONCLUSIONES: Las estimaciones de prevalencia de exceso de peso por los criterios de clasificación del IMC en adolescentes fueron similares y presentaron especificidad elevada para ambos sexos, pero baja sensibilidad en los adolescentes del sexo femenino.

Descriptores: Adolescente. Índice de Masa Corporal. Sensibilidad y Especificidad. Sobrepeso, diagnóstico. Obesidad, diagnóstico. Estado Nutricional.

INTRODUCTION

Screening for excess weight (overweight/obesity) among youths has been widely recommended,²⁴ given the rapid increase in prevalence, its health-related implications, and the possibility of transfer to adult age. This has underscored the need for a simple, safe, valid, and precise instrument for evaluating nutritional status.

The Body Mass Index (BMI) is recommended by the World Health Organization (WHO)²⁴ as an indicator for evaluating the nutritional status of adolescents, and has been widely employed in epidemiological studies.^5,6 This is due to the fact that BMI is based on easily obtained measures, has high precision, does not require sophisticated equipment or specialized personnel, and shows good ability to discriminate excess body fat in adolescents.^13,14,19

In spite of the consensus surrounding BMI, there is substantial divergence with respect to the cutoff points that should be employed to define excess body weight in adolescents based on this indicator. Among the several criteria available in the literature, those proposed by the International Obesity Task Force (IOTF - Cole et al² 2000), WHO²⁴ (1995), the Centers for Disease Control and Prevention (CDC - Kuczmarski et al¹¹ 2002), and Must et al¹⁵ (1991), are the most widely used. More recently, Conde & Monteiro³ (2006) proposed critical BMI values for Brazilian children and adolescents.

Unlike those for adults,²⁴ cutoff points for adolescents have been established in an arbitrary manner, not grounded on health considerations.¹⁷ Moreover, there is limited information on the validity of such criteria, especially among populations different from those for which they were developed.¹⁷

Studies comparing prevalence of excess weight according to different BMI classification criteria and evaluating the sensitivity and specificity of these criteria in adolescents are scarce,^16,19 especially in Brazil.²¹ The aim of the present study was to investigate prevalence of overweight among adolescents using five different BMI classification criteria, and to determine sensitivity and specificity values for these criteria.

METHODS

Sampling in this survey was carried out in two stages. In the first, the 98 secondary schools (both public and private) in the municipality of Florianópolis, Southern Brazil, were listed in increasing order of number of students (small, up to 200 students; medium, 200 to 499 students; large, 500 or more students). Twenty-one schools were then systematically selected, of which 14 were public and seven private. In the second stage, after obtaining authorization from the schools' managers, classes were randomly selected so as to compose the sample.

As the present study was nested within a larger survey, sample size was determined by assuming 60% prevalence of physical inactivity, with 95% confidence intervals (95%CI), a four percentage point error, and an additional 30% to allow for potential losses and refusals (population estimated at 22,067 based on data from 2001). These assumptions led to a sample size of 731 subjects. The final sample included 1,062 adolescents of both sexes, aged 14-18 years, previously authorized by a parent or guardian to take part in the survey. Adolescents with limitations that prevented anthropometric measurement or who were pregnant were excluded from the sample. According to previous work,¹⁸ this sample size would suffice for the present analysis. Of the 1,062 adolescents that participated in data collection, seven were excluded due to lack of information on sex and/or age, and 121 (52 males and 69 females) refused to undergo anthropometric measurement. The final sample included 934 adolescents (462 males and 472 females) aged 14 to 18 years (mean age 16.2; sd = 1.0).

Data collection was carried out between May and August 2001 by a team of four previously trained researchers. Weight and height measures were always obtained by the same researcher (intraclass correlation coefficients (ICC): weight = 0.99; height = 0.98). Subscapular (SB) and tricipital (TR) skinfold (SF) thickness (ICC SB = 0.96; TR = 0.98) was measured exclusively by another researcher. Measurements were recorded by the other researchers.

Weight was measured using a Filizola electronic scale with 100 g precision, with the subject wearing light clothing and no shoes. Height was measured using a non-extensible tape measure with 1 cm precision, fixed to the wall, on a plain support surface. Subjects were measured without shoes, arms held straight alongside the body, and in apnea. Both measures were taken in duplicate, according to the procedures described by Gordon et al⁹ (1988), the final value being considered as the mean of the two measurements.

SB and TR SF thickness was measured according to Harrison¹⁰ (1988), using a Cescorf-type caliper with 0.01 mm resolution. We performed three separate measurements in the same place, in an alternate manner. A further series of three measurements was performed in case the three previous measures diverged by more than 5%. The mean of the three measurements was used as the final value for skinfold thickness.

BMI was determined based on the ratio between weight and height (BMI = weight [kg]/height [m²]). The quantity of fat in relation to the body mass (%F) was estimated using equations specific for adolescents, proposed by Lohman¹² (1986), based on the measures of TR and SB SF thickness.

For data analysis, we used Student's t test for unpaired measurements in order to compare the mean anthropometric measures of males and females. We determined prevalences of excess weight (grouped into the risk categories overweight and obesity), with their respective 95%CI, based on the critical BMI values derived from the five criteria analyzed: Conde & Monteiro³ (2006); IOTF² (2000); CDC¹¹ (2002); WHO²⁴ (1995); and Must et al¹⁵ (1991). Differences between these prevalences were evaluated using the McNemar test.

We estimated the sensitivity and specificity of each BMI classification criterion using %F as a gold-standard. Excess weight was defined as body fat values greater than 25% in male, and 35% in female adolescents. These cutoff points have been used in other works assessing the validity BMI classification criteria in adolescents,^16,21 and are shown to be associated with risk of disease.²³

Sensitivity was defined as the percentage of adolescents classified as with excess body fat (excess weight) using the BMI classification criteria and by the gold-standard (true positives). Specificity was defined as the percentage of adolescents classified as without excess body fat (non-excess weight) using the BMI classification criteria compared to the gold-standard (true negatives). Statistical analyses were carried out using Stata 10.0 software and adopting a 5% significance level.

The study was approved by the Research Ethics Committee of the Federal University of Santa Catarina (process no. 066/2000).

RESULTS

Mean SF thickness (SB and TR) and %F were statistically higher among females (p<0.001), whereas mean BMI was higher among males (p=0.02) (Table 1).

No significant differences were found in terms of excess weight prevalence when using the different BMI classification criteria, with the exception of male subjects, for whom the critical BMI values proposed by Conde & Monteiro³ yielded prevalences 4% to 8% higher than the remaining criteria (p<0.05) (Table 2).

Table 3 presents values of sensitivity and specificity for the five BMI classification criteria. Assuming %F e" 25% for males and e" 30% for females as the gold-standard for excess weight, for all five criteria, specificity was higher than sensitivity among both males and females.

Sensitivity was high for males (> 85%) and low for females (< 60%). The criteria proposed by Conde & Monteiro³ showed higher sensitivity when compared to the remaining criteria. However, these differences were small (H"6%), especially when compared to those of IOTF,² Must et al,¹⁵ and WHO,²⁴ for males, and when compared to IOTF² for females.

All BMI criteria evaluated (Table 3) showed high specificity. Specificity was higher for females (> 95%) than for males (> 80%). The critical values proposed by Conde & Monteiro³ showed slightly lower specificity (H"7%) for males than the remaining criteria. Among females, sensitivity was similar in for all criteria evaluated.

DISCUSSION

The use of the critical BMI values for defining excess weight among adolescents proposed by IOTF,² CDC,¹¹ WHO,²⁴ and Must et al,¹⁵ resulted in similar prevalences of excess weight. The critical values proposed by Conde & Monteiro³ yielded higher prevalences among males than the remaining criteria. It is likely that the small differences in the cutoff points of IOFT,² CDC,¹¹ Must et al,¹⁵ and WHO²⁴ for adolescents aged 14 to 18 years, in addition to the distribution of BMI values in the studied population, have led to the differences in prevalence of excess weight detected between these criteria. However, the higher prevalences found using the criteria proposed by Conde & Monteiro³ can be explained by the critical BMI values adopted by these authors, which are lower than those of the other criteria.

Our results are similar to those reported in other surveys with adolescents,^8,22 including a study carried out in Brazil,¹ which also failed to detect significant differences in prevalence of excess weight as defined by the criteria proposed by IOTF,² WHO,²⁴ and Must et al.¹⁵

Though not significant, Vieira et al²¹ (2006) found discrepancies (differences of up to 21.3%) between excess weight prevalences determined using different BMI classification criteria (percentile 85 of Brazilian youths, IOTF,² CDC,¹¹ and Must et al¹⁵), among Brazilian adolescents (12-19 years).

We were unable to locate any studies comparing prevalence of excess weight determined based on the critical values recommended by Conde & Monteiro³ with the other criteria evaluated in the present study. However, the use of BMI percentile 85 from the same population studied by Conde & Monteiro³ generated prevalences of excess weight that were higher than those detected using other criteria.^20,21

Differences in age group, sampling procedures, and distribution of BMI values in the population/sample may explain part of the divergence between different studies of prevalence of BMI in adolescents determined using different criteria.⁸

There is no consensus regarding the establishment of a universal criterion for classifying BMI in adolescents. This is due to the changes in body composition resulting from the process of sexual maturation, which vary greatly according to age, sex, and ethnicity, and which are not captured precisely by the BMI.^4,13

As described in other Brazilian^1,20,21 and international^8,16 studies, the BMI classification criteria for adolescents evaluated here show higher specificity than sensitivity.

The sensitivity of different the criteria evaluated in the present study was higher to that reported in some studies^1,16,20 and similar to that reported in others.^19,21 The use of these criteria for diagnosing excess weight as determined by excess body fat should accurately classify approximately 85-90% of males (10-15% false positives) and results in a large proportion of false-negative results among females (50-70%).

The low sensitivity of BMI classification criteria among females, especially those aged 16-18 years, may be a consequence of the use of a single value to define excess body fat at all ages, which may lead to overestimation of the prevalence of excess body fat. On the other hand, the critical BMI values evaluated may be too high to diagnose excess body fat in this subgroup.¹⁶

The slightly higher sensitivity found for the critical values proposed by Conde & Monteiro³ resulted in differences below 10% in the number of false-negatives when compared to the remaining criteria, especially IOTF,² Must et al,¹⁵ and WHO²⁴ for males and IOTF² for females.

Other studies using BMI percentile 85, specific for sex and age, of the same reference population used by Conde & Monteiro³ (Brazilian adolescents), also found that critical values of BMI for the Brazilian population were more sensitive than those suggested by Must et al,¹⁵ IOTF,² and CDC.¹¹

Part of the variability in the sensitivity of BMI classification criteria for adolescents in the different studies may be explained by differences in the methods employed for estimating %F; in the critical values used to define excess body fat based on this indicator;¹⁷ and on the age group of the study population; as well as by the influence of factors such as ethnicity, culture, and environment on indicators of body composition.¹⁷

As seen in previous work,^1,8,16,20,21 the BMI classification criteria evaluated in the present study were highly specific (between 83.6% and 98.8% specificity), especially for females, with little variation between the different criteria. Although they result in lower specificity, the cutoff points suggested by Conde & Monteiro⁴ strengthen the results of previous studies that used BMI percentile 85 of the same reference population.^20,21 Irrespective of the criteria used to classify BMI, we found that the number of false-positive results was always below 10%.

Given the good ability of BMI to discriminate excess body fat in adolescents,^13,14,19 the major challenge remains that of establishing cutoff points that will allow us to reduce the number of false-negatives, especially among females (increase sensitivity), while maintaining the high levels of specificity already seen for the different criteria, in addition to ensuring that these levels are associated to health hazard.⁷

Since our measurements were carried out independently by two researchers, and considering that both were blinded as to the hypotheses of the present study, we believe the possibility of observer bias may be discarded. Furthermore, reproducibility of anthropometric measurements was high (ICC >0.95).

Although the refusal rate for the different anthropometric measurements was relatively low (H"12%), we cannot discard the possibility of selection bias, given that we were unable to compare these characteristics between participants and non-participants.

Another limitation to be considered when interpreting the present results is the use of %F determined based on skinfold thickness measurements. This procedure is expected to underestimate the amount of fat in leaner adolescents while overestimating this amount in fatter ones.

We conclude that the BMI classification criteria analyzed in the present study provide similar estimates of prevalence of excess weight, with the exception of the criteria proposed by Conde & Monteiro,³ which result in higher prevalence among males.

Sensitivity of the criteria evaluated was high for males and low for females; specificity was high for adolescents of both sexes. Thus, the cutoff points of these criteria allowed for accurate classification of almost all adolescents without excess body fat, with very few false-positives. On the other hand, these criteria resulted in a high number of false-negatives among female adolescents.

REFERENCES

References

• 1. Chiara V, Sichieri R, Martins PD. Sensibilidade e especificidade de classificação de sobrepeso em adolescentes, Rio de Janeiro. Rev Saude Publica. 2003;37(2):226-31. DOI: 10.1590/S0034-89102003000200010
• 2. Cole TJ, Bellizzi MC, Flegal KM, Dietz WD. Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ. 2000;320(7244):1240-3. DOI: 10.1136/bmj.320.7244.1240
• 3. Conde WL, Monteiro CA. Body mass index cutoff points for evaluation of nutritional status in Brazilian children and adolescents. J Pediatr (Rio J). 2006;82(4):266-72. DOI: 10.2223/JPED.1502
• 4. Demerath EW, Schubert CM, Maynard LM, Sun SS, Chumlea WC, Pickoff A. Do changes in body mass index percentile reflect changes in body composition in children? Data from the feels longitudinal study. Pediatrics 2006;117(3):487-95. DOI: 10.1542/peds.2005-0572
• 5. Dutra CL, Araújo CL, Bertoldi AD. Prevalência de sobrepeso em adolescentes: um estudo de base populacional em uma cidade no sul do Brasil. Cad Saude Publica. 2006;22(1):151-62. DOI: 10.1590/S0102-311X2006000100016
• 6. Eaton DK, Kann L, Kinchen S, Ross J, Hawkins J, Harris WA. Youth Risk Behavior Surveillance - United States, 2005. MWR Surveill Summ. 2006;55(5):1-108
• 7. Engeland A, Bjorge T, Sogaard AJ, Tverdal A. Body mass index in adolescence in relation to total mortality: 32-year follow-up of 227,000 Norwegian boys and girls. Am J Epidemiol. 2003;157(6):517-23. DOI: 10.1093/aje/kwf219
• 8. Flegal KM, Ogden CL, Wei R, Kuczmarski RL, Johnson CL. Prevalence of overweight in US children: comparison of US growth charts from the Centers for Disease Control and Prevention with other reference values for body mass index. Am J Clin Nutr. 2001;73(6):1086-93.
• 9. Gordon CC, Chumlea WC, Roche AF. Stature, recumbent length, and weight. In: Lohman TG, Roche AF, Martorell R, editors. Anthropometric standardization reference manual. Champaign: Human Kinetics; 1988. p.3-8.
• 10. Harrison GG. Skinfold thickness and measurement technique. In: Lohman T, Roche AF, Martorell R, editors. Anthropometric standardization reference manual. Champaign: Human Kinetics; 1988. p.55-80.
• 11. Kuczmarski RJ, Ogden CL, Guo SS, Grummer-Strawn LM, Flegal KM, Mei Z, et al. 2000 CDC growth charts for the United States: methods and development. Vital Health Stat 11. 2002;(246):1-190.
• 12. Lohman TG. Applicability of body composition techniques and constants for children and youths. Exerc Sport Sci Rev. 1986;14:325-57. DOI: 10.1249/00003677-198600140-00014
• 13. Malina RM, Katzmarzyk PT. Validity of the body mass index as an indicator of the risk and presence of overweight in adolescents. Am J Clin Nutr. 1999;70(1):131S-6S.
• 14. Mei Z, Grummer-Strawn LM, Pietrobelli A, Goulding A, Goran MI, Dietz WH. Validity of body mass index compared with other body-composition screening indexes for the assessment of body fatness in children and adolescents. Am J Clin Nutr. 2002;75(6):978-85.
• 15. Must A, Dallal GE, Dietz WH. Reference data for obesity: 85th and 95th percentiles of body mass index (wt/ht2) and triceps skinfold thickness. Am J Clin Nutr. 1991;53(4):839-46.
• 16. Neovius MG, Linné YM, Barkeling BS, Rossner S. Sensitivity and specificity of classification systems for fatness in adolescents. Am J Clin Nutr. 2004;80(3):597-603.
• 17. Neovius M, Linné Y, Barkeling B, Rössner S. Discrepancies between classification systems of childhood obesity. Obes Rev. 2004;5(2):105-14. DOI: 10.1111/j.1467-789X.2004.00136.x
• 18. Pereira MG, Andrade ALS. Métodos de investigação epidemiológica em doenças transmissíveis. Brasília: Organização Pan-Americana da Saúde; 2003. Avaliação de testes diagnósticos; p.22-40.
• 19. Taylor RW, Jones IE, Williams SM, Goulding A. Body fat percentages measured by dual-energy x-ray absorptiometry corresponding to recently recommended body mass index cutoffs for overweight and obesity in children and adolescents aged 3-18 y. Am J Clin Nutri. 2002;76(6):1416-21.
• 20. Veiga GV, Dias PC, Anjos LA. A comparison of distribution curves of body mass index from Brazil and the United States for assessing overweight and obesity in Brazilian adolescents. Rev Panam Salud Publica. 2001;10(2):79-85. DOI: 10.1590/S1020-49892001000800002
• 21. Vieira AC, Alvarez MM, Martins VMR, Sichieri R, Veiga GV. Desempenho de pontos de corte do índice de massa corporal de diferentes referências na predicação de gordura corporal em adolescentes. Cad Saude Publica. 2006;22(8):1681-90. DOI: 10.1590/S0102-311X2006000800016
• 22. Wang Y, Wang JQ. A comparison on international references for the assessment of child and adolescent overweight and obesity in different populations. Euro J Clin Nutr. 2002;56(10):973-82. DOI: 10.1038/sj.ejcn.1601415
• 23. Williams DP, Going SB, Lohman TG, Harsha DW, Srinivasan SR, Webber LS, et al. Body Fatness and Risk for Elevated Blood Pressure, Total Cholesterol, and Serum lipoprotein Ratios in Children and Adolescents. Am J Public Health. 1992;82(3):358-63.
• 24. World Health Organization. Physical status: the use and interpretation of anthropometry. Geneva; 1995. (WHO Technical Report Series, 854).

Sensitivity and specificity of criteria for classifying body mass index in adolescents

Sensibilidad y especificidad de criterios de clasificación del índice de masa corporal en adolescentes

Publication Dates

• Publication in this collection
  06 Aug 2010
• Date of issue
  Feb 2009

History

• Received
  21 May 2008
• Accepted
  28 Aug 2008