Abstract
Physical activity measurement with accuracy and precision is extremely important in establishing the dose-response relationship between levels of physical activity and the different outcome possibilities. Subjective methods of measurement, such as proxy-reports have been used as a possibility to check physical activity in children. The aim of this study was to test the Netherlands Physical Activity Questionnaire (NPAQ), valid for Brazilian schoolchildren using physical aerobic fitness as a criterion. The study included 290 children aged 6-10 years from public schools of Itaúna/MG. NPAQ was applied to parents or guardians and children were tested using the Luc Léger test. NPAQ had mean score of 25 for children (25 for boys and 24 for girls) and VO2max was 50.8 ml/kg/min for children (52.6 and 50.2 ml/kg/min for boys and girls, respectively). The Spearmam correlation test showed significant correlation (rsho = 0.146; p = 0.013) between NPAQ and VO2max, but the correlation is weak (Kappa -0.14). The results showed that NPAQ presented poor construct validity for physical activity measurement in a Brazilian schoolchildren sample, based on aerobic physical fitness criteria.
Key words Child; Physical activity; Psychometric; Reproducibility of results
Resumo
A mensuração da atividade física com acurácia e precisão é de extrema importância no estabelecimento da relação de dose-resposta entre os níveis de atividade física e as diversas possibilidades de desfecho, sendo um desafio de extrema complexidade. A utilização de métodos subjetivos de mensuração, como os instrumentos proxy-reports, é uma possibilidade de verificação de atividade física em crianças. O objetivo deste estudo foi testar a validade do Netherland Physical Activity Questionnaire (NPAQ) em escolares brasileiros tendo como medida critério a aptidão física aeróbica. Participaram deste estudo 290 crianças de seis a 10 anos de idade, matriculados em escolas públicas do município de Itaúna/MG. Foi aplicado aos responsáveis o NPAQ e as crianças realizaram o teste de Luc Léger. O NPAQ apresentou um escore mediano de 25 para as crianças (25 meninos e 24 meninas) e o VO2máx foi de 50,8 ml/kg/min para as crianças (52,6 e 50,2 ml/kg/min para meninos e meninas, respectivamente). O NPAQ e o VO2máx apresentaram no teste de correlação simples de Spearmam rsho = 0,146 (p = 0,013) correlação significativa, porém fraca (Kappa –0.14). Os resultados permitem concluir que o NPAQ apresentou fraca validade de constructo para mensuração de atividade física em uma amostra de escolares brasileiros, tendo como medida critério a aptidão física aeróbica.
Palavras-chave Atividade Física; Criança; Psicometria; Reprodutibilidade dos testes
INTRODUCTION
Physical activity measurement with accuracy and precision is extremely important so that a dose-response relationship can be established between levels of physical activity and the different outcome possibilities, involving prevention and control of chronic-degenerative diseases1. However, despite the importance of monitoring and evaluating levels of physical activity, it is known that measuring it is a great and extremely complex challenge. Ridley et al.1 reported that physical activity is a multidimensional construct that can vary in intensity, duration, type and frequency and warn that there is no gold standard method capable of accurately measuring each of its four dimensions.
The methods of assessing levels of physical activity are divided into objective and subjective2. Objective methods include the measurement of physiological and/or biomechanical variables by means of electronic monitors, double-marked water (deuterium), accelerometers, pedometers, heart rate monitors and combined sensors (heart rate + accelerometer). Despite their great usability, these instruments still have high cost for epidemiological studies. Subjective methods are questionnaires, physical activity inventories and direct observations2,3, which can be applied in epidemiological studies, usually for their practicality and low cost. Several authors have pointed out that there are limitations in the use of subjective instruments, such as difficulty in specifying the intensity of activities performed, difficulties of instruments that measure all the domains that compose the physical activity construct, difficulty in remembering and estimating the intensity of activities performed4-7. These factors could affect the validity in estimating the level of physical activity, especially when it comes to children under 10 years of age8, and would compromise the results of studies using such instruments, reproducing erroneous dose-response outcomes between levels of physical activity and health9,10.
In order to minimize such age-related intercurrences, Corder et al.2 suggest that children and adolescents use proxy-report instruments. These instruments must be completed by parents or guardians, or even by their teachers. The theoretical assumption that supports this theory is that adults can better remember and report activities performed during the day, which could result in better validity in determining the level of physical activity when compared to self-report instruments2,11,12. On the other hand, the degree of kinship or coexistence and the interest in monitoring the child could result in less validity. In Brazil, the instrument that has such characteristics is the Netherlands Physical Activity Questionnaire12. This questionnaire had its psychometric qualities recently tested in Brazilian children living in the city of Pelotas, southern Brazil, and satisfactory validity was not found when compared to the criterion measure (accelerometry)13. No further studies have yet been carried out to confirm the low validity of this instrument, using criterion measures such as physiological indicators of physical fitness.
Validity is conceptually defined as the quality of the instrument in reporting precise measures of the phenomenon that is intended to be measured14,15. There are several types of validation, among them, face, construct, content and criterion. The criterion validity compares the instrument to be validated with a measure considered criterion14. In physical activity measures, traditionally, as quoted in several articles, the validity of self report and proxy report instruments has been obtained through combined pedometry, accelerometry/accelerometer methods and heart rate12. Thus, the present study aims to test the validity of the Netherlands Physical Activity Questionnaire (NPAQ) in Brazilian schoolchildren having aerobic physical fitness as a criterion measure.
METHODOLOGICAL PROCEDURES
Study type and design
This is a cross-sectional and correlational study. Due to the nature of the research, the results may be, with a small margin of error, generalized to the population represented by the sample.
Participants
The students selected to participate in this study were from the city of Itaúna, located 80 km from the Minas Gerais capital, Belo Horizonte, in the midwestern region of the state. It has population of 85,463 inhabitants and Human Development Index of 0.823, classified as high16.
Population and sample
Study population: students aged 6-10 years enrolled in grades from 1 to 5 in all public schools in the urban area of Itaúna were eligible to compose the sample. These students constituted a universe of 4649 schoolchildren (data provided by the Municipal Department of Education and school register). The sample consisted of 228 children, with 5% probabilistic error. However, predicting losses, the final sample was defined in 456 children.
Sex and age classification was performed within each school so that age and sex ratios were maintained. With data obtained from each school, students were numbered in each grade in sequential order. Then, using a table of random numbers generated by the software Excel 2003, children of the corresponding number in the list created in each grade were selected, until reaching the number needed to compose the sample for that sex and age in that school.
Inclusion and exclusion criteria
Children were selected based on the age group of 6-10 years and enrolled in the state and municipal public networks, in the morning or afternoon shift, from the first to the fifth grades. Due to the difficulty of access and the small number of children enrolled in rural schools (279 children), representing about 6% of students in the municipality, they were not included. Children with clinical and/or motor impairment that prevented the performance of physical tests were excluded.
Instruments, variables and collection procedures
Data collection was performed by questionnaire, anthropometric measurements and cardiorespiratory fitness test.
After parents’ or guardians’ consent, they filled out, in the presence of researchers, the following questionnaires and forms:
-
Socioeconomic and demographic: housing conditions, parental profession, number of dwellers, number of rooms, number of children, ABEP questionnaire reporting the ownership of goods and educational level of the family head, etc.
-
Personal history of the child: height and birth weight, whether full-term or not, breastfeeding, health problems, use of medications and medical appointments in the last year.
-
Level of physical activity: measured using NPAQ, translated into Portuguese. NPAQ is a questionnaire that contains 7 questions (likert 1-5) about patterns of physical activity and must be answered by parents and / or guardians. The level of physical activity is calculated by the sum of the 7 questions, with score 2513 as the cutoff point.
This instrument was originally validated for children aged 4-6 years; however, its validity has recently been extended for children and adolescents 13. According to Janz et al.17, the question about the number of hours per day that the child spent watching television, playing video games or on the computer was included.
Each school made available a room and a court for the accomplishment of anthropometric measures and the aerobic physical fitness test. Anthropometric evaluations were performed by an experienced evaluator in the area of cineanthropometry and performed in a reserved environment.
Anthropometric measurements were body mass, height, circumferences and skinfolds. To measure body mass, "Seca" digital electronic scale (Scales Galore, New York, USA), with maximum capacity of 150 kg and accuracy of 0.1 kg was used. Height was measured using "Alturaexata" vertical anthropometer (Alturaexata, Minas Gerais, Brazil), with graduation in centimeters (cm) up to 2.13 meters and accuracy of 0.001m.
For measuring abdominal and hip circumferences, flexible and inelastic 2-meter Venosan (Venosan Brazil, Pernambuco, Brazil) measuring tape was used, divided into centimeters and accuracy of 0.001 m, being careful not to compress the soft parts. For all measurements, Lohman et al.18 standardization was used. BMI was calculated by the ratio between total body mass in kilograms and height in squared meters. For all anthropometric measures, three measurements were performed and the median was used.
The aerobic physical fitness test used was the Luc Léger test19,20, which consisted of a round-trip run in a 20-meter course, with progressive intensity until exhaustion. The test starts at 8.5 km/h and is increased by 0.5 km/h every minute until the child cannot keep pace with 2 consecutive beeps. The distance was demarcated on the sports court or other area with paved floor available within schools. All children were verbally encouraged to reach as many stages as possible. To determine the run pace, a portable stereo and a CD recorded with the test media were used. The final velocity (VF) of the test was used to estimate VO2max using the formula (VO2max = 14.49 – 2.143 VF + 0.00324 VF2) proposed by the test protocol. This test was validated for children aged 12-14 years (r = 0.76), using the direct oxygen consumption measure19 as gold standard, being used worldwide to evaluate the aerobic fitness of children and adolescents21. For the classification of the cardiorespiratory capacity, the 75th percentile was adopted according to the study of Gonçalves et al.22.
Ethical aspects
The project was previously approved by the Departmental Chamber of Pediatrics of the Faculty of Medicine - Federal University of Minas Gerais, protocol No. 93/2009; and by the Ethics Research Committee of UFMG, protocol No. 0040.0.203.000-10, and by the Ethics Research Committee of the University of Itaúna, protocol No. 012/10. The study was carried out only with children whose parents authorized their participation by signing the free and informed consent form.
Statistics
Descriptive statistics (median and interquartile range), frequency tables and the non-parametric inference test were used for data analysis. To verify data normality, the Kolmogorov Smirnov test was used and the Mann Whitney test was used to verify differences between sexes. In order to evaluate the internal consistency of the instrument, Conbrach alpha was used. For criterion validity, the correlation of the VO2max measurement obtained in Lec Leger versus the score generated by the NAPQ instrument through Spearman correlation was used. The Kappa test was used to verify concordance. For this, both NAPQ and VO2max scores were dichotomized, adopting 75th percentile for VO2 and value 26 for NAPQ. Subsequently, the Kappa test was used to verify the concordance among instruments. For all tests, significance level of p <0.05 was used and the Statistic software for Windows version 10.0 was used.
RESULTS
Demographic data show that in the sample of 290 students, 158 were male, in the five ages surveyed, the distribution of participants ranged from 13.5% to 25.8%, and 42 participants had low birth weight and 20 were preterm infants, presenting 69.2% of families belonging to socioeconomic classes C1 and C2, with 80.8% of families having 1 to 3 children, and 40.7% of parents with basic education schooling and 8.6% illiterate. The internal consistency of NAPQ obtained by the Conbrach alpha was 0.92. Table 1 shows the demographic and socioeconomic characteristics of children and parents.
Table 2 shows the descriptive results of the study variables. It was observed that significant differences were found for most variables, where boys had higher mean values in relation to girls, except for TV hours, which did not present significant difference between boys and girls.
Comparison of medians of the study variables of students from public schools in the city of Itaúna, MG
Table 3 shows Spearman’s simple correlation coefficients between reference variables and physical activity scores of the NPAQ questionnaire. Analyzing correlations without stratification, it was observed that VO2max, level and number of trajectories in the Luc Léger test and the final velocity showed significant and positive correlations, while abdominal circumference showed significant and negative correlation. For males, only abdominal circumference and TV and computer hours presented significant and negative correlations. For females, only TV and computer hours showed significant and negative correlation.
Spearman’s simple correlation coefficient (rsho) between NPAQ physical activity scores and physical fitness variables, age and abdominal circumference, Itaúna, MG, 2010
In Table 4, variables VO2max and NPAQ score were dichotomized, assuming the 75th percentile for VO2 and score 26 for NPAQ. Based on this dichotomization, the concordance between VO2max (P75 -low cardiorespiratory capacity, P> 75 high respiratory capacity) and the NPAQ score (Inactive <26; Active ≥ 26) were presented. For the Kappa test, the concordance between instruments was -0.14. This concordance value is considered by literature to be weak. Considering the VO2max test as a criterion for validity, when performing concordance among instruments, it was observed that 49 children with high cardiorespiratory capacity were considered inactive, while 84 children who presented low cardiorespiratory capacity were considered active. From these values, it could be inferred that 17% and 29% are false positives and false negatives, respectively.
DISCUSSION
The present study aimed to verify the validity of an instrument (NPAQ) to be filled by parents or guardians on the physical activity levels of children younger than 10 years of age, with aerobic capacity as a criterion measure, as measured by the indirect Luc Léger test20.
Several studies were conducted with the aim of validating proxy report instruments1,3-5,7,8. In the study by Murph23 and collaborators, the validity of the report of teachers and caregivers on the level of physical activity of 213 children and adolescents (6-18 years) was investigated, using the maximum test in cycloergometer as criterion. The results of the study showed significant moderate and strong correlation, respectively, for teachers (r = 0.59) and caregivers (r = 0.82). In the study by Manios24 and colleagues, the validity of two proxy report instruments was correlated with the heart rate of 39 children (6-10 years). Both instruments had significantly positive correlations when correlated with heart rate (instrument 1 - r = 0.49, instrument 2 - r = 0.69). Although the above studies used instruments different from those of the present study, the theoretical assumptions that support the construction of proxy report questionnaires are the same. All of them have, as a characteristic, the report of parents / guardians or teachers about the behavior in relation to the practice of physical activity.
Some studies3-5 showed significantly good correlation levels, which probably allowed researchers to indicate the use of proxy reports in population studies for the measurement of physical activity. However, their use should be viewed with care12. Many authors8-13 and studies4,5,7,8 have pointed to weaknesses in proxy report or self-report (daily) questionnaires in the measurement of physical activity and indicated the combination with the use of accelerometers. Telford et al.25 tested the validity of the Children’s Leisure Activities Study Survey (CLASS) in 280 children aged 5-12 years using accelerometry as a criterion measure and found correlation values between -0.05 and .09 for physical activity. Bieleman et al. 13 interviewed 369 mothers, fathers or guardians of children aged 4-11 years in the city of Pelotas, RS. The authors assumed a score of 25 in NPAQ as cutoff point and found sensitivity and specificity values respectively of 68.0% (95% CI = 60.5 -74.8) and 50.0% (95% CI = 37.2 -62.8). This means that for every two inactive children, one would be considered active. Janz et al.17 interviewed 204 mothers, fathers or guardians of children aged 4-7 years using NPAQ. The results showed low correlation values between NPAQ scores and total counts / min (= -0.33) and vigorous activity time / day (= -0.36). Bieleman et al.13 and Janz et al.17 used NPAQ; however, they used the accelerometry measure as a criterion, while our study used the indirect cardiorespiratory capacity measure. Despite this difference, the results of this study were similar to those of our study. In our study, it was found that 46% of children investigated presented erroneous classifications by parents or guardians and correlations between NPAQ and the Luc Leger test were weak. These results reinforce that instruments that estimate levels of physical activity in children, whether self-reported by parents or guardians, should be used with caution.
The use of questionnaires, diaries and self-reports to measure physical activity in children and adolescents has been questioned by several authors. The estimation of physical activity has been questioned when using questionnaires. A study by Corder et al.8 entitled "Is it possible to estimate and evaluate physical activity and energy expenditure in young people using self-reports?" investigated children aged 4-17 years using accelerometry and double-marked water as criterion, respectively, for physical activity and energy expenditure. The average validity of instruments (Youth Physical Activity Questionnaire, Children’s Physical Activity Questionnaire, Child Heart and Health Study in England Questionnaire, Swedish Adolescent Physical Activity Questionnaire) evaluated to measure physical activity was 0.32 when correlated with accelerometry, while to measure energy expenditure, there is an underestimation of energy expenditure values around 23 kcal.kg-1.min-1 and mean correlation values of r = -0.38.
Our study reinforces that the NPAQ self-report questionnaire presents low validity to estimate physical activity. Given the low performance of the instrument, some issues should be raised, especially regarding the relationship between physical activity and health.
It is important to highlight that this study may present limitations in the aerobic fitness of children/adolescents, since an indirect method was used to validate the NPAQ questionnaire. However, the study has large sampling n, which made it impossible to perform an aerobic test based on the direct method. Despite these limitations, the study advances in the sense that proxy-report questionnaires should be used with caution.
CONCLUSION
NPAQ showed weak validity in a sample of Brazilian schoolchildren, having as criterion aerobic fitness verified through the indirect Luc Léger test.
Funding
Ethical approval
REFERENCES
- 1 Ridley K, Olds TS, Hill A. The Multimedia Activity Recall for Children and Adolescents (MARCA): development and evaluation. Int J Behav Nutr Phys Act 2006;3:10.
- 2 Corder K, Ekelund U, Steele RM, Wareham NJ, Brage S. Assessment of physical activity in youth. J Appl Physiol 2008;105(3):977-87.
- 3 Trost SG. Measurement of Physical Activity in Children and Adolescents. Am J Lifestyle Med 2007;10(10):1-16.
- 4 Welk GJ, Corbin CB, Dale D. Measurement issues in the assessment of physical activity in children. Res Q Exerc Sport 2000;71(2 Suppl):S59-73.
- 5 Baranowski T, de Moor C. How many days was that? Intra-individual variability and physical activity assessment. Res Q Exerc Sport 2000;71(2 Suppl):S74-78.
- 6 Pate RR, O'Neill JR, Mitchell J. Measurement of physical activity in preschool children. Med Sci Sports Exerc 2010;42(3):508-12.
- 7 Pate RR, Stevens J, Pratt C, Sallis JF, Schmitz KH, Webber LS, et al. Objectively measured physical activity in sixth-grade girls. Arch Pediatr Adolesc Med 2006;160(12):1262-8.
- 8 Corder K, van Sluijs EM, Wright A, Whincup P, Wareham NJ, Ekelund U. Is it possible to assess free-living physical activity and energy expenditure in young people by self-report? Am J Clin Nutr 2009;89(3):862-70.
- 9 Kurtze N, Rangul V, Hustvedt BE. Reliability and validity of the international physical activity questionnaire in the Nord-Trondelag health study (HUNT) population of men. BMC Med Res Methodol. 2008;8:63.
- 10 Kurtze N, Rangul V, Hustvedt BE, Flanders WD. Reliability and validity of selfreported physical activity in the Nord-Trondelag Health Study: HUNT 1. Scand J Public Health 2008;36(1):52-61.
- 11 Oliver M, Schofield GM, Kolt GS, Schluter PJ. Pedometer accuracy in physical activity assessment of preschool children. J Sport Health Sci 2007;10(5):303-10.
- 12 I-Min Lee, Steven N. Blair, JoAnn E. Manson, Ralph S. Paffenbarger J. Epidemiologic Methods in Physical Activity Studies. New York: Oxford University Press; 2009.
- 13 Bielemann RM, Reichert FF, Paniz VM, Gigante DP. Validation of the Netherlands physical activity questionnaire in Brazilian children. Int J Behav Nutr Phys Act 2011;8:45.
- 14 Garson GD. Validity & Reliability. Asheboro, NC: Statistical Associates Publishers; 2016.
- 15 Hutz CS, Bandeira D, Trentini CM. Psicometria. Porto Alegre, R.S.: Artmed Editora Ltda; 2015.
- 16 Instituto Brasileiro de Geografia e Estatística. Pesquisas de Orçamentos Familiares 2008-2009 -Antropometria e Estado Nutricional de Crianças, Adolescentes e Adultos no Brasil. Rio de Janeiro: IBGE; 2010.
- 17 Janz KF, Broffitt B, Levy SM. Validation evidence for the Netherlands physical activity questionnaire for young children: the Iowa bone development study. Res Q Exerc Sport 2005;76(3):363-9.
- 18 Lohman TG, Roche AF, Martorell R. Anthropometric standardization reference manual. Abridged ed. Champaign, Ill.: Human Kinetics Books; 1991. vi, 90p. p.
- 19 Van Mechelen W, Hlobil H, Kemper HC. Validation of two running tests as estimates of maximal aerobic power in children. Eur J Appl Physiol Occup Physiol 1986;55(5):503-6.
- 20 Leger L, Lambert J, Goulet A, Rowan C, Dinelle Y. Aerobic capacity of 6 to 17-year-old Quebecois--20 meter shuttle run test with 1 minute stages. Can J Appl Sport Sci 1984;9(2):64-9.
- 21 Tomkinson GR, Leger LA, Olds TS, Cazorla G. Secular trends in the performance of children and adolescents (1980-2000): an analysis of 55 studies of the 20m shuttle run test in 11 countries. Sports Med Open 2003;33(4):285-300.
- 22 Goncalves R, Szmuchrowski LA, Damasceno VO, de Medeiros ML, Couto BP, Lamounier JA. Association of body mass index and aerobic physical fitness with cardiovascular risk factors in children. Rev Paul Pediatr 2014;32(3):208-214.
- 23 Murphy JK, Alpert BS, Christman JV, Willey ES. Physical fitness in children: a survey method based on parental report. Am J Public Health Res 1988;78(6):708-10.
- 24 Manios Y, Kafatos A, Markakis G. Physical Activity of 6-Year-Old Children: Validation of Two Proxy Reports. Pediatr Exerc Sci 1998;10(2):176-88.
- 25 Telford A, Salmon J, Jolley D, Crawford D. Reliability and Validity of Physical Activity Questionnaires for Children: The Children’s Leisure Activities Study Survey (CLASS). Pediatr Exerc Sci 2004;16(1):64-78.
Publication Dates
-
Publication in this collection
Nov-Dec 2018
History
-
Received
30 Jan 2018 -
Accepted
18 July 2018