Abstract
Objective:
Enuresis is associated with attentional and emotional comorbidities in 20 to 30 % of cases. The Short Screening Instrument for Psychological Problems in Enuresis (SSIPPE) is a questionnaire that allows the initial screening of these comorbidities. This study aimed to translate, culturally adapt, and validate the SSIPPE for Brazilian children and adolescents (SSIPPE-Br).
Methods:
Six steps were performed for translation and cross-cultural adaptation: translation, synthesis of translations, back-translation, preparation of the pre-final version of the translated instrument, test of comprehensibility of the pre-final version of the tool, and elaboration of the instrument cross-culturally adapted for Brazil, named 13-itens version SSIPPE-Br. To validate the SSIPPE-Br, a cross-sectional study was carried out, in which the validated Brazilian version of the Child and Adolescent Behavior Inventory (CABI) was used.
Results:
Validation was performed on 127 children and adolescents with a mean age of 9.7 ± 2.8 years, 48 % male. The reliability was estimated using Cronbach’s alpha, ranging from 0.86 to 0.89, indicating good internal consistency. The factorial analysis had a good agreement adjustment (KMO 0.755, Bartlett’s test < 0.001) and explained 70.5 % of the data variability. In the reproducibility analysis, the Kappa coefficient ranged from 0.94 to 1, which can be considered almost perfect. A highly significant (p-value < 0.001) and direct correlation existed between the three SSIPPE-Br domains and all evaluated CABI domains.
Conclusion:
The SSIPPE-Br is a valid and reliable tool for emotional problems screening and ADHD symptoms in children and adolescents with enuresis whose first language is Brazilian Portuguese.
KEYWORDS
Validation study; Patient health questionnaire; Enuresis; Nocturnal enuresis; Attention-deficit hyperactivity disorder; Psychopathology
Introduction
According to the International Children’s Continence Society (ICCS) criteria, enuresis is a condition characterized by urinary incontinence during sleep in individuals aged at least five years, which occurs at least 1x/month for three consecutive months after the exclusion of all organic causes.11 Austin PF, Bauer SB, Bower W, Chase J, Franco I, Hoebeke P, et al. The standardization of terminology of lower urinary tract function in children and adolescents: update report from the standardization committee of the International Children’s Continence Society. Neurourol Urodyn. 2016;35:471-81.,22 Neveus T, Fonseca E, Franco I, Kawauchi A, Kovacevic L, Nieu-whof-Leppink A, et al. Management, and treatment of nocturnal enuresis-an updated standardization document from the International Children’s Continence Society. J Pediatr Urol. 2020;16:10-9.,33 Harris J, Lipson A, dos Santos J. Evaluation and management of enuresis in the general paediatric setting. Paediatr Child Health. 2023;28:362-76. It is a common condition, and its prevalence in the general population occurs in approximately 10.6 % of children at six years of age and in 5.7 % at 11 years of age, being more common in males.44 Mota DM, Matijasevich A, Santos IS, Petresco S, Mota LM. Psychiatric disorders in children with enuresis at 6 and 11 years old in a birth cohort. J Pediatr. 2020;96:318-26.
Enuresis is associated with psychiatric/psychological comorbidities44 Mota DM, Matijasevich A, Santos IS, Petresco S, Mota LM. Psychiatric disorders in children with enuresis at 6 and 11 years old in a birth cohort. J Pediatr. 2020;96:318-26. in 20 to 30 % of cases.55 von Gontard A, Baeyens D, Van Hoecke E, Warzak WJ, Bachmann C. Psychological and psychiatric issues in urinary and fecal incontinence. J Urol. 2011;185:1432-6. There is an increased risk of conduct problems, oppositional behavior, and Attention Deficit Hyperactivity Disorder (ADHD) in this population,66 Joinson C, Heron J, Emond A, Butler R. Psychological problems in children with bedwetting and combined (day and night) wetting: a UK population-based study. J Pediatr Psychol. 2007;32:605-16. the latter being the most common.77 YangTK, Huang KH, Chen SC, Chang HC, YangHJ, Guo YJ. Correlation between clinical manifestations of nocturnal enuresis and attentional performance in children with attention deficit hyperactivity disorder (ADHD). J Formos Med Assoc. 2013;112:41-7.,88 Amiri S, Shafiee-Kandjani AR, Naghinezhad R, Farhang S, Abdi S. Comorbid psychiatric disorders in children and adolescents with nocturnal enuresis. Urol J. 2017;14:2968-72. Individuals with enuresis are 2.88 times more likely to have ADHD compared to those without enuresis,77 YangTK, Huang KH, Chen SC, Chang HC, YangHJ, Guo YJ. Correlation between clinical manifestations of nocturnal enuresis and attentional performance in children with attention deficit hyperactivity disorder (ADHD). J Formos Med Assoc. 2013;112:41-7. with a prevalence ranging from 28.37 to 74 %.88 Amiri S, Shafiee-Kandjani AR, Naghinezhad R, Farhang S, Abdi S. Comorbid psychiatric disorders in children and adolescents with nocturnal enuresis. Urol J. 2017;14:2968-72. These patients are at greater risk of persistent, treatment-resistant enuresis.99 Tsuji S, Kaneko K. Management of treatment-resistant nocturnal enuresis. Pediatr Int. 2023;65:e15573.,1010 de Sena Oliveira AC, Athanasio BDS, Mrad FCC, Vasconcelos MMA, Albuquerque MR, Miranda DM, et al. Attention deficit and hyperactivity disorder and nocturnal enuresis co-occurrence in the pediatric population: a systematic review and meta-analysis. Pediatr Nephrol. 2021;36:3547-59. The ADHD inattentive presentation is the most prevalent in enuresis, described in approximately 60 %77 YangTK, Huang KH, Chen SC, Chang HC, YangHJ, Guo YJ. Correlation between clinical manifestations of nocturnal enuresis and attentional performance in children with attention deficit hyperactivity disorder (ADHD). J Formos Med Assoc. 2013;112:41-7. to 73.3 %.1111 Abd-Elmoneim N, Elsheshtawy E, Gomaa Z, Elsayed M. Comorbidity between enuresis and attention deficit hyperactivity disorder: a case-control study. Middle East Curr Psychiatry. 2020;27:32. of the patients. Our recent meta-analysis that aimed to answer the central question, "How frequent is the comorbidity of ADHD and enuresis?", demonstrated a significant and reciprocal association between enuresis and ADHD, with the inattentive presentation having a higher relationship with enuresis.1010 de Sena Oliveira AC, Athanasio BDS, Mrad FCC, Vasconcelos MMA, Albuquerque MR, Miranda DM, et al. Attention deficit and hyperactivity disorder and nocturnal enuresis co-occurrence in the pediatric population: a systematic review and meta-analysis. Pediatr Nephrol. 2021;36:3547-59.
The condition impacts children’s functionality.11 Austin PF, Bauer SB, Bower W, Chase J, Franco I, Hoebeke P, et al. The standardization of terminology of lower urinary tract function in children and adolescents: update report from the standardization committee of the International Children’s Continence Society. Neurourol Urodyn. 2016;35:471-81.,22 Neveus T, Fonseca E, Franco I, Kawauchi A, Kovacevic L, Nieu-whof-Leppink A, et al. Management, and treatment of nocturnal enuresis-an updated standardization document from the International Children’s Continence Society. J Pediatr Urol. 2020;16:10-9. It can compromise the quality of life with low self-esteem, changes in school performance, and decreased socialization with peers.1212 Rangel RA, Seabra CR, Ferrarez CE, Soares JL, Choi M, Cotta RG, et al. Quality of life in enuretic children. Int Braz J Urol. 2021;47:535-41.,1313 Sa CA, Martins de Souza SA, Villela MC, Souza VM, de Souza MH, de Figueiredo AA, et al. Psychological intervention with parents improves treatment results and reduces punishment in children with enuresis: a randomized clinical trial. J Urol. 2021;205:570-6.,1414 Iscan B, Ozkayin N. Evaluation of health-related quality of life and affecting factors in child with enuresis. J Pediatr Urol. 2020;16. 195.e1-7. The psychological comorbidities screening is recommended in patients with enuresis.11 Austin PF, Bauer SB, Bower W, Chase J, Franco I, Hoebeke P, et al. The standardization of terminology of lower urinary tract function in children and adolescents: update report from the standardization committee of the International Children’s Continence Society. Neurourol Urodyn. 2016;35:471-81.,22 Neveus T, Fonseca E, Franco I, Kawauchi A, Kovacevic L, Nieu-whof-Leppink A, et al. Management, and treatment of nocturnal enuresis-an updated standardization document from the International Children’s Continence Society. J Pediatr Urol. 2020;16:10-9.,55 von Gontard A, Baeyens D, Van Hoecke E, Warzak WJ, Bachmann C. Psychological and psychiatric issues in urinary and fecal incontinence. J Urol. 2011;185:1432-6. Standardized and validated questionnaires are essential for adequate screening associated with a thorough clinical history and physical examination.55 von Gontard A, Baeyens D, Van Hoecke E, Warzak WJ, Bachmann C. Psychological and psychiatric issues in urinary and fecal incontinence. J Urol. 2011;185:1432-6.,1515 Chase J, Bower W, Gibb S, Schaeffer A, von Gontard A. Diagnostic scores, questionnaires, quality of life, and outcome measures in pediatric continence: a review of available tools from the International Children’s Continence Society. J Pediatr Urol. 2018;14:98-107.
To enable initial screening of emotional, behavioral, and attentional comorbidities in children and adolescents with enuresis, Hoecke et al.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. developed in Belgium and validated in English in 2007, the Short Screening Instrument for Psychological Problems in Enuresis (SSIPPE) based on Child Behavior Checklist (CBCL)1717 Achenbach TM. Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry; 1991. and Disruptive Behavior Disorders Rating Scale (DBDRS).1818 Oosterlaan J, Scheres A, Antrop I, Roeyers H, Sergeant JA. Han-dleiding Vragenlijst voor Gedragsproblemen bij Kinderen (VvGK) (Manual of the Disruptive Behavior Disorder Rating Scale [DBDRS]). Lisse, The Netherlands: Swets and Zeitlinger BV, Swets Test Services; 2000. The instrument composed of 13 dichotomous items that assess three main domains: one for emotional problems and two for ADHD symptoms is recommended by the ICCS.11 Austin PF, Bauer SB, Bower W, Chase J, Franco I, Hoebeke P, et al. The standardization of terminology of lower urinary tract function in children and adolescents: update report from the standardization committee of the International Children’s Continence Society. Neurourol Urodyn. 2016;35:471-81.,22 Neveus T, Fonseca E, Franco I, Kawauchi A, Kovacevic L, Nieu-whof-Leppink A, et al. Management, and treatment of nocturnal enuresis-an updated standardization document from the International Children’s Continence Society. J Pediatr Urol. 2020;16:10-9. If two or more items score positively in a domain, a full psychiatric/psychological screening is required.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5.
To use a screening tool, it is important to have a cross-cultural validation process for the population to be applied that follows internationally accepted standards, that is, the items must not only be translated appropriately from a linguistic point of view but also culturally adapted, maintaining the validity of the original1919 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186-91.,2020 Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17:268-74.,2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.,2222 Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by experts. MethodsX. 2021;8:101326. In this context, the objective of this study was to carry out the process of translation, cross-cultural adaptation and validation of the SSIPPE1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. for Brazilian children and adolescents with enuresis.1919 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186-91.,2020 Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17:268-74.,2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.,2222 Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by experts. MethodsX. 2021;8:101326. The Child and Adolescent Behavior Inventory (CABI)2323 Cianchetti C, Pittau A, Carta V, Campus G, Littarru R, Ledda MG, et al. Child and Adolescent Behavior Inventory (CABI): a new instrument for epidemiological studies and pre-clinical evaluation. Clin Pract Epidemiol Ment Health. 2013;9:51-61.,2424 Cianchetti C, Pittau A, Carta V, Campus G, Littarru R, Ledda MG, et al. Child and Adolescent Behavior Inventory (CABI): a new instrument for epidemiological studies and pre-clinical evaluation. Clin Pract Epidemiol Ment Health. 2019;15:44-8. validated for Brazilian Portuguese2525 Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22. was used for this validation process.
Methods
Ethical approval
The project was approved by the ethics board of the Federal University of Minas Gerais, Brazil (registry: 86,171,118.0.0000.5149) and by the principal author of the original SSIPPE study.
Instruments
Short Screening Instrument for Psychological Problems in Enuresis (SSIPPE)
This instrument was developed and validated by Hoecke et al.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. as a screening tool for early detection of emotional problems, inattention, and hyperactivity/impulsivity in children and adolescents with enuresis. The SSIPPE was based on the items with the highest load on the CBCL1717 Achenbach TM. Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry; 1991./DBDRS1818 Oosterlaan J, Scheres A, Antrop I, Roeyers H, Sergeant JA. Han-dleiding Vragenlijst voor Gedragsproblemen bij Kinderen (VvGK) (Manual of the Disruptive Behavior Disorder Rating Scale [DBDRS]). Lisse, The Netherlands: Swets and Zeitlinger BV, Swets Test Services; 2000. subscales in a sample of enuretic individuals with psychological and psychiatrics comorbidities symptoms. The classification accuracy (absent/present) for each subscale is around 88 %. The three SSIPPE subscales had an excellent specificity (0.91 to 0.99), which indicates that a negative prediction (less than two positive items) on the SSIPPE is reliable and leads to few false-negative results. The questionnaire has 13 questions divided into three parts. In the first part, the person responsible for the participant must answer seven questions related to emotional problems. The second and third parts are composed of three questions each, assessing symptoms of inattention, hyperactivity and impulsivity, respectively. The questions’ answer format is yes, if signs or symptoms are present, and no, for their absence. If more than two items are marked as yes in any SSIPPE domain, the participant should be referred for a mental health evalua-tion1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. (Supplement 1 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
Child and Adolescent Behavior Inventory (CABI)
The CABI is a parental questionnaire that assesses different domains of child behavior and psychopathology based on the Diagnostic and Statistical Manual of Mental Disorders (DSM-5)2626 American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. American Psychiatric Association; 2022, (5th ed., text rev.). referring to the last six months. The inventory includes 75 items grouped by psychopathological areas, which facilitate application and interpretation with the following distribution: five items for anxiety, four for somatic symptoms, ten for depression, five for Oppositional Defiant Disorder, five for Conduct Disorder and nine for ADHD.2323 Cianchetti C, Pittau A, Carta V, Campus G, Littarru R, Ledda MG, et al. Child and Adolescent Behavior Inventory (CABI): a new instrument for epidemiological studies and pre-clinical evaluation. Clin Pract Epidemiol Ment Health. 2013;9:51-61.,2424 Cianchetti C, Pittau A, Carta V, Campus G, Littarru R, Ledda MG, et al. Child and Adolescent Behavior Inventory (CABI): a new instrument for epidemiological studies and pre-clinical evaluation. Clin Pract Epidemiol Ment Health. 2019;15:44-8. The CABI has validity and reliability similar to the CBCL.1717 Achenbach TM. Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry; 1991. For our study, the authors used the Brazilian version of the CABI because it is a valid and reliable inventory that assesses individuals’ behavior aged between six and 18 years2525 Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22. (Supplement 2 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
Study design
The study design was carried out in two stages, following rigorous guidelines.1919 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186-91.,2020 Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17:268-74.,2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.,2222 Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by experts. MethodsX. 2021;8:101326. First, the instrument was translated into Brazilian Portuguese, and culturally adapted for the Brazilian population by a committee of experts (composed of six physicians and a physiotherapist, with experience in urology and pediatric psychiatry). Second, the validation process was carried out (Supplement 3 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
Stage 1: the translation and the cross-cultural adaptation
The original SSIPPE was translated independently by two translators from the expert committee whose mother language is Brazilian Portuguese and who are fluent in English. Two translated versions were generated (T1 and T2). A third translator, whose native language is Brazilian Portuguese, fluent in English and who did not participate in the initial translation, prepared the translations’ synthesis (T3). The experts’ committee resolved the ambiguities and discrepancies during the translations’ synthesis and preparation.
The translations’ synthesis was then back-translated, independently into English, by a bilingual translator whose mother language is English. This translator did not participate in the previous stages, was not a health professional, and was not informed about the instrument’s concepts explored. The back-translation into English, carried out without knowledge of the questionnaire’s original version, resulted in an instrument version called R1.
The experts’ committee analyzed the versions generated in the previous stages (T1, T2, T3 and R1) and compared them with the original questionnaire. The committee evaluated, reviewed, and consolidated the instructions, items, and response format of the translated and R1 versions about the conceptual, semantic, and content equivalence of the instrument in the original language. The committee also prepared the pre-final version of the instrument in Brazilian Portuguese (T4) for the transcultural adaptation.
A pre-test was carried out to evaluate the operational equivalence, verbal understanding, and clarity of the items in the instrument’s pre-final version (T4). This version was then applied to 40 randomly recruited people from different age groups and education levels. The expert committee analyzed the pre-test results. The necessary changes to the questionnaire were made according to the difficulties encountered by participants in the pre-test phase. The guiding question for evaluating the T4 version was: “Did you understand what was asked?” with an answer in the format “YES” for when they understood or “NO” for when they did not understand. After the final consensus, the SSIPPE’s final version was created, translated, and cross-culturally adapted for the Brazilian population, called SSIPPE-Br (T5) and shown in Figure 1. Subsequently, this version of the SSIPPE-Br was sent to the principal author of the original instrument, for approval.
Brazilian version of the Short Screening Instrument for Psychological Problems in Enuresis (SSIPPE-Br) authorized by Van Hoecke et al.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5.
Stage 2: validation of the SSIPPE-Br in a sample of Brazilian children and adolescents
In the second stage, a cross-sectional observational study was carried out in a sample of Brazilian children and adolescents to assess the equivalence of the measure through psychometric analysis of the reliability and validity of the culturally adapted instrument. 22 Neveus T, Fonseca E, Franco I, Kawauchi A, Kovacevic L, Nieu-whof-Leppink A, et al. Management, and treatment of nocturnal enuresis-an updated standardization document from the International Children’s Continence Society. J Pediatr Urol. 2020;16:10-9. The CABI’s Brazilian version2525 Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22. was used to validate the SSIPPE-Br. A trained researcher read the cross-culturally adapted version of the SSIPPE with the parents during the application. The face-to-face application of the questionnaires was repeated seven days after, to assess the test-retest reliability. The researchers used a stopwatch and recorded the time in minutes taken to complete the questionnaires.
Study population
The study population consisted of 150 children and adolescents aged between six and 17 years, randomly recruited from local public and private schools and the Enuresis Ambulatory from March to October 2022. The socioeconomic level was measured using the Brazil Socioeconomic Classification Criteria, 2022. Patients diagnosed with ADHD undergoing drug treatment were excluded.
Sample calculation
There has yet to be a consensus on the ideal sample size for validation studies.2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42. Kline2727 Kline P. Handbook of Psychological Testing. 2nd ed. London: Routledge; 2013. suggested an interval rule of four to 10 subjects per variable, with a minimum number of 100 participants that can be used for the sample calculation of these studies, which was used as a guideline for the definition of our sample.
Statistical analysis
Statistical analysis was performed using the IBM® SPSS® Statistics Version 21 statistical package (Microsoft Co., New York, NY, USA). For all statistical procedures, a confidence interval (CI) of 95% was applied, and the level of significance was set as p < 0.05.
Sample characterization
Sample characterization included frequency distribution tables to express categorical variables and measures of central tendency, position, and variability to show numeric variables.
Reliability
Internal consistency analysis
The internal consistency of each dimension proposed for the SSIPPE-Br was assessed using Cronbach’s alpha coefficient. Values between 0.70 and 0.95 indicated a measure of good internal consistency.2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.
Reproducibility analysis
The reproducibility of the SSIPPE-Br was evaluated using the Kappa coefficient, comparing the responses obtained for each item and domain in the test and retest (seven-day interval). The interpretation of the Kappa coefficient values was as follows: < 0 no agreement; 0-0.19 poor agreement; 0.20-0.39 fair agreement; 040-0.59 moderate agreement; 0.60 -0.79 substantial agreement and 0.80-1.00 almost perfect agreement.2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.
Validity assessment
Content validity index (CVI)
It measured the proportion or percentage of an experts ‘panel who agree with specific aspects and items of the instrument. The number of experts for content validation must be at least six, and acceptable CVI values must be at least 0.83.
The authors use three parameters: I-CVI (item-level content validity index), which measures the proportion of content experts who give the item a relevance rating of 3 or 4; S-CVI/ Ave (scale-level content validity index using the mean), which shows the average I-CVI scores for all scale items; S-CVI/UA (scale-level content validity index based on universal agreement method): the proportion of scale items that achieve a relevance scale of 3 or 4 by all experts. The universal agreement (UA) score is 1 when the item has reached 100 % expert agreement; otherwise, the UA score is zero.2828 Yusoff MS. ABC of content validation and content validity index calculation. EducMed J. 2019;11:49-54.
Factor analysis
Factor analysis was performed using the principal components method with the variables that constitute the SSIPPE. In this analysis, the adjustment’s quality of the factor analysis model was estimated using the indices "Kaiser Meyer Olkin test (KMO)" and "Bartlett’s sphericity test" (Bartlett’s test).
The total percentage of variance explained by the model, eigenvalues and scree plot were evaluated to define the number of factors to be considered. The factors’ maximum number was considered in the stability point of the scree plot, representing the factors’ number to be considered in the analysis. The factor matrix was created using varimax rotation, and items with a factor loading less than 0.40 were excluded.
Comparison between SSIPPE and CABI scores
The scores of the following CABI domains were considered: somatic symptoms (items 1 to 4), depression (items 19 to 28), impulsivity (items 43 to 45), hyperactivity (items 46 to 48), and inattention (items 49 to 51). These domains were selected considering the similarity with the constructs measured by the SSIPPE-Br and were also calculated by the sum of their respective items. Both instruments’ scores were compared using the Spearman Correlation Coefficient (rsp).
Results
Sample characterization
Of the 150 participants recruited for this study, 127 were eligible with a mean age of 9.7 ± 2.8 years (48 % male). Eight patients diagnosed with ADHD undergoing drug treatment and 15 participants who did not respond to the questionnaires were excluded. Table 1 displays a description of the sample. The SSIPPE-Br items with positive responses are shown in Supplement 4 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. .
Characterization of the analysed sample referring to sociodemographic and clinical data (n = 127).
Internal consistency analysis
Cronbach’s alpha values calculated for the complete SSIPPE-Br and for each proposed domain ranged from 0.86 to 0.89, indicating very good internal consistency (Table 2). In addition, Cronbach’s alpha values were calculated if any scale item was excluded (Supplement 6 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
Values of Cronbach alfa coefficient considering total SSIPPE-Br and each of the three proposed dimensions (emotional problems, inattention symptoms and hyperactivity and impulsivity symptoms) - (n = 127).
Reproducibility analysis
One hundred and eleven individuals were evaluated in the test and retest analysis (87.4 % of the original sample) (Supplement 6 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ). Among the items in the emotional problems domain, the Kappa coefficient assessment in the total sample varied between 0.96 and 1 (almost perfect).
Content validity index
The I-CVI was equal to 1 for 12 questions; only question four was not scored by three experts. S-CVI/AVE was 0.96, and S-CVI/UA was 0.92. There was agreement on 12 questions among six experts, except for question number four in the emotional domain, “Your child sometimes feels sick” (Supplement 7 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
Factor analysis
The 13 SSIPPE variables distributed across three domains (theoretical model) were included in the factor analysis. A “scree plot” was created (Figure 2) that helped define the factors’ number for analysis and build a model with three factors and 13 items (Supplement 8 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
No item presented reduced factor loading (< 0.40). The standard factor analysis model showed good adjustment according to the KMO test (0.755) and Bartlett’s test (< 0.001) and explained 70.5 % of the data variability with results identical to the theoretical model.
Correlation between SSIPPE-Brand CABI scores
There was a highly significant (p-value < 0.001) and direct correlation (positive coefficients) between the three SSIPPE-Br domains and all evaluated CABI domains (Supplement 9 Supplementary materials Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001. ).
The median time for applying the SSIPPE-Br, total test-retest, was two minutes (two to three). In relation to the CABI’s Brazilian version,2525 Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22. the median time to perform the test and retest was nine (eight to 10) and 10 (nine to 12) minutes, respectively.
Discussion
The SSIPPE is a cost-free screening tool originally developed in English to assess emotional problems and ADHD symptoms in children and adolescents with enuresis.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. In this study, the authors translated and cross-culturally adapted the SSIPPE to a Brazilian version following a strict methodological approach and examined its reliability (internal consistency through Cronbach’s Alpha and stability/ reproducibility through KAPPA) and validity (content validity through the I-CVI, S-CVI/AVE and S-CVI/UA and factor analysis through the KMO and Bartlett test) in an adequate sample size.1919 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186-91.,2020 Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17:268-74.,2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.,2222 Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by experts. MethodsX. 2021;8:101326. Our results support SSIPPE-Br as a valid, reliable, and easy-to-use tool.
The authors evaluated all the SSIPPE-Br’s psychometric properties in 127 participants aged six to 17 years. The reliability estimate through internal consistency was considered good,2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42. with Cronbach’s alpha of the total SSIPPE-Br of 0.89, ranging from 0.86 to 0.89 for one of the three domains. Deleting any items that make up the SSIPPE’s three domains would not increase its internal consistency. Our results further supported the reliability, homogeneity, and construct validity of the SSIPPE1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. The three original SSIPPE domains exhibit excellent specificity (0.91 to 0.99), which indicates that a negative prediction (less than two positive items) determines a few false-negative results.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5. The authors also demonstrated excellent stability/reproducibil-ity of SSIPPE-Br through test-retest in our sample (Kappa 1). The authors opted for a week to repeat the examination, as there seems unlikely to be any change in the reported clinical symptoms in such a short time. In addition, the time must be sufficient to avoid recalling the answers given.2121 Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.
Regarding content validation, the SSIPPE-Br proved to be valid according to experts’ assessment, with CVI values above the critical limit of 0.832828 Yusoff MS. ABC of content validation and content validity index calculation. EducMed J. 2019;11:49-54. for all items evaluated. The authors emphasize that some changes were made to the instrument to meet the demands presented in the pre-test in the cross-cultural adaptation phase. At the end of this stage, it was understood that the content of the SSIPPE-Br was clear, applicable, and relevant for the assessment of the proposed symptoms.
In the original SSIPPE study, to assess validity, seven items with factor loadings > 0.65 were used for emotional problems based on the CBCL scale and three items with factor loadings > 0.80 and 0.75, respectively, for Inattention and Hyperactivity/Impulsivity based on DBDRS scale. Our results showed a factor analysis similar to the original study, with factor loading values for the seven items related to emotional problems between 0.64 and 0.79. For the three symptoms of inattention, factor loadings values were between 0.77 and 0.88 and, for the three symptoms of hyperactivity, between 0.82 and 0.86. These factor loading values were considered with good to excellent adequacy, being similar to the original study.1616 Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5.
The present study showed a high positive correlation between the SSIPPE-Br and all the Brazilian version CABI2525 Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22. domains evaluated. The highest coefficients were observed when comparing the emotional problems domain of the SSIPPE-Br and somatic symptoms of the CABI (rsp = 0.82) and when comparing the inattention constructs of both questionnaires (rsp = 0.66). The psychometric analysis of the validated Brazilian version of the CABI2525 Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22. showed high reliability for internalizing and externalizing symptoms (hyperactivity and impulsivity) and inattention. Cianchetti et al.2929 Cianchetti C, Faedda N, Pasculli M, Ledda MG, Diaz G, Peschechera A, et al. Predictive validity for the clinical diagnosis of a new parent questionnaire, the CABI, compared with CBCL. Clin Child Psychol Psychiatry. 2020;25: 507-19. reported that the CABI has good predictive validity compared to the CBCL,1717 Achenbach TM. Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry; 1991. with the advantage of being a shorter instrument.
Our study has several limitations. Although the sample size was adequate, a convenience sample may not represent the Brazilian population in terms of gender and socioeco-nomic level. The SSIPPE-Br was applied to the general population with 13 % (17/127) of children and adolescents with enuresis, which may, at least in part, limit the criterion validity analysis. It is worth noting that the present study has some strengths, as it adopted the steps recommended for translation, cross-cultural adaptation, and validation of the SSIPPE-Br and tested the validity and reliability of the instrument.
The SSIPPE-Br is a valid and reliable tool for screening emotional problems and ADHD symptoms in children and adolescents (six to 17 years) with enuresis whose first language is Brazilian Portuguese. The use of a quick, cost-free, and easy-to-apply screening instrument, such as the SSIPPE-Br, allows an efficient assessment of these comorbidities by general pediatricians and will indicate if a complete psychiatric/psychological evaluation is necessary.
-
☆
Institution where the research was carried out: Universidade Federal de Minas Gerais.
-
Abbreviations:
- ADHD Attention-Deficit Hyperactivity Disorder
- BARTLETT’S TEST Bartlett’s Test of Sphericity
- CABI Child and Adolescent Behavior Inventory
- CBCL Children Behavior Checklist
- DBDRS Disruptive Behavior Disorders Rating Scale
- DSM-5 Diagnostic Statistical Manual 5th Edition
- ODD Oppositional Defiant Disorder
- CD Conduct Disorder
- CI Confidence Interval
- ICCS International Children’s Continence Society
- I-CVI item-level content validity index
- KMO Kaiser Meyer Olkin
- rsp Spearman’s Correlation Coefficient
- S-CVI/AVE scale-level content validity index
- S-CVI/UA (scale-level content validity index based on universal agreement
- SSIPPE Short Screening Instrument for Psychological Problems in Enuresis
- SSIPPE-Br SSIPPE-Br Brazilian version of the Short Screening Instrument for Psychological Problems in Enuresis
- UA Universal agreement
-
FundingThis study was financed by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) Finance Code 001 and by Pró-reitoria de Pesquisa-Universidade Federal de Minas Gerais Grant PRPQ-UFMG 26048*104.
Acknowledgments
The authors would like to thank Dr Eline Van Hoecke for the permission to use the Short Screening Instrument for Psychological Problems in Enuresis, in this study. The authors also thank the patients and their parents who participated in this study.
Supplementary materials
Supplementary material associated with this article can be found in the online version at doi: 10.1016/j.jped.2023. 11.001.
References
-
1Austin PF, Bauer SB, Bower W, Chase J, Franco I, Hoebeke P, et al. The standardization of terminology of lower urinary tract function in children and adolescents: update report from the standardization committee of the International Children’s Continence Society. Neurourol Urodyn. 2016;35:471-81.
-
2Neveus T, Fonseca E, Franco I, Kawauchi A, Kovacevic L, Nieu-whof-Leppink A, et al. Management, and treatment of nocturnal enuresis-an updated standardization document from the International Children’s Continence Society. J Pediatr Urol. 2020;16:10-9.
-
3Harris J, Lipson A, dos Santos J. Evaluation and management of enuresis in the general paediatric setting. Paediatr Child Health. 2023;28:362-76.
-
4Mota DM, Matijasevich A, Santos IS, Petresco S, Mota LM. Psychiatric disorders in children with enuresis at 6 and 11 years old in a birth cohort. J Pediatr. 2020;96:318-26.
-
5von Gontard A, Baeyens D, Van Hoecke E, Warzak WJ, Bachmann C. Psychological and psychiatric issues in urinary and fecal incontinence. J Urol. 2011;185:1432-6.
-
6Joinson C, Heron J, Emond A, Butler R. Psychological problems in children with bedwetting and combined (day and night) wetting: a UK population-based study. J Pediatr Psychol. 2007;32:605-16.
-
7YangTK, Huang KH, Chen SC, Chang HC, YangHJ, Guo YJ. Correlation between clinical manifestations of nocturnal enuresis and attentional performance in children with attention deficit hyperactivity disorder (ADHD). J Formos Med Assoc. 2013;112:41-7.
-
8Amiri S, Shafiee-Kandjani AR, Naghinezhad R, Farhang S, Abdi S. Comorbid psychiatric disorders in children and adolescents with nocturnal enuresis. Urol J. 2017;14:2968-72.
-
9Tsuji S, Kaneko K. Management of treatment-resistant nocturnal enuresis. Pediatr Int. 2023;65:e15573.
-
10de Sena Oliveira AC, Athanasio BDS, Mrad FCC, Vasconcelos MMA, Albuquerque MR, Miranda DM, et al. Attention deficit and hyperactivity disorder and nocturnal enuresis co-occurrence in the pediatric population: a systematic review and meta-analysis. Pediatr Nephrol. 2021;36:3547-59.
-
11Abd-Elmoneim N, Elsheshtawy E, Gomaa Z, Elsayed M. Comorbidity between enuresis and attention deficit hyperactivity disorder: a case-control study. Middle East Curr Psychiatry. 2020;27:32.
-
12Rangel RA, Seabra CR, Ferrarez CE, Soares JL, Choi M, Cotta RG, et al. Quality of life in enuretic children. Int Braz J Urol. 2021;47:535-41.
-
13Sa CA, Martins de Souza SA, Villela MC, Souza VM, de Souza MH, de Figueiredo AA, et al. Psychological intervention with parents improves treatment results and reduces punishment in children with enuresis: a randomized clinical trial. J Urol. 2021;205:570-6.
-
14Iscan B, Ozkayin N. Evaluation of health-related quality of life and affecting factors in child with enuresis. J Pediatr Urol. 2020;16. 195.e1-7.
-
15Chase J, Bower W, Gibb S, Schaeffer A, von Gontard A. Diagnostic scores, questionnaires, quality of life, and outcome measures in pediatric continence: a review of available tools from the International Children’s Continence Society. J Pediatr Urol. 2018;14:98-107.
-
16Van Hoecke E, Baeyens D, Vanden Bossche H, Hoebeke P, Vande Walle J. Early detection of psychological problems in a population of children with enuresis: construction and validation of the Short Screening Instrument for Psychological Problems in Enuresis. J Urol. 2007;178:2611-5.
-
17Achenbach TM. Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry; 1991.
-
18Oosterlaan J, Scheres A, Antrop I, Roeyers H, Sergeant JA. Han-dleiding Vragenlijst voor Gedragsproblemen bij Kinderen (VvGK) (Manual of the Disruptive Behavior Disorder Rating Scale [DBDRS]). Lisse, The Netherlands: Swets and Zeitlinger BV, Swets Test Services; 2000.
-
19Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186-91.
-
20Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17:268-74.
-
21Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34-42.
-
22Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by experts. MethodsX. 2021;8:101326.
-
23Cianchetti C, Pittau A, Carta V, Campus G, Littarru R, Ledda MG, et al. Child and Adolescent Behavior Inventory (CABI): a new instrument for epidemiological studies and pre-clinical evaluation. Clin Pract Epidemiol Ment Health. 2013;9:51-61.
-
24Cianchetti C, Pittau A, Carta V, Campus G, Littarru R, Ledda MG, et al. Child and Adolescent Behavior Inventory (CABI): a new instrument for epidemiological studies and pre-clinical evaluation. Clin Pract Epidemiol Ment Health. 2019;15:44-8.
-
25Costa DS, Cianchetti C, Dewey D, Junior AM, Kestelman I, da Silva AG, et al. Cross-cultural adaptation, validity, and reliability of the Child and Adolescent Behavior Inventory (CABI) for use in Brazil. J Pediatr. 2023;99:413-22.
-
26American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. American Psychiatric Association; 2022, (5th ed., text rev.).
-
27Kline P. Handbook of Psychological Testing. 2nd ed. London: Routledge; 2013.
-
28Yusoff MS. ABC of content validation and content validity index calculation. EducMed J. 2019;11:49-54.
-
29Cianchetti C, Faedda N, Pasculli M, Ledda MG, Diaz G, Peschechera A, et al. Predictive validity for the clinical diagnosis of a new parent questionnaire, the CABI, compared with CBCL. Clin Child Psychol Psychiatry. 2020;25: 507-19.
Publication Dates
-
Publication in this collection
13 May 2024 -
Date of issue
Mar-Apr 2024
History
-
Received
01 June 2023 -
Accepted
01 Nov 2023 -
Published
25 Nov 2023