Health related quality of life of Dutch children: psychometric properties of the PedsQL in the Netherlands
© Engelen et al; licensee BioMed Central Ltd. 2009
Received: 08 January 2009
Accepted: 03 November 2009
Published: 03 November 2009
Knowledge about psychometric properties of the Pediatric Quality of Life Inventory (PedsQL) in the Netherlands is limited and Dutch reference data are lacking. Aim of the current study is to collect Dutch reference data of the PedsQL and subsequently assess reliability, socio-demographic within-group differences and construct validity.
In this study the PedsQL was administered to Dutch children aged 5 to 18 years. A socio-demographic questionnaire was completed as well. The sample consisted of three age groups: 5-7 years (parent proxy report), 8-12 years and 13-18 years (child self report). Analysis was performed with SPSS 16.0.2. A reliability analysis was done using Cronbach's alpha coefficient. Socio-demographic within-group differences were assessed by means of an ANOVA with post hoc Bonferroni correction and t-tests. Subsequently, construct validity was determined by t-tests and effect sizes.
For 496 children PedsQL reference data were collected. PedsQL total scores were 84.18 (group 5-7), 82.11 (group 8-12) and 82.24 (group 13-18). Internal consistency coefficients ranged from .53 to .85. Socio-demographic within-group differences demonstrated that, in group 8-12, children of parents born in the Netherlands had significantly lower scores on several PedsQL subscales, compared to children of parents born in another country. With respect to construct validity, healthy children of group 5-7 and 13-18 scored significantly higher than children with a chronic health condition on all subscales, except for emotional functioning. In group 5-7, the PedsQL total score for healthy children was 85.31, whereas the same age group with a chronic health condition scored 78.80. Effect sizes in this group varied from 0.58 to 0.88. With respect to group 13-18, healthy children obtained a PedsQL total score of 83.14 and children suffering from a chronic health condition 77.09. Effect sizes in this group varied from 0.45 to 0.67. No significant differences were found in group 8-12 regarding health.
The Dutch version of the PedsQL has adequate psychometric properties and can be used as a health related quality of life instrument in paediatric research in the Netherlands.
The World Health Organization defines quality of life (QOL) as "individuals' perceptions of their position in life, in the context of the culture and value systems in which they live, and in relation to their goals, expectations, standards and concerns" . The concept of health related quality of life (HRQOL) refers to the impact of health and illness on an individual's QOL . It is generally accepted that HRQOL is a multidimensional construct incorporating at least three broad domains: physical, psychological and social functioning .
To assess HRQOL in children, different questionnaires are needed for different age groups. Comparison of HRQOL outcomes in children from different age groups or over time is complicated. It is important to consider the use of proxy ratings as substitutes for ratings made by children themselves. A case in point would be when a child is too young or too ill to complete the questionnaires himself .
In recent years, several HRQOL questionnaires for children were developed. Examples of questionnaires which can be administered to both healthy and chronically ill children are the TAPQOL , TACQOL , Kidscreen  and CHQ . These are referred to as generic questionnaires. For children with a chronic health condition, disease specific questionnaires were designed as well, e.g. the Disabkids .
The Pediatric Quality of Life Inventory 4.0 Generic Core Scale (PedsQL) measures HRQOL in both healthy and chronically ill children. Besides a 23-item generic module, the PedsQL has several disease specific modules, for instance for asthma , cancer  and cerebral palsy . The PedsQL encompasses four domains of HRQOL: physical, emotional, social and school functioning and covers a broad age range, including child self-reports as well as parent proxy-reports. Both comprise age versions 5-7, 8-12 and 13-18 years; parent proxy-report also incorporates ages 2-4 years. Feasibility, reliability and validity of the PedsQL are found to be good . Although translated and studied before , knowledge about psychometric properties of the PedsQL in the Netherlands is limited and Dutch reference data are lacking.
Aim of the current study is to collect Dutch reference data of the PedsQL and subsequently assess reliability, socio-demographic within-group differences and construct validity of this instrument in the Netherlands.
The PedsQL Generic Core Scale was administered to Dutch children aged 5 to 18 years between October 2006 and January 2007. Stratification criteria for school were geographic location (urban, suburban and rural), percentage of migrant children (low, middle and high) and level of education (low, middle and high).
Parents received a letter concerning the purpose and procedure of the study. Confidential processing of personal information and collected data was explained and guaranteed. Furthermore, a socio-demographic questionnaire and a form for non-participants were enclosed. Parents were requested to complete the socio-demographic questionnaire and send it back to school. If parents did not want to participate they were asked to fill out the non-participants form.
Three age versions of the PedsQL were administered in this study: parent proxy-report ages 5-7 years (group 5-7), child self-report ages 8-12 years (group 8-12) and ages 13-18 years (group 13-18). For the purpose of this study, the PedsQL was converted into two computer programs: one stand alone computer version (group 5-7 and 8-12) and an internet version (group 13-18). Layout of both programs was identical and resembled the paper version as much as possible, except that questions were presented one at a time instead of all at once and missing values were not accepted.
Parents and children from group 5-7 and group 8-12 were invited to school to complete the PedsQL on a laptop. Group 13-18 filled out the PedsQL via internet in a computer room at school. It concerned a simultaneous procedure, in which several children participated at the same time. Each child logged in on a website with a unique personal number. In all groups, two psychology students clarified the procedure and made sure children did not interfere with classmates. During all administrations PedsQL Manual instructions were observed.
The study was approved by the Medical Ethics Committee of the Amsterdam Medical Centre, the Netherlands.
The PedsQL accentuates perceptions of children and reflects their universal concerns on four subscales: physical (8 items), emotional (5 items), social (5 items) and school functioning (5 items). Each of the 23 items states a problem, for example "difficulty walking". The parent or child indicates on a 5-point Likert scale to what extent the child had difficulties with that problem. Answering options are never (0), almost never (1), sometimes (2), often (3) and almost always (4). Each answer is reversed scored and rescaled to 0-100 scale (0 = 100, 1 = 75, 2 = 50, 3 = 25 and 4 = 0). A score of 100 represents the best quality of life possible, a score of 0 the worst. Completion time is about 5-10 minutes. Parent proxy-reports are a parallel version of the child self-reports. Differences are the use of age appropriate language and first- or third-person tense. The PedsQL refers to two different periods of time: the past month or the past week . The past week version was used in this study.
The socio-demographic questionnaire consists of five items concerning the parent (date of birth, gender, country of birth, education and employment) and six items with respect to the child (date of birth, gender, presence of a chronic disease, contact with general practitioner and/or medical specialist over the past year, received psychological care over the past year).
The non-participants form is a brief list on which parents and children can indicate they are not interested in participating in this study. Parents are additionally requested to complete the five previously mentioned socio-demographic questionnaire items.
Data were analyzed with SPSS 16.0.2. Differences between participants and non-participants with respect to gender, country of birth and employment were analysed by means of Chi2 test. Age differences were examined with a t-test; a Mann-Whitney test was performed for education. Difference was made between low education (no education, primary school and primary vocational education) middle education (secondary school and secondary vocational education) and high education (higher vocational education and university). PedsQL scores were computed according to the PedsQL Manual and a reliability analysis was done using Cronbach's alpha coefficient based on average inter item correlation (according to SPSS 16.0.2). Socio-demographic within-group differences regarding PedsQL scores were assessed by means of an ANOVA with post hoc Bonferroni correction (p < .0167) for age group and education and t-tests for gender, country of birth and employment. Subsequently, construct validity was determined by t-tests and effect sizes (es), analysing differences in PedsQL scores (per age group) between healthy and chronically ill children and between children that did or did not visit their general practitioner, medical specialist or psychologist over the past year. Effect sizes were calculated dividing the difference in mean scores between the chronically ill and healthy group by the standard deviation of the healthy group. For the group of children that visited their general practitioner, medical specialist or psychologist effect sizes were determined thru the same formula, with the chronically ill group being replaced by respectively the group of children that visited the general practitioner, the medical specialist or psychologist. Effect sizes up to 0.2 were considered to be small, effect sizes of about 0.5 moderate and effect sizes of about 0.8 large .
In total, 891 children from Amsterdam and surrounding regions were approached. They attended four elementary schools (three suburban, one urban), four high schools (one rural, one suburban, two urban) and one school for vocational education (urban). 544 (61.1%) parents gave informed consent, 53 (5.9%) declined participation and 294 (33.0%) parents did not respond. Eventually, the PedsQL was completed by 496 (55.7%) participants.
Socio-demographic data of participants and non-participants
Socio-demographic data of participants per age group
Chronic health condition1
Contact general practitioner
Contact medical specialist
PedsQL scores and reliability
PedsQL scale scores
PedsQL Scale Scores
PedsQL scales: internal consistency reliability
Age group 5-7
Age group 8-12
Age group 13-18
Socio-demographic within-group differences
Results indicate a significant difference between age groups for the subscale school functioning (p < .01). Post hoc tests demonstrated that group 5-7 scored higher than group 8-12 (mean difference = 6.79, p < .001) and group 13-18 (mean difference = 10.89, p < .001). In addition, group 8-12 had higher scores than group 13-18 (mean difference = 4.10, p < .01).
There was a significant gender effect on the emotional subscale in age group 8-12; here, boys scored higher than girls (mean difference = 4.24, p < .05).
In group 8-12, children of parents born in the Netherlands had a significantly lower total (mean difference = 3.94, p < .05), psychosocial (mean difference = 4.63, p < .01), emotional (mean difference = 5.39, p < .05) and school functioning score (mean difference = 4.31, p < .05) compared to children of parents born in another country.
Differences were found with respect to education in group 13-18. Post hoc tests revealed that children of low educated parents scored higher than children of parents with a middle education on the total (mean difference = 6.21, p < .0167), psychosocial (mean difference = 7.69, p < .01), social (mean difference = 8.46, p < .01) and school subscale (mean difference = 8.99, p < .0167) of the PedsQL. Within the social domain scores of children from parents with a high education were significantly higher compared to children of parents that had a middle education (mean difference = 5.43, p < .0167).
For none of the age groups and subscales differences were found regarding employment.
PedsQL scales: construct validity
Chronic health condition
Age group 5-7
Age group 8-12
Age group 13-18
Children also scored significantly lower on several PedsQL subscales when they had contact with their general practitioner over the past year. In group 5-7, this was the case for social functioning (p < .05, es = 0.49) and in group 8-12 for the total (p < .05, es = 0.31), physical (p < .05, es = 0.32) and school functioning subscale (p < .05, es = 0.37). Children belonging to group 13-18 obtained lower scores on all subscales except for school functioning: total (p < .01, es = 0.51), physical (p < .01, es = 0.70), psychosocial (p < .05, es = 0.37), emotional (p < .05, es = 0.34) and social functioning (p < .05, es = 0.36).
In some cases, children also had lower PedsQL scores when they had contact with a medical specialist over the past year. For groups 5-7 and 8-12 this difference was observed on the school functioning subscale (both p < .05, respectively es = 0.65 and es = 0.31). In group 13-18 the difference was apparent on more subscales: total (p < .05, es = 0.46), physical (p < .05, es = 0.42), psychosocial (p < .05, es = 0.42) and school (p < .05, es = 0.39).
Finally, in some cases psychological care was an indicator for lower PedsQL scores as well. In group 8-12, a difference was measured for the total (p < .05, es = 0.51), physical (p < .05, es = 0.46) and psychosocial subscale (p < .05, es = 0.46). In the oldest group 13-18, these children obtained lower scores with respect to total (p < .05, es = 0.67), psychosocial (p < .05, es = 0.68) and social functioning (p < .01, es = 0.80).
In this study, reference data of the Dutch PedsQL Generic Core Scale were collected and psychometric properties were assessed in a sample of 496 children aged 5 to 18 years and their parents. The psychometric properties of the PedsQL in the Netherlands range from sufficient to good.
The PedsQL reference scores obtained in this study are an adequate representation of the general Dutch population. According to Statistics Netherlands  in 2008 80.4% (of the total population) were from Dutch origin and 77.9% (of population aged 45-55 years) were employed. These figures are comparable to the socio-demographic data from our study. Furthermore, it is not uncommon  to find a large percentage of highly educated parents (48.4%) in the current study, compared to the Dutch working population (33.5%). It is likely that highly educated parents are better aware of the necessity of this type of research, and thus be more willing to participate. During data collection we experienced that willingness to take part in the study seemed lower on schools with lower educational levels and higher percentages of migrant children. Possibly, parents not born in the Netherlands experienced language problems and for this reason did not fully understand the information letter to participate in the study. These findings are supported by the fact that there were fewer parents with a high education and Dutch ethnicity in the non-participants group, compared to the group that did participate.
The Dutch sample shows the same trend in reliability across subscales as the US , however with slightly lower alphas. In both samples, the total score appears to be most reliable and subscale school functioning least. A possible clarification for the lower Dutch reliability figures could be the difference in sample size. The US sample ranges from 1159 to 2674 children per age group; the Dutch from 92 to 219. More over, the US sample included children from the State Children's Health Insurance Program (SCHIP) that provides health insurance coverage to uninsured children from low-income families . In the current study a stratified sampling technique was applied in order to create a sample as diverse as possible, which can be generalized to the overall Dutch population. Bastiaansen et al  have investigated the psychometric properties of the PedsQL in the Netherlands as well. In their study a sample (n = 74) from the general Dutch population (6-18 years) was compared with 310 children referred for psychiatric problems: alpha's were in concordance with Varni et al , however, their sample size was very small.
Regarding the socio-demographic within-group differences, this study demonstrates a gender difference in group 8-12 on the emotional subscale with girls obtaining lower scores than boys. Similar results in adolescent girls have been reported by Reinfjell et al .
Salient finding is that country of birth of the parent had an effect on PedsQL scores in group 8-12. Children of parents born in the Netherlands scored significantly lower on all subscales except physical functioning. Previous studies only correspond partly with this result. For instance in the US, White together with Asian children scored higher than Hispanic and Black children . Important to note is that we only collected data regarding country of birth of the parent, and not country of birth of the child. Moreover, this difference was not found in groups 5-7 and 13-18.
Results of our study indicate a relationship between educational level and PedsQL scores in group 13-18: children of parents with a low education perceived a significantly better HRQOL. This phenomenon is difficult to explain, since previous research mainly pointed out that high quality of life scores were related to high parental education, or that education had no effect at all [19, 20].
Findings on parental employment are also notable: having a job had no influence on the child's HRQOL in our sample. Previous research has shown that children with low socioeconomic status (SES) functioned worse than children from middle SES backgrounds . Employment and SES are not exchangeable, though. Having a job does not necessarily implicate a middle or high SES.
With respect to construct validity, this study demonstrates that the Dutch PedsQL version differentiates between children with and without a chronic condition in group 5-7 and 13-18. Differences in group 8-12 were not significant - however, except for the emotional functioning subscale, healthy children obtained higher scores than their chronically ill peers. Although several studies have shown that the PedsQL differentiates between children with and without a chronic health condition [9, 12, 13] it is not exceptional to find adequate functioning for chronically ill children . Another explanation could be that severely ill children did not take part in our study, because they were not present at the time of administration due to illness or that parents did not want to burden them with participation. A further possible reason might be the fact that the presence of a chronic health condition in our sample was determined by the parent and not diagnosed by a physician. Physician-diagnosed chronic health conditions are often stricter than those reported by the parent. Therefore, the 8-12 year old chronic health condition sample in our study might not be completely representative of children with more serious chronic diseases.
Limitations of the study need to be taken into account. First, a considerable number of children were approached, which eventually resulted in nearly 500 participants. However, considering the different age groups and the socio-demographic within-group differences, sample sizes per group were relatively small. Furthermore, it is possible that presenting PedsQL items one at a time on a computer - with missing values not being allowed - could have some psychometric implications. Digital administration of the PedsQL has demonstrated equivalent measurement properties to the paper version , yet in the study of Varni et al (2008) each PedsQL scale was depicted on a separate screen and participants had the option to skip items. The fact that this possibility was lacking in the current study could have forced participants to choose an answer that did not really apply to them. Nonetheless, this probably concerns a minimum of items since Varni et al (2008) also demonstrated similar (low) percentages of missing-item responses of digital and paper version PedsQL. Additionally, it would have been interesting to have examined all age versions of the PedsQL involving all regions of the Netherlands, but this was unfeasible for the purpose of our study. Therefore, we recommend that future research with respect to the PedsQL in the Netherlands should include more regions of the country and incorporate the remaining PedsQL versions.
We conclude that the Dutch version of the PedsQL has adequate psychometric properties and can be used as an HRQOL instrument in pediatric research in the Netherlands.
We thank Machteld Pijzel for her work and effort with respect to the data acquisition for this study. Our gratitude also goes out to Robert Segaar, who developed the stand alone computer version of the PedsQL, and Floris Hekma of Artsen voor Kinderen/BioMedia, responsible for the internet version of the PedsQL. In addition, we thank the Dutch Cancer Society for funding this research.
- WHO. WHOQOL-BREF: Introduction, administration, scoring andgeneric version of the assessment. 1996, [http://www.who.int/mental_health/media/en/76.pdf]Google Scholar
- Eiser C, Morse R: Quality-of-life measures in chronic diseases of childhood. Health Technol Assess. 2001, 5: 1-157.View ArticlePubMedGoogle Scholar
- Sprangers M, Aaronson N: Quality-of-Life Assessment in Oncology. Acta Oncol. 2002, 41: 229-237. 10.1080/02841860260088764.View ArticlePubMedGoogle Scholar
- Fekkes M, Theunissen NC, Brugman E, Veen S, Verrips EG, Koopman HM, Vogels T, Wit JM, Verloove-Vanhorick SP: Development and psychometric evaluation of the TAPQOL: a health-related quality of life instrument for 1-5-year-old children. Qual Life Res. 2000, 9: 961-972. 10.1023/A:1008981603178.View ArticlePubMedGoogle Scholar
- Verrips GH, Vogels TG, Verloove-Vanhorick SP, Fekkes M, Koopman HM, Theunissen NCM: Health-related quality of life measure for children-the TACQoL. J Applied Therapeutics. 1997, 1: 357-360.Google Scholar
- Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, Duer W, Auquier P, Cloetta B, Czemy L: The KIDSCREEN-52 Quality of Life Measure for Children and Adolescents: Psychometric Results from a Cross-Cultural Survey in 13 European Countries. Value Health. 2007, 11: 645-58. 10.1111/j.1524-4733.2007.00291.x.View ArticlePubMedGoogle Scholar
- Landgraf JM, Abetz L, Ware JE: Child Health Questionnaire (CHQ). A User's Manual. 1999, Boston: HealthActGoogle Scholar
- Bullinger M, Schmidt S, Petersen C: Assessing quality of life of children with chronic health conditions and disabilities: a European approach. Int J Rehabil Res. 2002, 25: 197-206. 10.1097/00004356-200209000-00005.View ArticlePubMedGoogle Scholar
- Chan KS, Mangione-Smith R, Burwinkle TM, Rosen M, Varni JW: The PedsQL: reliability and validity of the short-form generic core scales and Asthma Module. Med Care. 2005, 43: 256-265. 10.1097/00005650-200503000-00008.View ArticlePubMedGoogle Scholar
- Meeske K, Katz ER, Palmer SN, Burwinkle T, Varni JW: Parent proxy-reported health-related quality of life and fatigue in pediatric patients diagnosed with brain tumors and acute lymphoblastic leukemia. Cancer. 2004, 101: 2116-2125. 10.1002/cncr.20609.View ArticlePubMedGoogle Scholar
- Varni JW, Burwinkle TM, Sherman SA, Hanna K, Berrin SJ, Malcarne VL, Chambers HG: Health-related quality of life of children and adolescents with cerebral palsy: hearing the voices of the children. Dev Med Child Neurol. 2005, 47: 592-597. 10.1017/S0012162205001179.View ArticlePubMedGoogle Scholar
- Varni JW, Burwinkle TM, Seid M, Skarr D: The PedsQL 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambul Pediatr. 2003, 3: 329-341. 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2.View ArticlePubMedGoogle Scholar
- Bastiaansen D, Koot HM, Bongers IL, Varni JW, Verhulst FC: Measuring quality of life in children referred for psychiatric problems: psychometric properties of the PedsQL 4.0 generic core scales. Qual Life Res. 2004, 13: 489-495. 10.1023/B:QURE.0000018483.01526.ab.View ArticlePubMedGoogle Scholar
- Cohen J: Statistical power analysis for the behavioral sciences. 1988, New York: Academy PressGoogle Scholar
- Statistics Netherlands. 2009, [http://www.cbs.nl]
- Hatzmann J, Heymans HS, Carbonell A, van Praag BM, Grootenhuis MA: Hidden consequences of success in pediatrics: parental health-related quality of life--results from the Care Project. Pediatrics. 2008, 122: e1030-e1038. 10.1542/peds.2008-0582.View ArticlePubMedGoogle Scholar
- Brach C, Lewit EM, VanLandeghem K, Bronstein J, Dick AW, Kimminau KS, LaClaire B, Shenkman E, Shone LP, Swigonski N: Who's enrolled in the State Children's Health Insurance Program (SCHIP)? An overview of findings from the Child Health Insurance Research Initiative (CHIRI). Pediatrics. 2003, 112: e499-PubMedGoogle Scholar
- Reinfjell T, Diseth TH, Veenstra M, Vikan A: Measuring health-related quality of life in young adolescents: reliability and validity in the Norwegian version of the Pediatric Quality of Life Inventory 4.0 (PedsQL) generic core scales. Health Qual Life Outcomes. 2006, 4: 61-10.1186/1477-7525-4-61.View ArticlePubMedPubMed CentralGoogle Scholar
- Kulkarni AV, Cochrane DD, McNeely PD, Shams I: Medical, Social, and Economic Factors Associated with Health-Related Quality of Life in Canadian Children with Hydrocephalus. J Pediatr. 2008, 153: 689-95. 10.1016/j.jpeds.2008.04.068.View ArticlePubMedGoogle Scholar
- Sherman EM, Griffiths SY, Akdag S, Connolly MB, Slick DJ, Wiebe S: Sociodemographic correlates of health-related quality of life in pediatric epilepsy. Epilepsy Behav. 2008, 12: 96-101. 10.1016/j.yebeh.2007.07.009.View ArticlePubMedGoogle Scholar
- Varni JW, Burwinkle TM, Seid M: The PedsQL 4.0 as a school population health measure: feasibility, reliability, and validity. Qual Life Res. 2006, 15: 203-215. 10.1007/s11136-005-1388-z.View ArticlePubMedGoogle Scholar
- Grootenhuis MA, Koopman HM, Verrips EG, Vogels AG, Last BF: Health-related quality of life problems of children aged 8-11 years with a chronic disease. Dev Neurorehabil. 2007, 10: 27-33. 10.1080/13682820600691017.View ArticlePubMedGoogle Scholar
- Varni JW, Limbers CA, Burwinkle TM, Bryant WP, Wilson DP: The ePedsQL in type 1 and type 2 diabetes: feasibility, reliability, and validity of the Pediatric Quality of Life Inventory Internet administration. Diabetes Care. 2008, 31: 672-677. 10.2337/dc07-2021.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2431/9/68/prepub