- Research article
- Open Access
- Open Peer Review
A puzzle form of a non-verbal intelligence test gives significantly higher performance measures in children with severe intellectual disability
© Bello et al; licensee BioMed Central Ltd. 2008
- Received: 16 January 2008
- Accepted: 01 August 2008
- Published: 01 August 2008
Assessment of 'potential intellectual ability' of children with severe intellectual disability (ID) is limited, as current tests designed for normal children do not maintain their interest. Thus a manual puzzle version of the Raven's Coloured Progressive Matrices (RCPM) was devised to appeal to the attentional and sensory preferences and language limitations of children with ID. It was hypothesized that performance on the book and manual puzzle forms would not differ for typically developing children but that children with ID would perform better on the puzzle form.
The first study assessed the validity of this puzzle form of the RCPM for 76 typically developing children in a test-retest crossover design, with a 3 week interval between tests. A second study tested performance and completion rate for the puzzle form compared to the book form in a sample of 164 children with ID.
In the first study, no significant difference was found between performance on the puzzle and book forms in typically developing children, irrespective of the order of completion. The second study demonstrated a significantly higher performance and completion rate for the puzzle form compared to the book form in the ID population.
Similar performance on book and puzzle forms of the RCPM by typically developing children suggests that both forms measure the same construct. These findings suggest that the puzzle form does not require greater cognitive ability but demands sensory-motor attention and limits distraction in children with severe ID. Thus, we suggest the puzzle form of the RCPM is a more reliable measure of the non-verbal mentation of children with severe ID than the book form.
- Autism Spectrum Disorder
- Autism Spectrum Disorder
- Down Syndrome
- Intellectual Disability
- Typically Develop
Intellectual disability (ID) affects 1.25% of the Australian population  and is defined according to the ICD-10 criteria as ongoing difficulties in age appropriate functioning and below age average cognitive performance as demonstrated by a score of two standard deviations below the mean on standardized intelligence tests. However, standardized intelligence tests such as the WISC-IV are often limited in their assessment of children with severe intellectual disability (ID) who are often unable to stay on task for the lengthy administration of the test, or handle its heavy reliance on language skills [2–4] and lack of ability to motivate . Thus, to produce a valid measure of cognitive ability for children with severe ID, testing procedures must accommodate their profound deficits in communication, attention and social skills [6–10]. Such procedures are necessary and important to facilitate the most appropriate educational placement to enhance their educational and learning potential. We suggest that the Raven's Coloured Progressive Matrices Test (RCPM ) is a potentially more suitable alternative to tests like the WISC as it is an untimed non-verbal measure of reasoning ability [3, 12, 13]. This is supported by a recent study by Dawson, Soulières, Gernsbacher and Mottron , which showed that the WISC-III underestimates intelligence in children with ASD. They found that scores of 38 children with ASD were on average 30 percentile points higher on the Raven's Progressive Matrices (RPM) than their scores on the WISC-III, whereas no such difference was found for typically developing (TD) children. The RCPM consists of 36 coloured multiple choice matrices (although colour is irrelevant to the completion of the task), organized in three increasingly complex sets [3, 11–15]. It is being utilized increasingly with children with severe ID, including those with Autism Spectrum Disorder (ASD) [5, 16] in research settings to control for non-verbal mentation [13, 17, 18] and in educational settings to determine the level of functioning and treatment progress as part of a battery of tests [19, 20].
Despite it being a better indicator of non verbal cognitive ability than the WISC III, many children with severe ID still show difficulties in completing the RCPM. Clark and Rutter  found that motivation and associated disruptive behaviours such as task avoidance, self-stimulation and escape behaviours in children with lower functioning ASD, hindered test performance on the RCPM. Techniques adopted to maintain motivation (e.g. lowering task difficulty to increase success rate in low scoring children) led to better performance, which suggests that the task itself is not sufficiently engaging of attention for children with impaired intellectual functioning. The standard book form of the RCPM also requires the child to point to their chosen pattern, which is a problem as pointing is one of several delayed social communication skills observed in many children with ID, particularly ASD .
To enhance compliance in cognitively less able clinical groups, Raven produced a board form of the RCPM  where each item, presented on a wooden board, can be completed with the correct placement of movable pieces. Raven et al.  claim that the board form is a consistent, reliable and psychologically valid estimate of reasoning ability, with a test retest reliability of approximately r = 0.80. However, although past studies [16, 22–24] have utilized the board form, the study details are not available and, evidence of its validity is limited. Furthermore its heavy inflexible wooden design is often unsuitable for use for children with severe ID. Carlson and Weidl used a test-retest design to show that the board form produced better performance than the book form in typically developing children  and children with ID . However, because they allowed for trial and error in the completion of the board form, it is unclear whether the better performance on the board form was due to increased opportunity for self-correction or the nature of the board form itself. The board form is also limited as the moveable pieces are easily disarranged when in use and administration of 36 separate board pieces is quite time consuming . Such task characteristics do not encourage sustained attention and motivation in children with severe ID.
In line with the merits of the board form and considering its administrative inflexibility we have designed a puzzle version as an alternate form of the RCPM specifically designed to encourage greater sensory attention and motivation, increase task comprehension and consequently limit other disruptive behaviours in order to obtain a more valid measure of reasoning ability in children with ID. This new form resembles a jigsaw puzzle and therefore minimizes verbal task instructions for children with severe ID . It is also conceptually like the board form in that participants must physically remove pieces, however, our puzzle form utilizes a cardboard and Velcro™ system to allow the children to simply grasp and easily remove their chosen piece and place it in the gap of the larger pattern. Unlike the board form, the puzzle form is presented in a folder with each item displayed individually on one page and each piece secured with Velcro to minimize weight, distractions and ease and time of administration. Another advantage of the puzzle form is that grasping the pieces maintains attention better than the requirement of pointing, as in the book form. This is consistent with the idea that grasping requires more brain activation than visual recognition alone . Grasping requires processing of spatial location, in addition to form, orientation and size  and serves to draw attention to the object, which maintains attention on the task. Motor engagement with the pieces and placement in the appropriate area provides immediate feedback and requires more attentional resources. Kaplan et al.  showed that people with ID receiving sensory input from different pieces of equipment, showed less aggression and self-stimulatory behaviour and more task completion. This effect was also generalized to subsequent tasks, which supports the effect of tactile stimulation in increasing task engagement in people with ID. Motor engagement is particularly important in children with severe ID and children with ASD who are less motivated by social reinforcement  perhaps due to they failure to orient to and engage with the affective expressions of others [28, 30, 31]. Doussard-Roosevelt, Joe, Bazhenova and Porges  found that children with ASD were more engaged when their mothers physically and non-verbally demonstrated an object to them than when she verbally described the object to them.
Thus the aims of these studies were in Study 1, to test the validity of performance of typically developing (TD) on the puzzle form of the RCPM by comparing it to the standard book form; and in Study 2, to examine overall performance and completion rate of the puzzle and book form in children with idiopathic ID, Down Syndrome (DS) or ASD to establish the potential applicability of this alternative puzzle form to children with severe ID. We hypothesized that, in Study 1, TD children would show comparable performance in the book and puzzle form of the RCPM, irrespective of which form was completed first on a counterbalanced cross over design over a three week period. We also hypothesized that, in Study 2, children with severe ID, whether ID, DS or ASD, who completed the puzzle form, would show a higher performance rate than children who completed the book form, irrespective of clinical group.
Study 1: Comparison of the standard and puzzle forms for the validation of the puzzle form of the RCPM
Means and standard deviations for age for children who were all randomly assigned to one of two groups that either completed the standard book form first or the puzzle form first.
Age (years) (SD)
RCPM score (SD)
Ethics approval for studies 1 and 2 was obtained from the Swinburne University of Technology and La Trobe University Human Ethics Committees. Permission to conduct testing in the school was obtained from the Catholic Education Office in Victoria, and the Principal of the School. Individual parental or guardian consent for each child was required prior to testing and all children were free to withdraw from testing at any time.
The RCPM is comprised of 36 items divided into three subsets of 12 items (Sets A, Ab, and B). Each item consists of a different coloured pattern with six possible pieces available to fill the "missing" location required to complete the pattern. The participant's task was to deduce the theme of relations expressed among the designs and choose the missing figure from among the alternative set of six. The original book form displayed each item on a page in a booklet. The alternative puzzle version was the same size and colour as the book form, but differed in that each of the alternative patterns could be removed and physically attached to the missing place on the matrix through the use of a Velcro system.
The standard administration procedure as prescribed by Raven et al , was used for the original book form, with trained clinicians administering both book and puzzle forms individually to each child [11, 15], within the school setting. As suggested by Raven et al. no time limit was assigned for either task. Participants were required to select a piece from six alternatives that completed the pattern for each item by either pointing to their chosen response in the book form or by removing their chosen response and placing it in the missing section of the matrix in the puzzle form. Participants were asked to do this using the verbal instruction "find missing". This very simple, clear and short verbal instruction was chosen to ensure that it could be successfully used with children with ID who have limited receptive language. Participants were required to select a piece their responses by pointing to Item one of the standard and puzzle versions served as a practice trial, where incorrect responses were corrected and no further assistance or verbal reward was given during performance and completion of the task. Performance on the RCPM was calculated according to the number of items correct, and unattempted items were classified as incorrect. Inclusion criteria required children to attempt at least one full set of 12 items. Children attempting less than this, were excluded from further analyses.
In Study 1, the TD children were randomly assigned to two groups where one group attempted the book form first while the other half attempted the puzzle form. The alternate form of the RCPM was again administered after three weeks. To minimize the impact of maturation in learning and memory or practice effects on performance a three-week interval between the puzzle and book form was used [13, 33].
To validate the puzzle form, the performance of children who completed the standard book form first was compared to the performance of children who completed the puzzle form first using an independent samples t-test. A comparison of the two versions using a cross-over design was then used to examine the puzzle version performance over time, and to show that it matters little to overall performance of TD children, which form of the test was performed first. Previous test-retest studies using only the book form of the RCPM were conducted three weeks apart and reported correlations of Pearson's r = 0.80 [13, 34, 35]. As an alternative measure to Pearson's r, interclass correlation coefficient (ICC)  and coefficient of variation of measurement error (CVME)  were also calculated for an indication of degree of relatedness and percentage of variation respectively, between scores from the first and second test occasions.
Data were initially screened for outliers and any violations of the assumptions of normality, homogeneity of variance, and sphericity. No outliers or violations of assumptions in the data were detected.
Comparison between performance on standard and puzzle forms
Table 1 shows the RCPM means and standard deviations for the TD participants who completed the original book form and the group who completed the puzzle version. It can be observed from Table 1 that the mean score for each group was similar and an independent samples t-test showed no significant difference in RCPM score between children who completed the original book form and children who completed the novel puzzle form, t (74) = -0.22, p > .05.
Correlation coefficients Pearson's r, interclass correlation coefficient (ICC), and coefficient of variation of measurement error (CVME) values for RCPM score for first and second attempt for children who completed the book first and children who completed the puzzle first.
A large test-retest reliability score (r = 0.85, p < .01) was found between the standard book form and the puzzle version, in TD children. This correlation is comparable to past studies solely examining the RCPM book form using a similar time frame of three weeks [32–34]. The findings suggest that the puzzle form is as useful as the standard book form of the RCPM in measuring nonverbal mentation in typically developing children.
In summary, the findings of Study 1 support the hypothesis that the book and the puzzle forms are measuring similar constructs in TD children. This suggests that the puzzle form, can be used with children with severe ID and potentially enhance performance and completion rate whilst still measuring the same constructs as the book form. Study 2 was conducted to examine the use of the puzzle form of the RCPM to measure non-verbal mentation in children with ID to evaluate the hypothesis that the puzzle form maintains attention in such children.
Study 2: The puzzle form of the RCPM to measure non-verbal mentation in children with Intellectual Disability
Means and standard deviations for age for each group of children with Autism Spectrum Disorder (ASD), Down Syndrome (DS), and idiopathic intellectual disability (ID).
Chronological Age (years) (SD)
Given that the data from this study were not normally distributed, non-parametric testing was used for all analyses.
While the inter-group RCPM performance and hence mentation age was not significantly different, there was a significant difference in age between the three clinical groups F (2, 161) = 13.20, p < .05, with the mean age of the ASD group significantly less than the DS and ID groups. However, the age difference between children administered the puzzle and book form was not significantly different for each clinical group (ASD t (99) = -1.20, p > .05; DS t (18) = -0.78, p > .05; ID t (41) = 0.44, p > .05).
The finding from Study 1 of no difference between the performance of TD children in the RCPM book and puzzle forms, combined with the finding of a strong correlation between first and second performance of the RCPM regardless of the order in which the forms were completed, shows that the alternative puzzle version is comparable to the book form in measuring reasoning ability. Past studies have reported that three factors delineate performance on the RCPM: continuous and discrete pattern completion, pattern completion through closure, and concrete abstract reasoning [23, 36, 37]. The high correlation between the book and puzzle forms found in the current study suggests that these constructs are maintained in the puzzle version.
Study 2 demonstrated that children with severe ID who were administered the puzzle form showed a performance advantage, as compared to those who were administered the book form. The findings suggest that the puzzle form provides a better indicator of learning potential than the book form in children with severe ID. We suggest that the performance advantage observed for the puzzle form is due to its unique features designed specifically to maintain attention and increase completion rate, though have not tested this suggestion directly. This is consistent with previous studies that have shown that added motivational techniques increased performance [5, 18]. However, the current study does provide evidence that attention can be engaged while maintaining the underlying constructs being measured. Thus, it is likely that the puzzle form does not demand additional cognitive processing on children with severe ID, but increases sustained attention on the task in comparison to the book form. If this were the case, it would suggest that the puzzle form effectively engages cognitive ability of children with severe ID through the integration of motor and sensory based learning but only when the child directs their own responses. This is also advantageous as it potentially useful as it puts the emphasis on the test to be able to engage children with severe ID rather than requiring the administrator efforts to promote engagement in the child during the testing. For example, a study found that certain adult style of interaction, such as following a child's line of action instead of trying to re-direct it enhances social engagement in children with ASD .
The greater completion rate for the puzzle form than the book form for the children with severe ID in study 2 suggest that the ability to sustain attention and maintain motivation is a factor contributing to performance on cognitive ability measures for children with severe ID. This is supported by previous research showing that salience of variables engaging attention are highly correlated with measures of intelligence [38, 39]. The findings challenge the clinical assumption that task incompletion reflects the inability to maintain attention and indicates limits of cognitive ability. Increasing task completion rate in children with severe ID is also important as it allows better comparison of cognitive ability to children with TD.
Alternatively, the performance advantage of the puzzle form may be due to the greater completion rate for children who were administered the puzzle form, compared to the book form. It can be argued that the puzzle form produces a performance advantage because the physical placement of response pieces reduces the mental function of abstractly visualizing the chosen piece in the missing area . Unlike the results of the study by Carlson and Wiedl , a trial and error approach was not permitted and hence this cannot be the source of increased performance when using the puzzle form. In addition, the performance advantage in the puzzle form was only demonstrated by children of the same mental age, some with ID and some developing normally, which could suggest that the puzzle form maintained attention and motivation in those with severely limited attentional resources.
Given that more ID children were able to complete the puzzle form than the book form, it is possible that the performance advantage of the puzzle form was associated with an increased opportunity to select responses, as oppose to heightened task engagement. As the RCPM is a multiple choice task, the more items an individual completes, even at random, the greater the possibility of obtaining a higher overall scores. However, this is unlikely as additional analyses showed that the performance advantage of the puzzle form was maintained even when only those children who completed either RCPM form were included. However, this performance advantage was not observed in the DS and ID groups (also in the DS group when all participants were included regardless of whether they completed the RCPM or not). These non-significant findings are likely to reflect a Type II error and may be due to the small number of participants in the DS and ID groups. Future studies should examine more closely the effect of responses due to chance when completing the RCPM, specifically error-type analysis reflecting problem solving strategies in children with ID .
Profound deficits often make the assessment of children with severe ID very difficult, and the characteristics of standardized intelligence tests do not take into consideration such deficits. The current study indicates that children with ID perform better on the puzzle form of the RCPM and suggests that it is a better indicator of problem solving ability in children with severe ID than the book form. The puzzle form has proven to give a useful measure of RCPM in children with ID as it considers the degree of intellectual disability and severity of the language deficit, as well as engage attention and motivation while limiting distractions. Hence, this study supports the use of the puzzle form in clinical and educational research settings in place of the book form, as a better measure of reasoning ability in children with severe ID and in clinical settings for monitoring treatment progress, as a component of a battery of tests.
This research was supported by an ARC Linkage grant LP0346984. We thank Bella Irlicht, Dr. Carl Parsons, as well as the staff, parents, students of Port Phillip Specialist School, Bulleen Heights School, and St. Pius X Primary School, along with Dr. Sue Cotton.
- White P, Chant E, Townsend C, Waghorn G: Prevalence of intellectual disability and comorbid illness in an Australian community sample. Australian and New Zealand Journal of Psychiatry. 2005, 39 (5): 395-400. 10.1111/j.1440-1614.2005.01587.x.View ArticlePubMedGoogle Scholar
- Borthwick-Duffy SA: Epidemiology and prevalence of psychopathology in people with cognitive impairment. Journal of Consulting & Clinical Psychology. 1994, 52: 17-27. 10.1037/0022-006X.62.1.17.View ArticleGoogle Scholar
- Sattler JM: Assessment of Children: Behavioural and Clinical Applications. 2001, San Diego, CA: Jerome M. Sattler Publishing Inc., 4Google Scholar
- Walsh DM, Finwall J, Touchette PE, McGregor MR, Fernandez GE, Lott IT, Sandman CA: Rapid assessment of severe cognitive impairment in individuals with developmental disabilities. Journal of Intellectual Disability Research. 2007, 51: 91-100. 10.1111/j.1365-2788.2006.00853.x.View ArticlePubMedGoogle Scholar
- Koegel LK, Koegel RL, Smith A: Variables related to differences in standardized test outcomes for children with autism. Journal of Autism and Developmental Disorders. 1997, 27: 233-243. 10.1023/A:1025894213424.View ArticlePubMedGoogle Scholar
- Brown JH, Johnson MH, Paterson SJ, Gilmore R, Longhi E, Karmiloff-Smith A: Spatial representation and attention in toddlers with Williams Syndrome and Down Syndrome. Neuropsychologia. 2003, 41: 1037-1046. 10.1016/S0028-3932(02)00299-3.View ArticlePubMedGoogle Scholar
- Chapman RS: Language development in children and adolescents with Down Syndrome. Mental Retardation and Developmental Disabilities Research Reviews. 1998, 3 (4): 301-312.Google Scholar
- Rapin I, Dunn M: Language disorders in children with autism. Seminars in Pediatric Neurology. 1997, 4: 86-92. 10.1016/S1071-9091(97)80024-1.View ArticlePubMedGoogle Scholar
- Wing L: Language, social and cognitive impairments in autism and severe mental retardation. Journal of Autism and Developmental Disorders. 1981, 11 (1): 31-44. 10.1007/BF01531339.View ArticlePubMedGoogle Scholar
- Ypsilant A, Grouios G: Linguistic profile of individuals with Down Syndrome: Comparing the linguistic performance of three developmental disorders. Child Neuropsychology. 2008, 14: 148-170. 10.1080/09297040701632209.View ArticleGoogle Scholar
- Raven J, Raven JC, Court JH: Section 2: Coloured Progressive Matrices (1998 Edition). Introducing the Parallel Version of the Test. Manual for Raven's Progressive Matrices and Vocabulary Scales. 1998, Great Britain: Oxford Psychologist PressGoogle Scholar
- Carpenter PA, Just MA, Shell P: What one intelligence test measures: a theoretical account of the processing in the Raven Progressive Matrices Test. Psychol Rev. 1990, 97: 404-431. 10.1037/0033-295X.97.3.404.View ArticlePubMedGoogle Scholar
- Cotton SM, Crewther DP, Crewther SG: Measurement error: Implications for diagnosis and discrepancy models of developmental dyslexia. Dyslexia (Chichester, England). 2005, 11: 186-202. 10.1002/dys.298.View ArticleGoogle Scholar
- Dawson M, Soulieres I, Gernsbacher MA, Mottron L: The level and nature of autistic intelligence. Psychol Sci. 2007, 18: 657-662. 10.1111/j.1467-9280.2007.01954.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Raven JC, Court JH, Raven J: Manual for Raven's Progressive Matrices. 1992, Oxford: Oxford Psychologist PressGoogle Scholar
- Clark P, Rutter M: Task difficulty and task performance in autistic children. J Child Psychol Psychiatry . 1979, 20: 271-285. 10.1111/j.1469-7610.1979.tb00514.x.View ArticlePubMedGoogle Scholar
- Barnard N, Crewther SG, Crewther DP: Development of a magnocellular function in good and poor primary school-age readers. Optom Vis Sci. 1998, 75: 62-68. 10.1097/00006324-199801000-00026.View ArticlePubMedGoogle Scholar
- Crewther S, Lawson ML, Bello K, Crewther DP: The visual attentional blink reflects constraints on temporal visual processing, not just a lapse of visual memory. Clin Exp Optom. 2007, 90: 282-289. 10.1111/j.1444-0938.2007.00160.x.View ArticlePubMedGoogle Scholar
- Anderson HE, Kern FE, Cook C: Sex, brain damage, and race effects in the progressive matrices with retarded populations. The Journal of social psychology. 1968, 76: 207-211.View ArticlePubMedGoogle Scholar
- Budoff M, Corman L: Effectiveness of a learning potential procedure in improving problem-solving skills of retarded and nonretarded children. Am J Ment Defic. 1976, 81: 260-264.PubMedGoogle Scholar
- Camaioni L, Perucchini P, Muratori F, Parrini B, Cesari A: The communicative use of pointing in autism: developmental profile and factors related to change. Eur Psychiatry. 2003, 18: 6-12. 10.1016/S0924-9338(02)00013-5.View ArticlePubMedGoogle Scholar
- Carlson JS, Wiedl KH: Applications of "testing-the-limits": Towards a differential testing approach employing the Raven Coloured Matrices. Triere Psychologische Berichte. 1976, 3: 1-8.Google Scholar
- Carlson JS, Wiedl KH: Use of testing-the-limits procedure in the assessment of intellectual capabilities in children with learning difficulties. American Journal of Mental Deficiency. 1978, 82: 559-564.PubMedGoogle Scholar
- Wright SC, Taylor DM, Ruggiero KM: Examining the potential for academic achievement among Inuit children: Comparisons on the Raven Coloured Progressive Matrices. Journal of Cross-Cultural Psychology. 1996, 27: 733-753. 10.1177/0022022196276006.View ArticleGoogle Scholar
- Quill KA: Instructional considerations for young children with autism: The rationale for visually cued instruction. Journal of Autism and Developmental Disorders. 1997, 27: 697-714. 10.1023/A:1025806900162.View ArticlePubMedGoogle Scholar
- Culham JC, Danckert SL, De Souza JFX, Gati JS, Menon RS, Goodale MA: Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas. Experimental Brain Research. 2003, 153: 180-189. 10.1007/s00221-003-1591-5.View ArticlePubMedGoogle Scholar
- Goodale MA, Milner AD, Jakobson LS, Carey PD: A neurological dissociation between perceiving objects and grasping them. Nature. 1991, 349: 154-156. 10.1038/349154a0.View ArticlePubMedGoogle Scholar
- Kaplan H, Clopton M, Kaplan M, Messbauer L, McPherson K: Snoezelen multi-sensory environments: task engagement and generalization. Res Dev Disabil. 2006, 27: 443-455. 10.1016/j.ridd.2005.05.007.View ArticlePubMedGoogle Scholar
- Allen G, Courchesne E: Attention function and dysfunction. Frontiers in Bioscience. 2001, 6: D105-D119. 10.2741/allen.View ArticlePubMedGoogle Scholar
- Lee A, Hobson RP: On developing self-concepts: a controlled study of children and adolescents with autism. Journal of child psychology and psychiatry, and allied disciplines. 1998, 39: 1131-1144. 10.1017/S0021963098003023.View ArticlePubMedGoogle Scholar
- Wimpory DC, Hobson RP, Nash S: What facilitates social engagement in preschool children with autism?. J Autism Dev Disord. 2007, 37: 564-573. 10.1007/s10803-006-0187-x.View ArticlePubMedGoogle Scholar
- Doussard-Roosevelt JA, Joe CM, Bazhenova OV, Porges SW: Mother-child interaction in autistic and nonautistic children: characteristics of maternal approach behaviors and child social responses. Dev Psychopathol. 2003, 15: 277-295.View ArticlePubMedGoogle Scholar
- Portney LG, Watkins MP: Foundations of Clinical Research Applications to Practice. 2000, New Jersey: Prentice Hall Health, 2Google Scholar
- Jaworska A, Szustrowa T: Polish standardization of the RPM. Polish Psychological Bulletin. 1993, 24: 303-307.Google Scholar
- Rao S, Reddy IK: Development of norms for the Raven's Coloured Progressive Matrices test (Booklet form) on elementary school children. Psychological Studies. 1968, 13: 105-107.Google Scholar
- Cotton SM, Kiely PM, Crewther DP, Thomson B, Laycock R, Crewther SG: A normative and reliability study of the Raven's Coloured Progressive Matrices for primary school aged children from Victoria, Australia. Personality and Individual Differences. 2005, 39: 647-659. 10.1016/j.paid.2005.02.015.View ArticleGoogle Scholar
- Carlson JS, Jensen CM: Reliability of the Raven Coloured Progressive Matrices Test: Age and ethnic group comparisons. Journal of Consulting and Clinical Psychology. 1981, 49: 320-322. 10.1037/0022-006X.49.3.320.View ArticleGoogle Scholar
- Annett RD, Bender BG, Gordon M: Relating children's attentional capabilities to intelligence, memory and academic achievement: a test of construct specificity in children with asthma. Child Neuropsychology. 13: 64-85. 10.1080/09297040600770779.Google Scholar
- Gordon M, Thomason D, Cooper S: To what extent does attention affect K-ABC scores?. Psychology in the Schools. 1990, 27: 144-149. 10.1002/1520-6807(199004)27:2<144::AID-PITS2310270209>3.0.CO;2-G.View ArticleGoogle Scholar
- Gunn DM, Jarrold C: Raven's Matrices performance in Down Syndrome: Evidence of unusual errors. Res Dev Disabil. 2004, 25 (5): 443-457. 10.1016/j.ridd.2003.07.004.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2431/8/30/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.