Skip to main content
  • Research article
  • Open access
  • Published:

Adaptation of the INTERGROWTH-21st neurodevelopment assessment (INTER-NDA) to the context of the English-speaking Caribbean

Abstract

Background

Adaptation of standardized early child development (ECD) assessments to low- and middle-income countries can be challenging because of culture-specific factors relating to language, content, context, and tool administration, and because the reliance of these tests on specialist healthcare professionals limits their scalability in low resource settings.

Methods

We report the cross-cultural adaptation of an international, standardized ECD instrument, the INTERGROWTH-21st Project Neurodevelopment Assessment (INTER-NDA), measuring cognitive, language, motor and behavioural outcomes in 2-year-olds, from a UK-based English-speaking population to the English-speaking Caribbean. Children aged 22-30 months were recruited from a pre-existing randomized controlled neurodevelopment intervention study in Grenada, West Indies.

Results

Eight of 37 INTER-NDA items (22%) were culturally and linguistically adapted for implementation in the Caribbean context. Protocol adherence across seven newly-trained non-specialist child development assessors was 89.9%; six of the seven assessors scored ≥80%. Agreement between the expert assessor and the non-specialist child development assessors was substantial (κ = 0.89 to 1.00 (95% CI [0.58, 1.00]). The inter-rater and test-retest reliability for non-specialist child development assessors was between κ = 0.99 -1.00 (95% CI [0.98, 0.99]) and κ = 0.76 - 1.00 (95% CI [0.33, 1.00]) across all INTER-NDA domains.

Conclusions

The current study provides evidence to support the use of the adapted INTER-NDA by trained, non-specialist assessors to measure ECD prevalence in the English-speaking Caribbean. It also provides a methodological template for the adaptation of child developmental measures to cultural and linguistic contexts that conform to the cultural standards of the countries in which they are utilized to aid in the measurement of neurodevelopmental impairments (NDIs) in a variety of global clinical settings.

Peer Review reports

Background

An estimated 249.4 million children under the age of five years, in low and middle-income countries (LMICs), are at risk of failing to achieve their full neurodevelopmental potential [18, 23]. There is considerable evidence of higher incidence and prevalence of neurodevelopmental impairment in LMICs compared to high-income countries [9, 18, 23]. The measurement of children at risk of neurodevelopmental impairment (NDI) is essential to providing interventions to children at highest risk, especially in LMIC settings where healthcare resources are often limited [14]. Moreover, quantification of NDI burden in and across populations is the first important step in measuring its long-term impact and evaluating the effectiveness of intervention strategies. Nevertheless, epidemiological data on normative child development are sparse or non-existent in many parts of the world, particularly in those areas where children are most at risk [3]. This creates challenges for early child development (ECD) surveillance in LMICs, where ECD outcomes in children from disparate geographical and/or cultural contexts are evaluated using instruments that have not been subjected to a rigorous standardization, adaptation and cultural-customization process for use in these settings. This is particularly significant in ECD assessments because social, cultural and language-related factors can adversely affect a child’s understanding of a test item and his/her subsequent performance on the ECD measure [30]. The use of inadequately adapted ECD assessment tools, at a population-health level, could result in over- or under-estimation of the prevalence of NDIs and, at an individual level, result in the misclassification of children as being at risk (or not) of NDIs. The life-course and public health consequences of either outcome are significant.

It is important to have a reliable ECD assessment tool that can be utilized to screen and assess the neurodevelopment of children residing in LMICs, as it enables healthcare systems residing in LMICs to: (1) conduct primary screenings, such as those held at daycare centers or local schools, to identify children at risk for NDIs; (2) refer children identified to be at risk for NDIs to primary and secondary healthcare settings, such as their primary healthcare provider or local rehabilitation clinic, respectively; and (3) assess the changes in functioning associated with newly-developed interventions that have been implemented either as a part of community-based or institution-based programs that aim to reduce the prevalence of NDIs within the country.

The importance of cross-cultural adaptation of ECD instruments, their adequate translation in the context of colloquialisms and accents; and the robust evaluation of adapted instruments has been highlighted in the World Bank’s Toolkit for the assessment of ECD in children aged under five years in LMICs [11, 12]. The Toolkit encourages cross-cultural adaptations because the data from the ECD assessments can provide tremendous developmental insight in areas where formal testing is unavailable, or rarely practiced. Measures that are not amended tend to demonstrate biases and poorer performance levels because some items do not function in the same manner across cultures [11]. Moreover, the interpretation of unfamiliar phraseology and its linkage to familiar lexical items to express roughly the same concept, are executive functions that can only be expected to emerge during mid to late childhood [10]. It is widely acknowledged that sociolinguistics is critically important when administering a standardized assessment within a culture, including within the same language, as pronunciation, tonality, sentence placement and the words themselves are very important in language processing [15].

One region in which there is limited data on ECD is the 700-island Caribbean basin with a regional population of 44 million [34]. Of the 33 countries and individual territories in the region, ten of these are classified as LMICs [38]. Previously, tropical infections represented the greatest disease burden in the region, however in recent years the burden has shifted to chronic diseases (during adulthood) and ECD disorders, including NDIs (during childhood) [27]. Importantly, the few coordinated efforts to assess individual or groups of young children in the Latin American and Caribbean region suggest that approximately 15% of children are at high risk of NDIs [23]. Despite this, there are, to our knowledge, no ECD tools adapted to and standardized in the cultural and linguistic context of the English-speaking Caribbean. We hypothesize that there are no culturally-adapted ECD assessments specifically for children living in the Caribbean because the region’s residents speak dialects of English, French or Spanish. European and American instruments have been directly exported there without a consideration of how linguistic and cultural differences between these disparate geographical and social populations might influence the test delivery and children’s performance.

The current study addresses this methodological gap in ECD measurement in the Caribbean by, for the first time, (1) adapting (from British to Caribbean English) and culturally customizing a rapid, multi-dimensional, international, standardized ECD instrument, The INTERGROWTH-21st Neurodevelopment Assessment (INTER-NDA), for the measurement of cognitive, motor, language and behavioral outcomes in young Caribbean children, (2) comparing the psychometric properties of the adapted to the original tool and (3) evaluating the ability of non-specialist child development assessors to administer and score the adapted version of the INTER-NDA.

Methods

Study location

The study was carried out in the tri-island nation of Grenada, West Indies. Grenada has been an independent English-speaking nation since 1974. Twenty-three percent of Grenada’s population is under 15 years of age [17]. Throughout the region, approximately half of all households are headed by a single parent [1]. Despite its ranking as an upper middle-income country, approximately a third of its 112,000 residents live in poverty. Unemployment is reported at 20% and the nation’s debt ratio of 110% GDP ranks second worldwide [37]. The gross national income per capita was reported at $11,650 United States Dollars in 2014 [37]. Ethnically, more than 80% of the population identifies as Afro-Caribbean; the remainders are of mixed, or East Indian ancestry [5].

Child development assessors sample

The characteristics of the seven non-specialist child development assessors are described in Table 1. All of the assessors were female and native Caribbean-English speakers. Five of the assessors were Caribbean nationals and two were American citizens. None of these assessors were psychologists or healthcare professionals, and none had a formal education beyond an undergraduate degree. Their income, representative of their socioeconomic status, was equivalent to Grenada’s 2014 gross national income per capita at $11,750 United States Dollars [37], adjusted for inflation.

Table 1 Characteristics of non-specialist child developmental assessors (n = 7)

Inter-rater and test-retest reliability sample – child participants

To evaluate inter-rater and test-retest reliability of the adapted INTER-NDA, each of the seven non-specialist child developmental assessors assessed three children, for a total of 21 child participants. Children ranged from 22 to 30 months old and were recruited from the “Saving Brains Grenada” project – a randomized controlled trial study assessing the impact of a Conscious Discipline intervention on reducing corporal punishment rates and improving neurodevelopmental outcomes among Grenadian children [22]. The 21 children included in the assessor training were recruited from four day-care centers around the capital city of St. George’s and were randomly assigned to a child development assessor for evaluation. The majority were female (52.4%), and all the children were Afro-Caribbean and spoke English as their native language (Table 2).

Table 2 Characteristics of inter-rater and test-retest reliability sample of child participants (n = 21)

Internal consistency sample – child participants

To evaluate the Internal consistency of the adapted INTER-NDA, n = 145 children between 22 and 30 months old were recruited from the “Saving Brains Grenada” project and assessed on the INTER-NDA. A detailed description of this project and its methodology has been published elsewhere [36]. The children were recruited from communities across Grenada via a community based ECD outreach program called The Roving Caregivers. The sample size (n = 145) is consistent with that recommended by the Toolkit for Measuring Early Child Development in Low- and Middle-Income Countries [12]. The sample consisted of majority female (n = 53.8%), all were Afro-Caribbean, all but one spoke English as a native language, and the average child age was 26 months (SD = 2.21 months) (Table 3).

Table 3 Characteristics of internal consistency sample of child participants & their caregivers (n = 145)

Measures

The INTERGROWTH-21st project neurodevelopment assessment (INTER-NDA)

The INTER-NDA is a comprehensive, rapid assessment of cognition, (fine and gross) motor skills, language and (positive and negative) behavior for children aged 22–30 months (Additional file 1) [14]. Its 37 items are administered using a combination of psychometric techniques (direct administration, concurrent observation and caregiver reports) in approximately 15 min. Children’s performance on the INTER-NDA is scored across a spectrum of abilities, rather than on a predefined checklist and, therefore, affords a wider description of a child’s faculties. It has been reported to have strong agreement with the Bayley Scales of Infant and Toddler Development III edition, (BSID-III) (interclass correlation coefficients 0·75–0·88, p < 0·001 for all domains with little to no bias on Bland Altman analysis); satisfactory internal consistency (Cronbach’s alpha 0.56–0.81) and good unidimensionality across subscales (Comparative Fit Index = 0.90; Tucker-Lewis Index = 0.94) and good levels of inter-rater (k = 0·70; 95% CI 0·47 to 0·88) and test–retest reliability (k = 0·79; 95% CI 0·48 to 0·96) [13, 24].

The INTER-NDA is designed for use across socioeconomic groups and populations. Its operation manual, standardization protocol and forms are freely available at www.intergrowth21.org.uk. The kit consists of common household items encountered across the world. The INTER-NDA was developed in 2014 by the International Fetal and Newborn Growth Consortium for the twenty-first Century (INTERGROWTH-21st) Project, a population-based, longitudinal study in five countries, including Brazil, India, Italy, Kenya, and the United Kingdom [35]. In all INTERGROWTH-21st Project study sites, the INTER-NDA was translated into the local languages of the sites using the WHO Mental Health Initiative translation guidelines, which included processes of cultural customization, translation and back translation [14]. The INTER-NDA’s norms are international standards (rather than population-specific references that are adapted for use in the Caribbean) for child development at 2 years of age, constructed from the INTERGROWTH-21st Project population using, the WHO’s prescriptive methodology. Scaled INTER-NDA domain scores are interpreted against the INTER-NDA’s standards to ascertain a child’s risk of no (>10th centile), mild-to-moderate (3rd to 10th centile) or severe (<3rd centile) neurodevelopmental delay for each of the domains [14].

Training of child development assessors

Seven non-specialist child development assessors were trained in the INTER-NDA in Grenada over a five-day period by the developer of the INTER-NDA (MF) who is a UK-based paediatrician, and who served as the expert assessor (expert) for the purpose of this study. During the training process, importance was paid to the conceptual basis of each item, the accurate administration of tasks to the child, as well as the accurate and objective reporting of the child’s performance on each item. All sessions were video recorded, and the expert observed the trainee-assessors carrying out three assessments each on 22-30-month-old children, randomly assigned. After these sessions, the expert provided each trainee-assessor with feedback on their administration and scoring of the INTER-NDA and on their interaction with the child and the caregiver.

INTER-NDA adaptation process to the Caribbean context

The process of the linguistic and cultural adaptation of the INTER-NDA was undertaken on day three of the training, after each trainee-assessor had assessed at least one child, and involved all trainee-assessors, the study PIs and the expert assessor. This process adhered to the previously published, recommended guidelines for the adaptation of an ECD instrument [11]. The process consisted of the following steps:

  1. 1.

    The trainee-assessors and PIs evaluated each of the 37 INTER-NDA items for linguistic and cultural relevance. Items considered to benefit from amendments to fit the local context were identified.

  2. 2.

    The trainee-assessors proposed alternatives to the phraseology of the items identified above. These options were discussed with the study PIs and expert assessor. Each option was scrutinized for contextual relevance by the trainee and expert assessors; any conflicts identified were discussed among all the assessors and alternative phraseology was proposed.

  3. 3.

    The eight adapted items were compared to the original INTER-NDA items by the expert assessor to confirm conceptual equivalence in accurately screening for NDIs. Conflicts identified were discussed with the trainee-assessors, alternative phraseology was considered and the process of assessment for contextual and conceptual equivalence repeated until a consensus was achieved.

  4. 4.

    The final list of adapted items were included into the measure and piloted on children aged 22-30 months.

Evaluation of the INTER-NDA’s administration and scoring by non-specialist child development assessors

Each non-specialist child developmental assessor was evaluated for their ability to (1) administer and (2) score the INTER-NDA in a standardized manner according the INTERGROWTH-21st Project protocols. To assess their ability to administer the INTER-NDA in a standardized manner, each non-specialist child development assessor was rated for protocol adherence on the INTERGROWTH-21st Project’s INTER-NDA protocol adherence checklist (Additional file 2; http://www.medscinet.net/Intergrowth/patientinfodocs/Standardisation%20Protocol.pdf) by the six other non-specialist child developmental assessors and the expert assessor. The agreement between each trainee-assessors’ INTER-NDA scores was compared with the expert’s INTER-NDA scores, across INTER-NDA domains, for the four video recordings of the INTER-NDA described in the reliability experiment above. Protocol adherence scores were summed across all the items to yield an overall INTER-NDA protocol adherence score for each trainee-assessor, from which protocol adherence percentages (range 0-100%) were calculated. The agreement between INTER-NDA domain scores, measured on the adapted INTER-NDA, was compared between trainee-assessors and the expert using kappa coefficients [6, 7].

Statistical analysis - assessment of psychometric properties of the adapted INTER-NDA

All data were analysed in SPSS Statistics v21.0.0.0©IBM Corp. Inter-rater and test-retest reliability between INTER-NDA scores across domains was determined for each trainee-assessor based on their scoring of four videos of the expert assessor administering the INTER-NDA to two-year old children. The second and fourth videos were identical, and trainee-assessors scored these videos separately, without access to the scores of video 1, allowing an assessment of test-retest reliability. Discussion between trainee-assessors and replaying of sections of the videos was not permitted. The video-based approach was selected over a conventional real-time approach to ensure that the child’s scores were not affected by: (i) anxiety about performance in the presence a large number of assessors; and (ii) inability of assessors to hear and see the child’s performance uniformly at all times during the assessment. This approach has been previously used in the INTERGROWTH-21st Project for reliability assessments [14, 24]. Each trainee-assessor administered the INTER-NDA on three children, randomly assigned, Test-retest and inter-rater reliability for the adapted INTER-NDA, across domains, was quantified using kappa coefficients [6, 7]. Kappas of 0.81 and above are considered representative of almost perfect agreement, kappas of 0.61 - 0.80 as substantial agreement, kappas of 0.41 - 0.60 as moderate agreement, kappas of 0.21 - 0.40 as fair agreement, and kappas of 0.20 and below as poor agreement [7]. Internal consistency was determined for each INTER-NDA domain by calculating Cronbach’s alphas on a separate group of n = 145 children between 22 and 30 months of age [4]. Cronbach’s alpha values were considered “good” if they were above a threshold of 0.7 [32].

Ethics

The Institutional Review Board at St. George’s University approved the study (IRB #14066). All research personnel involved in the study completed the National Institutes of Health Office of Extramural Research Protecting Human Research Participants online course. Parents/guardians provided informed written consent on behalf of the participating children. Participating child development assessors provided informed written consent.

Results

Adaptation of the INTER-NDA to the English-speaking Caribbean context

Following the evaluation of each of the 37 INTER-NDA items for linguistic and cultural relevance, eight items were identified to benefit from amendments to fit the local context. These were adapted to meet the study’s requirements of cultural and linguistic prevalence, and the resulting amendments were scrutinized for conceptual equivalence with the corresponding original items of the INTER-NDA by the expert. The adaptations, as well the justifications for these, are presented in Table 4.

Table 4 Adaptation of the INTER-NDA items to the Caribbean context

Psychometric properties of the adapted INTER-NDA

The inter-rater and test-retest reliability across all domains of the INTER-NDA, as determined by the assessments of n = 21 children by the seven non-specialist child developmental assessors, is presented in Table 5. Inter-rater reliability and test-retest reliability among the seven assessors ranged between κ = 0.99 - 1.00, 95% CI [0.98, 0.99] and κ = 0.76 - 1.00 (95% CI [0.33, 1.00]) respectively, across all domains of the INTER-NDA, representing fair to near-perfect agreement [7]. The Cronbach’s alpha scores for the sample of n = 145 children are presented in Table 6. These were near-perfect for the cognitive (α = 0.84), language (α = 0.84) and positive behavior (α = 0.90) domains, substantial for the fine motor (α = 0.62) domain, and fair for the negative behavior (α = 0.31) domain. The Cronbach alpha score is not reported for the gross motor domain because one of the 3 items that make up this domain showed ceiling effects, greatly reducing confidence in the accuracy of the score. The corresponding internal consistencies of the original INTER-NDA, previously published, are also presented in Table 6 for comparison [24].

Table 5 Reliability assessments
Table 6 Internal consistencies of the adapted INTER-NDA

Evaluation of the INTER-NDA’s administration and scoring by non-specialist child development assessors

The protocol adherence scores of non-specialist child development assessors in the context of the administration of the adapted INTER-NDA ranged between 70.5 and 100% (n = 7, M = 89.9%, SD = 10.1%) (Table 7).

Table 7 Protocol Adherence Scores for non-specialist child developmental assessors for the adapted INTER-NDA

Agreement between the expert and the non-specialist child development assessors is presented in Table 5 and ranged between κ = 0.89 and k = 1.00 (95% CI 0.58, 1.00) representing almost perfect agreement [7].

Discussion

This study presents, to our knowledge, the first adaptation of the INTER-NDA to the linguistic and cultural context of the Caribbean, making the INTER-NDA the first ECD measure specifically adapted for use in the English-speaking Caribbean. The adapted INTER-NDA is very similar to the original INTER-NDA, with linguistic and cultural adaptations in 8 of the 37 items while simultaneously maintaining conceptual equivalence between the original and adapted versions. The inter-rater and test-retest reliability of the adapted INTER-NDA, and its internal consistency, were satisfactory across domains and comparable to the original INTER-NDA. Importantly, especially in the context of LMIC settings, we also showed that the adapted INTER-NDA can be administered and scored by non-specialist child development assessors at high levels of protocol adherence and agreement with an expert specialist assessor.

The results of this study provide evidence to support the use of the adapted INTER-NDA to measure ECD prevalence in the English-speaking Caribbean and for non-specialist child development assessors, trained and standardized in the INTER-NDA, to use the tool to conduct ECD evaluations. Previous studies have shown that the INTER-NDA can be administered in school settings in Mexico, and in research settings in Brazil, India, Italy, Kenya and the UK, by non-specialist assessors at high levels of reliability and protocol adherence [14, 31]. These studies have focused on the translation, back translation and cultural adaptation of the INTER-NDA, developed initially in British English, into non-English languages. This study extends this work by culturally and linguistically adapting the INTER-NDA for use in an English-speaking, yet culturally and geographically diverse, LMIC population, i.e. the English-speaking Caribbean. Moreover, we have presented a methodological template for this process, which we hope can be applied to the adaptation and subsequent pilot testing of other ECD tools for use in various Caribbean settings.

Strengths and limitations of the study

This study is important in a number of ways. First, consideration was given to different lexical items to express similar concepts in British and Creole English; for example, “throw” and “pelt”; “cubes” and “blocks”; and “teapot” and “kettle. This is particularly necessary in the Grenadian context where children are more familiar with Creole English, rather than British English, during early life. Second, care was taken to ensure that the components of the INTER-NDA’s kit were familiar to Caribbean children, and commonly encountered in Caribbean households. The use of items unfamiliar to the average child’s repertoire of household and play-related exposures, such as a puffed rice grain or a maize bean [16, 19]; or items which the child may be forbidden from playing with, such as a matchbox [16], are commonly overlooked factors that can skew ECD assessment results. Third, we assessed whether non-specialist child development assessors, in the Caribbean context, can measure ECD outcomes on the adapted INTER-NDA. In LMIC settings where reliance for ECD assessments on specialist professionals for their administration, scoring and interpretation is one of the key rate-limiting steps to the scalability of ECD surveillance and for the identification of children at risk who may benefit from interventions. Although non-specialists have been previously shown to administer and score the INTER-NDA reliably, this study is, to our knowledge, the first effort to assess this in a Caribbean setting and provides evidence to support ECD evaluations in Grenada by non-specialist child development assessors.

There are a number of limitations to consider. First, the sample size used to determine inter-rater reliability and test-retest reliability was small – 7 trainee-assessors performed 3 randomly-assigned child assessments each, for a total of 21 assessments. Thus, test-retest reliability and inter-rater reliability statistics should be interpreted with caution. Second, this study was carried out in Grenada, and while socio-cultural similarities exist among Caribbean nations, the adapted INTER-NDA should be piloted and assessed in other Caribbean settings to establish firmer reliability. Third, this adaptation of the INTER-NDA is limited to the English-speaking Caribbean, despite substantial proportions of the region’s population being native in Spanish and French. Fourth, our results are restricted to the INTER-NDA’s age range of assessment (22 to 30 months) and, as such, ECD tools for the assessment of a wider age range of children should be adapted and standardized in order to significantly impact ECD surveillance in the Caribbean across the early childhood. Fifth, we were not able to assess internal consistency of the gross motor domain within the INTER-NDA as a result of measurement challenges (i.e., ceiling effects) with one of the 3 items that make up this domain score.

Context of the study

An essential condition for achieving the United Nations Sustainable Development Goal (UN SDG) 4.2 (‘ensure that all girls and boys have access to quality early child development, care and preprimary education so that they are ready for primary education’) [33] is the measurement of ECD outcomes at scale, in order to identify children at risk and to make cross-population comparisons [14]. While a multitude of tools to measure ECD risk exist, none are culturally adapted and standardized for use in the Caribbean setting, especially for administration by non-specialists. By linguistically and culturally adapting the INTER-NDA to the context of the English-speaking Caribbean, without compromising its conceptual integrity, we have, for the first time, produced a practically applicable, culturally relevant ECD measure specifically adapted to this setting. The INTER-NDA is a unique clinical tool for use across all healthcare systems to measure neurodevelopmental milestones and associated behaviors in 2-year-olds uniformly and at scale, and to identify children at risk of NDIs who would benefit from specialist referral and further investigation [14]. It is our hope that the adapted INTER-NDA will complement the INTERGROWTH-21st Project’s international INTER-NDA standards [14] for the measurement of ECD outcomes in the Caribbean while simultaneously providing a methodological template for the adaptation of child developmental measures to cultural and linguistic contexts.

Conclusion

This study represents, to our knowledge, the first adaptation of an ECD instrument to the English-speaking Caribbean. This is important for standardized, robust ECD measurement in the region, at scale, and supports the inclusion of Caribbean infants in international efforts at ECD surveillance. Furthermore, this study highlights the importance of the linguistic and cultural adaptation of ECD measures, even between settings which appear to share the same primary language but in which social, cultural, geographic and economic contexts vary.

Availability of data and materials

The data that support the findings of this study are available from the corresponding author (SH) upon reasonable request.

Abbreviations

INTER-NDA:

The INTERGROWTH-21st Neurodevelopment Assessment

ECD:

early child development

LMICs:

low and middle-income countries

NDI:

neurodevelopmental impairment

BSID-III:

Bayley Scales of Infant and Toddler Development III edition

SD :

standard deviation

UN SDG:

United Nations Sustainable Development Goal

References

  1. Bakker C, Elings-Pels M, Reis M. The impact of migration on children in the Caribbean. In: UNICEF Office for Barbados & eastern Caribbean; 2009. Retrieved from https://www.unicef.org/easterncaribbean/Impact_of_Migration_Paper.pdf.

    Google Scholar 

  2. Bayley N. Bayley scales of infant and toddler development. 3rd ed. San Antonio, TX: Harcourt Assessment; 2006.

    Google Scholar 

  3. Black MM, Lawn JE. Early childhood developmental disabilities—data still needed. Lancet Glob Health. 2018;6(10):e1050–1. https://doi.org/10.1016/s2214-109x(18)30399-1.

    Article  PubMed  Google Scholar 

  4. Bland JM, Altman DG. Statistics notes: Cronbach’s alpha. BMJ. 1997;314(572):7080. https://doi.org/10.1136/bmj.314.7080.572.

    Article  Google Scholar 

  5. Central Intelligence Agency. Grenada. In: In The world factbook; 2018. Retrieved from https://www.cia.gov/library/publications/the-world-factbook/geos/gj.html.

    Google Scholar 

  6. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.

    Article  Google Scholar 

  7. Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20. https://doi.org/10.1037/h0026256.

    Article  CAS  PubMed  Google Scholar 

  8. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334. https://doi.org/10.1007/bf02310555.

    Article  Google Scholar 

  9. Durkin M. The epidemiology of developmental disabilities in low-income countries. Ment Retard Dev Disabil Res Rev. 2002;8(3):206–11. https://doi.org/10.1002/mrdd.10039.

    Article  PubMed  Google Scholar 

  10. Farrar MJ, Ashwell S. Phonological awareness, executive functioning, and theory of mind. Cogn Dev. 2012;27(1):77–89. https://doi.org/10.1016/j.cogdev.2011.08.002.

    Article  Google Scholar 

  11. Fernald LCH, Kariger P, Engle P, Raikes A. Examining early childhood development in low-income countries: a toolkit for the assessment of children in the first five years of life. Washington, DC: The World Bank; 2009. https://doi.org/10.1596/28107.

    Book  Google Scholar 

  12. Fernald LCH, Prado E, Kariger P, Raikes A. A toolkit for measuring early childhood development in low- and middle-income countries. DCL The World Bank: Washington; 2017.

    Book  Google Scholar 

  13. Fernandes M, Stein A, Newton CR, Cheikh-Ismail L, Kihara M, Wulff K, et al. The INTERGROWTH-21st project neurodevelopment package: a novel method for the multi-dimensional assessment of neurodevelopment in pre-school age children. PLoS One. 2014;9(11). https://doi.org/10.1371/journal.pone.0113360.

  14. Fernandes M, Villar J, Stein A, Urias ES, Garza C, Victora CG, et al. INTERGROWTH-21st project international INTER-NDA standards for child development at 2 years of age: an international prospective population-based study. BMJ Open. 2020;10(6). https://doi.org/10.1136/bmjopen-2019-035258.

  15. Gladkova A. Grammar and the influence of society and culture. The Encyclopedia of Applied Linguistics. 2012. https://doi.org/10.1002/9781405198431.wbeal0471.

  16. Gladstone M, Lancaster GA, Umar E, Nyirenda M, Kayira E, Broek NR, et al. The Malawi developmental assessment tool (MDAT): the creation, validation, and reliability of a tool to assess child development in rural African settings. PLoS Med. 2010;7(5). https://doi.org/10.1371/journal.pmed.1000273.

  17. Government of Grenada (2011). Non Institutional Population in Private Households, by Age Group and Sex, 2011. Retrieved from https://gov.gd/mof/data.

  18. Grantham-McGregor S, Cheung YB, Cueto S, Glewwe P, Richter L, Strupp B. Developmental potential in the first 5 years for children in developing countries. Lancet. 2007;369(9555):60–70. https://doi.org/10.1016/s0140-6736(07)60032-4.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Khan NZ, Muslima H, Shilpi AB, Begum D, Parveen M, Akter N, et al. Validation of rapid neurodevelopmental assessment for 2- to 5-year-old children in Bangladesh. Pediatrics. 2013;131(2). https://doi.org/10.1542/peds.2011-2421.

  20. Lambert MC, Williams SG, Morrison JW, Samms-Vaughan ME, Mayfield WA, Thornburg KR. Are the indicators for the language and reasoning subscale of the early childhood environment rating scale-revised psychometrically appropriate for Caribbean classrooms? Int J Early Years Educ. 2008;16(1):41–60. https://doi.org/10.1080/09669760801892219.

    Article  Google Scholar 

  21. Lambert MC, Sewell WC, Levitch AH. Metamorphosing euro American psychological assessment instruments to measures developed by and for English-speaking Caribbean people. In: Roopnarine JL, Chadee D, editors. Caribbean psychology: indigenous contributions to a global discipline. Washington, DC, US: American Psychological Association; 2016. p. 327–55. https://doi.org/10.1037/14753-014.

    Chapter  Google Scholar 

  22. Landon B, Waechter R. Reducing corporal punishment with saving brains Grenada. In: Presented at the international congress on Psychology. Yokohama, Japan; 2016.

  23. Lu C, Black MM, Richter LM. Risk of poor development in young children in low-income and middle-income countries: an estimation and analysis at the global, regional, and country level. Lancet Glob Health. 2016;4(12):e916–22. https://doi.org/10.1016/s2214-109x(16)30266-2.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Murray E, Fernandes M, Newton CR, Abubakar A, Kennedy SH, Villar J, et al. Evaluation of the INTERGROWTH-21st neurodevelopment assessment (INTER-NDA) in 2 year-old children. PLoS One. 2018;13(2). https://doi.org/10.1371/journal.pone.0193406.

  25. Olusanya BO, Davis AC, Wertlieb D, Boo N, Nair M, Halpern R, et al. Developmental disabilities among children younger than 5 years in 195 countries and territories, 1990–2016: a systematic analysis for the global burden of disease study 2016. The Lancet Global Health. 2018;6(10):e1100–21. https://doi.org/10.1016/s2214-109x(18)30309-7.

    Article  Google Scholar 

  26. Patterson JL. Comparing bilingual and monolingual toddlers expressive vocabulary size. Journal of Speech, Language, and Hearing Research. 2004;47(5):1213–5. https://doi.org/10.1044/1092-4388(2004/089).

    Article  PubMed  Google Scholar 

  27. Razzouk D, Gallo C, Olifson S, Zorzetto R, Fiestas F, Poletti G, et al. Challenges to reduce the ‘10/90 gap’: mental health research in Latin American and Caribbean countries. Acta Psychiatr Scand. 2008;118(6):490–8. https://doi.org/10.1111/j.1600-0447.2008.01242.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Rothbart MK. Measurement of temperament in infancy. Child Dev. 1981;52(2):569–78. https://doi.org/10.2307/1129176.

    Article  Google Scholar 

  29. Samms-Vaughn M. Comprehensive longitudinal studies of child health, development and behavior in Jamaica: findings and policy impact. West Indian Med J. 2008;57(6):639–44.

    Google Scholar 

  30. Semrud-Clikeman M, Romero RAA, Prado EL, Shapiro EG, Bangirana P, John CC. Selecting measures for the neurodevelopmental assessment of children in low- and middle-income countries. Child Neuropsychology. 2016;23(7):761–802. https://doi.org/10.1080/09297049.2016.1216536.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Slim J, Villar J, Varela GG, Castillo FH, Duran AB, Guzman MDLL, et al. Individual or group-based approach to the assessment of presechool children: a comparison using the INTERGROWTH-21st neurodevelopmental assessment (INTER-NDA). International journal of growth and development. 2018;2:11–33. https://doi.org/10.25081/ijgd.2018.v2.60.

    Article  Google Scholar 

  32. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2(53). https://doi.org/10.5116/ijme.4dfb.8dfd.

  33. United Nations, Department of Economic and Social Affairs (2015). Transforming our world: The 2030 agenda for sustainable development. Retrieved from https://sdgs.un.org/publications/transforming-our-world-2030-agenda-sustainable-development-17981

  34. United Nations, Department of Economic and Social Affairs, Population Division (2017). World population prospects: The 2017 revision. Retrieved from https://population.un.org/wpp/DataQuery/

  35. Villar J, Altman DG, Purwar M, Noble JA, Knight HE, Ruyan P, et al. The objectives, design and implementation of the INTERGROWTH-21st project. BJOG. 2013;120(Suppl 2):9–26. https://doi.org/10.1111/1471-0528.12047.

    Article  PubMed  Google Scholar 

  36. Waechter R, Evans R, Fernandes M, Bailey B, Holmes S, Murray T, et al. A community-based responsive caregiving program improves neurodevelopment in two-year old children in a middle-income country; in press.

  37. World Bank (2016). GNI per Capita, PPP (current international $). Retrieved from http://data.worldbank.org/indicator/NY.GNP.PCAP.PP.CD?order=wbapi_data_value_2014+wbapi_data_value+wbapi_data_value-last&sort=asc

  38. World Bank (2018). World Bank country and lending groups. Retrieved from https://datahelpdesk.worldbank.org/knowledgebase/articles/906519

Download references

Funding

This study was supported by the Grand Challenges Canada Saving Brains Programme for the Grenada Saving Brains project, grant # 0587-03. Michelle Fernandes is funded by the National Institute of Health Research, UK through a BRC Career Track fellowship in Paediatrics. Neither of the funding bodies listed carried a role in the design of the study, the collection, analysis, and interpretation of data, or the preparation of the current manuscript.

Author information

Authors and Affiliations

Authors

Contributions

RW1, MF, RE, TM, CM, SH2, RI, RW2, EA, and BL conducted the outlined methods. RW1, RE, MF, and SH1 prepared the current manuscript. All authors have read and approved the current manuscript prior to its submission.

Corresponding author

Correspondence to Sean Hanna.

Ethics declarations

Ethics approval and consent to participate 

The Institutional Review Board at St. George’s University approved the study (IRB #14066). All research personnel involved in the study completed the National Institutes of Health Office of Extramural Research Protecting Human Research Participants online course. Parents/guardians provided informed written consent on behalf of the participating children. Participating child development assessors provided informed written consent.

Competing interests

None of the authors have a conflict of interest to declare. 

Consent for publication

Not Applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

The INTERGROWTH-21st Neurodevelopment Assessment (INTER-NDA).

Additional file 2.

The INTERGROWTH-21st Neurodevelopment Assessment (INTER-NDA) Protocol Adherence Checklist.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Waechter, R., Evans, R., Hanna, S. et al. Adaptation of the INTERGROWTH-21st neurodevelopment assessment (INTER-NDA) to the context of the English-speaking Caribbean. BMC Pediatr 22, 21 (2022). https://doi.org/10.1186/s12887-021-03039-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12887-021-03039-7

Keywords