DATA TOOLS

4 & 5 YEARS ASSESSMENT TOOL

Measures whether preschool children are on track for their age in key areas of development.

ABOUT THIS TOOL

The ELOM 4 & 5 Years Assessment is a standardised tool that measures performance across five key developmental domains for children aged 50 to 59 months and 60 to 69 months:
  • Gross Motor DevelopmentThis domain looks at the child’s ability to control the large muscles of the body
  • Fine Motor Coordination and Visual Motor IntegrationThis domain looks at the child’s ability to control small muscles and coordinate small movements with visual information perceived by the eyes
  • Emergent Numeracy and MathematicsThis domain looks at early math skills, such as the ability to understand number concepts, symbols, shapes, and size
  • Cognition and Executive FunctioningThis domain looks at the child’s ability to stay focused, think critically, solve problems, form concepts, attend to instructions, and control impulses
  • Emergent Literacy and LanguageThis domain looks at the child’s ability to communicate effectively. This includes their ability to speak in full sentences, recognise the initial sounds of words, name common objects, relay events and listen to and understand stories told to them

For each of these domains, and for learning overall, the tool helps determine whether children are:

  • On track for achieving the expected standard for their age
  • Falling behind the standard
  • Falling far behind and in need of significant assistance to reach the standard

The tool is intended for use with groups of at least 15 children. Results can be used to guide programme enhancement, to optimise resource allocation, to compare the relative effectiveness of different types of programmes, to assess the impact of risk factors on young children, to inform systems enhancements and to enable population-level surveillance of child outcomes. View Case Studies.

This tool is available in all of South Africa’s 11 official languages. It is designed to be used by an accredited ELOM assessor or trained professional psychometrist e.g. occupational therapist.

Because social and emotional functioning cannot be satisfactorily measured by a person unfamiliar with the child, we recommend also using the ELOM Social-Emotional Rating Scale (alongside the ELOM 4&5) to measure these important aspects of development. This scale is completed by an adult who knows the child well.

USE THE 4 & 5 YEARS ASSESSMENT TOOL

Apply here to use this tool or to access the menu of support options.

TECHNICAL DOCUMENTS

This Technical Manual outlines the rigorous process followed in the development of the ELOM 4&5 Assessment Tool and describes further psychometrics undertaken since the release of the tool. 

The tool provides a reliable and fair assessment of children regardless of their socio-economic and ethnolinguistic background. Content, construct, age, and concurrent validity (with the WPSSI-IV), as well as test-retest reliability, have been established. 

The relationship between age and learning gains (maturation effect) has also been investigated, and can thus be used as a counterfactual against which to evaluate programme gains.

FAQ

The tool contains 23 items in a game-style format that children find fun and engaging. The children are assessed one at a time, in a quiet, appropriate space at their ECD centre or elsewhere. Data capture on the ELOM 4&5 is fully digitised using Survey CTOa digital platform that allows you to collect high-quality data using mobile phones, tablets, or computers, even when you’re offline (on an appropriate tablet). Instructions for assessors are colour-coded for ease of use, and stop rules are hard coded into the tool in such a way that if the child does not succeed on a specific item, the system automatically progresses to the next relevant item.

The assessment takes approximately 45 minutes per child.

The domains chosen for ELOM 4&5 underpin the South African early learning curriculum: Gross Motor Development; Fine Motor Coordination and Visual Motor Integration; Emergent Numeracy and Mathematics; Cognition and Executive Functioning; and Emergent Literacy and Language.

Once the overall domains had been decided, a scan of available tools used in similar exercises to the ELOM was undertaken. A particular focus was on measures with established validity and reliability which had been developed for use in South Africa and the region or in similar socio-cultural and socio-economic contexts. In designing the items used in the tool, the team also drew extensively on research literature, the South African National Curriculum Framework for Children from Birth to Four, and interviews with experts, including ECD practitioners and Grade R teachers. An initial long list of items were tested using accepted psychometric practices (see technical manual for detail) before selecting the final 23 items used in the tool.

A child’s performance on each item in each of the five ELOM 4&5 domains is awarded a raw score, which is then transformed into a scaled score. In each domain, item scaled scores are summed to provide a domain Total Score out of 20. The five domain scores are then summed to derive the ELOM 4&5 Total Score out of 100. Scores for each domain and for the total fall within one of 3 performance bands: On Track, Falling Behind and Falling Far Behind (in earlier versions this last category was referred to as At Risk). The cut off points for On Track, Falling Behind and Falling Far Behind for children aged 50 to 59 months and 60-69 months were set empirically and in consultation with key stakeholders (in 2016).

ELOM 4 & 5 Years Direct Assessment was validated on a sample representative of a range of socio-economic backgrounds of South African children, with children from five of the main language groups (isiXhosa, isiZulu, Afrikaans, Setswana, English). 1,331 randomly selected children from 173 schools in three provinces were assessed.

Yes, internationally accepted psychometric practice was followed to check for fairness. Analyses showed that the ELOM did not discriminate between children from different socio-economic or language backgrounds.

Yes they do. In the development process, we looked at three types of reliability:

  1. internal reliability (also known as consistency) is a measure of the consistency of a test-taker’s performance on the test questions. If all the questions on the test measure related skills, then its internal reliability will be high.
  2. test-retest reliability refers to the consistency (stability) of the test over time. This form of reliability is assessed by administering a test to the same participants on two occasions (for young children normally within a week), and correlating the two scores. A significant test-retest correlation of .75 or above is considered acceptable
  3. inter-rater (scorer) reliability is evident when the scores awarded by different assessors of the same individual are correlated. In a study where more than one assessor is testing a number of children or adults it is important that all have the same approach to scoring the test. This form of reliability is established during assessor training. It can be established by calculating Cohen’s Kappa (among other methods). Values of 0.4 to 0.75 are considered moderate to good and a kappa of >0.75 represents excellent agreement.
The team followed accepted practices in setting standards. This requires the use of empirical dataEmpirical data is acquired by observation or experimentation using accepted methods. Child test scores and observations of caregiver-child interactions would be two examples and the judgments of qualified people. The ELOM team used data from the standardisation sample to explore how children from the five economic quintiles performed. The task was to set standards for each domain and for the ELOM Total that was neither too high nor too low. They had to be aspirational but realistic. The preliminary standard was set at the score achieved by the top 40% of the children in the age validation sample (the 60th percentile). Children from all quintiles were represented in that band (fewer in quintile 1 and more in quintiles 4 and 5). A consultation with expert stakeholders in the ECD sector (both in government and civil society) resulted in the finalisation of this standard. It will be re-examined and changed if necessary as experience with the ELOM is accumulated.

No, ELOM is not a tool for assessing the school readiness of individual children. It is not designed to assess intelligence or diagnose developmental delay. However, it can be used to identify children who are significantly behind the standard expected for their age. They could then be referred for specialist assessment.

No, the ELOM 4 & 5 Years Targeting Tool was designed to quickly identify individual children within a programme that need additional early learning support.

Children’s performance on the five domains is more important than the total score, as these give programme managers a clear indication of how their programmes are performing, and where attention is needed to bring the children up to standard.

Costs depend on the amount of support required from the DataDrive2030 team and a cost estimate is provided once a request is received. We aim to keep the costs as low as possible and to subsidise costs for smaller non-profit organisations to enable their use of the tools.

The tool is designed to be used by an accredited ELOM assessor or trained professional psychometrist e.g. occupational therapist.

This tool is available in all of South Africa’s 11 official languages.

We recommend that you carry out a pre-post study once your programme implementation is mature – that is, once you are satisfied that it is consistently being implemented with quality. A pre-post study involves conducting an ELOM baseline assessment before the programme year commences, and then about eight/nine months later towards the end of the programme year. Your sample’s performance is then compared between these two time points to estimate whether the programme has impacted your sample’s development. This kind of study cannot replace a full-scale evaluation, but provides basic key insights into programme effectiveness.
 

CASE STUDIES

The following case studies illustrate how the ELOM 4 & 5 Years Assessment Tool has been used:

  • To evaluate and enhance early learning programmes and systems
  • To optimise resource allocation and facilitate outcomes based financing
  • To enable population level tracking and reporting
  • To answer a variety of important research questions