Report on National Support Group for Work Experience:
Impact Assessment Tool
1. Background
The purpose of the project is to develop a simple tool that can be used to collect
evidence of the impact of pre-16 work experience upon learners across the NEBPN
membership. If central work experience organisers and schools used the same
impact assessment tools, then this information could be collated to produce a
baseline measure against which to judge future quality improvements.
The NEBPN has developed a draft impact assessment tool for students with
accompanying questionnaires for teachers and employers. The tools have been
tested in a number of EBP areas, and a revised tool was developed and trialled in
Wolverhampton. Andrew Miller was invited to review this work in the light of
feedback from workshops held at the national conference for central work experience
organisers in 2006.
2. Impact assessment
„Impact assessment‟ is concerned with measuring the effects of an educational
activity or process upon learners, i.e. trying to establish in what ways their knowledge
and understanding, skills, qualities, experience, attitudes and attributes have
changed. The most common (and probably only feasible way) of establishing such
impact measures is to ask learners through some form of self-assessment process.
Given the potentially large numbers involved and the likelihood of the „sub-
contracting‟ of the process to teachers, it is important that the impact assessment tool
is simple, clear and robust.
A common research tool to measure the impact of an intervention on learners is to
seek to establish distance travelled through „before and after‟ tests. However, this is
only appropriate when there is a more objective attempt to measure „knowledge‟
which is more amenable to pencil and paper testing. It is also more difficult to
achieve as it relies on schools testing learners twice. It would be hard to control
exactly when learners were tested prior to placements and results would be affected
by where they were in their preparation programme.
For these reasons most evaluations of the impact of work experience on learners
have used a reflective self-assessment process, i.e. asking students to consider the
extent to which work experience has affected their knowledge, skills etc. This is
clearly, and inevitably, a subjective process.
3. Previous evaluations of impact
Previous evaluations using student questionnaires to elicit impact assessment
include: Ofsted (May 2004) Increased flexibility programme: improving work
experience, HMI 2220; Institute for Employment Studies (2001) Pre-16 Work
Experience Practice in England: An Evaluation: Research report RR263, DfEE; and
Pike, G (1999) Skills for Work: The Effects of Work Experience, Focus Central
London. The tools used in their data collection are discussed in this section.
Ofsted (May 2004) Increased flexibility programme: improving work experience, HMI
2220