RAND Europe was commissioned by the National Endowment for Science, Technology and the Arts (NESTA) to undertake a piece of exploratory research examining the types of data and information which Local Authorities draw upon to make commissioning decisions. The research focused on the field of community safety, crime and violence, and is based on twenty-three interviews with informants involved in commissioning at the local, regional, and central Government level. This research raises questions about what ‘counts’ as evidence about what works; our findings suggest that the label ‘good practice’ is often applied to services or interventions on the basis of professional judgment rather than evidence from evaluation. This, however, was rarely questioned by interviewees, who reported satisfaction with both the quantity and quality of information available about effective interventions.
We found that commissioning processes tend to rely upon practitioners’ informal, local knowledge of potential providers, and there is a tendency to re-commission known organisations. We highlight concerns that this may disadvantage small or new providers.
Our findings also suggest there was little evaluation of the impacts of interventions at the local level. Whilst most areas use simple ‘before and after’ information to evaluate an intervention, the data collected related mostly to throughput and process rather than outcomes; interviewees were, however, aware of the limits on their ability to carry out evaluations. We conclude the report by suggesting a number of possible tools and initiatives that could support commissioners of public services in making value for money decisions.
Table of Contents
Introduction and background
Information about local social challenges and policy priorities
Information on what works in addressing policy priorities
Identifying and selecting service providers
Evaluation and performance monitoring
Methodology and approach