Snapshots in time: using real‐time evaluations in humanitarian emergencies

Abstract

PurposeThe paper's aim is to assess the usefulness of the real time evaluation methodology in rapid‐onset humanitarian emergencies and to document recurring constraints and lessons learned.Design/methodology/approachA small online survey was carried out among evaluation interviewees and a desk study was commissioned to extrapolate good practice and learning points from nine evaluations carried out by one international organisation over the past three years.FindingsGiven the changing nature of the environment in which agencies work during rapid onset humanitarian emergencies, impact evaluations are often carried out too late for important programme changes to be made. The real time evaluation methodology has proved to be a reliable and useful tool for process evaluation during rapid‐onset emergencies. However, it is clear, if it does not take place within the first two months the chances of programmatic changes being made are minimal. There is still the issue of organisational learning and ensuring that lessons learned from one response are taken forward in future programmes. Although there are several risks associated with the methodology, these are outweighed by the advantages, both immediate and longer‐term.Practical implicationsThe findings from these studies has been of value to the organisation but they are also of interest to the wider humanitarian sector struggling with the practicalities of process evaluations in a challenging environment.Originality/valueAlthough there are several publications about real time evaluation methodology, this paper is one of the first attempts by a non‐UN organisation to critically review evaluation reports and to document the staff opinions.