Evaluations

External evaluation reports from disaster management projects undertaken by Tearfund’s operational teams and partners are a valuable source of learning and good practice.

Evaluation of Humanitarian Action 2003-2013 (PDF 590 KB)
Evaluation date: February 2013 
Introduction: In 2013 Darfur, in western Sudan, reached the ten year anniversary of the humanitarian crisis triggered by the start of civil war in February 2003. Despite the launch of a concerted humanitarian intervention by the international community, humanitarian need still remains. Tearfund began operating directly in Darfur in 2004. 

The aim of the assignment was to critically assess Tearfund’s operations in Darfur since 2004 through an evaluation of humanitarian action.

Achievements in a complex protracted crisis, 2004-2013 (PDF 2.5 MB)
Evaluation date: February 2013 
Introduction: In 2013 Darfur, in western Sudan, reached the ten year anniversary of the humanitarian crisis triggered by the start of civil war in February 2003. Despite the launch of a concerted humanitarian intervention by the international community, humanitarian need still remains. Tearfund began operating directly in Darfur in 2004. 

The ten year anniversary offered an opportunity to take stock of what  Tearfund’s Darfur programme has been able to achieve. This is set out in a 15 page document entitled ‘Achievements in a complex protracted crisis’, now available here.

Evaluation of Mid-term review of Tearfund’s Pakistan Flood Response (PDF 1.8 MB)
Evaluation date: May 2012
Introduction: The aim of this assignment was to conduct a mid term learning review of Tearfund’s Pakistan Flood response strategy.  There was no attempt to evaluate all the projects within the flood response but rather to learn from the experience of Tearfund’s partner agencies as well as its own operational programme team so far, so that the learning could be applied to planning for the next twenty months of the appeal strategy (up to 31 December 2013). A sample of projects were visited in order to better understand the context, partners and their work, but not for a detailed evaluation of each. The review assessed grants and capacity building support and covered the period from January 2011 (post RTE) to  March 2012. the evaluation concluded that, overall, the affected communities which were targeted by Tearfund’s flood response strategy have been significantly assisted and well-targeted – in many of the areas very limited support was provided by other organizations. Beneficiaries gained multiple benefits aside from material support in terms of seed, cash grants, shelter and sanitation solutions which has resulted in the consolidation of the bond with partners and communities of the target areas. The project was also well received by the district administrations of the project intervention areas. The mid-term review found that though very basic level initiatives have been taken in terms of promoting Disaster Risk Reduction (DRR) under this flood response project, it is envisaged that the initiative will culminate into a long term programme in coming years. Tearfund partners in Pakistan have gradually shifted their focus from response to preparedness e.g. DRR has been mainstreamed into early recovery initiatives by building shelter and hand-pumps on raised platforms as well providing awareness on DRR through training sessions. This approach is getting popularity among beneficiaries as they feel more aware, prepared and resilient on the whole.  

Afghanistan OFDA-funded support to drought-affected families in Jawzjan province: end-of-project evaluation (PDF 1.9 MB)
Donor: OFDA
Evaluation date: September 2012
Introduction: This is the final evaluation report of the United States Agency for International Development (USAID) Office of Foreign Disaster Assistance (OFDA) funded cash-for-work (cfw) project carried out by Tearfund in Murdian and Khoja Doko Districts of Jawzjan province between January and June 2012. The evaluation judged that the project had a significant impact on its beneficiaries, within its limited scope and goals of injecting cash into very vulnerable households and enabling valuable community work to be undertaken. It found though that longer-term impacts were probably rather limited. There were no other discernible negative impacts, however. Stakeholders expressed their satisfaction with the project, and it was clear in the evaluation that relationships between project staff, local Government, community representatives and beneficiaries were good. Community members and their representatives did however, understandably, request more and longer interventions in future. Project implementation processes were of high quality, particularly emphasizing Tearfund’s standards of Impartiality and Targeting, and Accountability. Communications and coordination were judged to be of a high standard. The project did achieve its short-term goals. However the evaluation found that the situation which gave rise to the project remains largely unchanged, and the lasting impact is likely to be small. The evaluator commented that ‘strong consideration should be given to achieving better integration of Tearfund’s long-term development, DRR and emergency response work in Jawzjan and elsewhere in Afghanistan’. 
 
Afghanistan BPRM-funded support to returnees, IDPs and host communities in Jawzjan and Kandahar provinces: end-of-project evaluation (PDF 405 KB)
Donor: BPRM
Evaluation date: December 2011
Introduction: Tearfund’s operational team in Afghanistan, active in the country since 2001 and currently having a particular focus on WASH (water, sanitation and hygiene), nutrition, and livelihood activities, carried out a one year multi-sector project entitled Kandahar, Jawzjan and Faryab Integrated and Sustainable Services for Returnees and Host Communities between September 2010 and September 2011. The project, funded solely by the US Bureau for Population, Refugees and Migration (BPRM), targeted 2,300 returnees, IDPs and vulnerable host community members in three provinces (Jawzjan, Faryab and Kandahar) with a goal of aiding in resettlement and helping to establlish a sustainable healthy standard of life. Specific project objectives were developed relating to safe drinking water, basic hygiene knowledge and practice, livelihood opportunities, nutrition through vegetable gardening and animal husbandry, and community self-reliance. This report is the result of the end-of-project evaluation to assess the effectiveness of this project from perspectives of impact, stakeholders, output, processes, resources and organisational capacity. In assessing the six key perspectives, a four-point scale was used, with 1 indicating the project made no contribution to the aspect and 4 indicating substantial contribution. The overall score for the assessment was 19 out of a possible 24. This represents a strong project, based on proposal design and DMT mandate, with room for improvement in the future.

Evaluation of Tearfund's Pakistan Flood Response (PDF 1.7 MB)
Evaluation date: December 2010
Introduction: An external Real Time Evaluation of Tearfund's response (both partner and operational) to the devastating 2010 floods in Pakistan – intended to learn from Phase 1 and make recommendation for the recovery and rehabilitation phase.  The evaluation found that items distributed in phase 1 were appropriate and met immediate needs; there was good use of local implementing agencies and the decision to support partners in their areas of expertise was good.  Tearfund made funding decisions and transfers very quickly.  Despite a slow start, Tearfund’s Operational Programme now has reasonably robust procedures and systems in place. 
Key recommendations: a systematic and intentional approach to DRR, including a dedicated staff member; greater consideration of the gender dimension; and consideration of a sustainable livestock distribution scheme.   

Evaluation of DEC-funded Shelter Projects following the 2009 Indonesian Earthquake (PDF 126 KB)
Donor: Disasters Emergency Committee 
Evaluation Date: August 2010 
Introduction: The focus of this external evaluation was the effectiveness of Tearfund’s response to the 2009 Padang earthquake, considering shelter projects outworked by Tearfund’s partners CRWRC/GenAssist and World Relief.  Despite delays, both funded projects represent an appropriate use of DEC Appeal funds.
Key recommendations: The evaluation notes the need for the Indonesian Shelter Cluster to agree an overall approach to shelter reconstruction before the next earthquake.

Real Time Evaluation of Tearfund's Haiti Earthquake Response (PDF 145 KB)
Evaluation Date: May 2010
Introduction: This is a report of a Real Time Evaluation of the response by Tearfund UK (in partnership with Tear Netherlands) to the 2010 Haiti Earthquake, intending to learn from the second phase of the response and to identify lessons for the remainder of phase 2 and for Phase 3 (recovery and reconstruction).  The evaluation found that Tearfund’s chosen areas, sectors and overall strategy appeared highly appropriate and no major changes were needed.
Key recommendations: a focus in phase 3 on helping more households restore their livelihoods and shelter; more contact with DEC agencies; greater priority given to reconstruction and transitional projects; use of a rapid grant approval mechanism.

Tearfund’s Appeal Strategy for Cyclone Nargis, Myanmar (PDF 879 KB)
Donor: Disasters Emergency Committee and Tearfund supporters
Evaluation Date: January 2010
Introduction: The focus of this external evaluation was on the effectiveness of Tearfund’s support for partners in achieving its Cyclone Nargis strategy, considering assistance provided to partners, application of lesson learning from the tsunami response and appropriateness of INGO and local church partnerships.  The evaluation judged that the appeals strategy was efficient and effective, through channelling a large portion of grant money through one INGO partner and forging new links with church partners despite challenges with organisational cultures and limited outputs.  
Key recommendations: the secondment of finance personnel to partners; partnering with more than one agency; the timely recruitment of a local staff member to support lower capacity partners.  

DRC - Uvira Midlands & Highlands, South Kivu, DRC (PDF 19 KB)
Donor: ECHO
Evaluation date: July 2009
Introduction:  This evaluation of a WatSan, PHE and Education Project commented that the programme has achieved its objectives despite the remoteness of communities and a reduced timeline, due to the quality of Tearfund’s field staff. The evaluator commented that Tearfund was often the only NGO serving these remote communities. 
Key recommendations: technical improvements to improve structural outputs. Tearfund has incorporated this advice into ongoing work.  

Bangladesh HEED response to Cyclone Sidr (PDF 25 KB)
Donor: Disasters Emergency Committee
Evaluation date: April 2009
Introduction: This external evaluation reviewed the response to Cyclone SIDR by Tearfund local partner HEED Bangladesh. The evaluator noted HEED’s rapid response in supporting temporary shelter with high quality tarpaulin and distributing dry food, the critical role of volunteers trained from HEED’s DRR project, and the impact of cash for work schemes. 
Key recommendations: the need for clear targeting in order to provide a more substantive dry food ration within a more concentrated geographical area; the need for finding culturally appropriate beneficiary feedback mechanisms.  

Afghanistan Jawzjan ECHO Food Security and livelihoods 09  (PDF 47 KB)
Donor: ECHO
Evaluation date: March 2009
Introduction: This evaluation assessed the effectiveness and impact of 2 ECHO funded food security projects implemented between Oct 07 and Feb 09. Overall finding was that the projects had been “implemented participatively and in line with the articulated needs of the communities” It found that overall project activity indicators were met or exceeded. In general the projects were well targeted and complimentary to the local coping strategies for dealing with food insecurity. Co-ordination with local Gov departments was strong. 
Key recommendations: consideration of longer term interventions with development of producer groups, strategies for improvement to access to products and services, and greater emphasis to draw on and contribute to best practice in Afghanistan.

Afghanistan Kandahar ECHO WATSAN 08 (PDF 710 KB)
Donor: ECHO
Evaluation date: February 2009
Introduction: Overall finding was that the WASH project "software" (hygiene training) was successful but the "hardware" (school latrines, piped water scheme) was less so, with significant sustainability issues.  In particular, complying with the schools' insistence on flush toilets (an inappropriate technology in the local context) led to a failed sanitation intervention. The plan to bring piped water to an IDP community with "questionable legal status" caused difficulties in vital government relationships.  Management staff evacuations and resignations due to insecurity resulted in damaging gaps in engineering supervision and government relationship-building.
Key recommendations: Work on increased local ownership of interventions (through e.g. connection charges for pipe scheme, emphasising DoE responsibility for school sanitation); greater involvement of local officials during design and implementation; resist requests for unsustainable technologies; develop clearer "business plan" for water scheme.
Management response: Organisationally this project highlighted that in areas of high risk that require remote monitoring, we need to take an objective and realistic view regarding the skill set of our local staff, and to limit and commit ourselves to more realistic targets using fewer indicators.

Darfur Beida DFID & OFDA Integrated Relief and Rehabilitation 2009 (PDF 26 KB)
Donor: DFID & OFDA
Evaluation date: February 2009
Introduction:  This evaluation covered the period April to December 2008 for Tearfund’s multi-sectoral relief and rehabilitation programme in Beida, West Darfur. The evaluators commended the appropriateness and competence of the activities and felt that attempts to serve all communities involved in the conflict has positively contributed to a local de-escalation of tensions.  

Darfur Wadi Salih Integrated Relief and Rehabilitation Project ‘09 (PDF 26 KB)
Donor: BUZA, Tearfund Australia, Tearfund New Zealand, Tearfund Switzerland, Tear Netherlands, and Tearfund Belgium
Evaluation date: February 2009
Introduction:  This external evaluation covered the period April – December 2008.  The evaluators concluded that Tearfund had played a valued role in improving conditions in Wadi Salih, West Darfur to a point where Tearfund’s objectives have been largely achieved and emergency needs largely met.  
Key recommendations: Tearfund should close the project as planned at the end of March 2010, focus on consolidating activities and exiting well from partner communities for the remaining 12 months.

Natural Disaster Risk Reduction through Policy Change, Capacity Building and Community Based Mitigation and Preparedness (mid-term evaluation) (PDF 311 KB)
Donor: DFID
Evaluation date: January 2009
Introduction: A five-year DRR project, which provided Tearfund a platform from which to launch other initiatives. The experience of implementing a cross-continent and cross-team project has provided a learning base for the development of further multi-country institutional funding applications. It has also provided a substantial volume of information on the detail of how to implement DRR at the grassroots level, increasing expertise and analysis.  This information has been captured for internal learning for the organisation and partners, but the future challenge is to use it as a foundation to influence policy, especially in the field of Climate Change Adaptation.

Darfur Ed Daein ECHO Integrated Emergency (PDF 33 KB)
Donor: ECHO
Evaluation date: September 2008
Introduction:  This evaluation of Tearfund’s ‘’Integrated Emergency Nutrition, Water, Sanitation and Health Promotion Project’’ in the Ed Daein area of South Darfur covered the period June 2007 to June 2008. The evaluators commended the high quality of work and timely response and had a high opinion of the quality of staff, both National and International. 
Key recommendations: greater clarity concerning which activities were responding to the crisis and which could move towards rehabilitation and that there should be a greater focus given to the sustainability of such rehabilitation work. Alongside this, the evaluation underlined the need to retain capacity to respond to any further emergency needs that might arise.

Liberia Impact Evaluation (2005 - 2008) (PDF 560 KB)
Donor: ECHO, DFID, Irish Aid, UN and others
Evaluation date: October 2008
Introduction:  This was a high level evaluation of the DMT Liberia Programme 2005-08, at a time when projects were being handed over to local partner organisations. Evaluators noted Tearfund’s strong commitment to partnership and found that the investments made had not only contributed to the successful achievement of the DMT Programme, but had resulted in a strengthened local partner better able to contribute longer-term development. High levels of behavioural change were also noted within communities. 
Key recommendations: that guidelines be developed for partnership working, including a clear exit strategy and to include a detailed livelihoods assessment in future food security programmes. 

Liberia Nimba WCR CFGB Food Security 08 
(PDF 83 KB)
See Liberia impact evaluation (2005 - 2008)

Liberia Sinoe ECHO Food Security 08 (PDF 72 KB)
See Liberia impact evaluation (2005 - 2008)