Program Overview
MCC’s $351 million Malawi Compact (2013-2018) funded the $20 million Environmental and Natural Resources Management (ENRM) Project. Consistent, reliable, and affordable electricity is a key constraint on Malawi’s economic growth, so the program aimed to reduce disruptions and increase the efficiency of hydropower generation. The Weed and Sediment Management (WSM) Activity provided equipment to remove sediments and weeds in the Shire River that hinder hydropower generation. The ENRM and the Social and Gender Enhancement Fund (SGEF) created a grant facility to promote sustainable land management. The project also sought to establish an environmental trust to fund land management activities post-compact.
Evaluator Description
MCC commissioned Mathematica to conduct an independent interim performance evaluation of the ENRM Project. Full results and learning: https://data.mcc.gov/evaluations/index.php/catalog/210.
Key Findings
Weed and Sediment Management Activity
- Dredge delivery was significantly delayed or canceled because of poor contractor selection and performance. By compact closeout, the weed removal equipment and one dredge were delivered, although the dredge was not yet in use.
- Due to equipment delays, the project has yet to show a reduction in disruptions to hydropower generation.
- Malawi’s Electricity Generation Company (EGENCO) and the government have committed funds to complete implementation of the WSM Activity.
ENRM and SGEF Grant Facility
- The grant facility was successfully implemented but was constrained by a three-year intervention window and cost-reimbursement contracts that slowed grant implementation. The grant-making process sometimes relied on subjective criteria and undocumented decisions.
- The grant facility exceeded several of its targets but did not have the resources or capacity to monitor key outcomes like farming practices.
Environmental Trust
- The lack of early agreement between MCC and MCA-Malawi on the trust structure, a focus on implementing the grant facility, and poor contractor performance resulted in trust operations not being launched before compact closeout. It is uncertain if the environmental trust will be launched and sustained in the coming years.
Evaluation Questions
This interim performance evaluation was designed to answer research questions for the WSM Activity, the grant facility, the environmental trust, and the overall ENRM Project.
- 1
How did project implementation vary from what was planned, and why? - 2
Which objectives from the grant facility were achieved and which were not, and why? - 3
What are stakeholders’ perceptions of the sustainability of outcomes for each activity? - 4
To what extent is the environmental trust on track to reach administrative and operational sustainability?
Detailed Findings
Weed and Sediment Management Activity
Equipment delivery for weed and sediment control was significantly delayed or canceled because of poor contractor selection and performance. By compact closeout, weed removal equipment was delivered, and one out of two planned dredgers was delivered but not yet in use, while the other was canceled.
Because the investments of the WSM Activity are not fully operational, it is too early to assess higher-level outcomes for power generation or reduced disruptions in hydropower generation. Average power plant utilization fluctuated between 50 and 70 percent during the compact, and was only 55 percent in its final quarter.
EGENCO and the Government of Malawi have committed funds to complete implementation of the WSM Activity post-compact but EGENCO faces financial challenges that could limit its plans.
ENRM and SGEF Grant Facility
The grant facility was well designed to allow for experimentation in order to identify effective sustainable land management interventions. But it was also constrained by a three-year intervention window, which may be an insufficient period of time for introducing sustainable changes in land management practices among the target population. Additionally, the use of cost-reimbursement contracts slowed some aspects of grant implementation due to the limited financial resources of many grantees.
MCA-Malawi was able to conduct rigorous financial and programmatic oversight of facility grantees, but human resources were limited and staff members were overwhelmed by the volume of work.
The grant facility succeeded in pushing all grantees to integrate ENRM and SGEF activities—a novel approach. Depending on their technical expertise, however, some grantees focused on ENRM activities while others on SGEF activities.
The grant facility exceeded several tracked targets, such as the number of surviving trees, the number of leaders trained in ENRM, and the number of village savings and loans groups. It did not have, however, the resources or capacity to monitor key outcomes like farming practices. Many grants also did not cover the entire agricultural value chain.
Environmental Trust
Despite ENRM and SGEF efforts, the data suggests that deforestation and cropland expansion continue in the Shire River Basin, exacerbating soil erosion. Evidence provides further justification for an environmental trust that can fund effective interventions to support sustainable land management to combat soil erosion.
Even with MCC’s support, MCA-Malawi struggled to establish the environmental trust. The lack of early agreement between MCC and MCA-Malawi on the trust structure, a focus on implementing the grant facility, and poor contractor performance left too little time for successfully launching the trust before compact closeout.
It is uncertain if the environmental trust will be launched and sustained in the coming years. The trust has a functional board of directors, but board members have limited availability for their tasks and need permanent technical staff to push the trust forward. The trust has key supporters and prospects for sufficient capital, but lacks a strong champion (outside MCA-Malawi and MCC) to become a reality.
MCC Learning
Program implementers should be selected on the basis of the expertise needed to translate complex due diligence analyses into well-targeted and effective activities.
Project teams should have enough staff to be able to draw on sector-specific expertise, while not overburdening team members who have broad responsibilities for cross-cutting work.
Consider carefully whether to use a grant facility or another implementation modality to achieve project objectives.
Planning for long-term sustainability of interventions and the institutions that will exist after the compact ends should be a focus from the start of program design and implementation.
Evaluation Methods
The interim performance evaluation of the ENRM Project used a rigorous mixed-methods approach. It collected cross-cutting quantitative and qualitative data, including key informant interviews with seven staff at MCC, six staff at MCA-Malawi, and 33 activity implementers, including staff at EGENCO, ENRM and SGEF grantees, and environmental trust board members. The evaluation also collected monthly administrative data on water quality from the Blantyre and Southern Region water boards; power generation and weed management data from EGENCO; and geospatial and activity location data in the Shire River Basin collected by Mathematica, as well as datasets from HydroSHEDS, Global Extent of Rivers and Streams, Shuttle Radar Topography Mission, and National Forest Restoration Opportunity areas from the Malawi Ministry of Natural Resources, Energy and Mining. The evaluation conducted implementation site visits and analyzed grant monitoring data and documents provided by MCA-Malawi, MCC, and activity implementers.
To address the research questions, the evaluation used a variety of methods to analyze data, including data triangulation, thematic framing, descriptive trends analysis, geospatial analysis, and a cross-evaluation data synthesis. To estimate the effects of expanding ENRM activities in the Shire River Basin area on soil erosion and sedimentation, the evaluation used the Soil and Water Assessment Tool (SWAT), a hydrological transport model. SWAT provides an integrated framework to simulate hydrologic, water quality, and agricultural production processes and represents the spatiotemporal variability of these processes.
Data was collected between May and November 2018, during the final five months of the compact, and two months after the compact closed. Although implementation of the grant facility was complete in July 2018, implementation of the WSM activity and the environmental trust was ongoing during the final month of the compact. Ultimately, parts of the WSM activity and environmental trust were transferred to MCA-Malawi’s successor agency, the Malawi Millennium Development Trust.
Next Steps
The evaluation will examine project outcomes two years after the end of the compact. The final evaluation results are expected in 2021.
2020-002-2354