What can go wrong with a Forecast-based Financing project?

 

Achieving great things

The goal of Forecast-based Financing is to reduce the impact of disasters.

In the precious window of time between a forecast and a potential disaster, FbF releases resources to take early action. Ultimately, we hope this early action will be more effective at reducing suffering, compared to waiting until the disaster happens and then doing only disaster response. For example, in Bangladesh, people who received a forecast-based cash transfer were less malnourished during a flood in 2017.

With the promise of increased effectiveness, the concept of FbF is rapidly gaining traction in the humanitarian and development sectors. Clearly, FbF can be a saving grace for people who would otherwise experience a catastrophe.

However…what could possibly go wrong?

FbF doesn’t inherently have a higher chance of “going wrong” than much of our other work. But because it is new, people might not realize potential pitfalls.

Here we outline several ways in which FbF can go wrong – some are inevitable, and some can be avoided.

Let’s create a fake country – let’s call it Madeupsville.

In Madeupsville, FbF has taken off, and is widely implemented by everyone. However, in Madeupsville, people are starting to run into a few problems…

Illustration of a person in a rowing boat

Act in vain
In Madeupsville, the disaster managers evacuated several villages based on a cyclone forecast, but, then the cyclone took a sharp turn, hit a different region.
The people of Madupsville got really mad because they’d evacuated “in vain” and accused the mayor of squandering city funds.

Illustration of two people looking at a storm.

Unforecasted disaster
The next year, Madeupsville was hit by a monster storm. The forecasts hadn’t warned of such a big event, and people were frustrated there was no early action taken.

Illustration of a person standing in front of a complex model

Too complicated
Even though the meteorological service of Madeupsville developed a high-tech model with the most amaaaazing data, the system went offline and no one knew that a disaster was forecasted!

Actions are not taken in time
The FbF system triggered while the Madeupsville disaster manager was away. Logistics staff had only one vehicle and couldn’t get goods to the neighborhoods in time to help. Early action came too late!

The money doesn’t arrive
The next time they got the alert, Madeupsville Red Cross was ready to go! But, they had to wait 2 weeks for the fund transfer, and by that point the disaster had occurred.

Illustration of two people working at a roof.

Actions are useless
In Madeupsville, the local Red Cross gave people storage buckets to protect harvested food from a forecasted flood. However, because the buckets had no ventilation, all their food spoiled…

Illustration of an adult and a child in a room.

Conflict of interest
In Madeupsville, the large-scale hay distributor talked to his friend at the weather service. His friend agreed to send a drought forecast to a local NGO, and voila!
The hay distributor got lots of business that year. He made sure to share some of his earnings with his friend at the weather service!

Illustration of a person putting out a fire.

Only a local project
When a major storm is forecasted for the Eastern part of Madeupsville, no one is ready to take action because the pilot project is only in a few villages in the West.

Actions are not right-sized
When a flood trigger happens, the Madeupsville Red Cross distributes one week of water purification tablets to all households in the 3 pilot villages. However, for 4-6 weeks the families drink dirty water and are also exposed to contaminated food. This leads to a large-scale outbreak of diarrheal disease, and people wonder why FbF did not eliminate the disaster!

Illustration of a person calling other households.

Exacerbates inequality
The FbF team in Madeupsville is verrry proud of their data-driven FbF programme, which uses state-of-the-art vulnerability and exposure data to target people most affected by a forecasted disaster. However, the team does not realize that landless migrant populations are totally missing from this database. Therefore, no one evacuates the landless people during an FbF intervention. What’s worse, there was no coordination among agencies, and local NGOs targeted the same people.

Illustration of two person dancing.

Graphics: Rebeka Ryvola / Climate Centre

Wrong priorities
In Madeupsville, FbF became such a cool innovative idea that everyone and their brother starting making FbF projects! The Madeupsville government was excited to involve domestic tech and modelling firms. They even tried to fund FbF projects for disasters that were not forecastable! Less and less money and attention was paid to the incremental benefits of this investment for people, measuring success only from an international financial point of view.

Also, community members complained about receiving lots of forecast-based hygiene kits when by far the leading cause of death was road accidents. They really wished someone had just given out motorcycle helmets, instead of using complicated forecasts to distribute soap every few years.

Implications

Clearly these problems are bad. Consequences could include:

  • Direct harm to people, or missed opportunity to help people.
  • Bad press that means people abandon FbF even though it could have been useful if implemented well in some places.
  • Reputational damage to organisations that implement FbF that affects our ability to help people in real disasters (including potential loss of general funding).

Solutions:

Though these stories from “Madeupsville” were – you guessed it – made up, they are all based on events that actually happened.

A few people not working in “Not Madeupsville” have come up with recommendations that may help many of these problems.

Here’s what they learned from these (very real) experiences.

  • Invest in the capacity to act.
    Invest in basic organizational development, including volunteer training, staff salaries, and basic infrastructure. This will allow your local organizations to act on a meaningful scale when faced with a major disaster forecast.
  • Measure what matters and use the results.
    Monitor and evaluate relevant indicators to understand what’s working. Be honest about what is not working. When results are known, adapt programming accordingly. Newcomers – ask for the advice from others already piloting and measuring.
  • Be transparent about risks.
    Communicate the meaning of triggers and manage expectations about forecast accuracy. Understand that forecasts aren’t perfect.
  • Be smart about data.
    If you want the best possible data– you must invest in improving information management and data quality.
  • Minimize complexity:
    More data won’t automatically make your forecast trigger better. Focus on knowing and improving the skill of the forecast and quality of risk data. Even if you have very few indicators but have good quality data, your model is likely to be more effective.
  • Agree on goals.
    Donors, implementers and at-risk people should have a common narrative of what the FbF system is meant and not meant to achieve. This will require education and communication.
  • Ensure financing is put to good use.
    Financing is not a goal in itself. Early actions should be based on vulnerability assessments and what different social groups actually need and want in the event of a disaster.
  • Include household-level perspectives in system design and monitoring.
    So that unexpected or adverse consequences can be noticed quickly.
  • Link to wider risk financing strategies.
    FbF is not designed to address every type of risk; FbF should slot into an overall ecosystem for risk management.
  • Invest in systems and procedures.
    FbF is not just about science and clever uses of data. It must be underpinned by systems that channel funds efficiently, turn money into goods and services that are useful to people, and ensure all of this is done without malpractice, corruption and fraud. Make sure you have people who understand financial management, governance and political economy on your team.
  • Be cautious about pilots.
    Think about how your work contributes to longer-term (transformational) change to the institutions and processes that create or enhance risks. Don’t be hasty to “scale up” assuming what worked in a pilot will work on a much larger scale.
  • Don’t go too fast.
    Ensure technical expertise keeps up with new FbF work.
  • Identify the right time for FbF.
    There should be an enabling environment in which to embark on an FbF project. This starts with meaningful interest and willingness of key actors.
  • Think about whether this is really a good idea.
    Consider whether FbF would be an efficient, equitable and cost-effective way of reducing risks, or whether other instruments or approaches might be better – this could be other ways of providing finance, or it could be just investing resources in preparedness and prevention.

FbF holds immense potential to transform how humanitarians operate, avoiding disaster impacts before they happen. Changing systems is a complex endeavour, and can be achieved if we are transparent about things that inevitably “go wrong”, while keeping a clear focus on what we mean by “going right”.


Have a what could go wrong story? Please share your experiences and learnings in the comments!

How does FbF work in the Red Cross Red Crescent Movement?

We define actions in advance. These actions are not set in stone, but we realize that if people don’t think in advance they often aren’t prepared to take action quickly. In order to be eligible for FbF funding, a Red Cross or Red Crescent National Society must write an Early Action Protocol, explaining what they will do when they receive the forecast trigger.

We define forecast triggers in advance. The Early Action Protocol must explain why we think this forecast is credible in some way. Our scientific validation studies are not necessarily comprehensive (and in fact, we make a lot of compromises in places with very little data), but they show evidence that this forecast has historically had some ability to predict the disaster.

We only use international emergency funds for unusual events. The Forecast-based Action by the Disaster Relief Emergency Fund requires that FbF plans focus on events that don’t happen every year – only every 5 years or less frequently. The EAP must clearly explain how the forecasted event is linked to disaster impacts on the ground.

We plan to work at the scale of the forecast and prioritize the most exposed and vulnerable. In our Early Action Protocols, we attempt to combine forecast information with vulnerability and exposure information, to identify those who are likely to be most affected by the extreme event. (We do not select these people in advance, but we wait to see what the forecast tells us.)