Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

💄 oecd: Add changes to ODA data after external feedback #3414

Merged
merged 3 commits into from
Oct 16, 2024
Merged

💄 oecd: Add changes to ODA data after external feedback #3414

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
309b1ec
:bug: fix typos
paarriagadap Oct 16, 2024
74e7856
:lipstick: private foundations
paarriagadap Oct 16, 2024
cfafb27
:lipstick: limit grant equivalents from 2018 only
paarriagadap Oct 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 12 additions & 12 deletions etl/steps/data/garden/oecd/2024-08-21/official_development_assistance.meta.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ definitions:
G7 countries (OECD): Canada, France, Germany, Italy, Japan, UK and US
Multilateral organizations (OECD): e.g. World Bank and UN agencies
Official donors: DAC countries, Non-DAC countries and multilateral organizations
Private donors: Private voluntary agencies and NGOs
Private donors: Private foundations reporting aid data

# NOTE: Modify this year in future updates.
inflation_year: 2022
Expand All @@ -26,7 +26,7 @@ definitions:
G7 countries (OECD): Canada, France, Germany, Italy, Japan, UK and US
Multilateral organizations (OECD): EU institutions
Official donors: DAC countries, Non-DAC countries and multilateral organizations
Private donors: Private voluntary agencies and NGOs
Private donors: Private foundations reporting aid data

short_oda: "[Official development assistance (ODA)](#dod:oda) is defined as government aid designed to promote the economic development and welfare of developing countries."

Expand All @@ -37,7 +37,7 @@ definitions:
short_oof: Other official flows (OOF) are official sector transactions that do not meet [official development assistance (ODA)](#dod:oda) criteria.
short_officially_supported_export_credits: Officially supported export credits are credits that governments provide to support national exporters competing for overseas sales.
short_private_flows_market_terms: Private flows are defined as financial flows at market terms financed out of private sector resources and private grants.
short_net_private_grants: Grants by private voluntary agencies and non-government organisations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.
short_net_private_grants: Grants by private voluntary agencies and non-government organizations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.

short_flows: Total official and private flows are defined as the sum of official development assistance, other official flows and private flows. This represents the total net disbursements by the official and private sector of the creditor country to the recipient country.

Expand All @@ -52,7 +52,7 @@ definitions:
Official development assistance (ODA) eligibility criteria are based on (i) country eligibility, (ii) concessionality, and (iii) the promotion of the economic development and welfare of developing countries as the main objective. This means that (i) only countries and territories included in the list of ODA recipients are eligible to receive this assistance, (ii) lending is defined by minimum requirements according to the income category of the recipient country, and (iii) reporting rules have been implemented to define what is "primarily developmental". For more details about ODA, please refer to the [official OECD documentation](https://one.oecd.org/document/DCD/DAC/STAT(2023)9/FINAL/en/pdf).

key_oda_target: A long-standing United Nations target is that developed countries should devote 0.7% of their GNI to ODA.
key_oda_list_of_countries: The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) mantains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in [the OECD website](https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).
key_oda_list_of_countries: The [OECD Development Assistance Committee (DAC)](https://www.oecd.org/en/about/committees/development-assistance-committee.html) maintains a list of territories where ODA can be provided. The countries and territories on the DAC list of ODA recipients consist of all low and middle income countries based on gross national income (GNI) per capita as published by the World Bank, with the exception of former G8 members, EU members, and countries with a firm date for entry into the EU. The list also includes all of the Least Developed Countries (LDCs) as defined by the United Nations. The list is updated every three years and is available in [the OECD website](https://www.oecd.org/en/topics/sub-issues/oda-eligibility-and-conditions/dac-list-of-oda-recipients.html).

key_grant_equivalents: |-
"[Grant equivalent](#dod:grant-equivalents)" is a methodology to estimate the value of loans compared to a grant. It is an estimate, at today’s value of money, of how much is being given away over the life of a financial transaction, compared with a transaction at market terms.
Expand All @@ -68,14 +68,14 @@ definitions:
key_officially_supported_export_credits_2: Such support can take the form either of “official financing support”, such as direct credits to foreign buyers, refinancing or interest-rate support, or of “pure cover support”, such as export credits insurance or guarantee to cover credits provided by private financial institutions.
key_private_flows_market_terms: |-
Private flows are financed out of private sector resources (changes in holdings of private, long-term assets held by residents of the reporting country) and private grants (grants by non-government organizations, net of subsidies received from the official sector). Private capital flows can be divided into: foreign direct investment; portfolio equity (the buying and selling of stocks and shares); remittances sent home by migrants; and private sector borrowing.
key_net_private_grants: The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organisations; and the for-profit private sector.
key_net_private_grants: The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organizations; and the for-profit private sector.

key_flows: Total official flows incorporate the sum of concessional and non-concessional flows to developing countries, including export credits, which have a primarily commercial motive. Private flows are defined as flows at market terms and financed out of private sector resources and private grants.

key_oda_bilateral: Bilateral ODA also includes cases where a donor contracts a multilateral agency to deliver a program or project on its behalf. This is often referred to as “Bi/Multi” flows. Donor funds channeled through NGOs are also typically counted as bilateral flows.

key_food_aid: |-
In terms of its use, food aid can be subdivided into three categories: program food aid (budgetary support), project food aid (targeted poverty alleviation and disaster prevention) and relief food aid (targeted to victims of disasters). It can also be classified by modes of suppply in direct transfers, food aid purchases or local purchases.
In terms of its use, food aid can be subdivided into three categories: program food aid (budgetary support), project food aid (targeted poverty alleviation and disaster prevention) and relief food aid (targeted to victims of disasters). It can also be classified by modes of supply in direct transfers, food aid purchases or local purchases.

key_capital_subscriptions_deposits: |-
Capital subscriptions are payments to multilateral agencies in the form of notes and similar instruments, unconditionally encashable at any time by the recipient institutions. They are assimilated to grants in DAC statistics.
Expand Down Expand Up @@ -122,14 +122,14 @@ definitions:
producer_private_flows_market_terms: |-
_[From OECD's indicator explainer](https://www.oecd.org/en/data/indicators/total-official-and-private-flows.html)_

Private flows are financial flows for development at market terms financed out of private sector resources (changes in holdings of private, long-term assets held by residents of the reporting country) and private grants (grants by non-government organisations, net of subsidies received from the official sector). Private capital flows can be divided into: foreign direct investment; portfolio equity (the buying and selling of stocks and shares); remittances sent home by migrants; and private sector borrowing.
Private flows are financial flows for development at market terms financed out of private sector resources (changes in holdings of private, long-term assets held by residents of the reporting country) and private grants (grants by non-government organizations, net of subsidies received from the official sector). Private capital flows can be divided into: foreign direct investment; portfolio equity (the buying and selling of stocks and shares); remittances sent home by migrants; and private sector borrowing.

producer_net_private_grants: |-
_[From OECD's indicator explainer](https://www.oecd.org/en/data/indicators/grants-by-private-agencies-and-ngos.html)_

Grants by private voluntary agencies and non-government organisations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.
Grants by private voluntary agencies and non-government organizations (NGOs) are defined as transfers for development made by private voluntary agencies and NGOs in cash, goods or services for which no payment is required.

The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organisations; and the for-profit private sector.
The private sector comprises private corporations, households and non-profit institutions serving households. Development funding from the private sector is becoming more significant. This includes private foundations, which play an increasing role in funding development and in finding innovative ways to promote it; non-government organizations; and the for-profit private sector.

producer_net_flows: |-
_[From OECD's indicator explainer](https://www.oecd.org/en/data/indicators/total-official-and-private-flows.html)_
Expand All @@ -141,21 +141,21 @@ definitions:

Food aid are grants and concessional loans that conform to official development assistance (ODA).

Food aid is categorised and reported in terms of its uses and modes of supply. In terms of the use of food aid, three categories are distinguished: programme food aid is supplied as a resource transfer providing balance of payments (BoP) or budgetary support; project food aid is usually provided to support specific poverty alleviation and disaster prevention activities, targeted on specific beneficiary groups or areas; relief food aid is targeted on, and freely distributed to, victims of natural or man-made disasters. In practice, there has been a blurring of the distinctions between different categories of use, especially in an emergency, crisis situation. The other main approach to distinguish food aid is by looking at its sources or modes of supply: direct transfers, including all food aid originating from a donor country; food aid purchases or exchanges in one developing country for use as food aid in another country; and, local purchases, procured in a country and used as food aid in the same country.
Food aid is categorized and reported in terms of its uses and modes of supply. In terms of the use of food aid, three categories are distinguished: programme food aid is supplied as a resource transfer providing balance of payments (BoP) or budgetary support; project food aid is usually provided to support specific poverty alleviation and disaster prevention activities, targeted on specific beneficiary groups or areas; relief food aid is targeted on, and freely distributed to, victims of natural or man-made disasters. In practice, there has been a blurring of the distinctions between different categories of use, especially in an emergency, crisis situation. The other main approach to distinguish food aid is by looking at its sources or modes of supply: direct transfers, including all food aid originating from a donor country; food aid purchases or exchanges in one developing country for use as food aid in another country; and, local purchases, procured in a country and used as food aid in the same country.

processing_per_capita: |-
We calculated this indicator by dividing by the population of the donor country or regional aggregation. The population estimate is available in the OECD dataset.

processing_per_capita_2: |-
We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset [mantained by Our World in Data](https://ourworldindata.org/population-sources).
We calculated this indicator by dividing by the population of the recipient country. We use a long-run population dataset [maintained by Our World in Data](https://ourworldindata.org/population-sources).

processing_share_gni: |-
We calculated this indicator by dividing by the gross national income (GNI) of the donor country regional aggregation. The GNI estimate is available in the OECD dataset.

The OECD provides indicators as a share of GNI, but only until 2017 for net flows. We calculated this to have the entire series.

processing_oda_net_disbursements: |-
We have combined net disbursements aid data from the [DAC1: Flows by donor (ODA+OOF+Private) dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df[ds]=dsDisseminateFinalDMZ&df[id]=DSD_DAC1%40DF_DAC1&df[ag]=OECD.DCD.FSD&df[vs]=1.2&dq=DAC...1140%2B1160..Q.&lom=LASTNPERIODS&lo=10&to[TIME_PERIOD]=false) with the [DAC2A: Aid (ODA) disbursements to countries and regions dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df[ds]=dsDisseminateFinalDMZ&df[id]=DSD_DAC2%40DF_DAC2A&df[ag]=OECD.DCD.FSD&df[vs]=1.1&dq=.DPGC.206.USD.Q&lom=LASTNPERIODS&lo=5&to[TIME_PERIOD]=false) to add aid given by multilateral organizations and grants given by private organizations.
We have combined net disbursements aid data from the [DAC1: Flows by donor (ODA+OOF+Private) dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df[ds]=dsDisseminateFinalDMZ&df[id]=DSD_DAC1%40DF_DAC1&df[ag]=OECD.DCD.FSD&df[vs]=1.2&dq=DAC...1140%2B1160..Q.&lom=LASTNPERIODS&lo=10&to[TIME_PERIOD]=false) with the [DAC2A: Aid (ODA) disbursements to countries and regions dataset](https://data-explorer.oecd.org/vis?fs[0]=Topic%2C1%7CDevelopment%23DEV%23%7COfficial%20Development%20Assistance%20%28ODA%29%23DEV_ODA%23&pg=0&fc=Topic&bp=true&snb=20&df[ds]=dsDisseminateFinalDMZ&df[id]=DSD_DAC2%40DF_DAC2A&df[ag]=OECD.DCD.FSD&df[vs]=1.1&dq=.DPGC.206.USD.Q&lom=LASTNPERIODS&lo=5&to[TIME_PERIOD]=false) to add aid given by multilateral organizations and grants given by private foundations.

processing_oda_by_sector: |-
<% if sector == "Non-humanitarian aid" %>
Expand Down
19 changes: 18 additions & 1 deletion etl/steps/data/garden/oecd/2024-08-21/official_development_assistance.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -210,6 +210,8 @@ def run(dest_dir: str) -> None:

tb_dac1 = remove_jumps_in_the_data_and_unneeded_cols(tb=tb_dac1)

tb_dac1 = limit_grant_equivalents_from_2018_only(tb=tb_dac1)

tb = add_donor_data_from_recipient_dataset(tb_donor=tb_dac1, tb_recipient=tb_dac2a)

tb = add_recipient_dataset(tb=tb, tb_recipient=tb_dac2a)
Expand Down Expand Up @@ -525,7 +527,7 @@ def remove_jumps_in_the_data_and_unneeded_cols(tb: Table) -> Table:
This is most likely because of aggregations of population and GNI not properly done by the source.
This is a temporary solution until the source fixes the data. It is already reported.

# Also, remove redundant columns.
Also, remove redundant columns.
"""

# For i_oda_net_disbursements_share_gni
Expand All @@ -545,3 +547,18 @@ def remove_jumps_in_the_data_and_unneeded_cols(tb: Table) -> Table:
)

return tb


def limit_grant_equivalents_from_2018_only(tb: Table) -> Table:
"""
Limit grant equivalent indicators from year 2018 onwards.
"""

tb = tb.copy()

# Define grant equivalent indicators by looking at all the columns containing the word "grant_equivalents"
grant_equivalent_indicators = [col for col in tb.columns if "grant_equivalents" in col]

tb.loc[tb["year"] < 2018, grant_equivalent_indicators] = None

return tb
Loading