Skip to content
This repository has been archived by the owner on Aug 20, 2024. It is now read-only.

Latest commit

 

History

History
42 lines (36 loc) · 3.66 KB

README.md

File metadata and controls

42 lines (36 loc) · 3.66 KB

valuation-systems

Uses web scraping to obtain from UN COMTRADE whereas a country C in the year Y uses CIF, FOB or a special system to report imports or exports. The standard is FOB for exports and CIF for imports, but that's not always the case.

The reason to do this is that COMTRADE website doesn't not provide a single Excel file (or other format) to provide that information, but provides hundreds of tabs that make it very hard to copy and paste the information in Excel.

This repo uses Selenium to import thousands of tables from UN COMTRADE into R. There is no readily available Excel or similar, except the RDS file I've included here.

Data preview for the end result:

# A tibble: 15,148 × 11
    year reporter       iso3_digit_alpha reported_classireported_currentrade_flow currency_convertrade_system valuation
   <dbl> <chr>          <chr>            <chr>            <chr>            <chr>                 <dbl> <chr>        <chr>    
 1  1962 Angola         ago              SITC Rev.1       PTE              Import               0.0348 Special      CIF      
 2  1962 Angola         ago              SITC Rev.1       PTE              Export               0.0348 Special      FOB      
 3  1962 Morocco        mar              SITC Rev.1       MAD              Import               0.198  Special      CIF      
 4  1962 Morocco        mar              SITC Rev.1       MAD              Export               0.198  Special      FOB      
 5  1963 Morocco        mar              SITC Rev.1       MAD              Import               0.198  Special      CIF      
 6  1963 Morocco        mar              SITC Rev.1       MAD              Export               0.198  Special      FOB      
 7  1963 Myanmar        mmr              SITC Rev.1       MMK              Import               0.21   General      CIF      
 8  1963 Myanmar        mmr              SITC Rev.1       MMK              Export               0.21   General      FOB      
 9  1964 Brunei Darussbrn              SITC Rev.1       BND              Import               0.327  Special      CIF      
10  1964 Brunei Darussbrn              SITC Rev.1       BND              Export               0.327  Special      FOB      
# … with 15,138 more rows, and 2 more variables: partner <chr>, uncomtrade_id <dbl>
Rows: 15,148
Columns: 11
$ year                       <dbl> 1962, 1962, 1962, 1962, 1963, 1963, 1963, 1963, 1964, 1964, 1964, 1964, 1964, …
$ reporter                   <chr> "Angola", "Angola", "Morocco", "Morocco", "Morocco", "Morocco", "Myanmar", "My…
$ iso3_digit_alpha           <chr> "ago", "ago", "mar", "mar", "mar", "mar", "mmr", "mmr", "brn", "brn", "mar", "$ reported_classification    <chr> "SITC Rev.1", "SITC Rev.1", "SITC Rev.1", "SITC Rev.1", "SITC Rev.1", "SITC Re…
$ reported_currency          <chr> "PTE", "PTE", "MAD", "MAD", "MAD", "MAD", "MMK", "MMK", "BND", "BND", "MAD", "$ trade_flow                 <chr> "Import", "Export", "Import", "Export", "Import", "Export", "Import", "Export"$ currency_conversion_factor <dbl> 0.034780, 0.034780, 0.197600, 0.197600, 0.197600, 0.197600, 0.210000, 0.210000$ trade_system               <chr> "Special", "Special", "Special", "Special", "Special", "Special", "General", "
$ valuation                  <chr> "CIF", "FOB", "CIF", "FOB", "CIF", "FOB", "CIF", "FOB", "CIF", "FOB", "CIF", "$ partner                    <chr> "Origin", "Last Known Destination", "Origin", "Last Known Destination", "Origi…
$ uncomtrade_id              <dbl> 24, 24, 504, 504, 504, 504, 104, 104, 96, 96, 504, 504, 104, 104, 96, 96, 470,…