📊 Improve minerals explorer, further changes #3167
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
pabloarosado
commented
Aug 21, 2024
•
pabloarosado
commented
- Small improvements on map bracketer and etl.helpers.
- Many improvements on minerals data and minerals explorer.
- Minerals metadata improvements.
|
Quick links (staging server):
Login: chart-diff: ✅No charts for review.data-diff: ❌ Found differences= Dataset garden/bgs/2024-07-09/world_mineral_statistics
~ Table world_mineral_statistics (changed metadata)
- - - unit
~ Column commodity (changed data)
- - Removed values: 71335 / 91105 (78.30%)
commodity
Diatomite
Potash
Aluminum
Titanium
Sulfur
~ Changed values: 88528 / 91105 (97.17%)
commodity - commodity +
Petroleum Feldspar
Mica Niobium
Phosphate rock Iron
Steel Copper
Gold Tin
~ Column country (changed data)
- - Removed values: 71335 / 91105 (78.30%)
country
Peru
Sri Lanka
Sweden
United States
World
~ Changed values: 87972 / 91105 (96.56%)
country - country +
Bulgaria China
Cuba Honduras
France Mexico
Libya Tunisia
Netherlands World
~ Column exports (changed metadata, changed data)
+ + {}
- - title: Exports of commodities
- - origins:
- - - producer: British Geological Survey
- - title: World Mineral Statistics
- - description: |-
- - The World Mineral Statistics dataset is a compilation of production and trade statistics on a wide range of mineral commodities since 1913.
- - However, data prior to 1960 is only available a scanned PDF books, whose content, currently, cannot successfully be extracted programmatically.
- - title_snapshot: World Mineral Statistics - 1970 onwards
- - description_snapshot: |-
- - This is a compilation of all the data that is accessible via the BGS web interface, containing imports, exports and production of minerals by country from 1970 onwards.
- - citation_full: |-
- - World Mineral Statistics, contributed by permission of the British Geological Survey (BGS). The copyright of all materials derived from the BGS's work is vested in the Natural Environment Research Council (NERC) and/or the authority that commissioned the work.
- - attribution: BGS - World Mineral Statistics (2023)
- - attribution_short: BGS
- - url_main: https://www2.bgs.ac.uk/mineralsuk/statistics/worldStatistics.html
- - date_accessed: '2024-07-09'
- - date_published: '2023-01-01'
- - license:
- - name: © Natural Environment Research Council (NERC) and/or the authority that commissioned the work
- - url: https://www2.bgs.ac.uk/mineralsUk/statistics/termsAndConditions.html
- - unit: tonnes
- - short_unit: t
- - processing_level: major
- - presentation:
- - attribution_short: BGS
- - topic_tags:
- - - Energy
- - Removed values: 71335 / 91105 (78.30%)
exports
NaN
NaN
NaN
NaN
9903192.0
~ Changed values: 24566 / 91105 (26.96%)
exports - exports +
760.000000 NaN
2744.607910 NaN
2.088000 NaN
111.000000 NaN
1011.513977 NaN
~ Column imports (changed metadata, changed data)
+ + {}
- - title: Imports of commodities
- - origins:
- - - producer: British Geological Survey
- - title: World Mineral Statistics
- - description: |-
- - The World Mineral Statistics dataset is a compilation of production and trade statistics on a wide range of mineral commodities since 1913.
- - However, data prior to 1960 is only available a scanned PDF books, whose content, currently, cannot successfully be extracted programmatically.
- - title_snapshot: World Mineral Statistics - 1970 onwards
- - description_snapshot: |-
- - This is a compilation of all the data that is accessible via the BGS web interface, containing imports, exports and production of minerals by country from 1970 onwards.
- - citation_full: |-
- - World Mineral Statistics, contributed by permission of the British Geological Survey (BGS). The copyright of all materials derived from the BGS's work is vested in the Natural Environment Research Council (NERC) and/or the authority that commissioned the work.
- - attribution: BGS - World Mineral Statistics (2023)
- - attribution_short: BGS
- - url_main: https://www2.bgs.ac.uk/mineralsuk/statistics/worldStatistics.html
- - date_accessed: '2024-07-09'
- - date_published: '2023-01-01'
- - license:
- - name: © Natural Environment Research Council (NERC) and/or the authority that commissioned the work
- - url: https://www2.bgs.ac.uk/mineralsUk/statistics/termsAndConditions.html
- - unit: tonnes
- - short_unit: t
- - processing_level: major
- - presentation:
- - attribution_short: BGS
- - topic_tags:
- - - Energy
- - Removed values: 71335 / 91105 (78.30%)
imports
774.0
46525.0
NaN
10337.0
6376516.0
~ Changed values: 40398 / 91105 (44.34%)
imports - imports +
38892.0 NaN
1308.0 NaN
552694.0 NaN
124710.0 NaN
1479.0 NaN
~ Column notes_exports (changed metadata, changed data)
+ + {}
- - title: Value
- - origins:
- - - producer: British Geological Survey
- - title: World Mineral Statistics
- - description: |-
- - The World Mineral Statistics dataset is a compilation of production and trade statistics on a wide range of mineral commodities since 1913.
- - However, data prior to 1960 is only available a scanned PDF books, whose content, currently, cannot successfully be extracted programmatically.
- - title_snapshot: World Mineral Statistics - 1970 onwards
- - description_snapshot: |-
- - This is a compilation of all the data that is accessible via the BGS web interface, containing imports, exports and production of minerals by country from 1970 onwards.
- - citation_full: |-
- - World Mineral Statistics, contributed by permission of the British Geological Survey (BGS). The copyright of all materials derived from the BGS's work is vested in the Natural Environment Research Council (NERC) and/or the authority that commissioned the work.
- - attribution: BGS - World Mineral Statistics (2023)
- - attribution_short: BGS
- - url_main: https://www2.bgs.ac.uk/mineralsuk/statistics/worldStatistics.html
- - date_accessed: '2024-07-09'
- - date_published: '2023-01-01'
- - license:
- - name: © Natural Environment Research Council (NERC) and/or the authority that commissioned the work
- - url: https://www2.bgs.ac.uk/mineralsUk/statistics/termsAndConditions.html
- - unit: tonnes
- - short_unit: t
- - processing_level: major
- - presentation:
- - attribution_short: BGS
- - topic_tags:
- - - Energy
- - Removed values: 71335 / 91105 (78.30%)
notes_exports
[]
[]
[]
[]
['BGS estimates, based on known imports into certain countries.', 'Estimate.', 'Years ended 30 June of that stated.']
~ Changed values: 91105 / 91105 (100.00%)
notes_exports - notes_exports +
[] NaN
[] NaN
[] NaN
[] NaN
[] NaN
~ Column notes_imports (changed metadata, changed data)
+ + {}
- - title: Value
- - origins:
- - - producer: British Geological Survey
- - title: World Mineral Statistics
- - description: |-
- - The World Mineral Statistics dataset is a compilation of production and trade statistics on a wide range of mineral commodities since 1913.
- - However, data prior to 1960 is only available a scanned PDF books, whose content, currently, cannot successfully be extracted programmatically.
- - title_snapshot: World Mineral Statistics - 1970 onwards
- - description_snapshot: |-
- - This is a compilation of all the data that is accessible via the BGS web interface, containing imports, exports and production of minerals by country from 1970 onwards.
- - citation_full: |-
- - World Mineral Statistics, contributed by permission of the British Geological Survey (BGS). The copyright of all materials derived from the BGS's work is vested in the Natural Environment Research Council (NERC) and/or the authority that commissioned the work.
- - attribution: BGS - World Mineral Statistics (2023)
- - attribution_short: BGS
- - url_main: https://www2.bgs.ac.uk/mineralsuk/statistics/worldStatistics.html
- - date_accessed: '2024-07-09'
- - date_published: '2023-01-01'
- - license:
- - name: © Natural Environment Research Council (NERC) and/or the authority that commissioned the work
- - url: https://www2.bgs.ac.uk/mineralsUk/statistics/termsAndConditions.html
- - unit: tonnes
- - short_unit: t
- - processing_level: major
- - presentation:
- - attribution_short: BGS
- - topic_tags:
- - - Energy
- - Removed values: 71335 / 91105 (78.30%)
notes_imports
[]
["So far as possible the term 'potassic chemicals', as used in this table, relates to items 522.64, 523.3,4,5 and 7 of the S.I.T.C. (Revision 3) and includes hydroxide, carbonate, chlorate, nitrate and sulphate, (1992 Onwards)."]
[]
['Significant quantities of titanium slag are traded, but it is not always possible to identify this material in national trade accounts (1992 Onwards).', "So far as possible, the term 'oxides', as used in this table, includes oxides and oxide based pigments classified under Standard International Trade Classification (Revision 3) items 522.56 and 533.1 (1992 Onwards).", "So far as possible, the term 'oxides', as used in this table, includes oxides and oxide based pigments classified under Harmonised System items 2823 and 3206.10 (1996 Onwards).", 'Metal traded in ferro-alloy form is included under Iron, Steel and Ferro-alloys (1992 Onwards).']
['Years ended 30 June of that stated.', 'BGS estimates, based on known exports from certain countries.', 'Estimate.']
~ Changed values: 91105 / 91105 (100.00%)
notes_imports - notes_imports +
[] NaN
['Except where alumina hydrate is separately specified, national trade figures for alumina can be considered as inclusive of hydrate (1992 Onwards).', "In this table the term 'unwrought' aluminium corresponds to item 684.1 of the Standard International Trade Classification (Revision 3) and comprises ingots, blocks, unwrought bars, etc. (1992 Onwards).", "In this table the term 'unwrought' aluminium corresponds to item 7601 of the Harmonised System and comprises ingots, blocks, unwrought bars, etc. (1996 Onwards).", 'Metal traded in ferro-alloy form is included under Iron, Steel and Ferro-alloys (1992 Onwards).'] NaN
[] NaN
[] NaN
[] NaN
~ Column notes_production (changed metadata, changed data)
- - attribution_short: BGS
- - Removed values: 71335 / 91105 (78.30%)
notes_production
['Estimate.', 'In addition to the countries listed, Hungary and Japan are believed to produce diatomite (1992 Onwards).', 'In addition to the countries listed, Egypt, Hungary, Japan and Turkey are believed to produce diatomite (1993 Onwards).', 'In addition to the countries listed, Egypt, Hungary, Iran and Turkey are believed to produce diatomite (1994 Onwards).', 'In addition to the countries listed, Egypt, Hungary and Iran are believed to produce diatomite (1995 Onwards).', 'In addition to the countries listed, Egypt is believed to produce diatomite (1996 Onwards).', 'In addition to the countries listed, Egypt and Turkey are believed to produce diatomite (2000 Onwards).', 'In addition to the countries listed, Armenia, Egypt, Iran, Georgia and Russia may produce diatomite (2009 Onwards).', 'In addition to the countries listed, Iran, Georgia and Russia may produce diatomite (2010 Onwards).', 'In addition to the countries listed, Georgia may produce diatomite (2011 Onwards).', 'In addition to the countries listed, Georgia and Vietnam may produce diatomite (2012 Onwards).', 'In addition to the countries listed, Georgia, Saudi Arabia and Vietnam may produce diatomite (2013 Onwards).']
[]
['The figures in this table are for primary aluminium only. Aluminium can also be produced from secondary sources and may be recovered from salt slags (2007 Onwards).']
[]
[]
~ Changed values: 83270 / 91105 (91.40%)
notes_production - notes_production +
['Estimate.', 'Some countries produce large quantities of synthetic gypsum. Where possible, this output is excluded from the table. (1993 Onwards).', 'Some countries produce large quantities of synthetic gypsum. Where possible, this output is excluded from the table (2001 Onwards).', 'In addition to the countries listed, Japan may also produce gypsum. (2010 Onwards).', 'In addition to the countries listed, Indonesia, Japan and Vietnam may also produce gypsum. (2012 Onwards).'] ['Excluding uranium production from decommissioning operations in France, Germany and Spain (1998 Onwards).', 'Excluding uranium production from decommissioning operations (2009 Onwards).']
[] ['In addition to the countries listed, Vietnam is believed to produce iron ore (1992 Onwards).']
[] ['Estimate.', 'In several countries substantial amounts of gold produced in small operations are not recorded in the official statistics used when compiling this table (1992 Onwards).', 'In several countries substantial amounts of gold produced in small and/or artisanal operations are not recorded in the official statistics. Estimates have been added where possible but these have varying degrees of uncertainty. (2013 Onwards).', 'In addition to the countries listed, Bulgaria, Cameroon, former Czechoslovakia, Greece, Morocco, Norway and Thailand are believed to produce gold (1992 Onwards).', 'In addition to the countries listed, Eritrea, Laos and Madagascar produce less than 100 kg gold per year according to official statistics (1993 Onwards).', 'In addition to the countries listed, Laos and Madagascar produce less than 100 kg gold per year according to official statistics (1994 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Laos, Madagascar, Nigeria, Rwanda and Sierra Leone produce less than 100 kg gold per year (1995 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Laos, Madagascar, Mozambique, Niger, Nigeria, Rwanda and Sierra Leone produce less than 100 kg gold per year (1996 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Laos, Madagascar, Mozambique, Niger, Nigeria, Rwanda, Sierra Leone and Taiwan produce less than 100 kg gold per year (1997 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Republic of Korea, Laos, Madagascar, Mozambique, Niger, Nigeria, Rwanda, Sierra Leone and Taiwan produce less than 100 kg gold per year (1998 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Republic of Korea, Laos, Liberia, Madagascar, Mozambique, Niger, Nigeria, Rwanda, Sierra Leone and Taiwan produce less than 100 kg gold per year (1999 Onwards).', 'In addition to the countries listed, Central African Republic, (2000 Onwards).', 'In addition to the countries listed, Central African Republic, Liberia, Mozambique, Nigeria, Sierra Leone, Solomon Islands, Taiwan and Ukraine produce less than 100 kg gold per year (2001 Onwards).', 'In addition to the countries listed, Central African Republic, Eritrea, Liberia, Mozambique, Nigeria, Sierra Leone, Solomon Islands, Taiwan and Ukraine produce less than 100 kg gold per year (2002 Onwards).', 'In addition to the countries listed, Central African Republic, Eritrea, Liberia, Mozambique, Nigeria, Sierra Leone, Taiwan and Ukraine produce less than 100 kg gold per year (2004 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Congo, Eritrea, Madagascar, Rwanda, Taiwan and Ukraine produce less than 100 kg gold per year (2005 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Congo, Madagascar and Rwanda produce less than 100 kg gold per year (2007 Onwards).', 'In addition to the countries listed, Greece, Benin, Central African Republic, Congo Rwanda and Taiwan produce less than 100 kg gold per year (2008 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Congo, Uganda, Oman and Taiwan produce less than 100 kg gold per year (2009 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Equatorial Guinea, Uganda, Oman and Taiwan produce less than 100 kg gold per year (2012 Onwards).', 'Greece, Morocco, Norway and Thailand are believed to produce gold (1993 Onwards).', 'Greece, Norway and Thailand are believed to produce gold (1994 Onwards).', 'Greece and Norway are believed to produce gold (2000 Onwards).', 'In addition to the countries listed, Cambodia, El Salvador, Haiti, Macedonia, Malawi, Pakistan, Paraguay, Portugal, and South Sudan may produce gold. (2010 Onwards).', 'In addition to the countries listed, Cambodia, El Salvador, Haiti, Macedonia, Malawi, Pakistan, Paraguay and Portugal may produce gold. (2013 Onwards).']
['Estimate.', 'In several countries substantial amounts of gold produced in small operations are not recorded in the official statistics used when compiling this table (1992 Onwards).', 'In several countries substantial amounts of gold produced in small and/or artisanal operations are not recorded in the official statistics. Estimates have been added where possible but these have varying degrees of uncertainty. (2013 Onwards).', 'In addition to the countries listed, Bulgaria, Cameroon, former Czechoslovakia, Greece, Morocco, Norway and Thailand are believed to produce gold (1992 Onwards).', 'In addition to the countries listed, Eritrea, Laos and Madagascar produce less than 100 kg gold per year according to official statistics (1993 Onwards).', 'In addition to the countries listed, Laos and Madagascar produce less than 100 kg gold per year according to official statistics (1994 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Laos, Madagascar, Nigeria, Rwanda and Sierra Leone produce less than 100 kg gold per year (1995 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Laos, Madagascar, Mozambique, Niger, Nigeria, Rwanda and Sierra Leone produce less than 100 kg gold per year (1996 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Laos, Madagascar, Mozambique, Niger, Nigeria, Rwanda, Sierra Leone and Taiwan produce less than 100 kg gold per year (1997 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Republic of Korea, Laos, Madagascar, Mozambique, Niger, Nigeria, Rwanda, Sierra Leone and Taiwan produce less than 100 kg gold per year (1998 Onwards).', 'In addition to the countries listed, Botswana, Central African Republic, Gabon, Republic of Korea, Laos, Liberia, Madagascar, Mozambique, Niger, Nigeria, Rwanda, Sierra Leone and Taiwan produce less than 100 kg gold per year (1999 Onwards).', 'In addition to the countries listed, Central African Republic, (2000 Onwards).', 'In addition to the countries listed, Central African Republic, Liberia, Mozambique, Nigeria, Sierra Leone, Solomon Islands, Taiwan and Ukraine produce less than 100 kg gold per year (2001 Onwards).', 'In addition to the countries listed, Central African Republic, Eritrea, Liberia, Mozambique, Nigeria, Sierra Leone, Solomon Islands, Taiwan and Ukraine produce less than 100 kg gold per year (2002 Onwards).', 'In addition to the countries listed, Central African Republic, Eritrea, Liberia, Mozambique, Nigeria, Sierra Leone, Taiwan and Ukraine produce less than 100 kg gold per year (2004 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Congo, Eritrea, Madagascar, Rwanda, Taiwan and Ukraine produce less than 100 kg gold per year (2005 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Congo, Madagascar and Rwanda produce less than 100 kg gold per year (2007 Onwards).', 'In addition to the countries listed, Greece, Benin, Central African Republic, Congo Rwanda and Taiwan produce less than 100 kg gold per year (2008 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Congo, Uganda, Oman and Taiwan produce less than 100 kg gold per year (2009 Onwards).', 'In addition to the countries listed, Benin, Central African Republic, Equatorial Guinea, Uganda, Oman and Taiwan produce less than 100 kg gold per year (2012 Onwards).', 'Greece, Morocco, Norway and Thailand are believed to produce gold (1993 Onwards).', 'Greece, Norway and Thailand are believed to produce gold (1994 Onwards).', 'Greece and Norway are believed to produce gold (2000 Onwards).', 'In addition to the countries listed, Cambodia, El Salvador, Haiti, Macedonia, Malawi, Pakistan, Paraguay, Portugal, and South Sudan may produce gold. (2010 Onwards).', 'In addition to the countries listed, Cambodia, El Salvador, Haiti, Macedonia, Malawi, Pakistan, Paraguay and Portugal may produce gold. (2013 Onwards).']
...diff too long, truncated...Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included Edited: 2024-08-23 15:49:49 UTC |
…ing country names under smart tags
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.