Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fails with id "proj_19rp3" #304

Closed
JensXII opened this issue Apr 28, 2024 · 3 comments
Closed

fails with id "proj_19rp3" #304

JensXII opened this issue Apr 28, 2024 · 3 comments
Labels
API issues Issues related to functionalities / limitations of the Eurostat API

Comments

@JensXII
Copy link

JensXII commented Apr 28, 2024

Cannot download regional population projection data:

X <- eurostat::get_eurostat("proj_19rp3") Error in eurostat::get_eurostat("proj_19rp3") : get_eurostat_raw fails with the id proj_19rp3

It worked a few weeks ago.

Best regards
Jens

@pitkant
Copy link
Member

pitkant commented Apr 29, 2024

Thank you for reporting this @JensXII

This is related to #303 and to the discussion under #293 . The problem is related to Eurostat returning an ASYNC API response to data queries at a lower threshold than before, see documentation 1 2

We're currently working on finding some kind of intermediate solution to this problem. In the mean time using filters to make your query smaller might work.

@pitkant pitkant added the API issues Issues related to functionalities / limitations of the Eurostat API label Apr 29, 2024
@pitkant
Copy link
Member

pitkant commented Apr 29, 2024

I have received the following message from Eurostat user support:

"Last week maintenance introduced major changes to internal storage that required a big step forward and to renew the cache from scratch.

Sadly this release also contained a performance issue that remained undetected that is currently slowing down the repopulation process.

A hotfix was applied today at around 13:30."

So I think that the issues are related to big datasets not being cached as they previously were. Excerpt from the Eurostat documentation:

"When a data request is initiated, the system first checks if the exact same request was already performed previously and if applicable lookup the data directly from an internal cache and return it as a response."

I'm not sure if today's hotfix has renewed the cache for all files or not (probably not, sounds like a process that takes some time) but maybe something has changed for the better now.

@JensXII
Copy link
Author

JensXII commented Apr 29, 2024

Thanks - I works for me now :-)

@pitkant pitkant closed this as completed Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
API issues Issues related to functionalities / limitations of the Eurostat API
Projects
None yet
Development

No branches or pull requests

2 participants