Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Worldpop server does not integrate with GDAL #265

Open
goergen95 opened this issue May 13, 2024 · 5 comments
Open

Worldpop server does not integrate with GDAL #265

goergen95 opened this issue May 13, 2024 · 5 comments
Assignees

Comments

@goergen95
Copy link
Member

When querying worldpop layers with GDAL I see:

> gdalinfo /vsicurl/https://data.worldpop.org/GIS/Population/Global_2000_2020/2019/0_Mosaicked/ppp_2019_1km_Aggregated.tif

ERROR 1: Range downloading not supported by this server!
gdalinfo failed - unable to open '/vsicurl/https://data.worldpop.org/GIS/Population/Global_2000_2020/2019/0_Mosaicked/ppp_2019_1km_Aggregated.tif'.

So we cannot get the data from there via GDAL. I see three options:

    1. Find another source for the worldpop layers
    1. Develop a work-around in the package code to download locally
    1. Ask worldpop to change their server settings
@goergen95 goergen95 self-assigned this May 13, 2024
@goergen95
Copy link
Member Author

There is Meta's HighRes population layer on AWS here but I could not access the data yet without authentication.

@fBedecarrats
Copy link
Collaborator

Hi! I do not understand how to check the years for which the CIESIN/META dataset is available. I looked at the general documentation and the working papers [here] and there. It is not clearly stated but I think that the data starts in 2019. The data is also accessible on HDX, but only from 2019.
I think that it would be good to have @melvinhlwong 's opinion on this, but if this is confirmed, I don't think that Meta's HighRes population layer could replace Worldpop for the standard use case of mampe.biodiversity (ie. protected area impact evaluation). Impact evaluation require covariates that are anterior and/or not affected by the treatment. As put by Noah Greifer (MatchIt package author):

"To estimate total causal effects, all covariates must be measured prior to treatment (or otherwise not be affected by the treatment). " (source)

So in order to assess protected area impact, we need population estimates that precede the protected areas' creation. This is possible with Worldpop that provides estimates from 2000 onwards.

@goergen95
Copy link
Member Author

Agreed that most use-cases for the package require the time-series of Worldpop. I had a similar issue with one of the new carbon resources which are not directly readable from the source location. I solved it with downloads to a temporary location (see here) and would suggest to take the same path with WorldPop data. That would mean, however, that this data and related indicators are not compatible with "online" usage because they always require you to download the full data set even if you query just a handful of PAs with limited geographic extent.

@fBedecarrats
Copy link
Collaborator

We should maybe remove the Worldpop example from the Quickstart page then: https://mapme-initiative.github.io/mapme.biodiversity/articles/quickstart.html
at least until we have a more efficient procedure to showcase. Don't you think?

@goergen95
Copy link
Member Author

Please find b76a677 that will create temporary downloads for layers not already present in the path indicated by outdir. Next steps for the dev branch would be to update the vignette as per your last comment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants