Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SRTM 4.1 #16

Open
mdsumner opened this issue Dec 10, 2018 · 2 comments
Open

SRTM 4.1 #16

mdsumner opened this issue Dec 10, 2018 · 2 comments

Comments

@mdsumner
Copy link
Member

There's a bulk download form:

https://cgiarcsi.community/data/srtm-90m-digital-elevation-database-v4-1/

Let's do it! It seems the v3 stuff is all the files in one big folder, which is causing me problems. If 4.1 is useable I reckon this is worthwhile to update

@mdsumner
Copy link
Member Author

mdsumner commented Mar 26, 2019

Here's my bowerbird config:

##Example file: http://srtm.csi.cgiar.org/wp-content/uploads/files/srtm_5x5/TIFF/srtm_17_03.zip
library(bowerbird)

## create all src urls by code, though less than half will be valid - will clean up later and
## derive the proper list (bb is robust to this)
srcs <- purrr::map_chr(purrr::transpose(expand.grid(x = 1:72, y = 1:24)), ~sprintf("http://srtm.csi.cgiar.org/wp-content/uploads/files/srtm_5x5/TIFF/srtm_%02i_%02i.zip", .x$x, .x$y))
srtm4.1 <- bb_source(
  name="SRTM 90m Digital Elevation Database v4.1",
  id="10.1080/13658810601169899",
  description="The SRTM digital elevation data, produced by NASA originally, is a major breakthrough in digital mapping of the world, and provides a major advance in the accessibility of high quality elevation data for large portions of the tropics and other areas of the developing world.",
  doc_url="https://cgiarcsi.community/data/srtm-90m-digital-elevation-database-v4-1/",
  citation="Jarvis, A., H.I. Reuter, A. Nelson, E. Guevara, 2008, Hole-filled SRTM for the globe Version 4, available from the CGIAR-CSI SRTM 90m Database (http://srtm.csi.cgiar.org).",
  source_url = srcs,
  license="Please cite",
  method = list("bb_handler_rget"),
  postprocess=list("bb_unzip"),
  collection_size=32,
  comment="",
  data_group="Topography")

root <- "<secrets>"

cf <- bb_config(local_file_root= root )
cf <- cf %>% bb_add(srtm4.1)
sync_status <- bb_sync(cf,  verbose = TRUE)

32 Gb is aspirational, because 72 * 36 * (0.4) * (24 + 68)Mb (uncompressed 68 Mb .tif, each download is ~24Mb), so actually ~60Gb raw disk space - we can dump the .zips and compress the tifs natively, if needed

@mdsumner
Copy link
Member Author

mdsumner commented Mar 27, 2019

File finder at AustralianAntarcticDivision/raadfiles@60bdf42

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant