Adam H. Sparks May 20

RE: https://mas.to/@CRANberriesFeed/116606326823968998

We'll try for a third time. This has been archived 2X already. This time I just removed all caching capability and basically rewrote the whole package for a major release that breaks backward capability but simplifies using it. Now it only has two single functions, one creates a data.table the other a {terra} SpatRaster of the CRU CL 2.0 climate data either by download or from local files.
https://docs.ropensci.org/getCRUCLdata/

#RStats #ClimateData

Show threadMichael SumnerMay 20

@adamhsparks what's the download format, how big is it in total and what's the update schedule?

Just, maybe time to reformat it to an updating new store rather than downloading/caching? It's a hard boundary to cross but really nice when the new store is fast and lithe

We did this with GHRSST ~8000 daily 500Mb COGs, it's also a good collective topic going fwd. We copy to source.coop, S3 or bare url. No egress cost..the lambda $ about $10 a month, but it could run on hpc/nectar.

Show threadAdam H. Sparks May 20
@mdsumner .gz files. It’s not changing, static files. Just large enough to not want to download over and over for the full set but it is doable.
Show threadAdam H. Sparks May 20
@mdsumner oh, and the files are just text. Not geospatial
Show threadMichael Sumner
@adamhsparks oh even better 😅 xyz or .asc or something else? (I will.look at some point)
May 20 at 11:13amWeb
Show threadAdam H. Sparks May 20
@mdsumner no. Just plain text files compressed into a .gz file. 😅