Can we serialize a lazy #xarray to json? Lining up 10000 URLs takes a minute, can we save it out?

I figure that's what #kerchunk is, but it doesn't seem like it's used that way 🙏

I think "we" should write a #GDAL driver for #Kerchunk

mdim, and classic

how does Kerchunk publish its indexes?

Word Search Puzzle 224

Word List : #bessel #jere #oilcan #voiders #prisses #beaming #syces #kerchunk #mithraea #shimei #morish #subrigid #oxskin #mannans #cortex #aggrace #coelder #wormish

http://karafinance.com/2024/02/27/word-search-puzzle-224/

New on the blog: we're discussing our experience using #Kerchunk to improve access times to short-range streamflow predictions generated by NOAA's #NationalWaterModel Predictions Dataset.

https://www.element84.com/software-engineering/using-kerchunk-to-make-noaas-national-water-model-dataset-more-accessible/

Pythonistas: does {kerchunk} have facilities for HDF4?

#python #kerchunk

I'm frustrated by the HDF4 lib not being able to open a url (or can it, somehow??)

In the cloud session, Kerchunk has been mentioned twice as a way to work with legacy formats to optimize them to work in the cloud.

#kerchunk #aas241 #cloud #TOPS #OpenScience

https://github.com/fsspec/kerchunk

For my graduate #ScientificComputing class I made this little #JupyterNotebook for my students showing how to download #CFS data from #AWS, concatenate with #xarray, and save as a #NetCDF file.

This is the data intake step in an Idaho climate forecast dashboard pipeline the class is working on. It could be automated and sped up significantly. Also need to look at #Kerchunk to see if there's a way to stream only the required data (data is GrIB) https://github.com/LejoFlores/Download_CFS_S3/blob/main/DownloadCFS_files.ipynb