Decided to publish these two blog posts (that have been sitting in review for 4 months) in their original form. Nothing new really, they're basically written versions of my FOSS4G Oceania talk from Nov 2023 (mentioned at https://mastodon.nz/@weiji14/111253234798353977):

- Part 1: https://weiji14.github.io/blog/the-pangeo-machine-learning-ecosystem-in-2023
- Part 2: https://weiji14.github.io/blog/when-cloud-native-geospatial-meets-gpu-native-machine-learning

Source code is at https://github.com/weiji14/foss4g2023oceania/tree/v1.0.0. See this as a snapshot in time, what comes next might be even more exciting 😃

#Pangeo #RAPIDSAI #kvikIO #xbatcher #zen3geo #gischat

Presenting my talk today on "The ecosystem of geospatial machine learning tools in the Pangeo world"

Slides: https://hackmd.io/@weiji14/foss4g2023oceania
Code: https://github.com/weiji14/foss4g2023oceania

#FOSS4GOceania2023 #FOSS4G #Pangeo #GeoML @zarr #xarray #xbatcher #zen3geo #gischat

☯️ #zen3geo v0.6.2. Tiny patch release with another STAC DataPipe! Release notes are at https://zen3geo.readthedocs.io/en/v0.6.2/changelog.html

Have you got a need to connect Spatiotemporal Asset Catalogs (STAC) to deep learning workflows? Or interested in cloud-native geospatial machine learning? I'd love to hear more from you at
https://github.com/weiji14/zen3geo/discussions/48, or just comment below!

@pytorch #TorchData #gischat #STAC #CloudNativeGeospatial #GeoML

☯️ #zen3geo v0.6.1. Quick patch release with full support for 🐍 Python 3.11! Made a couple of bug fixes 🐞 to DatashaderRasterizer (for turning points/lines/polygons to pixel masks based on a template raster). Also sneaked in a tiny enhancement ✨ to XpySTACAssetReader (which wraps around `xarray.open_dataset`) to work without xpystac 🙃. Find out more in the release notes at https://zen3geo.readthedocs.io/en/v0.6.1/changelog.html.

@pytorch #TorchData #Python #DataShader #xarray #gischat #geospatial #datapipeline #computervision

☯️ #zen3geo v0.6.0. Scale to new heights if you dare. Open 📂 STAC Assets backed by Zarr, NetCDF or CloudOptimizedGeoTIFF files using the new XpySTACAssetReader DataPipe. Attempt super-resolution 🔭 with the walkthrough on handling multi-resolution CMIP6 climate data from CarbonPlan over the Philippines 🇵🇭 at https://zen3geo.readthedocs.io/en/v0.6.0/multi-resolution.html. Clarity, seek it, give it 🥽

@zarr #STAC #NetCDF #CloudOptimizedGeoTIFF #xarray @pytorch #DataPipe #SuperResoluton #MultiResolution #CarbonPlan #CMIP6 #ClimateModel

Morning: Will be at my poster from 9-12. Come ask me about geospatial machine learning, data pipelines and cloud-native geospatial! https://agu.confex.com/agu/fm22/meetingapp.cgi/Paper/1094759

Afternoon: Gonna check out the exhibit booths to see if I spot any Frontier Development Lab folks, and will be coding away at Pod 5 for the Earthdata login filesystem hackathon https://discourse.pangeo.io/t/cloud-computing-using-nasa-earthdata-with-earthdata-login/2434/1

#AGU22 #eochat #gischat #torchdata #zen3geo #edlfs #FDL22

Giving a talk on 7 Nov 2022 at 17:00 (UTC) about ☯️ #zen3geo: Guiding Earth Observation 🌏 data on its path to enlightenment. Learn about #torchdata #DataPipes for #geospatial #machinelearning! More info at https://discourse.pangeo.io/t/monday-november-07-2022-machine-learning-working-group-presentation-zen3geo-guiding-earth-observation-data-on-its-path-to-enlightenment-by-wei-ji-leong/2883

P.S. I'm now over at https://mastodon.nz/@weiji14