Blosc2 4.1 Release!
We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!π
Notebook here - https://github.com/Blosc/python-blosc2/blob/main/examples/ndarray/mandelbrot-dsl.ipynb
π’ OSS Synergy : Blosc2 π€ OpenZL π
Exciting pluginπannouncement - you can now use the new OpenZL compression ποΈ library from Blosc2: https://github.com/Blosc/blosc2-openzl!
It's as simple as
πΜ²πΜ²πΜ²βΜ²πΜ²πΜ²πΜ²πΜ²πΜ²πΜ²πΜ²βΜ²πΜ²πΜ²πΜ²πΜ²πΜ²πΈΜ²βΜ²πΜ²πΜ²πΜ²πΜ²π£Μ²πΜ²
and just like that, OpenZL compression + Blosc2 compute engine!
Thanks to Yann Collet, his team and all contributors to the OpenZL project - check it out here https://openzl.org/.
Find out more about how the Blosc team implemented this plugin here β© https://blosc.org/posts/openzl-plugin/
π¨ Double threat!: Blosc2 3.12.2 + Caterva2 2025.12.3 release!π¨
β
Streamlined computation for LazyUDFs
β
Upload LazyUDFs for server-side execution in Caterva2
And as another consequence, Numba can now be integrated into your Blosc2 LazyUDF workflow very easily!
π€ Can a library that computes on compressed data actually outperform performance heavyweights like NumPy and NumExpr? I'm using the Roofline model to find out, and the answer isn't as straightforward as you might think.
Join me to explore the different angles and find some surprising answers π https://www.blosc.org/posts/roofline-analysis-blosc2/
During the walk, I'm also introducing a funny anecdote back when NumPy was still gently sitting in his craddle πΆ
Enjoy!
hashtag#Blosc2 hashtag#HPC hashtag#NumPy hashtag#Numexpr
To round off our presentation of the shiny new Cat2Cloud product, we have a final π ironPill πon data handling from the web client π .
See how to move β‘οΈ , copy Β©οΈ and perform other file management operations easily from the prompt box!
Stop downloading, start doing! π¨
To round off our presentation of the shiny new Cat2Cloud product, we have a final π ironPill πon data handling from the web client π .
See how to move β‘οΈ , copy Β©οΈ and perform other file management operations easily from the prompt box!
Stop downloading, start doing! π¨
Unlock the power of your HDF5 data in the cloud! βοΈ
Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. β¨
Watch our video π¬ to see how you can:
* Upload an HDF5 file β¬οΈ
* Unfold its structure π
* Apply operations on datasets βοΈ
* Visualize the results π
Ready to see it in action? Try our online demo server today! π https://cat2cloud.com/demo/
The crown jewel of Cat2Cloud π !
With Cat2Cloud released this week we continue our πironPill series with a video on the most exciting feature of our platform: πΏπ²πΊπΌππ² π·ππ½πππ²πΏ π»πΌππ²π―πΌπΌπΈπ!
βοΈ cloud-based computation
βοΈ cloud-hosted data
βοΈ cloud-hosted jupyter notebooks!
π Rapidly prototype code, explore data and share insights with your team, computing efficiently on shared data - all from the browser!
β‘No environment headaches, no waiting for computations - all wrapped in a seamless interface!
ironArray is on a roll π !
With Cat2Cloud released this week we continue our πironPill series with another video, showing you how to browse your cloud-hosted data βοΈ in the bespoke web client!
Visualise and manage all kinds of data formats - from arrays to jpgs πΌοΈ, markdown to PDFs π !
π’π¨Blosc2 3.11.0 Released! π¨ π’
Blosc2 also now features as a part of the NumPy array library ecosystem: https://numpy.org/
In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object! That's right:
ππππππΈ.ππππππ(π°, π±)
will work directly for π°, π± PyTorch, Jax, NumPy, Tensorflow, Zarr... arrays!
**Plot: computation (for NumPy, Blosc2, Pytorch) on NxNxN arrays from the three libraries. Machine has 32GB of RAM **
Francesc Alted
ironArray SLU