[email protected]

@luke_shaw_ironarray
5 Followers
6 Following
44 Posts

Blosc2 4.1 Release!

We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!πŸ‘‡

Notebook here - https://github.com/Blosc/python-blosc2/blob/main/examples/ndarray/mandelbrot-dsl.ipynb

πŸ“’ OSS Synergy : Blosc2 🀝 OpenZL πŸ”

Exciting pluginπŸ”Œannouncement - you can now use the new OpenZL compression πŸ—œοΈ library from Blosc2: https://github.com/Blosc/blosc2-openzl!

It's as simple as

πš™Μ²πš’Μ²πš™Μ²β€‚Μ²πš’Μ²πš—Μ²πšœΜ²πšΜ²πšŠΜ²πš•Μ²πš•Μ²β€‚Μ²πš‹Μ²πš•Μ²πš˜Μ²πšœΜ²πšŒΜ²πŸΈΜ²β€“Μ²πš˜Μ²πš™Μ²πšŽΜ²πš—Μ²πš£Μ²πš•Μ²

and just like that, OpenZL compression + Blosc2 compute engine!

Thanks to Yann Collet, his team and all contributors to the OpenZL project - check it out here https://openzl.org/.

Find out more about how the Blosc team implemented this plugin here ⏩ https://blosc.org/posts/openzl-plugin/

🚨 Double threat!: Blosc2 3.12.2 + Caterva2 2025.12.3 release!🚨

βœ… Streamlined computation for LazyUDFs
βœ… Upload LazyUDFs for server-side execution in Caterva2

And as another consequence, Numba can now be integrated into your Blosc2 LazyUDF workflow very easily!

To round off our presentation of the shiny new Cat2Cloud product, we have a final πŸ’Š ironPill πŸ’Šon data handling from the web client 🌐 .

See how to move ➑️ , copy ©️ and perform other file management operations easily from the prompt box!

Stop downloading, start doing! πŸ”¨

The crown jewel of Cat2Cloud πŸ’Ž !

With Cat2Cloud released this week we continue our πŸ’ŠironPill series with a video on the most exciting feature of our platform: π—Ώπ—²π—Ίπ—Όπ˜π—² π—·π˜‚π—½π˜†π˜π—²π—Ώ π—»π—Όπ˜π—²π—―π—Όπ—Όπ—Έπ˜€!

☁️ cloud-based computation
☁️ cloud-hosted data
☁️ cloud-hosted jupyter notebooks!

🌐 Rapidly prototype code, explore data and share insights with your team, computing efficiently on shared data - all from the browser!

⚑No environment headaches, no waiting for computations - all wrapped in a seamless interface!

ironArray is on a roll πŸš…!

With Cat2Cloud released this week we continue our πŸ’ŠironPill series with another video, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client!

Visualise and manage all kinds of data formats - from arrays to jpgs πŸ–ΌοΈ, markdown to PDFs πŸ“„ !

πŸ“’πŸš¨Blosc2 3.11.0 Released! 🚨 πŸ“’

Blosc2 also now features as a part of the NumPy array library ecosystem: https://numpy.org/

In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object! That's right:

πš‹πš•πš˜πšœπšŒπŸΈ.πš–πšŠπšπš–πšžπš•(𝙰, 𝙱)

will work directly for 𝙰, 𝙱 PyTorch, Jax, NumPy, Tensorflow, Zarr... arrays!

**Plot: computation (for NumPy, Blosc2, Pytorch) on NxNxN arrays from the three libraries. Machine has 32GB of RAM **

#Compute
#Tensor
#PyTorch
#Python

πŸ’ŠIronPill 2πŸ’Š
In the second of our series of short videos ("ironPills") showcasing ironArray's work, we see how Blosc2 can be used to power heavy-duty linear algebra (100GB!) workflows
⚑1.5-2x faster than PyTorch + h5py!
🧱 automated chunking optimised for your machine's cache hierarchy
🐍 simple one-line syntax πš‹πš•πš˜πšœπšŒπŸΈ.πš–πšŠπšπš–πšžπš•(𝙰, 𝙱, πšžπš›πš•πš™πšŠπšπš‘='𝚘𝚞𝚝.πš‹πŸΈπš—πš')

See blog here: https://ironarray.io/blog/la-blosc

#Blosc2
#Data
#SignalProcessing
#LinearAlgebra

πŸ’Š IronPill 1πŸ’Š
In the first of a series of short videos ("ironPills") showcasing ironArray's work, we see how Blosc2 can be used to calculate Fourier approximations:
⚑5x faster than NumPy
πŸ‘£ fraction of the memory footprint
🐍 pythonic one-line syntax πšœπšžπš–(πšŠβ€‚*β€‚πšŒπš˜πšœ(𝚝) +β€‚πš‹β€‚*β€‚πšœπš’πš—(𝚝),β€‚πšŠπš‘πš’πšœ=𝟷)

See full notebook here: https://github.com/Blosc/python-blosc2/blob/main/examples/ndarray/ironpill1.ipynb

(inspired by this blog post: https://towardsdatascience.com/numexpr-the-faster-than-numpy-library-that-no-ones-heard-of/)

#Blosc2
#Data
#SignalProcessing

πŸ“’Blosc2 3.10.2 Released! πŸ“’

Building on the functions introduced in version 3.9, we have extended lazy evaluation to general expressions with ALL blosc2 functions in version 3.10.

Blosc2's compute engine ingests many array formats, as well as blosc2 arrays, with impressive results - see the graphic below!
Details on the comparisons in our blog: https://www.blosc.org/posts/tensordot-pure-persistent/

Blosc2's compute engine also powers Cat2Cloud (visit the demo site here https://cat2.cloud/demo/)!

#Zarr
#HDF5
#Python