🚀 Our #PyDataGlobal 2025 tutorial recording on modern #Blosc2 & #Caterva2 features is out!
We show how compression is more than just a space saver, boosting performance for large in-memory & out-of-memory arrays via auto-chunking & parallelism.

We also cover: 🌐 Serving Blosc2/#HDF5 data online with Caterva2 ☁️ Computing directly in the cloud (no downloads needed!)

Watch here: 👉 https://www.youtube.com/watch?v=tUvSI3EpTBQ&list=PLGVZCDnMOq0qmerwB1eITnr5AfYRGm0DF&index=80

#Python #DataScience #BigData #HPC #DataHandling

🚀 Caterva2 2025.8.7 is out!

This release features a major refactoring for a simpler, more robust system. Best of all, client APIs are unaffected. ✅

🌟 Highlights:

The new cat2agent 🤖: A CLI client to watch a directory and auto-sync it with a Caterva2 server.
New stack and concat commands in the web UI for easier data manipulation.
Full release notes: https://github.com/ironArray/Caterva2/releases

Learn more about Caterva2: https://ironarray.io/caterva2

#Caterva2 #Blosc2 #HDF5 #DataStorage #OpenSource #DataScience

Thanks to the advanced double partitioning techniques in #Blosc2, our #Caterva2 package can serve small slices of big datasets (3.8 GB) through internet in less than the blink of an eye.

See how you can do that with the help of #JupyterLite in #Cat2Cloud using two different techniques:

1) Plain Python-Blosc2 library for quick and dirty access
2) Caterva2 Python client for a more heavy-duty and flexible operation

Try it out! 👉 https://cat2.cloud/demo/roots/@public/examples/large-dataset-indexing.ipynb?roots=%40public

#BigData #RemoteAccess #Performance

🚀 Excited to share more about Caterva2, your ultimate gateway to Blosc2/HDF5 repositories! 🚀

Caterva2 is designed to redefine how you interact with large datasets.

Want to see it in action? 🤔 We've just released a new introductory video showcasing Caterva2's main functionalities! 🎬

👉 https://ironarray.io/caterva2

#Caterva2 #Blosc2 #HDF5 #BigData #DataManagement #FreeSoftware #Python #DataScience #Tech

#Caterva2 cannot only be used for sharing your compressed datasets in the internet, but also to efficiently perform operations on datasets exceeding available memory.

Look at our new blog explaining how this works 👉 https://ironarray.io/blog/caterva2-lazy-eval

Learn how to:

⬆ Upload your own datasets
🌎 Use remote servers for evaluation
💻 Evaluate complex expressions either programmatically of via a web interface
🗜 Use advanced compression everywhere, from transmission to computation

Make compression better 😀

Big news! #Caterva2 enters advanced beta stage 🎉 🎉

Caterva2 is a FOSS distributed system written in Python meant for sharing Blosc2 datasets (either native or converted on-the-fly from HDF5) among different hosts.

It follows the pub-sub paradigm, so it can publish data once and allow multiple subscribers to access it, saving time and resources. It comes with a Python API and a Web interface for easy browsing.

Learn more in https://ironarray.io/caterva2

Make Compression Better 😀
#blosc2 #ironarray

📢 Big news! Caterva2 enters advanced beta stage 🎉 🎇 Caterva2 is a FOSS distributed system written in Python meant for sharing Blosc2 datasets (either native or converted on-the-fly from HDF5) among different hosts.

It follows the pubsub paradigm, so it can publish data once and allow multiple subscribers to access it, saving time and resources.

Learn more about Caterva2 (2 min video included) in https://ironarray.io/caterva2

Make Compression Better 😀
#blosc2 #ironarray #caterva2 #pubsub