Dr. Zilch
BDFL for the Blosc project
https://blosc.org
https://github.com/FrancescAlted
Francesc Alted
@FrancescAlted@masto.social
- 92 Followers
- 53 Following
- 240 Posts
CEO of https://ironarray.io
BDFL for the Blosc project
https://blosc.org
https://github.com/FrancescAlted
BDFL for the Blosc project
https://blosc.org
https://github.com/FrancescAlted
Blosc Development Team🚀 C-Blosc2 2.19.0 is out!
We’ve added b2nd_expand_dims(), making it easy to add new dimensions to your b2nd arrays—perfect for evolving your data structures on the fly.
Big thanks to @lshaw8317 for the contribution! 🙏
Check out the release notes: https://github.com/Blosc/c-blosc2/blob/main/RELEASE_NOTES.md
#C-Blosc2 #DataCompression #OpenSource
📢 We are pleased to announce the integration of a new stack feature in #Blosc2 🚀, which allows for stacking large arrays along a new axis.
Performance benchmarks show that while aligned chunks yield the best results, #Blosc2 with unaligned chunks can still outperform #NumPy—a welcome discovery! 🎉
Many thanks to Luke Shaw for his excellent work on this new functionality. 🙏
We've updated our recent blog post:
Check it out! 🔗 https://www.blosc.org/posts/blosc2-new-concatenate/#stacking-arrays
David BeazleyI really can't understate how much I'm enjoying my "hard way" journey with Rust this summer. The "hard way" meaning (a) Typing in things myself, (b) Not using an IDE, (c) No LLMs, (d) Making a lot of mistakes (e) Experimenting, and (f) Figuring things out on my own.
Honestly, it's been the most fun coding I've had in a long while.
📢 Blosc2 just launched a super-efficient array concatenation feature! 🎉
Combine massive arrays quickly and with minimal memory. If your array chunks are aligned, it's even faster – no need to decompress first! Perfect for big data tasks.
Check out our blog post: https://www.blosc.org/posts/blosc2-new-concatenate/
Compress Better, Compute Bigger
#DataScience #Blosc2 #DataStorage #Performance #MachineLearning
NumExpr 2.11.0 is here! 🎉
Key highlights:
🚀 Experimental support for free-threaded Python 3.13!
✨ Imaginary number evaluation like 1.1e1j is now fixed.
✅ Test suite modernized to pytest for easier contributions.
🐍 Python 3.10 is now the minimum supported version.
Check out the release notes for more details!
https://github.com/pydata/numexpr/blob/master/RELEASE_NOTES.rst
🚀 Excited to share more about Caterva2, your ultimate gateway to Blosc2/HDF5 repositories! 🚀
Caterva2 is designed to redefine how you interact with large datasets.
Want to see it in action? 🤔 We've just released a new introductory video showcasing Caterva2's main functionalities! 🎬
👉 https://ironarray.io/caterva2
#Caterva2 #Blosc2 #HDF5 #BigData #DataManagement #FreeSoftware #Python #DataScience #Tech
#Python-Blosc2 is hitting 1 million weekly downloads on PyPI! 🎉 https://pypacktrends.com/?packages=blosc2&packages=blosc&time_range=2years
Users are rapidly adopting #Blosc2, which now accounts for over 95% of downloads compared to Blosc1. 📈 This success is thanks to our amazing users and community contributors. 🙏 We're dedicated to making Python-Blosc2 even better. 🚀
Our motto: Compress Better, Compute Bigger! 💪
ironArray✨ Ever wondered how to effortlessly apply lazy expressions to massive tomographic HDF5 datasets and visualize them instantly in Cat2Cloud? 🤯
🎬 Check out this fantastic new video from our very own Luke Shaw! Discover how a bit of Python 🐍 magic and our user-friendly web interface simplify the process.
👇 Watch the full video to see the magic unfold: https://ironarray.io/cat2cloud
#HDF5 #Tomography #LazyEvaluation #DataVisualization #Cat2Cloud
💡 Did you know you can supercharge your #HDF5 datasets with #Blosc2? 🚀
Leverage hdf5plugin (https://hdf5plugin.readthedocs.io) to integrate Blosc2 as a filter within HDF5. Create, write, and read data using popular Python wrappers like h5py or PyTables, while achieving excellent performance! 💨
More speed?
* h5py users: b2h5py offers optimized reads for n-dim slices.
* PyTables users: Optimized support is already built-in.
Learn more: https://www.blosc.org/posts/pytables-b2nd-slicing/
Compress Better, Compute Bigger :-)
