Blosc Development Team

@blosc.org

30 Followers 4 Following

Announcements about Blosc2 developments https://blosc.org

New miniexpr compute engine leading to better data flow for compressed data streams, leading to much better compute efficiency.
New Blosc2 fancy indexing performance against other competitors, including NumPy. Blosc2 is quite efficient.
Evaluate slices of lazy expressions (inner dims)
Performance of Blosc2 transposition depending on the chunk size
Transposing a compressed array with Blosc2
Up to 75x speedups of Blosc2 vs NumPy and Numba when computing with generic NumPy functions
The plot shows the performance of the new Blosc2 compute capabilities. It can be more than 10x faster than NumPy and numba.
blosc2.jit can accelerate computations a lot, and very easily.
Performance of Blosc2 vs Dask+Zarr+Blosc for a complex math calculation.
Compute performance vs arbitrary precision
Compute performance scales well beyond the available RAM
Double partitioning diagram
Compare performance of Blosc2 against NumPy, Numexpr, Numba and Dask.
Compare reductions on different axis of a 4D array, using NumPy and Python-Blosc2
Comparison of computation on compressed vs uncompressed ndarrays