79438694

Date: 2025-02-14 08:08:00
Score: 1
Natty:
Report link

Both blosc and blosc2 have support for parallel compression. However, for leveraging the full potential of acceleration, you need to choose appropriate chunksizes (and blocksizes for blosc2).

For example, latest python-blosc2 3.x series allow you to automatically select appropriate chunk/block sizes and number of threads to accelerate your data access/store specifically for your machine. For more info on the class of performance this can lead, see: https://www.blosc.org/python-blosc2/getting_started/overview.html#operating-with-ndarrays

Reasons:
  • No code block (0.5):
  • Low reputation (0.5):
Posted by: Francesc