Release 3.0.0 beta3
Pre-releaseChanges from 3.0.0-beta.1 to 3.0.0-beta.3
-
Revamped documentation. Now, it is more complete and has a better structure. Thanks to Oumaima Ech Chdig (@omaech), our newcomer to the Blosc team. Also, thanks to NumFOCUS for their support in this task.
-
New
Proxy
class to access other arrays, while providing caching. This is useful for example when you have a big array, and you want to access a small part of it, but you want to cache the accessed data for later use. See its doc. -
Lazy expressions can accept proxies as operands.
-
Read-ahead support for reading super-chunks from disk. This allows for overlapping reads and computations, which can be a big performance boost for some workloads.
-
New BLOSC_LOW_MEM envar for keeping memory under a minimum while evaluating expressions. This makes it possible to evaluate expressions on very large arrays, even if the memory is limited (at the expense of performance).
-
Fine tune block sizes for the internal compute engine.
-
Better CPU cache size guessing for linux and macOS.
-
Build tooling has been modernized and now uses
pyproject.toml
andscikit-build-core
for managing dependencies and building the package. Thanks to @LecrisUT for the excellent guidance in this area. -
Many code cleanup and syntax improvements in code. Thanks to @DimitriPapadopoulos.