ceeaf2d066
Importing dask.dataframe in a sandboxed build results in a TypeError like
this:
File "/nix/store/nv60iri29bia4szhhcvsdxgsci4wxvp6-python3.8-dask-2021.03.0/lib/python3.8/site-packages/dask/dataframe/io/csv.py", line 392, in <module>
AUTO_BLOCKSIZE = auto_blocksize(TOTAL_MEM, CPU_COUNT)
File "/nix/store/nv60iri29bia4szhhcvsdxgsci4wxvp6-python3.8-dask-2021.03.0/lib/python3.8/site-packages/dask/dataframe/io/csv.py", line 382, in auto_blocksize
blocksize = int(total_memory // cpu_count / memory_factor)
TypeError: unsupported operand type(s) for //: 'int' and 'NoneType'
This occurs because dask.dataframe has a non-deterministic component which
generates an automatic chunk-size based on system information.
This went unnoticed because the dask tests were disabled.
Changes:
- add a patch making the chunk-size inference more robust
- re-enable the tests
Resolves #120307
|
||
|---|---|---|
| .. | ||
| applications | ||
| build-support | ||
| common-updater | ||
| data | ||
| desktops | ||
| development | ||
| games | ||
| misc | ||
| os-specific | ||
| pkgs-lib | ||
| servers | ||
| shells | ||
| stdenv | ||
| test | ||
| tools | ||
| top-level | ||