Commit Graph

4 Commits

Author SHA1 Message Date
Daniël de Kok
403e2506af python3Packages.tokenizers: 0.8.1rc1 -> 0.8.1 2020-08-05 08:23:11 +02:00
Daniël de Kok
b0a6bd4281 python3Packages.tokenizers: fix build
Update the parking_lot dependency to be compatible with recent Rust
versions that replace asm! by llvm_asm!:

https://github.com/Amanieu/parking_lot/pull/223

Fixes #94682
2020-08-05 08:19:01 +02:00
Daniël de Kok
918d5cfb33 python3Packages.tokenizers: 0.8.0 -> 0.8.1.rc1
Changelog:
https://github.com/huggingface/tokenizers/releases/tag/python-v0.8.1.rc1
2020-07-07 07:25:13 +02:00
Daniël de Kok
66d0b2a0d0 python3Packages.tokenizers: init at 0.8.0 2020-07-02 21:53:51 +02:00