Commit Graph

4 Commits

Author SHA1 Message Date
Daniël de Kok
27d0c5a07e sentencepiece: split into multiple outputs, optional gperftools
I am using sentencepiece in a downstream application where I want to
minimize the resulting closures. This commit makes changes to make
sentencepiece a leaner dependency:

- Split the outputs, so that the binaries/headers do not end up in the
  transitive closure in a library dependency.

- Add the `withGPerfTools` option, which is enabled by default, to
  make it possible to disable the gperftools dependency. According to
  the sentencepiece README, this dependency gives a 10-40% performance
  improvement. But in many cases this is overshadowed by the neural
  networks that use piece identifiers as input anyway.
2020-03-14 15:40:29 -07:00
Daniël de Kok
9bab3b5a61 sentencepiece: set platforms to unix to support Darwin
- The sentencepiece library builds fine on Darwin as well.
- Remove superfluous `enableParallelBuilding = true`.
- Make the value of homepage a string.
2020-02-22 10:55:48 -08:00
R. RyanTM
f8a5d63357 sentencepiece: 0.1.84 -> 0.1.85 2020-01-17 10:41:53 +00:00
Pash Shocky
82116878da sentencepiece: init at 0.1.84 2019-12-17 16:46:52 -08:00