overrides: use a wheel for the tokenizers package

The tokenizers build system is pretty complex and requires cargo setup
to actually build (cf. the nixpkgs python override).

Using the wheel seems like the local optimum here to prevent the
source build complexity.
This commit is contained in:
Félix Baylac-Jacqué 2021-03-30 11:00:59 +02:00
parent dc053d1f31
commit 8585b78353
No known key found for this signature in database
GPG key ID: EFD315F31848DBA4

View file

@ -1388,6 +1388,14 @@ self: super:
}
);
# The tokenizers build requires a complex rust setup (cf. nixpkgs override)
#
# Instead of providing a full source build, we use a wheel to keep
# the complexity manageable for now.
tokenizers = super.tokenizers.override {
preferWheel = true;
};
torch = lib.makeOverridable
({ enableCuda ? false
, cudatoolkit ? pkgs.cudatoolkit_10_1