Installation error of the package 'crosslingual-coreference' #13316

DavideLagano · 2024-02-09T08:56:23Z

DavideLagano
Feb 9, 2024

Chip: Apple M3
MacOS Sonoma, Version 14.3
Python version: 3.10.13
In already installed Rust.

Building wheels for collected packages: tokenizers
  Building wheel for tokenizers (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for tokenizers (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [586 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.macosx-14.3-arm64-cpython-310
      creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers
      copying py_src/tokenizers/__init__.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers
      creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/models
      copying py_src/tokenizers/models/__init__.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/models
      creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/decoders
      copying py_src/tokenizers/decoders/__init__.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/decoders
      creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/normalizers
      copying py_src/tokenizers/normalizers/__init__.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/normalizers
      creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/pre_tokenizers
...
8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblog-67209b2521d51704.rmeta --extern macro_rules_attribute=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libmacro_rules_attribute-efcdd1618729d88c.rmeta --extern onig=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libonig-55e025d9cd10ef1d.rmeta --extern paste=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libpaste-cbb23ac2fa72fb9c.dylib --extern rand=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librand-0b09f74aae2d6e40.rmeta --extern rayon=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon-30990235a038b514.rmeta --extern rayon_cond=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon_cond-2483fbb1a8df1d3e.rmeta --extern regex=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex-7fcb56abc3e47088.rmeta --extern regex_syntax=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex_syntax-66179a6cbc8e8d90.rmeta --extern reqwest=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libreqwest-beeb0f83a3b16ee5.rmeta --extern serde=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde-289f63c404915bfb.rmeta --extern serde_json=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde_json-ca3e386be1e1db16.rmeta --extern spm_precompiled=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libspm_precompiled-f9acdce561af88ff.rmeta --extern thiserror=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libthiserror-a91213e24d296260.rmeta --extern unicode_normalization_alignments=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_normalization_alignments-1aef014c0aec3a81.rmeta --extern unicode_segmentation=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_segmentation-0866dc6a2ac87bf1.rmeta --extern unicode_categories=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_categories-f44cb1f9440beb5c.rmeta -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/bzip2-sys-0c46cf013c67825b/out/lib -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/zstd-sys-9a4d4f9b48c0d595/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/esaxx-rs-9d2de4cc92300f46/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/onig_sys-433c7599de979028/out`
      warning: variable does not need to be mutable
         --> tokenizers-lib/src/models/unigram/model.rs:265:21
          |
      265 |                 let mut target_node = &mut best_path_ends_at[key_pos];
          |                     ----^^^^^^^^^^^
          |                     |
          |                     help: remove this `mut`
          |
          = note: `#[warn(unused_mut)]` on by default

      warning: variable does not need to be mutable
         --> tokenizers-lib/src/models/unigram/model.rs:282:21
          |
      282 |                 let mut target_node = &mut best_path_ends_at[starts_at + mblen];
          |                     ----^^^^^^^^^^^
          |                     |
          |                     help: remove this `mut`

      warning: variable does not need to be mutable
         --> tokenizers-lib/src/pre_tokenizers/byte_level.rs:200:59
          |
      200 |     encoding.process_tokens_with_offsets_mut(|(i, (token, mut offsets))| {
          |                                                           ----^^^^^^^
          |                                                           |
          |                                                           help: remove this `mut`

      error: casting `&T` to `&mut T` is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell`
         --> tokenizers-lib/src/models/bpe/trainer.rs:526:47
          |
      522 |                     let w = &words[*i] as *const _ as *mut _;
          |                             -------------------------------- casting happend here
      ...
      526 |                         let word: &mut Word = &mut (*w);
          |                                               ^^^^^^^^^
          |
          = note: for more information, visit <https://doc.rust-lang.org/book/ch15-05-interior-mutability.html>
          = note: `#[deny(invalid_reference_casting)]` on by default

      warning: `tokenizers` (lib) generated 3 warnings
      error: could not compile `tokenizers` (lib) due to previous error; 3 warnings emitted

      Caused by:
        process didn't exit successfully: `rustc --crate-name tokenizers --edition=2018 tokenizers-lib/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="cached-path"' --cfg 'feature="clap"' --cfg 'feature="cli"' --cfg 'feature="default"' --cfg 'feature="http"' --cfg 'feature="indicatif"' --cfg 'feature="progressbar"' --cfg 'feature="reqwest"' -C metadata=02b35ef3d3a318c6 -C extra-filename=-02b35ef3d3a318c6 --out-dir /private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps -L dependency=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps --extern aho_corasick=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libaho_corasick-1f16d7cbc1e140f2.rmeta --extern cached_path=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libcached_path-4aca8b2bc71340df.rmeta --extern clap=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libclap-6026cc4aa25a0aba.rmeta --extern derive_builder=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libderive_builder-3ec426cf16b9ba1a.dylib --extern dirs=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libdirs-1da7806f8cc3f346.rmeta --extern esaxx_rs=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libesaxx_rs-5aaf1f019751a9f2.rmeta --extern indicatif=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libindicatif-75757f2d3df8bc84.rmeta --extern itertools=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libitertools-e26f459727927c7c.rmeta --extern lazy_static=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblazy_static-a035a15073af7f16.rmeta --extern log=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblog-67209b2521d51704.rmeta --extern macro_rules_attribute=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libmacro_rules_attribute-efcdd1618729d88c.rmeta --extern onig=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libonig-55e025d9cd10ef1d.rmeta --extern paste=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libpaste-cbb23ac2fa72fb9c.dylib --extern rand=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librand-0b09f74aae2d6e40.rmeta --extern rayon=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon-30990235a038b514.rmeta --extern rayon_cond=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon_cond-2483fbb1a8df1d3e.rmeta --extern regex=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex-7fcb56abc3e47088.rmeta --extern regex_syntax=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex_syntax-66179a6cbc8e8d90.rmeta --extern reqwest=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libreqwest-beeb0f83a3b16ee5.rmeta --extern serde=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde-289f63c404915bfb.rmeta --extern serde_json=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde_json-ca3e386be1e1db16.rmeta --extern spm_precompiled=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libspm_precompiled-f9acdce561af88ff.rmeta --extern thiserror=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libthiserror-a91213e24d296260.rmeta --extern unicode_normalization_alignments=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_normalization_alignments-1aef014c0aec3a81.rmeta --extern unicode_segmentation=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_segmentation-0866dc6a2ac87bf1.rmeta --extern unicode_categories=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_categories-f44cb1f9440beb5c.rmeta -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/bzip2-sys-0c46cf013c67825b/out/lib -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/zstd-sys-9a4d4f9b48c0d595/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/esaxx-rs-9d2de4cc92300f46/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/onig_sys-433c7599de979028/out` (exit status: 1)
      error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib -- -C 'link-args=-undefined dynamic_lookup -Wl,-install_name,@rpath/tokenizers.cpython-310-darwin.so'` failed with code 101
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects

Thank you in advance.