Simpletransformers Import Error

[SamCox822]

I am trying to use Simpletransformers, and I have it pip installed and pinned as version 0.63.9.

I also have other packages installed, as can be seen here:
https://github.com/SamCox822/dmol-book/blob/b2e07c90993a612092dc5255d89a358a597787b1/package/setup.py , as well as pip install torch-scatter torch-sparse torch-cluster torch-spline-conv torch-geometric -f https://data.pyg.org/whl/torch-1.12.0+cpu.html

However, when I try to then import simpletransformers, I get the following error:

---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In [1], line 1
----> 1 from simpletransformers.classification import ClassificationModel
      2 import pandas as pd, sklearn, matplotlib.pyplot as plt, numpy as np

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/simpletransformers/classification/__init__.py:1
----> 1 from simpletransformers.classification.classification_model import ClassificationModel
      2 from simpletransformers.classification.multi_label_classification_model import (
      3     MultiLabelClassificationModel,
      4 )
      5 from simpletransformers.classification.multi_modal_classification_model import (
      6     MultiModalClassificationModel,
      7 )

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/simpletransformers/classification/classification_model.py:38
     36 from tqdm.auto import tqdm, trange
     37 from tqdm.contrib import tenumerate
---> 38 from transformers.optimization import (
     39     get_constant_schedule,
     40     get_constant_schedule_with_warmup,
     41     get_linear_schedule_with_warmup,
     42     get_cosine_schedule_with_warmup,
     43     get_cosine_with_hard_restarts_schedule_with_warmup,
     44     get_polynomial_decay_schedule_with_warmup,
     45 )
     46 from torch.optim import AdamW
     47 from transformers.optimization import Adafactor

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/transformers/__init__.py:30
     27 from typing import TYPE_CHECKING
     29 # Check the dependencies satisfy the minimal versions required.
---> 30 from . import dependency_versions_check
     31 from .utils import (
     32     OptionalDependencyNotAvailable,
     33     _LazyModule,
   (...)
     44     logging,
     45 )
     48 logger = logging.get_logger(__name__)  # pylint: disable=invalid-name

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/transformers/dependency_versions_check.py:41
     38         if not is_tokenizers_available():
     39             continue  # not required, check version only if installed
---> 41     require_version_core(deps[pkg])
     42 else:
     43     raise ValueError(f"can't find {pkg} in {deps.keys()}, check dependency_versions_table.py")

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/transformers/utils/versions.py:122, in require_version_core(requirement)
    120 """require_version wrapper which emits a core-specific hint on failure"""
    121 hint = "Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main"
--> 122 return require_version(requirement, hint)

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/transformers/utils/versions.py:116, in require_version(requirement, hint)
    114 if want_ver is not None:
    115     for op, want_ver in wanted.items():
--> 116         _compare_versions(op, got_ver, want_ver, requirement, pkg, hint)

File /usr/share/miniconda/envs/__setup_conda/lib/python3.8/site-packages/transformers/utils/versions.py:49, in _compare_versions(op, got_ver, want_ver, requirement, pkg, hint)
     47     raise ValueError("want_ver is None")
     48 if not ops[op](version.parse(got_ver), version.parse(want_ver)):
---> 49     raise ImportError(
     50         f"{requirement} is required for a normal functioning of this module, but found {pkg}=={got_ver}.{hint}"
     51     )

ImportError: tokenizers>=0.11.1,!=0.11.3,<0.13 is required for a normal functioning of this module, but found tokenizers==0.13.0.
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main

NOTE: when I check the version of transformers (that is only installed as a dependency of simpletransformers), I get version 4.23.1.

I am kind of lost on how to address this problem, and I value any feedback.

[DamithDR]

As the error suggests "ImportError: tokenizers>=0.11.1,!=0.11.3,<0.13 is required for a normal functioning of this module" can you try specifying
tokenizers==0.11.1 in your install_requires list and try again ?