Skip to content
This repository has been archived by the owner on Oct 23, 2020. It is now read-only.

Installations fails due to Ludwig dependency on Tensorflow v0.14.0 #13

Open
mingfang opened this issue Jan 6, 2020 · 4 comments
Open

Installations fails due to Ludwig dependency on Tensorflow v0.14.0 #13

mingfang opened this issue Jan 6, 2020 · 4 comments

Comments

@mingfang
Copy link

mingfang commented Jan 6, 2020

I was able to workaround the problem by changing https://github.com/uber-research/plato-research-dialogue-system/blob/master/requirements.txt#L10 to

tensorflow==1.14.0
@jadeye
Copy link

jadeye commented Aug 25, 2020

Just added this line to requirements.txt and installation is on it's way.
Still I get other errors now:


  Using cached https://files.pythonhosted.org/packages/c4/f4/770ae9385990f5a19a91431163d262182d3203662ea2b5739d0fcfc080f1/tabulate-0.8.7-py3-none-any.whl
Collecting tqdm (from ludwig>=0.2.1->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/28/7e/281edb5bc3274dfb894d90f4dbacfceaca381c2435ec6187a2c6f329aed7/tqdm-4.48.2-py2.py3-none-any.whl
Collecting pytz>=2017.2 (from pandas>=0.23.4->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/4f/a4/879454d49688e2fad93e59d7d4efda580b783c745fd2ec2a3adf87b0808d/pytz-2020.1-py2.py3-none-any.whl
Collecting python-dateutil>=2.7.3 (from pandas>=0.23.4->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl
Collecting google-pasta>=0.1.6 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/a3/de/c648ef6835192e6e2cc03f40b19eeda4382c49b5bafb43d88b931c4c74ac/google_pasta-0.2.0-py3-none-any.whl (57kB)
    100% |████████████████████████████████| 61kB 4.0MB/s 
Collecting keras-applications>=1.0.6 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/71/e3/19762fdfc62877ae9102edf6342d71b28fbfd9dea3d2f96a882ce099b03f/Keras_Applications-1.0.8-py3-none-any.whl (50kB)
    100% |████████████████████████████████| 51kB 3.8MB/s 
Collecting protobuf>=3.6.1 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/30/79/510974552cebff2ba04038544799450defe75e96ea5f1675dbf72cc8744f/protobuf-3.13.0-cp36-cp36m-manylinux1_x86_64.whl (1.3MB)
    100% |████████████████████████████████| 1.3MB 1.1MB/s 
Collecting wheel>=0.26 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/a7/00/3df031b3ecd5444d572141321537080b40c1c25e1caa3d86cdd12e5e919c/wheel-0.35.1-py2.py3-none-any.whl
Collecting astor>=0.6.0 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/c3/88/97eef84f48fa04fbd6750e62dcceafba6c63c81b7ac1420856c8dcc0a3f9/astor-0.8.1-py2.py3-none-any.whl
Collecting tensorboard<1.15.0,>=1.14.0 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/91/2d/2ed263449a078cd9c8a9ba50ebd50123adf1f8cfbea1492f9084169b89d9/tensorboard-1.14.0-py3-none-any.whl (3.1MB)
    100% |████████████████████████████████| 3.2MB 521kB/s 
Collecting keras-preprocessing>=1.0.5 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/79/4c/7c3275a01e12ef9368a892926ab932b33bb13d55794881e3573482b378a7/Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42kB)
    100% |████████████████████████████████| 51kB 6.7MB/s 
Collecting termcolor>=1.1.0 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/8a/48/a76be51647d0eb9f10e2a4511bf3ffb8cc1e6b14e9e4fab46173aa79f981/termcolor-1.1.0.tar.gz
Collecting gast>=0.2.0 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/b6/48/583c032b79ae5b3daa02225a675aeb673e58d2cb698e78510feceb11958c/gast-0.4.0-py3-none-any.whl
Collecting wrapt>=1.11.1 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/82/f7/e43cefbe88c5fd371f4cf0cf5eb3feccd07515af9fd6cf7dbf1d1793a797/wrapt-1.12.1.tar.gz
Collecting tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/3c/d5/21860a5b11caf0678fbc8319341b0ae21a07156911132e0e71bffed0510d/tensorflow_estimator-1.14.0-py2.py3-none-any.whl (488kB)
    100% |████████████████████████████████| 491kB 1.7MB/s 
Collecting grpcio>=1.8.6 (from tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/e3/0e/f56aa1f8200ae3c5d38305e69f5920caa480c7ff54ae4d8a5f57d1d69fa4/grpcio-1.31.0.tar.gz (20.0MB)
    100% |████████████████████████████████| 20.0MB 89kB/s 
Collecting soupsieve>1.2 (from beautifulsoup4->gtts>=2.0.1->plato==0.2)
  Downloading https://files.pythonhosted.org/packages/6f/8f/457f4a5390eeae1cc3aeab89deb7724c965be841ffca6cfca9197482e470/soupsieve-2.0.1-py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests->gtts>=2.0.1->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/5e/c4/6c4fe722df5343c33226f0b4e0bb042e4dc13483228b4718baf286f86d87/certifi-2020.6.20-py2.py3-none-any.whl
Collecting chardet<4,>=3.0.2 (from requests->gtts>=2.0.1->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->gtts>=2.0.1->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/9f/f0/a391d1463ebb1b233795cabfc0ef38d3db4442339de68f847026199e69d7/urllib3-1.25.10-py2.py3-none-any.whl
Collecting idna<3,>=2.5 (from requests->gtts>=2.0.1->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/a2/38/928ddce2273eaa564f6f50de919327bf3a00f091b5baba8dfa9460f3a8a8/idna-2.10-py2.py3-none-any.whl
Collecting joblib>=0.11 (from scikit-learn->ludwig>=0.2.1->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/51/dd/0e015051b4a27ec5a58b02ab774059f3289a94b0906f880a3f9507e74f38/joblib-0.16.0-py3-none-any.whl
Collecting threadpoolctl>=2.0.0 (from scikit-learn->ludwig>=0.2.1->plato==0.2)
  Downloading https://files.pythonhosted.org/packages/f7/12/ec3f2e203afa394a149911729357aa48affc59c20e2c1c8297a60f33f133/threadpoolctl-2.1.0-py3-none-any.whl
Collecting werkzeug>=0.11.15 (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/cc/94/5f7079a0e00bd6863ef8f1da638721e9da21e5bacee597595b318f71d62e/Werkzeug-1.0.1-py2.py3-none-any.whl (298kB)
    100% |████████████████████████████████| 307kB 3.1MB/s 
Collecting markdown>=2.6.8 (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/a4/63/eaec2bd025ab48c754b55e8819af0f6a69e2b1e187611dd40cbbe101ee7f/Markdown-3.2.2-py3-none-any.whl (88kB)
    100% |████████████████████████████████| 92kB 5.3MB/s 
Collecting importlib-metadata; python_version < "3.8" (from markdown>=2.6.8->tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/8e/58/cdea07eb51fc2b906db0968a94700866fc46249bdc75cac23f9d13168929/importlib_metadata-1.7.0-py2.py3-none-any.whl
Collecting zipp>=0.5 (from importlib-metadata; python_version < "3.8"->markdown>=2.6.8->tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->plato==0.2)
  Cache entry deserialization failed, entry ignored
  Using cached https://files.pythonhosted.org/packages/b2/34/bfcb43cc0ba81f527bc4f40ef41ba2ff4080e047acb0586b56b3d017ace4/zipp-3.1.0-py3-none-any.whl
Building wheels for collected packages: ludwig, gtts-token, termcolor, wrapt, grpcio
  Running setup.py bdist_wheel for ludwig ... error
  Complete output from command /home/username/plato-research-dialogue-system/plato-venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-7d4eyugp/ludwig/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmpaa6yb8ckpip-wheel- --python-tag cp36:
  /usr/lib/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'long_description_content_type'
    warnings.warn(msg)
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help
  
  error: invalid command 'bdist_wheel'
  
  ----------------------------------------
  Failed building wheel for ludwig
  Running setup.py clean for ludwig
  Running setup.py bdist_wheel for gtts-token ... error
  Complete output from command /home/username/plato-research-dialogue-system/plato-venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-7d4eyugp/gtts-token/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmpum_y4mzipip-wheel- --python-tag cp36:
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help
  
  error: invalid command 'bdist_wheel'
  
  ----------------------------------------
  Failed building wheel for gtts-token
  Running setup.py clean for gtts-token
  Running setup.py bdist_wheel for termcolor ... error
  Complete output from command /home/username/plato-research-dialogue-system/plato-venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-7d4eyugp/termcolor/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmpdp62dmp8pip-wheel- --python-tag cp36:
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help
  
  error: invalid command 'bdist_wheel'
  
  ----------------------------------------
  Failed building wheel for termcolor
  Running setup.py clean for termcolor
  Running setup.py bdist_wheel for wrapt ... error
  Complete output from command /home/username/plato-research-dialogue-system/plato-venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-7d4eyugp/wrapt/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmppctuhnkqpip-wheel- --python-tag cp36:
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help
  
  error: invalid command 'bdist_wheel'
  
  ----------------------------------------
  Failed building wheel for wrapt
  Running setup.py clean for wrapt
  Running setup.py bdist_wheel for grpcio ... error
  Complete output from command /home/username/plato-research-dialogue-system/plato-venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-7d4eyugp/grpcio/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmppva3hsswpip-wheel- --python-tag cp36:
  Found cython-generated files...
  usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: -c --help [cmd1 cmd2 ...]
     or: -c --help-commands
     or: -c cmd --help
  
  error: invalid command 'bdist_wheel'
  
  ----------------------------------------
  Failed building wheel for grpcio
  Running setup.py clean for grpcio
Failed to build ludwig gtts-token termcolor wrapt grpcio
Installing collected packages: click, soupsieve, beautifulsoup4, six, certifi, chardet, urllib3, idna, requests, gtts-token, gtts, Cython, pyyaml, absl-py, numpy, h5py, pytz, python-dateutil, pandas, scipy, joblib, threadpoolctl, scikit-learn, tabulate, google-pasta, keras-applications, setuptools, protobuf, wheel, astor, grpcio, werkzeug, zipp, importlib-metadata, markdown, tensorboard, keras-preprocessing, termcolor, gast, wrapt, tensorflow-estimator, tensorflow, tqdm, ludwig, pysimplegui, plato
  Running setup.py install for gtts-token ... done

And there are more.....
Ideas?

@jadeye
Copy link

jadeye commented Aug 25, 2020

I googled and experimented with solutions.
Still got errors of different kinds...
Here's what worked for me:

Command "/home/username/plato-research-dialogue-system/plato-venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-yft6k6uf/grpcio/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-nclm1mg8-record/install-record.txt --single-version-externally-managed --compile --install-headers /home/username/plato-research-dialogue-system/plato-venv/include/site/python3.6/grpcio" failed with error code 1 in /tmp/pip-build-yft6k6uf/grpcio/
(plato-venv) username@username-desktop:~/plato-research-dialogue-system$ python -m pip install --upgrade setuptools
Requirement already up-to-date: setuptools in ./plato-venv/lib/python3.6/site-packages

$ pip3 install --upgrade pip
Cache entry deserialization failed, entry ignored
Collecting pip
  Using cached https://files.pythonhosted.org/packages/5a/4a/39400ff9b36e719bdf8f31c99fe1fa7842a42fa77432e584f707a5080063/pip-20.2.2-py2.py3-none-any.whl
Installing collected packages: pip
  Found existing installation: pip 9.0.1
    Uninstalling pip-9.0.1:
      Successfully uninstalled pip-9.0.1
Successfully installed pip-20.2.2
(plato-venv) username@username-desktop:~/plato-research-dialogue-system$ python3 -m pip install --upgrade setuptools
Requirement already up-to-date: setuptools in ./plato-venv/lib/python3.6/site-packages (49.6.0)


Installing collected packages: termcolor, grpcio, tensorboard, keras-preprocessing, tensorflow-estimator, wrapt, tensorflow, ludwig, pysimplegui, plato
  Running setup.py develop for plato
ERROR: After October 2020 you may experience errors when installing or updating packages. This is because pip will change the way that it resolves dependency conflicts.

We recommend you use --use-feature=2020-resolver to test your packages with the new resolver before it becomes the default.

ludwig 0.2.2.8 requires tensorflow==1.15.3, but you'll have tensorflow 1.14.0 which is incompatible.
Successfully installed grpcio-1.31.0 keras-preprocessing-1.1.2 ludwig-0.2.2.8 plato pysimplegui-4.28.0 tensorboard-1.14.0 tensorflow-1.14.0 tensorflow-estimator-1.14.0 termcolor-1.1.0 wrapt-1.12.1
(plato-venv) username@username-desktop:~/plato-research-dialogue-system$

@jadeye
Copy link

jadeye commented Aug 25, 2020

And to resolve this last issue I executed: pip --use-feature=2020-resolver install -e ..
I am on:
Ubuntu 18.04.5
Python 3.6.9
pip 20.2.2

@papadako
Copy link

Is there any way to disable ludwig support? It seems that current python 3.8 distributions do not support tensorflow 1.15.0 needed by ludwig

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mingfang @jadeye @papadako