XSeg editor does not run on Apple M1 #77

chychkan · 2022-02-23T05:00:22Z

The ./scripts/xseg.sh script fails with the following error:

Traceback (most recent call last):
  File "/Users/alex/Code/chychkan/DeepFaceLab_MacOS/.dfl/DeepFaceLab/main.py", line 343, in <module>
    arguments.func(arguments)
  File "/Users/alex/Code/chychkan/DeepFaceLab_MacOS/.dfl/DeepFaceLab/main.py", line 291, in process_xsegeditor
    from XSegEditor import XSegEditor
  File "/Users/alex/Code/chychkan/DeepFaceLab_MacOS/.dfl/DeepFaceLab/XSegEditor/XSegEditor.py", line 15, in <module>
    from PyQt5.QtCore import *
ModuleNotFoundError: No module named 'PyQt5'

The root cause is that DeepFaceLap codebase is not compatible with PyQt6 which we install on M1 laptops.

The text was updated successfully, but these errors were encountered:

cantonalex · 2022-02-25T14:22:07Z

Is there GPU support?

github-actions · 2022-03-27T14:49:53Z

The issue is tagged as "stale issue" due to no activity in 30 days. If there is no activity for 15 more days, the issue will be closed.

rolandinthedeep · 2022-05-18T04:44:27Z

Bumping this because this isn't working for me too.

@chychkan were you able to find a workaround? I've tried installing python -m pip install PyQt5, but that doesn't seem to work.

chychkan · 2022-05-18T14:01:32Z

@rolandinthedeep yeah, PyQt5 is not compatible with M1 and DeepFaceLab itself is not compatible with PyQt6. One possible path forward could be to upgrade DeepFaceLab to PyQt6, but I didn't have time to look into that.

andrewortwein · 2022-05-29T01:23:59Z

I found PR #5523 that uses PySide6 instead of PyQt. I switched to this and now I'm able to train and use the XSeg editor on my M1 Mac mini!

Steps I followed

Follow all instructions in this repo's README, but stop before you run ./scripts/0_setup.sh
Edit ./scripts/0_setup.sh
1. Change https://github.com/chychkan/DeepFaceLab.git to https://github.com/jkennedyvz/DeepFaceLab.git (the source repo of the PR mentioned above)
2. Change python3 to python3.9 (you may not need to do this, but for some reason I had to do this or else virtualenv would use Python 3.10)
Edit requirements_3.9_arm64.txt
1. Add tensorflow-metal
2. Add PySide6
Run ./scripts/0_setup.sh

Temporary bug and workaround

At this point, you may run into different problems. It appears there is a bug in the latest update to protobuf. To get around this, force a downgrade in your Python environment:

Run source .dfl/env/bin/activate
Run pip install 'protobuf~=3.19.0'
Run deactivate

Notes

I'm completely new to the XSeg editor, so I don't know if it is working 100%. But it does launch, loads my frames, and seems to let me save changes.

ipatpat · 2022-06-10T06:40:25Z

I found PR #5523 that uses PySide6 instead of PyQt. I switched to this and now I'm able to train and use the XSeg editor on my M1 Mac mini!

Steps I followed

Follow all instructions in this repo's README, but stop before you run ./scripts/0_setup.sh

Edit ./scripts/0_setup.sh

Change https://github.com/chychkan/DeepFaceLab.git to https://github.com/jkennedyvz/DeepFaceLab.git (the source repo of the PR mentioned above)

Change python3 to python3.9 (you may not need to do this, but for some reason I had to do this or else virtualenv would use Python 3.10)

Edit requirements_3.9_arm64.txt

Add tensorflow-metal

Add PySide6

Run ./scripts/0_setup.sh

Temporary bug and workaround

At this point, you may run into different problems. It appears there is a bug in the latest update to protobuf. To get around this, force a downgrade in your Python environment:

Run source .dfl/env/bin/activate

Run pip install 'protobuf~=3.19.0'

Run deactivate

Notes

I'm completely new to the XSeg editor, so I don't know if it is working 100%. But it does launch, loads my frames, and seems to let me save changes.

Run on Apple air M1 successfully, Thanks for your effort to fix it.

jeremybarbaud · 2022-08-18T21:19:16Z

Hi,

When I tried with the PR I get this error :
(env) jbarbaud@MacBook-Air-de-Jeremy DeepFaceLab_MacOS % bash scripts/2_extract_images_from_video_data_src.sh
RuntimeError: module compiled against API version 0xf but this version of numpy is 0xe
RuntimeError: module compiled against API version 0xf but this version of numpy is 0xe
ImportError: numpy.core._multiarray_umath failed to import
ImportError: numpy.core.umath failed to import
Process Process-1:
Traceback (most recent call last):
File "/opt/homebrew/Cellar/[email protected]/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
self.run()
File "/opt/homebrew/Cellar/[email protected]/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/DeepFaceLab/core/leras/device.py", line 102, in _get_tf_devices_proc
import tensorflow
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/init.py", line 37, in
from tensorflow.python.tools import module_util as _module_util
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/init.py", line 42, in
from tensorflow.python import data
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/init.py", line 21, in
from tensorflow.python.data import experimental
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/experimental/init.py", line 95, in
from tensorflow.python.data.experimental import service
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/experimental/service/init.py", line 387, in
from tensorflow.python.data.experimental.ops.data_service_ops import distribute
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/experimental/ops/data_service_ops.py", line 22, in
from tensorflow.python.data.experimental.ops import compression_ops
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/experimental/ops/compression_ops.py", line 16, in
from tensorflow.python.data.util import structure
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/util/structure.py", line 22, in
from tensorflow.python.data.util import nest
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/data/util/nest.py", line 36, in
from tensorflow.python.framework import sparse_tensor as _sparse_tensor
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/framework/sparse_tensor.py", line 24, in
from tensorflow.python.framework import constant_op
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/framework/constant_op.py", line 25, in
from tensorflow.python.eager import execute
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/eager/execute.py", line 23, in
from tensorflow.python.framework import dtypes
File "/Users/jbarbaud/DeepFaceLab_MacOS/.dfl/env/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py", line 29, in
_np_bfloat16 = _pywrap_bfloat16.TF_bfloat16_type()
TypeError: Unable to convert function return value to a Python type! The signature was
() -> handle

Did you get that ?
Thank you

ngardelis · 2023-02-27T17:01:04Z

I found PR #5523 that uses PySide6 instead of PyQt. I switched to this and now I'm able to train and use the XSeg editor on my M1 Mac mini!

Steps I followed

Follow all instructions in this repo's README, but stop before you run ./scripts/0_setup.sh

Edit ./scripts/0_setup.sh

Change https://github.com/chychkan/DeepFaceLab.git to https://github.com/jkennedyvz/DeepFaceLab.git (the source repo of the PR mentioned above)

Change python3 to python3.9 (you may not need to do this, but for some reason I had to do this or else virtualenv would use Python 3.10)

Edit requirements_3.9_arm64.txt

Add tensorflow-metal

Add PySide6

Run ./scripts/0_setup.sh

Temporary bug and workaround

At this point, you may run into different problems. It appears there is a bug in the latest update to protobuf. To get around this, force a downgrade in your Python environment:

Run source .dfl/env/bin/activate

Run pip install 'protobuf~=3.19.0'

Run deactivate

Notes

I'm completely new to the XSeg editor, so I don't know if it is working 100%. But it does launch, loads my frames, and seems to let me save changes.

Run on Apple air M1 successfully, Thanks for your effort to fix it.

Hi does it still work? I also got m1 mbp

ngardelis · 2023-02-28T07:46:55Z

Hey @andrewortwein can you tell me which python version you use and all the versions of requirements_3.9_arm64.txt in your working solution? Because for me it works but when I train a model in the training preview, 3 from all 5 columns are grey and never update on each frame for some reason

andrewortwein · 2023-03-05T16:50:30Z

Hey @andrewortwein can you tell me which python version you use and all the versions of requirements_3.9_arm64.txt in your working solution? Because for me it works but when I train a model in the training preview, 3 from all 5 columns are grey and never update on each frame for some reason

It's been many months since I've tried that, but I do still have the env around and here are the settings it's in:

python version: 3.9

#requirements_3.9_arm64.txt
numpy==1.21.4
opencv-python==4.5.5.62
numexpr==2.8.1
h5py==3.1.0
tqdm==4.62.3
colorama==0.4.4
cython==0.29.26
ffmpeg-python==0.2.0
Pillow==8.4.0
scikit-image==0.19.1
scipy==1.8.0
tensorflow-macos==2.7.0
PyQt6==6.2.3
tensorflow-metal

ngardelis · 2023-03-07T18:13:12Z

@andrewortwein Thank you very much, it works for me now!

prashantspandey · 2023-03-15T21:23:05Z

Hey @andrewortwein can you tell me which python version you use and all the versions of requirements_3.9_arm64.txt in your working solution? Because for me it works but when I train a model in the training preview, 3 from all 5 columns are grey and never update on each frame for some reason

My training previews of columns 3 , 5 and 6 are empty. And my loss is also not going down. As if model is not learning , just calculating bunch of stuff.
Did you get any solution?

ngardelis · 2023-03-21T21:01:26Z

Hey @andrewortwein can you tell me which python version you use and all the versions of requirements_3.9_arm64.txt in your working solution? Because for me it works but when I train a model in the training preview, 3 from all 5 columns are grey and never update on each frame for some reason

My training previews of columns 3 , 5 and 6 are empty. And my loss is also not going down. As if model is not learning , just calculating bunch of stuff.

Did you get any solution?

Did you try to run it with SAEHD? The issue for me was I was using quick96 instead of SAEHD

This was referenced Feb 23, 2022

Add support for Apple M1 laptops #71

Merged

Issues with Python dependencies on MacBook M1 Pro #44

Closed

Anyone have this working well on M1? #69

Open

github-actions bot added the stale issue No activity in 30 days label Mar 27, 2022

chychkan removed the stale issue No activity in 30 days label Mar 28, 2022

andrewortwein mentioned this issue May 29, 2022

M1 Mac mini not using metal device "Apple M1" #78

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

XSeg editor does not run on Apple M1 #77

XSeg editor does not run on Apple M1 #77

chychkan commented Feb 23, 2022

cantonalex commented Feb 25, 2022

github-actions bot commented Mar 27, 2022

rolandinthedeep commented May 18, 2022 •

edited

Loading

chychkan commented May 18, 2022

andrewortwein commented May 29, 2022

ipatpat commented Jun 10, 2022

Steps I followed

Temporary bug and workaround

Notes

jeremybarbaud commented Aug 18, 2022

ngardelis commented Feb 27, 2023

Steps I followed

Temporary bug and workaround

Notes

ngardelis commented Feb 28, 2023

andrewortwein commented Mar 5, 2023

ngardelis commented Mar 7, 2023

prashantspandey commented Mar 15, 2023

ngardelis commented Mar 21, 2023

XSeg editor does not run on Apple M1 #77

XSeg editor does not run on Apple M1 #77

Comments

chychkan commented Feb 23, 2022

cantonalex commented Feb 25, 2022

github-actions bot commented Mar 27, 2022

rolandinthedeep commented May 18, 2022 • edited Loading

chychkan commented May 18, 2022

andrewortwein commented May 29, 2022

Steps I followed

Temporary bug and workaround

Notes

ipatpat commented Jun 10, 2022

Steps I followed

Temporary bug and workaround

Notes

jeremybarbaud commented Aug 18, 2022

ngardelis commented Feb 27, 2023

Steps I followed

Temporary bug and workaround

Notes

ngardelis commented Feb 28, 2023

andrewortwein commented Mar 5, 2023

ngardelis commented Mar 7, 2023

prashantspandey commented Mar 15, 2023

ngardelis commented Mar 21, 2023

rolandinthedeep commented May 18, 2022 •

edited

Loading