Installing TE is so hard.

[ZihaoZheng98]

Meeting problems such as

File "/TransformerEngine/build_tools/build_ext.py", line 91, in _build_cmake raise RuntimeError(f"Error when running CMake: {e}") RuntimeError: Error when running CMake: Command '['/usr/local/lib/python3.10/dist-packages/cmake/data/bin/cmake', '-S', '/TransformerEngine/transformer_engine/common', '-B', '/TransformerEngine/build/cmake', '-DPython_EXECUTABLE=/usr/bin/python3.10', '-DPython_INCLUDE_DIR=/usr/include/python3.10', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_INSTALL_PREFIX=/TransformerEngine/build/lib.linux-x86_64-3.10', '-DCMAKE_CUDA_ARCHITECTURES=70;80;89;90', '-Dpybind11_DIR=/usr/local/lib/python3.10/dist-packages/pybind11/share/cmake/pybind11', '-GNinja']' returned non-zero exit status 1.

and ninja -v

[timmoon10]

#355 (comment)

[wplf]

The real problem shows above.

[ZihaoZheng98]

Thanks, I will have a try. @wplf @timmoon10

[klhhhhh]

I agreed!!! 😮‍💨

[saurabh-kataria]

Following works for me after trying several combinations:

export TMPDIR=/tmp && export CMAKE_TEMP_DIR=/tmp && export BUILD_DIR=/tmp/build
mkdir -p $TMPDIR && mkdir -p $CMAKE_TEMP_DIR && mkdir -p $BUILD_DIR
TMP_DIR=$TMPDIR MAX_JOBS=1 CUDA_HOME=$CUDA_HOME CUDNN_PATH=$CUDNN_PATH CC=$CC CXX=$CXX pip -v install --cache-dir /tmp/pip-cache --no-deps git+https://github.com/NVIDIA/TransformerEngine.git@stable --no-deps

where your env vars are something like below

export CC=$GCCPATH/bin/gcc
export CXX=$GCCPATH/bin/g++
export CUDA_HOME=/home/$USER/cuda-12.3
export CUDNN_PATH=/home/$USER/cudnn-9.2.0/usr