Failed building wheel for transformer-engine

[RuslanSel]

Ubuntu 18.04
python 3.11.5
conda
pip install --upgrade git+https://github.com/NVIDIA/TransformerEngine.git@stable
...
...
[ 79%] Building CXX object common/CMakeFiles/transformer_engine.dir/util/cuda_driver.cpp.o
/tmp/pip-req-build-j223vg5e/transformer_engine/common/util/cuda_driver.cpp:8:10: fatal error: filesystem: No such file or directory
#include
^~~~~~~~~~~~

Thanks in advance.

[ptrendx]

You need a C++ compiler that supports C++17 to build TE and I assume that the version of GCC that is shipped with Ubuntu 18.04 is too old for that. According to the GCC feature list support for filesystem from C++17 was added in GCC 8.1. Could you try with at least that version?

[Zhihan1996]

Hello, did you figure out the issue? I am facing the same issue with cmake 3.28/3.29/3.30 and gcc 12.4.

[timmoon10]

This error message suggests that your compiler does not have C++17 support. You should first try building with verbose output so that we can see what compiler command is being run:

cd transformer_engine
pip install -v -v -v .

This will spit out a lot of info, so you'll need to search for where cuda_driver.cpp is being compiled. Some possible outcomes:

• CMake is not compiling with GCC 12.4, but is using an older compiler. Set CXX in the environment to tell CMake what C++ compiler you want to use.
• CMake is using the right compiler, but is not enabling C++17 support (look for -std=c++17 or -std=gnu++17 flags). This would be very strange since we explicity tell CMake to use C++17:

  TransformerEngine/transformer_engine/common/CMakeLists.txt

  Line 11 in a132ac4

  set(CMAKE_CXX_STANDARD 17)

• CMake is using the right compiler and has enabled C++17. This would be even stranger.

See #355 (comment) for more guidance on build errors.