Cannot Install LuisaRenderPy

[Yzhang367]

Trying Genesis has really excited me and the greate integrated functions do help a lot in simulation and RL. What made me a little frustrated was that LuisaRender could not run. As a beginner in ray tracing render, I genuinely want to try the LuisaRender in Genesis.

CPU: 13th Gen Intel(R) Core(TM) i9-13980HX
GPU: GeForce RTX 4060 Laptop
Memory: 16GB
OS: Ubuntu24.04

I followed the doc step by step. Everything went well until this step:

cd genesis/ext/LuisaRender
cmake -S . -B build -D CMAKE_BUILD_TYPE=Release -D PYTHON_VERSIONS=3.9 -D LUISA_COMPUTE_DOWNLOAD_NVCOMP=ON # remember to check python version
cmake --build build -j $(nproc)

Then warning messages as follows came out:
1.

CMake Warning at src/compute/scripts/validate_options.cmake:70 (message):
  The DirectX backend is not available.  The DirectX backend will be
  disabled.
Call Stack (most recent call first):
  src/compute/scripts/validate_options.cmake:80 (report_feature_not_available)
  src/compute/CMakeLists.txt:53 (include)


CMake Warning at src/compute/scripts/validate_options.cmake:70 (message):
  The Metal backend is not available.  The Metal backend will be disabled.
Call Stack (most recent call first):
  src/compute/scripts/validate_options.cmake:91 (report_feature_not_available)
  src/compute/CMakeLists.txt:53 (include)

But this message might only matter on Windows or Macs.
2.

-- Found CUDAToolkit: /home/yzhang/.conda/envs/genesis/targets/x86_64-linux/include;/home/yzhang/.conda/envs/genesis/include (found version "12.6.20") 
CMake Warning at src/compute/src/backends/cuda/CMakeLists.txt:149 (message):
  NVTT not found! Please install NVTT from
  https://developer.nvidia.com/nvidia-texture-tools-exporter and set the
  CMake NVTT_DIR variable to the folder containing nvtt*.dll (e.g.
  C:\Program Files\NVIDIA Corporation\NVIDIA Texture Tools) .


CMake Warning at src/compute/src/backends/cuda/CMakeLists.txt:156 (message):
  NVTT_DIR didn't contain an NVTT shared library of the form nvtt*.dll or
  libnvtt.so.*! Is NVTT_DIR set correctly? NVTT_DIR was


CMake Error at src/apps/CMakeLists.txt:12 (find_package):
  By not providing "Findpybind11.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "pybind11",
  but CMake did not find one.

  Could not find a package configuration file provided by "pybind11" with any
  of the following names:

    pybind11Config.cmake
    pybind11-config.cmake

  Add the installation prefix of "pybind11" to CMAKE_PREFIX_PATH or set
  "pybind11_DIR" to a directory containing one of the above files.  If
  "pybind11" provides a separate development package or SDK, be sure it has
  been installed.


-- Configuring incomplete, errors occurred!

I have tried a two ways to install NVTT but all failed. First, I downloaded the .tar.gz file from the official website but it didn't have a CMakeList.txt. Then I tried to download https://github.com/castano/nvidia-texture-tools and perform cmake install, but I came across errors might relate to CUDA.

I wonder if there was substitution for NVTT or if LuisaRender could run without NVTT.

[zswang666]

NVTT is warning. The main error is pybind11. Please check FAQ.

pip install -e ".[render]"

or

pip install "pybind11[global]"

[OIEIEIO]

Rewritten for my Ubuntu 24 setup

Note installation path for LuisaRenderPy

(genesis2) jorge@jorge-X99:~/Genesis/examples/rendering$ python demo.py --vis

import torch
import importlib.util
import genesis as gs
import os

# Function to load LuisaRenderPy dynamically
def load_luisarenderpy():
    luisa_path = "/home/jorge/Genesis/genesis/ext/LuisaRender/build/bin/LuisaRenderPy.cpython-310-x86_64-linux-gnu.so"
    if not os.path.exists(luisa_path):
        raise ImportError(f"LuisaRenderPy not found at {luisa_path}")

    spec = importlib.util.spec_from_file_location("LuisaRenderPy", luisa_path)
    module = importlib.util.module_from_spec(spec)
    spec.loader.exec_module(module)
    print(f"[INFO] Successfully loaded LuisaRenderPy from {luisa_path}")
    return module

# Load LuisaRenderPy
LuisaRenderPy = load_luisarenderpy()

def main():
    ########################## Initialize Genesis ##########################
    gs.init(seed=0, precision="32", logging_level="debug")
    print("[INFO] Genesis initialized successfully.")

    ########################## Create a Scene ##########################
    try:
        scene = gs.Scene(
            sim_options=gs.options.SimOptions(),
            viewer_options=gs.options.ViewerOptions(
                res=(1920, 1080),
                camera_pos=(8.5, 0.0, 4.5),
                camera_lookat=(3.0, 0.0, 0.5),
                camera_fov=50,
            ),
            rigid_options=gs.options.RigidOptions(enable_collision=False, gravity=(0, 0, 0)),
            renderer=gs.renderers.RayTracer(  # type: ignore
                env_surface=gs.surfaces.Emission(
                    emissive_texture=gs.textures.ImageTexture(
                        image_path="textures/indoor_bright.png",
                    ),
                ),
                env_radius=15.0,
                env_euler=(0, 0, 180),
                lights=[
                    {"pos": (0.0, 0.0, 10.0), "radius": 3.0, "color": (15.0, 15.0, 15.0)},
                ],
            ),
        )
        print("[INFO] Scene successfully created.")
    except Exception as e:
        print(f"[ERROR] Failed to create scene: {e}")
        return

    ########################## Add Materials and Entities ##########################
    # Floor
    scene.add_entity(
        morph=gs.morphs.Plane(pos=(0.0, 0.0, -0.5)),
        surface=gs.surfaces.Aluminium(ior=10.0),
    )

    # Various spheres with different materials
    materials = [
        ("meshes/sphere.obj", -3, (1.0, 0.5, 0.5)),
        ("meshes/sphere.obj", -1.8, (1.0, 1.0, 1.0)),
        ("meshes/sphere.obj", -0.6, (0.6, 0.8, 1.0)),
        ("meshes/sphere.obj", 0.6, "Iron"),
        ("meshes/sphere.obj", 1.8, "Gold"),
        ("meshes/sphere.obj", 3.0, "Glass"),
        ("meshes/sphere.obj", -3, (1.0, 1.0, 1.0, 0.5)),
    ]
    for file, pos, material in materials:
        scene.add_entity(
            morph=gs.morphs.Mesh(file=file, scale=0.5, pos=(0.0, pos, 0.0)),
            surface=(
                gs.surfaces.Rough(color=material)
                if isinstance(material, tuple)
                else getattr(gs.surfaces, material)(color=(1.0, 1.0, 1.0))
            ),
        )

    ########################## Add Cameras ##########################
    cam_0 = scene.add_camera(
        res=(1600, 900),
        pos=(8.5, 0.0, 1.5),
        lookat=(3.0, 0.0, 0.7),
        fov=60,
        GUI=True,
        spp=512,
    )

    ########################## Build and Render Scene ##########################
    scene.build()
    print("[INFO] Scene setup complete.")

    horizon = 2000
    scene.reset()
    for i in range(horizon):
        scene.step()
        cam_0.render()

if __name__ == "__main__":
    main()