[https://nvbugs/6329052][fix] Add attn_backend: FLASHINFER and model_kwargs: {num_hidden_layers: 4} to…#15464

tensorrt-cicd wants to merge 2 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

tensorrt-cicd:repair-bot-bug6329052tensorrt-cicd/TensorRT-LLM:repair-bot-bug6329052Copy head branch name to clipboard