Skip to content
Back to pull request #2630

CUDA-graph-compatible releasing and resuming KV cache and model weight memory #3532

Sign in to view logs

CUDA-graph-compatible releasing and resuming KV cache and model weight memory

CUDA-graph-compatible releasing and resuming KV cache and model weight memory #3532

performance-test-1-gpu-part-2

performance-test-1-gpu-part-2
succeeded Dec 31, 2024 in 11m 25s