Cache gpu_alloc_map
in Redis, and Add RescanGPUAllocMaps
mutation
#3392
Milestone
gpu_alloc_map
in Redis, and Add RescanGPUAllocMaps
mutation
#3392
Motivation
gpu_alloc_map
exists on the agent, querying this field requires an RPC call.In a production environment with multiple agents, repeatedly querying this field is inefficient and can significantly slow down response time.
Required Features
gpu_alloc_map
in Redis and create a new mutation based on a background task to update the cache.Impact
Testing Scenarios
gpu_alloc_map
for all agents is cached once the task is completed.The text was updated successfully, but these errors were encountered: