[FEATURE] K3s Node Auto Scaler

[rrmistry]

Business problem trying to be solved

In our cloud hosted solution we rely on Kubernetes node auto scaler to solve capacity problems. Our use case depends on bursting compute for simulation and modelling.

Node auto scaler is great for production but not cost effective for development locally or in a shared k3d/k3s cluster.

We are looking for k3d to provide a native way to experience auto scale for k3s node-level containers such that the overall k3s kubernetes functionality is closer to managed kubernetes systems.

Scope of your request

We need...

• a new flag for a command (e.g. k3d cluster create --<auto-scaler-flag>)
  • Set minimum, maximum, metric (cpu/mem/network), and threshold
  • Same to be configurable via k3d config file

Describe the solution you'd like

K3d to create k3s node containers whenever an existing node container experiences cpu/memory pressures.

K3d to destroy k3s node containers whenever threshold is reached, as configured via k3d CLI or config file.

Alternatives we've considered

Do this ourselves by orchestrating pods writhin k3s that monitor node pressures and make API calls to an external service that then calls K3d CLI to modify Node counts.

[mjekrami]

Any updates on this issue ?