Skip to content

Latest commit

 

History

History
26 lines (23 loc) · 4.67 KB

ROADMAP.md

File metadata and controls

26 lines (23 loc) · 4.67 KB
Raw

Kube-Burner Roadmap

This document is meant to define high-level plans for the kube-burner project and is neither complete nor prescriptive. Following are a list of enhancements that we are planning to work on adding support to our application. Each and every action item is tracked using github issues.

  • [RFE Enhancement] Funtionality to compare kube-burner collected metrics to detect regressions automatically.
  • [RFE Enhancement] Provide index subcommand for OCP wrapper. This will enable us to do an automated discovery and helps us fetch cluster metadata without any manual intervention.
  • [RFE Enhancement] Check if the cluster image-registry is up and running prior running workload with builds and stop the benchmark by logging the status message. Especially useful for bare metal use cases where the internal registry is not configured by default.
  • [RFE Enhancement] To improvise our error handling and index metrics locally in case of failed run. This will help us to debug/investigate the root cause for repetitive failures.
  • [RFE Enhancement] Create directories with unique name for local indexing instead of overriding the same for every run.
  • [RFE Enhancement] Check if ingress controller is up & running prior running a workload with routes and stop the benchmark by logging the status message. Especially useful for some of the workloads in OCP wrapper.
  • [RFE Enhancement] To simplify index subcommand usage by removing the need for a config file. Parameters should be minimal and should go through CLI.
  • [RFE Optimization] Improve client-go retry logic to continuously retry for creating resources until the benchmark job timeout.
  • [RFE Enhancement] A new workload with cluster maximums for OCP.
  • [RFE Enhancement] Use the current working directory to get configuration files and run the workload. Similar RFE.
  • [RFE Enhancement] Add a global waitWhenFinished flag to wait until all the resources in all our jobs are created and are in running state instead of doing it per job.
  • [RFE Enhancement] A standalone measure command to just fetch measurements of a workload.
  • [RFE Enhancement] Functionality to capture prometheus dump inspired by promdump tool.
  • [RFE CI/CD] To have unit tests implemented in place as our application is growing continously.
  • [RFE Enhancement] To improve measurement calculations in benchmark by considering resources only specific to our run in the entire cluster.
  • [RFE Enhancement] Ability to check if the ingress controller is up and running in a workload that contains routes.
  • [RFE Enhancement] Add measurements around persistent volume lifecycles along with pod/vmi latencies and pprof metrics that we have currently.
  • [RFE Enhancement] Ship grafana dashboards used to represent indexed metrics along with --reporting mode.
  • [RFE Enhancement] Add failure reason of a benchmark in the local indexing results. Or else to look for an option to back propagate the error to upper level i.e just before the benchmark exits.
  • [RFE Enhancement] To have an option to audit our own execution, and help our users understand if a run is valid or not. This would be really useful in scenarios where there is an environmental problem in our system under test.
  • [RFE enhancement] Add storage control plane related scenarios to ocp wrapper. An additional functionality that creates PVCs, bind them to PVs, mount them in pods and finally reclaims them.