Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metrics: Start to build a set of tests to track progress/regressions #117

Open
grahamwhaley opened this issue Jul 18, 2019 · 4 comments
Open

Comments

@grahamwhaley
Copy link

This is a placeholder/high level view issue. Expect sub-issues to implement/fix/add specific items.

We should start to build up a set of metrics tests that we can run (both in a regular/automated manner via a CI and by hand if necessary) to monitor progress and/or regressions in the stack performance, both due to stack changes and/or underlying OS updates.

We can start with the basic measurements:

  • pod launch times
  • pod footprints
  • pod scaling limits
  • cpu overheads

and then move on to more complex testing:

  • pod response times and availability
  • inter-pod container testing
  • cross-pod testing
  • both storage (volume) and network tests
@grahamwhaley
Copy link
Author

/cc @krsna1729 @mcastelino @obedmr @dklyle @kad

The idea is we will make a new subdir for the tree of tests and support tools.

@mcastelino
Copy link
Contributor

@grahamwhaley please do. This makes perfect sense.

@knangia
Copy link
Contributor

knangia commented Aug 12, 2019

Closing this, since the PR is merged.

@jascott1
Copy link
Contributor

Our bad, re-opening.

@jascott1 jascott1 reopened this Aug 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants