From a1a05f4b1f8b529f107bf97d31a082147ff5f974 Mon Sep 17 00:00:00 2001 From: Chandrakala Subramanyam Date: Fri, 2 Feb 2024 18:31:06 +0530 Subject: [PATCH 1/2] Initial draft of the test plan Signed-off-by: Chandrakala Subramanyam --- .github/test_plan_template.md | 123 ++++++++++++++++++++++++++++++++++ 1 file changed, 123 insertions(+) create mode 100644 .github/test_plan_template.md diff --git a/.github/test_plan_template.md b/.github/test_plan_template.md new file mode 100644 index 000000000..6c64d2c9c --- /dev/null +++ b/.github/test_plan_template.md @@ -0,0 +1,123 @@ +# TEST PLAN TITLE + +- [INTRODUCTION](#introduction) +- [FEATURES TO BE TESTED](#features-to-be-tested) +- [BUG FIXES TO BE TESTED](#bug-fixes-to-be-tested) +- [TEST ENVIRONMENT](#test-environment) +- [TEST SCHEDULE](#test-schedule) +- [TEST DELIVERABLES](#test-deliverables) + - [New Test Cases Developed](#new-test-cases-developed) + - [Regression Testing](#regresion-testing) +- [SCALABILITY TESTING](#scalability-testing) +- [RELEASE TESTING](#release-testing) +- [TEST METRICS](#test-metrics) +- [RISKS AND CONTINGENCIES](#risks-and-contingencies) +- [APPROVALS](#approvals) + +----- +## INTRODUCTION + +A short concise project description along with any references to the project plan + +---- + +## FEATURES TO BE TESTED +Desription of new features that needs to be tested along with any references + +------ +## BUG FIXES TO BE TESTED +Desription of bug fixes that needs to be tested along with any references + +--- +## TEST ENVIRONMENT + +Are there any special requirements for this test plan, such as: + +* Hardware configuration + +--- +## TEST SCHEDULE + +### Scalability Testing + +Start Date (The date when testing begins) + +End Date (The deadline) + +### Release Testing + +Start Date (The date when testing begins) + +End Date (The deadline) + + +--- + +## TEST DELIVERABLES + +Add references to test deliverables + +### New Test Cases Developed + +| # | ISSUE (NEW FEATURE) | TEST DESCRIPTION | TEST DELIVERABLES | RESULTS | COMMENTS | +| --- | --------- | ---------------- | ----------------- | ----- | --- | +| 1 | | | | | | + + +### Regression Testing + +| # | ISSUE (BUG/NEW FEATURE) | TEST SUITE | RESULTS | COMMENTS | +| --- | --------- | ---------------- | -------- | --- | +| 1 | | | | | + +--- +## SCALABILITY TESTING + +### Scalability Test Strategy + +Evaluate Kruize Scalability on OCP, with 5k and 100k experiments and with the resource usage data for 15 days + +### Scalability Test Cases + +| # | OBJECTIVE | INPUT | EXPECTED RESULTS | ACTUAL RESULTS | COMMENTS | +| --- | --------- | ----- | ---------------- | ----------------- | ------- | +| 1 | | | | | | + +---- +## RELEASE TESTING + +### Release Testing + +As part of the release testing, test the following will be executed: +- [Functional tests](/tests/scripts/remote_monitoring_tests/Remote_monitoring_tests.md) +- [Fault tolerant test](/tests/scripts/remote_monitoring_tests/fault_tolerant_tests.md) +- [Stress test](/tests/scripts/remote_monitoring_tests/README.md) +- [Scalability test (On openshift)](/tests/scripts/remote_monitoring_tests/scalability_test.md) - scalability test with 5000 exps / 15 days usage data + + +| # | TEST SUITE | EXPECTED RESULTS | ACTUAL RESULTS | COMMENTS | +| --- | --------- | ---------------- | -------------- | ---- | +| 1 | | | | | + +--- + +## TEST METRICS + +### Test Completion Criteria + +Define the test completion or exit criteria + +---- +## RISKS AND CONTINGENCIES + +* Lack of availability of required hardware or software +* Delay in delivery of the software +* Requirements or design changes + +---- +## APPROVALS + +Sign-off + +---- + From e8a5dbdf4d03dbce6728d6f2aa4a768dc4183f86 Mon Sep 17 00:00:00 2001 From: Chandrakala Subramanyam Date: Thu, 8 Feb 2024 11:52:07 +0530 Subject: [PATCH 2/2] Updated test exit criteria Signed-off-by: Chandrakala Subramanyam --- .github/test_plan_template.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/.github/test_plan_template.md b/.github/test_plan_template.md index 6c64d2c9c..07a7cf034 100644 --- a/.github/test_plan_template.md +++ b/.github/test_plan_template.md @@ -107,6 +107,13 @@ As part of the release testing, test the following will be executed: Define the test completion or exit criteria +* All must_fix defects identified for the release are fixed +* New features work as expected and tests have been added to validate these +* No new regressions in the functional tests +* 98% functional tests have passed +* All non-functional tests work as expected without major issues +* Documentation updates have been completed + ---- ## RISKS AND CONTINGENCIES