-
Notifications
You must be signed in to change notification settings - Fork 253
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test the output of ScubaGear's basic commands #1538
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just added some follow-ups to previous comments, but overall looks good to go.
# Stop the workflow if logging into Azure failed. | ||
if: ${{ success() }} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure the comment lines up with the step. Since this makes the run conditional, on a fail, won't it just skip the step to get vault info, but continue running other steps?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ah, you are correct. Comment fixed.
$ExpectedName = 'ScubaGear' | ||
$ExpectedDescription = 'The Secure Cloud Business Applications (SCuBA) Gear module automates conformance testing about CISA M365 Secure Configuration Baselines.' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's a DRY thing. If we decided to change the name of the tool to ScubaSomethingElse, and it was read from the manifest then you wouldn't need to update the workflow to match. So that's why I think it makes more sense. Even if it's only for some of the things at the moment.
🗣 Description
Added tests for checking the textual outputs that result from running ScubaGear's most basic commands:
The idea is to add additional checks to make sure SG is running as expected.
💭 Motivation and context
Closes #1490
🧪 Testing
The tests for Initialize-Scuba can be found by running the workflow pipeline and checking under Workflow Units Tests for the Pester Test called "Describing Initialize-ScubaGear Output Check." There should be 3 successful tests:
The tests for Install-Module can be found by running the nightly functional tests (test_production_function.yaml), finding the first job (publish package/private repo), and checking under Initialize ScubaGear. There should not be any errors that start with:
These would create annotation errors, so they should be easy to see.
✅ Pre-approval checklist
I did do some extra cleaning up while wandering around, like fixing input parameter for function help comments, removing random newlines, and setting better outputing.
✅ Pre-merge checklist
PR passed smoke test check.
Feature branch has been rebased against changes from parent branch, as needed
Use
Rebase branch
button below or use this reference to rebase from the command line.Resolved all merge conflicts on branch
Notified merge coordinator that PR is ready for merge via comment mention
Demonstrate changes to the team for questions and comments.
(Note: Only required for issues of size
Medium
or larger)✅ Post-merge checklist