Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrated Week 2 #599

Draft
wants to merge 115 commits into
base: develop
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
115 commits
Select commit Hold shift + click to select a range
7b83563
Add support for Detections and DetectionBenchmarks
MichaelBurgess Nov 5, 2024
234328e
Add missing changes from integrated-2024 branch
MichaelBurgess Nov 22, 2024
bacfb2c
Upgrade UI packages
MichaelBurgess Nov 22, 2024
4d343b0
Add missing file
MichaelBurgess Nov 22, 2024
e7944be
Add default column support for tables. Closes #567. (#584)
MichaelBurgess Nov 22, 2024
f5ad67c
Update pipe-fittings branch to tp
MichaelBurgess Nov 22, 2024
5f9d6fe
Add display_columns to Detection
kaidaguerre Nov 22, 2024
22ded81
Add snapshot tag to display_columns
kaidaguerre Nov 22, 2024
de61c63
Show display_columns only
MichaelBurgess Nov 24, 2024
bd84c01
Upgrade UI dependencies
MichaelBurgess Nov 25, 2024
41cd094
Remove references property from Detection
kaidaguerre Nov 26, 2024
9d07d77
Allow multiple benchmarks/controls to be filtered/grouped on a single…
MichaelBurgess Nov 26, 2024
b10bdf5
Remove legacy diff code
MichaelBurgess Nov 26, 2024
ed7a572
Improve date/time handling on custom date range input
MichaelBurgess Nov 26, 2024
75db070
Add support for filtering by benchmark severity. Closes #595. (#596)
MichaelBurgess Nov 27, 2024
cb2e33c
Add support for equal / not_equal / in / not_in filters. Closes #594.…
MichaelBurgess Nov 27, 2024
3b62e61
Upgrade UI dependencies and prettify code
MichaelBurgess Nov 28, 2024
e3ad79a
Fix filtering and grouping for dynamic keys like tags & dimensions
MichaelBurgess Nov 28, 2024
74df642
Show documentation in Benchmark UI. Closes #591. (#602)
MichaelBurgess Nov 28, 2024
1a87a1e
add documentation to leaf run
kaidaguerre Nov 28, 2024
4a9e61f
Ensure documentation for detections flows through the UI grouping logic
MichaelBurgess Nov 29, 2024
3341690
Merge pull request #603 from turbot/detection_documentation
kaidaguerre Nov 29, 2024
77ed24e
date_range input should not require a SQL query. Closes #568 (#593)
kaidaguerre Nov 29, 2024
faddb65
Improve dashboard search performance
MichaelBurgess Nov 29, 2024
6e341ef
Combine snap / open button into single split button. Closes #606.
MichaelBurgess Nov 29, 2024
6753585
Add DashboardLeafNodeImpl and NodeAndEdgeProviderImpl (#586)
kaidaguerre Dec 4, 2024
81ceb45
tactical - remove detection_benchmark block and parse into DetectionB…
kaidaguerre Nov 28, 2024
6a446fa
optimise detection benchmark run to not recreate init data
kaidaguerre Nov 29, 2024
102edfb
Update available dashboards payload to use Benchmarks rather than Det…
MichaelBurgess Dec 3, 2024
a199245
Add benchmark_type to benchmark panels
kaidaguerre Dec 3, 2024
aef9ff2
fix list and show for detection benchmarks
kaidaguerre Dec 3, 2024
2c74e1d
UI WIP
MichaelBurgess Dec 3, 2024
304fcc3
Fix grouping
MichaelBurgess Dec 3, 2024
56a7980
Fix BenchmarkType for check runs
kaidaguerre Dec 4, 2024
a6d143f
do not set type to "detection" for DetectionBenchmark as this leaks i…
kaidaguerre Dec 4, 2024
229fa9e
Various UI fixes
MichaelBurgess Dec 4, 2024
82e9df1
Ensure custom date picker is rendered in a portal so that it will alw…
MichaelBurgess Dec 5, 2024
4da89a0
Fix crash when first clicking custom date calendar
MichaelBurgess Dec 5, 2024
ad19c1d
Rename check to grouping in dashboard UI
MichaelBurgess Nov 5, 2024
3139454
WIP for making detections a supported resource
MichaelBurgess Nov 6, 2024
cb9248d
Add DateTimeRange Picker for Detetction Benchmark
Darkness4ever Nov 6, 2024
5f85396
Show root detection dashboards in dashboard list
MichaelBurgess Nov 6, 2024
6675c50
Working detection benchmark with table results
MichaelBurgess Nov 6, 2024
f0c90ae
Add severity support
MichaelBurgess Nov 7, 2024
fe2de01
dashboard input values now passed using InputValues struct
kaidaguerre Nov 8, 2024
e719328
Add DetectionChart to panel
Darkness4ever Nov 8, 2024
44e7c34
dashboard inputs are now passed using InputValues struct, which also …
kaidaguerre Nov 8, 2024
5647995
Add execution flow
MichaelBurgess Nov 8, 2024
6752c46
Fix UI crash
MichaelBurgess Nov 8, 2024
042b128
GetConnectionString returns error
kaidaguerre Nov 8, 2024
17b53a6
Add table scroll and panel alligment and sapce
Darkness4ever Nov 8, 2024
2159c3c
Add Loading Indicator for Panel Status
Darkness4ever Nov 8, 2024
3939adf
Moved summary chart
MichaelBurgess Nov 8, 2024
b2a4982
Init date range to 1d
MichaelBurgess Nov 8, 2024
46f820b
Fix date range init bug
MichaelBurgess Nov 8, 2024
2729356
Fix relative time bug
MichaelBurgess Nov 8, 2024
a44eb4f
Add tailwind css styling to DateRangePicker
Darkness4ever Nov 8, 2024
7cd9ead
Close custom pop up when clicked outside
Darkness4ever Nov 8, 2024
1040c00
More filtering tweaks
MichaelBurgess Nov 8, 2024
cd83eb6
Add hover to preset dates and Date Picker
Darkness4ever Nov 9, 2024
b18ba46
Highlight custom when non-preset relative unit selected
MichaelBurgess Nov 9, 2024
0143e48
Remove animation on date button hover
Darkness4ever Nov 9, 2024
0934d58
Tweaks
MichaelBurgess Nov 9, 2024
c432ef1
Show all severity cards
MichaelBurgess Nov 9, 2024
49483e3
delete test mod
kaidaguerre Nov 11, 2024
93a00cb
fix dashboard test
pskrbasu Nov 11, 2024
f8b59dc
Add CheckGrouping story
MichaelBurgess Nov 11, 2024
8c973bb
Add CheckGrouping story
MichaelBurgess Nov 11, 2024
49345aa
Fix bug
MichaelBurgess Nov 11, 2024
4f53cf2
Add panel type
MichaelBurgess Nov 11, 2024
b3dad9f
Add Diff to Cards
Darkness4ever Nov 11, 2024
1cbc8b2
Diff charts
MichaelBurgess Nov 11, 2024
7d91bdb
Fix dashboard crash in card
MichaelBurgess Nov 12, 2024
60b5ae5
Fix dashboard crash in card
MichaelBurgess Nov 12, 2024
e198caa
wip: snapshot diff - checkpoint initial wiring
graza-io Nov 12, 2024
0eed9ae
Add diff to result set
Darkness4ever Nov 12, 2024
251efcd
Add support for chart diffing
MichaelBurgess Nov 12, 2024
64a27b7
Add diff for SingleSeries Line Chart
Darkness4ever Nov 12, 2024
57a5af2
wip: snapshot diff - checkpoint
graza-io Nov 12, 2024
9ef86aa
wip: snapshot diff - checkpoint
graza-io Nov 12, 2024
225aa36
Add table diffing
MichaelBurgess Nov 12, 2024
53c4884
wip: loading snapshot changes
graza-io Nov 13, 2024
c3ed25c
Initial sending of diff request via web socket
MichaelBurgess Nov 13, 2024
521dcf5
Add Diff Changes for column, area and pie
Darkness4ever Nov 13, 2024
6994bea
Increase max socket message size
MichaelBurgess Nov 13, 2024
f049d79
wip: snapshot diff - checkpoint(inserting)
graza-io Nov 13, 2024
ef648c8
wip: started parsing diffs
graza-io Nov 13, 2024
9febd78
wip: started parsing diffs - updated to get new values in correct place
graza-io Nov 13, 2024
f333220
Fix card diffs to work with new format
MichaelBurgess Nov 13, 2024
c6c92ae
snapshot diffs - wip
graza-io Nov 13, 2024
7e9129b
Fix cards to work in new format
MichaelBurgess Nov 13, 2024
f3a58f8
Add diif to CheckSummary and CheckNode
Darkness4ever Nov 13, 2024
759c54d
Fix aggregation logic for summary
MichaelBurgess Nov 13, 2024
0201567
Logging
MichaelBurgess Nov 13, 2024
7807566
Fix benchmark summary cards
MichaelBurgess Nov 13, 2024
2aea296
Add Diff to CheckSummary
Darkness4ever Nov 13, 2024
7777ef9
Add __diff to CheckResult
MichaelBurgess Nov 13, 2024
4eae852
Load diff'd snapshot into UI
MichaelBurgess Nov 13, 2024
d0ccf8a
added 'attribute' to dashboard table column
graza-io Nov 14, 2024
0a15606
Fix bug showing dashboard list when we should not
MichaelBurgess Nov 14, 2024
e499143
Fix down to zero bug
MichaelBurgess Nov 14, 2024
ca4f720
Redirect to correct path
MichaelBurgess Nov 14, 2024
edeb1e3
Diff for CheckPanel
Darkness4ever Nov 14, 2024
4b84c4f
Fix up number change when not in diff mode
MichaelBurgess Nov 14, 2024
1b9078c
Add SpiltSnapButton
Darkness4ever Nov 14, 2024
1296f52
Remove Diff from Snapshot header
Darkness4ever Nov 14, 2024
c590e8e
Fixes for charts
MichaelBurgess Nov 14, 2024
915bcdb
Fix card
MichaelBurgess Nov 14, 2024
a83cdcf
Styling
MichaelBurgess Nov 14, 2024
3ef25e4
Fixes after rebase
MichaelBurgess Nov 28, 2024
ed5cb24
Remove unused code
MichaelBurgess Dec 4, 2024
a94c65b
Add diff to split snapshot button
MichaelBurgess Dec 5, 2024
c9af2a9
Upgrade UI dependencies
MichaelBurgess Dec 5, 2024
3ed631c
Remove noisy logging
MichaelBurgess Dec 5, 2024
ec22480
Initial commit for updating diffing logic to the `powerpipe snapshot …
sidr0cker Dec 11, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
88 changes: 44 additions & 44 deletions .github/workflows/01-powerpipe-pre-release.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ jobs:
with:
repository: turbot/pipe-fittings
path: pipe-fittings
ref: v1.6.x
ref: tp

# this is required, check golangci-lint-action docs
- uses: actions/setup-go@v5
Expand Down Expand Up @@ -330,56 +330,56 @@ jobs:
docker stop amazonlinux-2023-test
docker rm amazonlinux-2023-test

smoke_test_ubuntu_24_arm64:
name: Smoke test (Ubuntu 24, ARM64)
runs-on: ubuntu-latest
needs: [goreleaser]
steps:
- name: Checkout
uses: actions/checkout@v4

- name: Download Linux Build Artifact
uses: actions/download-artifact@v3
with:
name: build-artifact-linux-arm
path: ./artifacts
# smoke_test_ubuntu_24_arm64:
# name: Smoke test (Ubuntu 24, ARM64)
# runs-on: ubuntu-latest
# needs: [goreleaser]
# steps:
# - name: Checkout
# uses: actions/checkout@v4

# - name: Download Linux Build Artifact
# uses: actions/download-artifact@v3
# with:
# name: build-artifact-linux-arm
# path: ./artifacts

- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3
# - name: Set up Docker Buildx
# uses: docker/setup-buildx-action@v3

- name: Set up QEMU
uses: docker/setup-qemu-action@v3
with:
platforms: arm64
# - name: Set up QEMU
# uses: docker/setup-qemu-action@v3
# with:
# platforms: arm64

- name: Create Buildx Builder
run: |
docker buildx create --use --name mybuilder
docker buildx inspect --bootstrap
# - name: Create Buildx Builder
# run: |
# docker buildx create --use --name mybuilder
# docker buildx inspect --bootstrap

- name: Pull Ubuntu 24 ARM64 Image
run: docker pull arm64v8/ubuntu:latest
# - name: Pull Ubuntu 24 ARM64 Image
# run: docker pull arm64v8/ubuntu:latest

- name: Create and Start Ubuntu 24 ARM64 Container
run: |
docker run -d --name ubuntu-24-arm64-test -v ${{ github.workspace }}/artifacts:/artifacts -v ${{ github.workspace }}/scripts:/scripts arm64v8/ubuntu:latest tail -f /dev/null
# - name: Create and Start Ubuntu 24 ARM64 Container
# run: |
# docker run -d --name ubuntu-24-arm64-test -v ${{ github.workspace }}/artifacts:/artifacts -v ${{ github.workspace }}/scripts:/scripts arm64v8/ubuntu:latest tail -f /dev/null

- name: Get runner/container info
run: |
docker exec ubuntu-24-arm64-test /scripts/linux_container_info.sh
# - name: Get runner/container info
# run: |
# docker exec ubuntu-24-arm64-test /scripts/linux_container_info.sh

- name: Install dependencies, create user, and assign necessary permissions
run: |
docker exec ubuntu-24-arm64-test /scripts/prepare_ubuntu_container.sh
# - name: Install dependencies, create user, and assign necessary permissions
# run: |
# docker exec ubuntu-24-arm64-test /scripts/prepare_ubuntu_container.sh

- name: Run smoke tests
run: |
docker exec -u steampipe ubuntu-24-arm64-test /scripts/smoke_test.sh
# - name: Run smoke tests
# run: |
# docker exec -u steampipe ubuntu-24-arm64-test /scripts/smoke_test.sh

- name: Stop and Remove Container
run: |
docker stop ubuntu-24-arm64-test
docker rm ubuntu-24-arm64-test
# - name: Stop and Remove Container
# run: |
# docker stop ubuntu-24-arm64-test
# docker rm ubuntu-24-arm64-test

smoke_test_darwin_amd:
name: Smoke test (MacOS 13, x86_64)
Expand Down Expand Up @@ -421,7 +421,7 @@ jobs:

build_assets:
name: Build and Release Dashboard Assets
needs: [acceptance_test, smoke_test_ubuntu_24, smoke_test_centos_9, smoke_test_amazonlinux, smoke_test_ubuntu_24_arm64, smoke_test_darwin_amd]
needs: [acceptance_test, smoke_test_ubuntu_24, smoke_test_centos_9, smoke_test_amazonlinux, smoke_test_darwin_amd]
runs-on: ubuntu-latest
outputs:
version: ${{ steps.set_version.outputs.version }}
Expand Down Expand Up @@ -558,7 +558,7 @@ jobs:
with:
repository: turbot/pipe-fittings
path: pipe-fittings
ref: v1.6.x
ref: tp

- name: Tag Release
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/10-test-lint.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ jobs:
with:
repository: turbot/pipe-fittings
path: pipe-fittings
ref: develop
ref: tp

# this is required, check golangci-lint-action docs
- uses: actions/setup-go@v5
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/11-test-acceptance.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ jobs:
with:
repository: turbot/pipe-fittings
path: pipe-fittings
ref: develop
ref: tp

# this is required, check golangci-lint-action docs
- uses: actions/setup-go@v5
Expand Down
2 changes: 0 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,6 @@ _Whats new_
- Optimize workspace load time for large workspaces with multiple dependent mods. ([#365](https://github.com/turbot/pipe-fittings/issues/365))

## v0.1.1 [2024-03-07]

_Bug fixes_
* Fix CLI available version check. ([#250](https://github.com/turbot/powerpipe/issues/250))
* Notify when `mod install` creates a default mod. ([#246](https://github.com/turbot/powerpipe/issues/246))
Expand All @@ -116,7 +115,6 @@ _Bug fixes_


## v0.1.0 [2024-03-06]

Introducing Powerpipe - Dashboards for DevOps.

*Benchmarks* - 5,000+ open-source controls from CIS, NIST, PCI, HIPAA, FedRamp and more. Run instantly on your machine or as part of your deployment pipeline.
Expand Down
39 changes: 21 additions & 18 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ require (
github.com/xlab/treeprint v1.2.0 // indirect
github.com/zclconf/go-cty v1.14.4
github.com/zclconf/go-cty-yaml v1.0.3 // indirect
golang.org/x/exp v0.0.0-20240222234643-814bf88cf225
golang.org/x/exp v0.0.0-20240909161429-701f63a606c0
sigs.k8s.io/yaml v1.4.0 // indirect
)

Expand All @@ -44,17 +44,18 @@ require (
github.com/jackc/pgx/v5 v5.6.0
github.com/jedib0t/go-pretty/v6 v6.5.9
github.com/logrusorgru/aurora v2.0.3+incompatible
github.com/marcboeker/go-duckdb v1.7.1
github.com/marcboeker/go-duckdb v1.8.3
github.com/mattn/go-sqlite3 v1.14.22
github.com/r3labs/diff/v3 v3.0.1
github.com/thediveo/enumflag/v2 v2.0.5
golang.org/x/sync v0.8.0
golang.org/x/text v0.17.0
golang.org/x/text v0.19.0
gopkg.in/olahol/melody.v1 v1.0.0-20170518105555-d52139073376
)

require (
cloud.google.com/go v0.112.1 // indirect
cloud.google.com/go/compute/metadata v0.3.0 // indirect
cloud.google.com/go/compute/metadata v0.5.0 // indirect
cloud.google.com/go/iam v1.1.6 // indirect
cloud.google.com/go/storage v1.38.0 // indirect
dario.cat/mergo v1.0.0 // indirect
Expand All @@ -67,7 +68,7 @@ require (
github.com/acarl005/stripansi v0.0.0-20180116102854-5a71ef0e047d // indirect
github.com/agext/levenshtein v1.2.3 // indirect
github.com/allegro/bigcache/v3 v3.1.0 // indirect
github.com/apache/arrow/go/v17 v17.0.0 // indirect
github.com/apache/arrow-go/v18 v18.0.0 // indirect
github.com/apparentlymart/go-cidr v1.1.0 // indirect
github.com/apparentlymart/go-textseg/v15 v15.0.0 // indirect
github.com/aws/aws-sdk-go v1.44.183 // indirect
Expand Down Expand Up @@ -124,7 +125,7 @@ require (
github.com/go-playground/universal-translator v0.18.1 // indirect
github.com/goccy/go-json v0.10.3 // indirect
github.com/goccy/go-yaml v1.11.2 // indirect
github.com/golang/glog v1.2.1 // indirect
github.com/golang/glog v1.2.2 // indirect
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/golang/mock v1.6.0 // indirect
github.com/golang/protobuf v1.5.4 // indirect
Expand Down Expand Up @@ -162,7 +163,7 @@ require (
github.com/jmespath/go-jmespath v0.4.0 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/kevinburke/ssh_config v1.2.0 // indirect
github.com/klauspost/compress v1.17.9 // indirect
github.com/klauspost/compress v1.17.11 // indirect
github.com/klauspost/cpuid/v2 v2.2.8 // indirect
github.com/leodido/go-urn v1.4.0 // indirect
github.com/magiconair/properties v1.8.7 // indirect
Expand Down Expand Up @@ -213,6 +214,8 @@ require (
github.com/twitchyliquid64/golang-asm v0.15.1 // indirect
github.com/ugorji/go/codec v1.2.12 // indirect
github.com/ulikunitz/xz v0.5.10 // indirect
github.com/vmihailenco/msgpack/v5 v5.3.5 // indirect
github.com/vmihailenco/tagparser/v2 v2.0.0 // indirect
github.com/xanzy/ssh-agent v0.3.3 // indirect
github.com/yusufpapurcu/wmi v1.2.2 // indirect
github.com/zeebo/xxh3 v1.0.2 // indirect
Expand All @@ -230,21 +233,21 @@ require (
go.opentelemetry.io/proto/otlp v1.2.0 // indirect
go.uber.org/multierr v1.10.0 // indirect
golang.org/x/arch v0.8.0 // indirect
golang.org/x/crypto v0.24.0 // indirect
golang.org/x/mod v0.18.0 // indirect
golang.org/x/net v0.26.0 // indirect
golang.org/x/oauth2 v0.21.0 // indirect
golang.org/x/sys v0.21.0 // indirect
golang.org/x/term v0.21.0 // indirect
golang.org/x/crypto v0.28.0 // indirect
golang.org/x/mod v0.21.0 // indirect
golang.org/x/net v0.30.0 // indirect
golang.org/x/oauth2 v0.22.0 // indirect
golang.org/x/sys v0.26.0 // indirect
golang.org/x/term v0.25.0 // indirect
golang.org/x/time v0.5.0 // indirect
golang.org/x/tools v0.22.0 // indirect
golang.org/x/tools v0.26.0 // indirect
golang.org/x/xerrors v0.0.0-20231012003039-104605ab7028 // indirect
google.golang.org/api v0.171.0 // indirect
google.golang.org/genproto v0.0.0-20240227224415-6ceb2ff114de // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20240604185151-ef581f913117 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20240604185151-ef581f913117 // indirect
google.golang.org/grpc v1.66.0 // indirect
google.golang.org/protobuf v1.34.2 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20240814211410-ddb44dafa142 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20240903143218-8af14fe29dc1 // indirect
google.golang.org/grpc v1.67.1 // indirect
google.golang.org/protobuf v1.35.1 // indirect
gopkg.in/ini.v1 v1.67.0 // indirect
gopkg.in/warnings.v0 v0.1.2 // indirect
gopkg.in/yaml.v2 v2.4.0 // indirect
Expand Down
Loading