Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

prototype: delayed precommit #3737

Draft
wants to merge 129 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 55 commits
Commits
Show all changes
129 commits
Select commit Hold shift + click to select a range
dd31ca6
checks the target size against the max block size
staheri14 Jul 8, 2024
810bf33
removes unnecessary usage of Printf for logs
staheri14 Jul 8, 2024
d09f00f
adds benchtest with latency
staheri14 Jul 8, 2024
0d9abd0
adds ReadBlockchainInfo
staheri14 Jul 8, 2024
48adbef
retrieves block metadata
staheri14 Jul 8, 2024
423a8db
reads block headers in E2ESimple
staheri14 Jul 8, 2024
48a7014
updates log messages
staheri14 Jul 8, 2024
3b87baa
resolves linter issues
staheri14 Jul 8, 2024
8ee445f
increase seq count per txclient in E2ESimple
staheri14 Jul 8, 2024
3af0a79
expands on the godoc
staheri14 Jul 8, 2024
71655d5
Merge branch 'sanaz/perf-improvement-blockchain-read' into sanaz/test…
staheri14 Jul 9, 2024
e4e5333
includes LargeNetworkBigBlock64MBLatency in the list of available tests
staheri14 Jul 9, 2024
b7896f3
sets txsim volume to 0
staheri14 Jul 9, 2024
d09f96e
reads the entire history
staheri14 Jul 10, 2024
2909d2e
extends wait time
staheri14 Jul 11, 2024
0f218bb
updates read blockchain info
staheri14 Jul 11, 2024
22f6f1f
refactors the implementation
staheri14 Jul 11, 2024
0901d09
swaps info with headers
staheri14 Jul 11, 2024
c7bede7
minor doc fix
staheri14 Jul 11, 2024
070101e
deletes print statements
staheri14 Jul 11, 2024
b52cb08
retracts old waiting values
staheri14 Jul 11, 2024
8ae64a3
fix a bug
staheri14 Jul 11, 2024
c89ac2c
updates some of the comments for clarity
staheri14 Jul 11, 2024
9a240c9
Merge branch 'sanaz/perf-improvement-blockchain-read' into sanaz/test…
staheri14 Jul 11, 2024
9be6048
adds network test with latency and 8 MB block size
staheri14 Jul 11, 2024
074bea1
extends wait time for genesis nodes to sync
staheri14 Jul 11, 2024
c925179
adds a prefix
staheri14 Jul 12, 2024
222d45d
extends test duration
staheri14 Jul 12, 2024
af001b2
reduces sequences to 1
staheri14 Jul 12, 2024
7497714
manifest of next experiment
staheri14 Jul 12, 2024
bb76a42
points to the new core version
staheri14 Jul 25, 2024
09fc929
Merge branch 'main' into sanaz/test-w-latency
staheri14 Jul 25, 2024
8406e61
Merge branch 'sanaz/test-w-latency' into sanaz/delayed-precommit
staheri14 Jul 25, 2024
71cfbd6
uses custom app version for validators
staheri14 Jul 25, 2024
a77bc2a
uses go1.22.5
staheri14 Jul 25, 2024
b39bb9a
modifies manifet for gradual increase in block size
staheri14 Jul 25, 2024
2ed2cf8
updates go.mod
staheri14 Jul 26, 2024
7311c41
changes celestia-app version for validators
staheri14 Jul 26, 2024
777e9c4
downgrades go version
staheri14 Jul 26, 2024
6c75aa7
adds a prefix to test chainid
staheri14 Jul 26, 2024
59aee0a
points to the newer version of core with fixes
staheri14 Jul 29, 2024
38ae783
sets tx client version to the same PR
staheri14 Jul 29, 2024
b88fb79
sets chain id inside the test
staheri14 Jul 29, 2024
44ac183
bumps core version
staheri14 Jul 30, 2024
144a1e0
prepares network test with latency
staheri14 Jul 30, 2024
5d05084
points to a version of core that tracks precommit time
staheri14 Jul 31, 2024
9bbe7b3
points to a version of core that does not shorten wait time
staheri14 Jul 31, 2024
df8f868
increases chain id prefix counter
staheri14 Jul 31, 2024
9a29e92
breaks start into smaller methods
staheri14 Jul 31, 2024
70ddeb9
refactors benchamrk Run
staheri14 Jul 31, 2024
fd0aa9c
fixes linter complaints
staheri14 Jul 31, 2024
26bad96
removes excess new line
staheri14 Jul 31, 2024
3c33477
Merge branch 'sanaz/apply-latency-immediately' into sanaz/delayed-pre…
staheri14 Jul 31, 2024
4e6299a
bumps chain id counter prefix
staheri14 Jul 31, 2024
9b89f0d
Merge remote-tracking branch 'origin/main' into sanaz/delayed-precommit
staheri14 Aug 1, 2024
c667a27
another test setup
staheri14 Aug 2, 2024
2783e13
adds the next test manifest
staheri14 Aug 2, 2024
ffc585a
bumps chain id and timeout propose
staheri14 Aug 6, 2024
b744d23
bumps chain id
staheri14 Aug 6, 2024
0c8203a
retracts old chain id
staheri14 Aug 6, 2024
516827e
wip
staheri14 Aug 6, 2024
6da3840
bumps core version
staheri14 Aug 6, 2024
9ba0a22
bumps core
staheri14 Aug 6, 2024
4b7d3f6
bumps core
staheri14 Aug 7, 2024
7e5c45c
Merge remote-tracking branch 'origin/main' into sanaz/delayed-precommit
staheri14 Aug 8, 2024
f16e4e1
uses old PR for the validators
staheri14 Aug 8, 2024
605623a
reset experimental configs
staheri14 Aug 8, 2024
ec77b1a
bumps core version
staheri14 Aug 8, 2024
2692e38
deletes unused comment
staheri14 Aug 8, 2024
616c50f
retracts old amount of txclient volume
staheri14 Aug 8, 2024
b2ecf87
bumps core
staheri14 Aug 9, 2024
de68c0a
bumps chain id counter
staheri14 Aug 9, 2024
bafb2ac
updates test manifest for 37th
staheri14 Aug 21, 2024
7eddad5
points to new version of the core
staheri14 Aug 21, 2024
b683c00
points to new version of the core
staheri14 Aug 21, 2024
84ea7b9
Merge branch 'sanaz/delayed-precommit' of github.com:celestiaorg/cele…
staheri14 Aug 21, 2024
2554f6a
Merge branch 'main' into sanaz/delayed-precommit
staheri14 Aug 21, 2024
737d177
adjusts manifest
staheri14 Aug 22, 2024
7c630c2
removes remnants of debugging
staheri14 Aug 22, 2024
a55f1f4
adds the ability to set or unset bbr in e2e tests
staheri14 Aug 23, 2024
5268516
resolves linter issues
staheri14 Aug 23, 2024
0492a82
pass bbr flag for the versions that support it
staheri14 Aug 23, 2024
f47262b
checks against the latest version as well
staheri14 Aug 23, 2024
c9e738f
removes print statements
staheri14 Aug 23, 2024
46dacd7
Merge branch 'main' into sanaz/delayed-precommit
staheri14 Aug 26, 2024
64328e3
does not compare with the bbr version
staheri14 Aug 26, 2024
c3c47b7
bumps core
staheri14 Aug 26, 2024
a9df0b1
bumps core to a version with delay set to 14s
staheri14 Aug 27, 2024
6b9e4f1
Merge remote-tracking branch 'origin/main' into sanaz/disable-bbr-in-…
staheri14 Aug 28, 2024
9265070
adds a parameter to set bbr in the node creation methods instead of u…
staheri14 Aug 28, 2024
5eab0b8
replaces equalOrHigher with isBBRCompatible
staheri14 Aug 28, 2024
fc8adfc
disables BBR for e2e tests
staheri14 Aug 28, 2024
ac5975d
disables bbr on upgrade if applicable
staheri14 Aug 28, 2024
ed8cd89
logs state of nodes while forwarding ports
staheri14 Aug 28, 2024
a92ee08
adds bbr option to the benchmark tests
staheri14 Aug 28, 2024
64cf5ec
removes unused enableBBR parameter from testnet.New
staheri14 Aug 28, 2024
7f2e46f
deletes enableBBR as argument in e2e tests initialization
staheri14 Aug 28, 2024
95822b7
removes an old comment
staheri14 Aug 28, 2024
25ab5a6
renames enableBBR to disableBBR
staheri14 Aug 28, 2024
20c82d5
brings back original number of nodes
staheri14 Aug 28, 2024
366d55a
disables bbr in E2ESimple
staheri14 Aug 28, 2024
46c5799
makes disableBBR parameter ineffective in the Node's Upgrade
staheri14 Aug 28, 2024
9769d08
fixes left-over of refactoring
staheri14 Aug 28, 2024
9256ec6
resolves some of the linter issues
staheri14 Aug 28, 2024
e1eca7b
adds bbr to the chain id
staheri14 Aug 29, 2024
8b374cd
refactors isBBRCompatible
staheri14 Aug 29, 2024
3bb0939
retrieves the old version of Upgrade
staheri14 Aug 29, 2024
c807319
disables bbr for MinorVersionCompatibility
staheri14 Aug 29, 2024
91b91b4
disables BBR in benchmark tests
staheri14 Aug 29, 2024
6b108ad
fixes a bug
staheri14 Aug 29, 2024
6a831a6
deletes args field from Node
staheri14 Aug 30, 2024
2b10f77
Merge remote-tracking branch 'origin/main' into sanaz/disable-bbr-in-…
staheri14 Aug 30, 2024
d2f5eb7
minor formatting fix
staheri14 Aug 30, 2024
7d02543
bums to the core in which the amount of delayed is dynamically set ba…
staheri14 Aug 30, 2024
bb67508
Merge branch 'main' into sanaz/delayed-precommit
staheri14 Aug 30, 2024
82057ea
Merge branch 'sanaz/disable-bbr-in-e2e-tests' into sanaz/delayed-prec…
staheri14 Aug 30, 2024
99e134f
bumps core to the version with the addition of block prop time to the…
staheri14 Aug 30, 2024
35c88cd
removes chain counter
staheri14 Aug 30, 2024
8281216
bumps core to a version with delay precommit as env var
staheri14 Aug 31, 2024
15c37b4
adds env var to the bash script
staheri14 Aug 31, 2024
35e681c
reduces batch size
staheri14 Sep 10, 2024
d4a1d06
bumps core
staheri14 Sep 10, 2024
789b912
bums core to the version that traces proposer of all heights
staheri14 Sep 10, 2024
3c72062
Merge remote-tracking branch 'origin/main' into sanaz/delayed-precommit
staheri14 Sep 10, 2024
2fc3253
updates go.mod and go.sum
staheri14 Sep 10, 2024
06c54dc
Merge remote-tracking branch 'origin/main' into sanaz/delayed-precommit
staheri14 Sep 13, 2024
a082960
updates LargeNetworkBigBlock8MB with another manifest
staheri14 Sep 13, 2024
85ae86b
adds the ability to pass the amount of delay to each validator
staheri14 Sep 13, 2024
e39d9fb
modifies manifest to target block time of 6s
staheri14 Sep 13, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 11 additions & 10 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -94,6 +94,7 @@ require (
github.com/ethereum/c-kzg-4844 v1.0.0 // indirect
github.com/felixge/httpsnoop v1.0.4 // indirect
github.com/fsnotify/fsnotify v1.7.0 // indirect
github.com/go-ini/ini v1.67.0 // indirect
github.com/go-kit/kit v0.12.0 // indirect
github.com/go-kit/log v0.2.1 // indirect
github.com/go-logfmt/logfmt v0.6.0 // indirect
Expand All @@ -104,7 +105,7 @@ require (
github.com/go-openapi/jsonreference v0.20.2 // indirect
github.com/go-openapi/swag v0.22.3 // indirect
github.com/go-playground/validator/v10 v10.11.2 // indirect
github.com/goccy/go-json v0.10.2 // indirect
github.com/goccy/go-json v0.10.3 // indirect
github.com/godbus/dbus v0.0.0-20190726142602-4481cbc300e2 // indirect
github.com/gogo/gateway v1.1.0 // indirect
github.com/golang/glog v1.2.1 // indirect
Expand Down Expand Up @@ -147,8 +148,8 @@ require (
github.com/joho/godotenv v1.5.1 // indirect
github.com/josharian/intern v1.0.0 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/klauspost/compress v1.17.6 // indirect
github.com/klauspost/cpuid/v2 v2.2.7 // indirect
github.com/klauspost/compress v1.17.9 // indirect
github.com/klauspost/cpuid/v2 v2.2.8 // indirect
github.com/klauspost/reedsolomon v1.12.1 // indirect
github.com/lib/pq v1.10.7 // indirect
github.com/libp2p/go-buffer-pool v0.1.0 // indirect
Expand All @@ -161,7 +162,7 @@ require (
github.com/mimoo/StrobeGo v0.0.0-20210601165009-122bf33a46e0 // indirect
github.com/minio/highwayhash v1.0.2 // indirect
github.com/minio/md5-simd v1.1.2 // indirect
github.com/minio/minio-go/v7 v7.0.70 // indirect
github.com/minio/minio-go/v7 v7.0.74 // indirect
github.com/mitchellh/go-homedir v1.1.0 // indirect
github.com/mitchellh/go-testing-interface v1.14.1 // indirect
github.com/mitchellh/mapstructure v1.5.0 // indirect
Expand Down Expand Up @@ -219,13 +220,13 @@ require (
go.opentelemetry.io/proto/otlp v1.1.0 // indirect
go.uber.org/multierr v1.11.0 // indirect
go.uber.org/zap v1.27.0 // indirect
golang.org/x/crypto v0.23.0 // indirect
golang.org/x/net v0.25.0 // indirect
golang.org/x/crypto v0.24.0 // indirect
golang.org/x/net v0.26.0 // indirect
golang.org/x/oauth2 v0.20.0 // indirect
golang.org/x/sync v0.7.0 // indirect
golang.org/x/sys v0.20.0 // indirect
golang.org/x/term v0.20.0 // indirect
golang.org/x/text v0.15.0 // indirect
golang.org/x/sys v0.21.0 // indirect
golang.org/x/term v0.21.0 // indirect
golang.org/x/text v0.16.0 // indirect
golang.org/x/time v0.5.0 // indirect
google.golang.org/api v0.169.0 // indirect
google.golang.org/genproto v0.0.0-20240227224415-6ceb2ff114de // indirect
Expand Down Expand Up @@ -253,5 +254,5 @@ replace (
github.com/cosmos/ledger-cosmos-go => github.com/cosmos/ledger-cosmos-go v0.12.4
github.com/gogo/protobuf => github.com/regen-network/protobuf v1.3.3-alpha.regen.1
github.com/syndtr/goleveldb => github.com/syndtr/goleveldb v1.0.1-0.20210819022825-2ae1ddf74ef7
github.com/tendermint/tendermint => github.com/celestiaorg/celestia-core v1.38.0-tm-v0.34.29
github.com/tendermint/tendermint => github.com/celestiaorg/celestia-core v1.38.0-tm-v0.34.29.0.20240731004513-c544f8a947c2
)
46 changes: 24 additions & 22 deletions go.sum
Original file line number Diff line number Diff line change
Expand Up @@ -318,8 +318,8 @@ github.com/celestiaorg/bittwister v0.0.0-20231213180407-65cdbaf5b8c7 h1:nxplQi8w
github.com/celestiaorg/bittwister v0.0.0-20231213180407-65cdbaf5b8c7/go.mod h1:1EF5MfOxVf0WC51Gb7pJ6bcZxnXKNAf9pqWtjgPBAYc=
github.com/celestiaorg/blobstream-contracts/v3 v3.1.0 h1:h1Y4V3EMQ2mFmNtWt2sIhZIuyASInj1a9ExI8xOsTOw=
github.com/celestiaorg/blobstream-contracts/v3 v3.1.0/go.mod h1:x4DKyfKOSv1ZJM9NwV+Pw01kH2CD7N5zTFclXIVJ6GQ=
github.com/celestiaorg/celestia-core v1.38.0-tm-v0.34.29 h1:HwbA4OegRvXX0aNchBA7Cmu+oIxnH7xRcOhISuDP0ak=
github.com/celestiaorg/celestia-core v1.38.0-tm-v0.34.29/go.mod h1:MyElURdWAOJkOp84WZnfEUJ+OLvTwOOHG2lbK9E8XRI=
github.com/celestiaorg/celestia-core v1.38.0-tm-v0.34.29.0.20240731004513-c544f8a947c2 h1:66MyFXfm7xmhGaadcalR6RbmNS6rhFI9NBAop/+DoSc=
github.com/celestiaorg/celestia-core v1.38.0-tm-v0.34.29.0.20240731004513-c544f8a947c2/go.mod h1:gr8NlCcouMlH2bPBHySRXRXlTEZWLw8UpFyY0seMpR0=
github.com/celestiaorg/cosmos-sdk v1.24.0-sdk-v0.46.16 h1:AlBZS4WykzrwfcNbKD+yQQM1RTMz7lYDC1NS7ClAidM=
github.com/celestiaorg/cosmos-sdk v1.24.0-sdk-v0.46.16/go.mod h1:Bpl1LSWiDpQumgOhhMTZBMopqa0j7fRasIhvTZB44P0=
github.com/celestiaorg/go-square v1.1.0 h1:K4tBL5PCJwDtpBfyDxxZ3N962aC9VYb5/bw3LjagEtY=
Expand Down Expand Up @@ -569,6 +569,8 @@ github.com/go-chi/chi/v5 v5.0.0/go.mod h1:BBug9lr0cqtdAhsu6R4AAdvufI0/XBzAQSsUqJ
github.com/go-gl/glfw v0.0.0-20190409004039-e6da0acd62b1/go.mod h1:vR7hzQXu2zJy9AVAgeJqvqgH9Q5CA+iKCZ2gyEVpxRU=
github.com/go-gl/glfw/v3.3/glfw v0.0.0-20191125211704-12ad95a8df72/go.mod h1:tQ2UAYgL5IevRw8kRxooKSPJfGvJ9fJQFa0TUsXzTg8=
github.com/go-gl/glfw/v3.3/glfw v0.0.0-20200222043503-6f7a984d4dc4/go.mod h1:tQ2UAYgL5IevRw8kRxooKSPJfGvJ9fJQFa0TUsXzTg8=
github.com/go-ini/ini v1.67.0 h1:z6ZrTEZqSWOTyH2FlglNbNgARyHG8oLW9gMELqKr06A=
github.com/go-ini/ini v1.67.0/go.mod h1:ByCAeIL28uOIIG0E3PJtZPDL8WnHpFKFOtgjp+3Ies8=
github.com/go-kit/kit v0.8.0/go.mod h1:xBxKIO96dXMWWy0MnWVtmwkA9/13aqxPnvrjFYMA2as=
github.com/go-kit/kit v0.9.0/go.mod h1:xBxKIO96dXMWWy0MnWVtmwkA9/13aqxPnvrjFYMA2as=
github.com/go-kit/kit v0.10.0/go.mod h1:xUsJbQ/Fp4kEt7AFgCuvyX4a71u8h9jB8tj/ORgOZ7o=
Expand Down Expand Up @@ -622,8 +624,8 @@ github.com/gobwas/pool v0.2.0 h1:QEmUOlnSjWtnpRGHF3SauEiOsy82Cup83Vf2LcMlnc8=
github.com/gobwas/pool v0.2.0/go.mod h1:q8bcK0KcYlCgd9e7WYLm9LpyS+YeLd8JVDW6WezmKEw=
github.com/gobwas/ws v1.0.2 h1:CoAavW/wd/kulfZmSIBt6p24n4j7tHgNVCjsfHVNUbo=
github.com/gobwas/ws v1.0.2/go.mod h1:szmBTxLgaFppYjEmNtny/v3w89xOydFnnZMcgRRu/EM=
github.com/goccy/go-json v0.10.2 h1:CrxCmQqYDkv1z7lO7Wbh2HN93uovUHgrECaO5ZrCXAU=
github.com/goccy/go-json v0.10.2/go.mod h1:6MelG93GURQebXPDq3khkgXZkazVtN9CRI+MGFi0w8I=
github.com/goccy/go-json v0.10.3 h1:KZ5WoDbxAIgm2HNbYckL0se1fHD6rz5j4ywS6ebzDqA=
github.com/goccy/go-json v0.10.3/go.mod h1:oq7eo15ShAhp70Anwd5lgX2pLfOS3QCiwU/PULtXL6M=
github.com/godbus/dbus v0.0.0-20190726142602-4481cbc300e2 h1:ZpnhV/YsD2/4cESfV5+Hoeu/iUR3ruzNvZ+yQfO03a0=
github.com/godbus/dbus v0.0.0-20190726142602-4481cbc300e2/go.mod h1:bBOAhwG1umN6/6ZUMtDFBMQR8jRg9O75tm9K00oMsK4=
github.com/godbus/dbus/v5 v5.0.4/go.mod h1:xhWf0FNVPg57R7Z0UbKHbJfkEywrmjJnf7w5xrFpKfA=
Expand Down Expand Up @@ -928,12 +930,12 @@ github.com/klauspost/compress v1.11.7/go.mod h1:aoV0uJVorq1K+umq18yTdKaF57EivdYs
github.com/klauspost/compress v1.12.3/go.mod h1:8dP1Hq4DHOhN9w426knH3Rhby4rFm6D8eO+e+Dq5Gzg=
github.com/klauspost/compress v1.15.11/go.mod h1:QPwzmACJjUTFsnSHH934V6woptycfrDDJnH7hvFVbGM=
github.com/klauspost/compress v1.17.3/go.mod h1:/dCuZOvVtNoHsyb+cuJD3itjs3NbnF6KH9zAO4BDxPM=
github.com/klauspost/compress v1.17.6 h1:60eq2E/jlfwQXtvZEeBUYADs+BwKBWURIY+Gj2eRGjI=
github.com/klauspost/compress v1.17.6/go.mod h1:/dCuZOvVtNoHsyb+cuJD3itjs3NbnF6KH9zAO4BDxPM=
github.com/klauspost/compress v1.17.9 h1:6KIumPrER1LHsvBVuDa0r5xaG0Es51mhhB9BQB2qeMA=
github.com/klauspost/compress v1.17.9/go.mod h1:Di0epgTjJY877eYKx5yC51cX2A2Vl2ibi7bDH9ttBbw=
github.com/klauspost/cpuid v0.0.0-20170728055534-ae7887de9fa5/go.mod h1:Pj4uuM528wm8OyEC2QMXAi2YiTZ96dNQPGgoMS4s3ek=
github.com/klauspost/cpuid/v2 v2.0.1/go.mod h1:FInQzS24/EEf25PyTYn52gqo7WaD8xa0213Md/qVLRg=
github.com/klauspost/cpuid/v2 v2.2.7 h1:ZWSB3igEs+d0qvnxR/ZBzXVmxkgt8DdzP6m9pfuVLDM=
github.com/klauspost/cpuid/v2 v2.2.7/go.mod h1:Lcz8mBdAVJIBVzewtcLocK12l3Y+JytZYpaMropDUws=
github.com/klauspost/cpuid/v2 v2.2.8 h1:+StwCXwm9PdpiEkPyzBXIy+M9KUb4ODm0Zarf1kS5BM=
github.com/klauspost/cpuid/v2 v2.2.8/go.mod h1:Lcz8mBdAVJIBVzewtcLocK12l3Y+JytZYpaMropDUws=
github.com/klauspost/crc32 v0.0.0-20161016154125-cb6bfca970f6/go.mod h1:+ZoRqAPRLkC4NPOvfYeR5KNOrY6TD+/sAC3HXPZgDYg=
github.com/klauspost/pgzip v1.0.2-0.20170402124221-0bf5dcad4ada/go.mod h1:Ch1tH69qFZu15pkjo5kYi6mth2Zzwzt50oCQKQE9RUs=
github.com/klauspost/reedsolomon v1.12.1 h1:NhWgum1efX1x58daOBGCFWcxtEhOhXKKl1HAPQUp03Q=
Expand Down Expand Up @@ -1011,8 +1013,8 @@ github.com/minio/highwayhash v1.0.2 h1:Aak5U0nElisjDCfPSG79Tgzkn2gl66NxOMspRrKnA
github.com/minio/highwayhash v1.0.2/go.mod h1:BQskDq+xkJ12lmlUUi7U0M5Swg3EWR+dLTk+kldvVxY=
github.com/minio/md5-simd v1.1.2 h1:Gdi1DZK69+ZVMoNHRXJyNcxrMA4dSxoYHZSQbirFg34=
github.com/minio/md5-simd v1.1.2/go.mod h1:MzdKDxYpY2BT9XQFocsiZf/NKVtR7nkE4RoEpN+20RM=
github.com/minio/minio-go/v7 v7.0.70 h1:1u9NtMgfK1U42kUxcsl5v0yj6TEOPR497OAQxpJnn2g=
github.com/minio/minio-go/v7 v7.0.70/go.mod h1:4yBA8v80xGA30cfM3fz0DKYMXunWl/AV/6tWEs9ryzo=
github.com/minio/minio-go/v7 v7.0.74 h1:fTo/XlPBTSpo3BAMshlwKL5RspXRv9us5UeHEGYCFe0=
github.com/minio/minio-go/v7 v7.0.74/go.mod h1:qydcVzV8Hqtj1VtEocfxbmVFa2siu6HGa+LDEPogjD8=
github.com/mitchellh/cli v1.0.0/go.mod h1:hNIlj7HEI86fIcpObd7a0FcrxTWetlwJDGcceTlRvqc=
github.com/mitchellh/go-homedir v1.0.0/go.mod h1:SfyaCUpYCn1Vlf4IUYiD9fPX4A5wJrkLzIz1N1q0pr0=
github.com/mitchellh/go-homedir v1.1.0 h1:lukF9ziXFxDFPkA1vsr5zpc1XuPDn/wFntq5mG+4E0Y=
Expand Down Expand Up @@ -1435,8 +1437,8 @@ golang.org/x/crypto v0.0.0-20201221181555-eec23a3978ad/go.mod h1:jdWPYTVW3xRLrWP
golang.org/x/crypto v0.0.0-20210322153248-0c34fe9e7dc2/go.mod h1:T9bdIzuCu7OtxOm1hfPfRQxPLYneinmdGuTeoZ9dtd4=
golang.org/x/crypto v0.0.0-20210711020723-a769d52b0f97/go.mod h1:GvvjBRRGRdwPK5ydBHafDWAxML/pGHZbMvKqRZ5+Abc=
golang.org/x/crypto v0.0.0-20210921155107-089bfa567519/go.mod h1:GvvjBRRGRdwPK5ydBHafDWAxML/pGHZbMvKqRZ5+Abc=
golang.org/x/crypto v0.23.0 h1:dIJU/v2J8Mdglj/8rJ6UUOM3Zc9zLZxVZwwxMooUSAI=
golang.org/x/crypto v0.23.0/go.mod h1:CKFgDieR+mRhux2Lsu27y0fO304Db0wZe70UKqHu0v8=
golang.org/x/crypto v0.24.0 h1:mnl8DM0o513X8fdIkmyFE/5hTYxbwYOjDS/+rK6qpRI=
golang.org/x/crypto v0.24.0/go.mod h1:Z1PMYSOR5nyMcyAVAIQSKCDwalqy85Aqn1x3Ws4L5DM=
golang.org/x/exp v0.0.0-20180321215751-8460e604b9de/go.mod h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
golang.org/x/exp v0.0.0-20180807140117-3d87b88a115f/go.mod h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
golang.org/x/exp v0.0.0-20190121172915-509febef88a4/go.mod h1:CJ0aWSM057203Lf6IL+f9T1iT9GByDxfZKAQTCR3kQA=
Expand Down Expand Up @@ -1544,8 +1546,8 @@ golang.org/x/net v0.0.0-20220722155237-a158d28d115b/go.mod h1:XRhObCWvk6IyKnWLug
golang.org/x/net v0.0.0-20220909164309-bea034e7d591/go.mod h1:YDH+HFinaLZZlnHAfSS6ZXJJ9M9t4Dl22yv3iI2vPwk=
golang.org/x/net v0.0.0-20221014081412-f15817d10f9b/go.mod h1:YDH+HFinaLZZlnHAfSS6ZXJJ9M9t4Dl22yv3iI2vPwk=
golang.org/x/net v0.1.0/go.mod h1:Cx3nUiGt4eDBEyega/BKRp+/AlGL8hYe7U9odMt2Cco=
golang.org/x/net v0.25.0 h1:d/OCCoBEUq33pjydKrGQhw7IlUPI2Oylr+8qLx49kac=
golang.org/x/net v0.25.0/go.mod h1:JkAGAh7GEvH74S6FOH42FLoXpXbE/aqXSrIQjXgsiwM=
golang.org/x/net v0.26.0 h1:soB7SVo0PWrY4vPW/+ay0jKDNScG2X9wFeYlXIvJsOQ=
golang.org/x/net v0.26.0/go.mod h1:5YKkiSynbBIh3p6iOc/vibscux0x38BZDkn8sCUPxHE=
golang.org/x/oauth2 v0.0.0-20180821212333-d2e6202438be/go.mod h1:N/0e6XlmueqKjAGxoOufVs8QHGRruUQn6yWY3a++T0U=
golang.org/x/oauth2 v0.0.0-20190226205417-e64efc72b421/go.mod h1:gOpvHmFTYa4IltrdGE7lF6nIHvwfUNPOp7c8zoXwtLw=
golang.org/x/oauth2 v0.0.0-20190604053449-0f29369cfe45/go.mod h1:gOpvHmFTYa4IltrdGE7lF6nIHvwfUNPOp7c8zoXwtLw=
Expand Down Expand Up @@ -1701,14 +1703,14 @@ golang.org/x/sys v0.8.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.11.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.12.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
golang.org/x/sys v0.14.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
golang.org/x/sys v0.20.0 h1:Od9JTbYCk261bKm4M/mw7AklTlFYIa0bIp9BgSm1S8Y=
golang.org/x/sys v0.20.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
golang.org/x/sys v0.21.0 h1:rF+pYz3DAGSQAxAu1CbC7catZg4ebC4UIeIhKxBZvws=
golang.org/x/sys v0.21.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
golang.org/x/term v0.0.0-20201117132131-f5c789dd3221/go.mod h1:Nr5EML6q2oocZ2LXRh80K7BxOlk5/8JxuGnuhpl+muw=
golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1/go.mod h1:bj7SfCRtBDWHUb9snDiAeCFNEtKQo2Wmx5Cou7ajbmo=
golang.org/x/term v0.0.0-20210927222741-03fcf44c2211/go.mod h1:jbD1KX2456YbFQfuXm/mYQcufACuNUgVhRMnK/tPxf8=
golang.org/x/term v0.1.0/go.mod h1:jbD1KX2456YbFQfuXm/mYQcufACuNUgVhRMnK/tPxf8=
golang.org/x/term v0.20.0 h1:VnkxpohqXaOBYJtBmEppKUG6mXpi+4O6purfc2+sMhw=
golang.org/x/term v0.20.0/go.mod h1:8UkIAJTvZgivsXaD6/pH6U9ecQzZ45awqEOzuCvwpFY=
golang.org/x/term v0.21.0 h1:WVXCp+/EBEHOj53Rvu+7KiT/iElMrO8ACK16SMZ3jaA=
golang.org/x/term v0.21.0/go.mod h1:ooXLefLobQVslOqselCNF4SxFAaoS6KujMbsGzSDmX0=
golang.org/x/text v0.0.0-20170915032832-14c0d48ead0c/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.0/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.1-0.20180807135948-17ff2d5776d2/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
Expand All @@ -1719,8 +1721,8 @@ golang.org/x/text v0.3.5/go.mod h1:5Zoc/QRtKVWzQhOtBMvqHzDpF6irO9z98xDceosuGiQ=
golang.org/x/text v0.3.6/go.mod h1:5Zoc/QRtKVWzQhOtBMvqHzDpF6irO9z98xDceosuGiQ=
golang.org/x/text v0.3.7/go.mod h1:u+2+/6zg+i71rQMx5EYifcz6MCKuco9NR6JIITiCfzQ=
golang.org/x/text v0.4.0/go.mod h1:mrYo+phRRbMaCq/xk9113O4dZlRixOauAjOtrjsXDZ8=
golang.org/x/text v0.15.0 h1:h1V/4gjBv8v9cjcR6+AR5+/cIYK5N/WAgiv4xlsEtAk=
golang.org/x/text v0.15.0/go.mod h1:18ZOQIKpY8NJVqYksKHtTdi31H5itFRjB5/qKTNYzSU=
golang.org/x/text v0.16.0 h1:a94ExnEXNtEwYLGJSIUxnWoxoRz/ZcCsV63ROupILh4=
golang.org/x/text v0.16.0/go.mod h1:GhwF1Be+LQoKShO3cGOHzqOgRrGaYc9AvblQOmPVHnI=
golang.org/x/time v0.0.0-20180412165947-fbb02b2291d2/go.mod h1:tRJNPiyCQ0inRvYxbN9jk5I+vvW/OXSQhTDSoE431IQ=
golang.org/x/time v0.0.0-20181108054448-85acf8d2951c/go.mod h1:tRJNPiyCQ0inRvYxbN9jk5I+vvW/OXSQhTDSoE431IQ=
golang.org/x/time v0.0.0-20190308202827-9d24e82272b4/go.mod h1:tRJNPiyCQ0inRvYxbN9jk5I+vvW/OXSQhTDSoE431IQ=
Expand Down Expand Up @@ -1793,8 +1795,8 @@ golang.org/x/tools v0.1.3/go.mod h1:o0xws9oXOQQZyjljx8fwUC0k7L1pTE6eaCbjGeHmOkk=
golang.org/x/tools v0.1.4/go.mod h1:o0xws9oXOQQZyjljx8fwUC0k7L1pTE6eaCbjGeHmOkk=
golang.org/x/tools v0.1.5/go.mod h1:o0xws9oXOQQZyjljx8fwUC0k7L1pTE6eaCbjGeHmOkk=
golang.org/x/tools v0.1.12/go.mod h1:hNGJHUnrk76NpqgfD5Aqm5Crs+Hm0VOH/i9J2+nxYbc=
golang.org/x/tools v0.21.0 h1:qc0xYgIbsSDt9EyWz05J5wfa7LOVW0YTLOXrqdLAWIw=
golang.org/x/tools v0.21.0/go.mod h1:aiJjzUbINMkxbQROHiO6hDPo2LHcIPhhQsa9DLh0yGk=
golang.org/x/tools v0.21.1-0.20240508182429-e35e4ccd0d2d h1:vU5i/LfpvrRCpgM/VPfJLg5KjxD3E+hfT1SH+d9zLwg=
golang.org/x/tools v0.21.1-0.20240508182429-e35e4ccd0d2d/go.mod h1:aiJjzUbINMkxbQROHiO6hDPo2LHcIPhhQsa9DLh0yGk=
golang.org/x/xerrors v0.0.0-20190717185122-a985d3407aa7/go.mod h1:I/5z698sn9Ka8TeJc9MKroUUfqBBauWjQqLJ2OPfmY0=
golang.org/x/xerrors v0.0.0-20191011141410-1b5146add898/go.mod h1:I/5z698sn9Ka8TeJc9MKroUUfqBBauWjQqLJ2OPfmY0=
golang.org/x/xerrors v0.0.0-20191204190536-9bdfabe68543/go.mod h1:I/5z698sn9Ka8TeJc9MKroUUfqBBauWjQqLJ2OPfmY0=
Expand Down
2 changes: 2 additions & 0 deletions test/e2e/benchmark/main.go
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@ func main() {
{"LargeNetworkBigBlock8MB", LargeNetworkBigBlock8MB},
{"LargeNetworkBigBlock32MB", LargeNetworkBigBlock32MB},
{"LargeNetworkBigBlock64MB", LargeNetworkBigBlock64MB},
{"LargeNetworkBigBlock64MBLatency", LargeNetworkBigBlock64MBLatency},
{"LargeNetworkBigBlock8MBLatency", LargeNetworkBigBlock8MBLatency},
}

// check the test name passed as an argument and run it
Expand Down
38 changes: 35 additions & 3 deletions test/e2e/benchmark/throughput.go
Original file line number Diff line number Diff line change
Expand Up @@ -109,7 +109,7 @@

func runBenchmarkTest(logger *log.Logger, testName string, manifest Manifest) error {
logger.Println("Running", testName)
manifest.ChainID = manifest.summary()
//manifest.ChainID = "del-" + manifest.summary()

Check failure on line 112 in test/e2e/benchmark/throughput.go

View workflow job for this annotation

GitHub Actions / lint / golangci-lint

commentFormatting: put a space between `//` and comment text (gocritic)
log.Println("ChainID: ", manifest.ChainID)
benchTest, err := NewBenchmarkTest(testName, &manifest)
testnet.NoError("failed to create benchmark test", err)
Expand Down Expand Up @@ -157,8 +157,13 @@
manifest := bigBlockManifest
manifest.MaxBlockBytes = 8 * testnet.MB
manifest.Validators = 50
manifest.TxClients = 50
manifest.BlobSequences = 2
manifest.TxClients = 25
manifest.BlobSequences = 1
manifest.TimeoutCommit = 1 * time.Second
manifest.TimeoutPropose = 10 * time.Second
manifest.CelestiaAppVersion = "pr-3737"
manifest.TxClientVersion = "pr-3737"
manifest.ChainID = "fix-" + manifest.summary()
return runBenchmarkTest(logger, "LargeNetworkBigBlock8MB", manifest)
}

Expand All @@ -179,3 +184,30 @@
manifest.BlobSequences = 2
return runBenchmarkTest(logger, "LargeNetworkBigBlock64MB", manifest)
}

func LargeNetworkBigBlock64MBLatency(logger *log.Logger) error {
manifest := bigBlockManifest
manifest.MaxBlockBytes = 64 * testnet.MB
manifest.Validators = 50
manifest.TxClients = 50
manifest.BlobSequences = 2
manifest.EnableLatency = true
manifest.LatencyParams = LatencyParams{70, 0}
return runBenchmarkTest(logger, "LargeNetworkBigBlock64MBLatency", manifest)
}
func LargeNetworkBigBlock8MBLatency(logger *log.Logger) error {
manifest := bigBlockManifest
manifest.MaxBlockBytes = 8 * testnet.MB
manifest.Validators = 50
manifest.TxClients = 25
manifest.BlobSequences = 1
manifest.TimeoutCommit = 1 * time.Second
manifest.TimeoutPropose = 10 * time.Second
manifest.CelestiaAppVersion = "pr-3737"
manifest.TxClientVersion = "pr-3737"
manifest.EnableLatency = true
manifest.LatencyParams = LatencyParams{70, 0}
manifest.TestDuration = 15 * time.Minute
manifest.ChainID = "3-" + manifest.summary()
return runBenchmarkTest(logger, "LargeNetworkBigBlock8MBLatency", manifest)
}
2 changes: 1 addition & 1 deletion test/e2e/testnet/defaults.go
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ var DefaultResources = Resources{
MemoryRequest: "400Mi",
MemoryLimit: "400Mi",
CPU: "300m",
Volume: "1Gi",
Volume: "0Gi",
staheri14 marked this conversation as resolved.
Show resolved Hide resolved
}

const (
Expand Down
4 changes: 2 additions & 2 deletions test/e2e/testnet/testnet.go
Original file line number Diff line number Diff line change
Expand Up @@ -339,7 +339,7 @@ func (t *Testnet) WaitToSync() error {
if err != nil {
return fmt.Errorf("failed to initialize client for node %s: %w", node.Name, err)
}
for i := 0; i < 10; i++ {
for i := 0; i < 100; i++ {
resp, err := client.Status(context.Background())
if err == nil {
if resp.SyncInfo.LatestBlockHeight > 0 {
Expand All @@ -350,7 +350,7 @@ func (t *Testnet) WaitToSync() error {
} else {
err = errors.New("error getting status")
}
if i == 9 {
if i == 99 {
return fmt.Errorf("failed to start node %s: %w", node.Name, err)
}
log.Info().Str("name", node.Name).Int("attempt", i).Msg(
Expand Down
Loading