Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

smoke-test: add sanchonet #1287

Merged
merged 2 commits into from
Feb 6, 2024
Merged

smoke-test: add sanchonet #1287

merged 2 commits into from
Feb 6, 2024

Conversation

locallycompact
Copy link
Contributor

@locallycompact locallycompact commented Feb 5, 2024

Add sanchonet to the list of smoke-test configurations
Add --sanchonet to hydra-cluster binary.


  • CHANGELOG updated or not needed
  • Documentation updated or not needed
  • Haddocks updated or not needed
  • No new TODOs introduced or explained herafter

Copy link

github-actions bot commented Feb 5, 2024

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-02-06 12:17:38.229901954 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 985245919fcc6c0c5cd116023cd2c947c43e80dcbb5075fe12433fbb 4072
νCommit 7cb20fa71eb4c563ca283566ebe0aa65859d96c3f8cba35c52c181fd 2043
νHead 7a36661f5c15e9f1783aeaab890812c59b7286cbbc6de762d3110772 8816
μHead 8b111ac12274e46314769295a1c5dcab1d260096fc469fd698065463* 3851
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 4374 10.67 4.13 0.46
2 4576 12.68 4.88 0.49
3 4774 15.02 5.77 0.52
5 5177 19.22 7.35 0.59
10 6184 30.39 11.59 0.75
41 12417 99.19 37.67 1.77

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 534 11.37 4.44 0.30
2 721 15.04 6.07 0.35
3 909 18.85 7.75 0.40
5 1287 26.90 11.27 0.51
10 2218 49.55 20.97 0.80
19 3906 99.43 41.75 1.43

Cost of CollectCom Transaction

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 480 21.07 8.25 0.40
2 114 594 34.11 13.43 0.55
3 170 700 48.64 19.28 0.71
4 228 814 61.40 24.58 0.86
5 282 920 79.35 31.89 1.06
6 339 1031 91.80 37.30 1.21

Cost of Close Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 547 16.68 7.67 0.36
2 540 16.23 6.92 0.36
3 858 19.85 10.62 0.43
5 1023 21.60 12.46 0.46
10 1907 30.00 20.27 0.62
50 7719 88.98 75.79 1.76

Cost of Contest Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 566 20.23 8.96 0.40
2 757 22.22 10.67 0.44
3 897 23.75 12.03 0.47
5 1223 27.26 15.09 0.53
10 2088 36.50 23.17 0.70
47 7597 99.04 77.90 1.85

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4307 19.07 8.19 0.55
2 4475 31.97 13.93 0.71
3 4602 41.97 18.21 0.82
4 4728 59.85 26.14 1.03
5 4854 79.19 34.65 1.25

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4205 7.84 3.28 0.42
5 1 57 4240 8.94 3.99 0.44
5 5 284 4374 13.77 7.00 0.50
5 10 569 4545 19.71 10.73 0.59
5 20 1140 4885 32.43 18.53 0.76
5 30 1705 5223 44.52 26.07 0.93
5 40 2276 5563 56.83 33.70 1.10
5 50 2847 5905 69.14 41.34 1.27
5 74 4213 6718 98.50 59.60 1.67

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2024-02-06 12:20:18.040828991 UTC

Baseline Scenario

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 22.918880806
P99 117.56579817000002ms
P95 33.16002979999999ms
P50 19.516705ms
Number of Invalid txs 0

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 3.855440646
P99 10.016768169999978ms
P95 4.404645349999999ms
P50 3.650329ms
Number of Invalid txs 0

Copy link

github-actions bot commented Feb 5, 2024

Test Results

409 tests  +1   401 ✅ ±0   13m 1s ⏱️ +25s
138 suites ±0     8 💤 +1 
  5 files   ±0     0 ❌ ±0 

Results for commit 9de790c. ± Comparison against base commit 7ae45ba.

♻️ This comment has been updated with latest results.

@locallycompact locallycompact changed the title WIP: smoke-test: add sanchonet smoke-test: add sanchonet Feb 6, 2024
@locallycompact locallycompact force-pushed the lc/sanchonet branch 3 times, most recently from 53e72e4 to d0f3144 Compare February 6, 2024 12:11
@locallycompact locallycompact merged commit 0684dbe into master Feb 6, 2024
21 checks passed
@locallycompact locallycompact deleted the lc/sanchonet branch February 6, 2024 14:15
@ch1bo ch1bo linked an issue Feb 6, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Smoke tests on Sanchonet
2 participants