Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use named tag of haskellNix, update shell tools. #1820

Merged
merged 7 commits into from
Feb 4, 2025
Merged

Use named tag of haskellNix, update shell tools. #1820

merged 7 commits into from
Feb 4, 2025

Conversation

locallycompact
Copy link
Contributor

@locallycompact locallycompact commented Feb 3, 2025

Named tags of haskellNix make it easier to bisect issues with the underlying nixpkgs and hackage pins.

@locallycompact locallycompact force-pushed the lc/update branch 2 times, most recently from 1021ae2 to 5eea07b Compare February 3, 2025 15:33
@locallycompact locallycompact self-assigned this Feb 3, 2025
Copy link

github-actions bot commented Feb 3, 2025

Transaction cost differences

Script summary

Name Size (Bytes)
νInitial -
νCommit -
νHead -
μHead -
νDeposit -

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
40 - - - -

Commit transaction costs

UTxO Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
54 - - - -

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 - - - - -
2 - - - - -
3 - - - - -
4 - - - - -
5 - - - - -
6 - - - - -
7 - - - - -
8 - - - - -

Cost of Increment Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - $${\color{green}-0.39}$$ $${\color{green}-0.09}$$ $${\color{green}-0.01}$$
37 - - - -

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
40 - - - -

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
34 - - - -

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
27 - - - -

FanOut transaction costs

UTxO, Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
(0, 10) - - - - -
(1, 10) - - - - -
(5, 10) - - - - -
(10, 10) - - - - -
(20, 10) - - - - -
(37, 10) - - - - -

@locallycompact locallycompact force-pushed the lc/update branch 4 times, most recently from 7d20551 to ab67f8e Compare February 4, 2025 06:58
Copy link

github-actions bot commented Feb 4, 2025

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2025-02-04 13:24:01.142130597 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial c8a101a5c8ac4816b0dceb59ce31fc2258e387de828f02961d2f2045 2652
νCommit 61458bc2f297fff3cc5df6ac7ab57cefd87763b0b7bd722146a1035c 685
νHead 0e35115a2c7c13c68ecd8d74e4987c04d4539e337643be20bb3274bd 14756
μHead 57166715eadb8d3135964325c016eea546c21e1c0aae974ca67df9a5* 5541
νDeposit ae01dade3a9c346d5c93ae3ce339412b90a0b8f83f94ec6baa24e30c 1102
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 6091 11.02 3.43 0.53
2 6295 13.22 4.10 0.56
3 6495 15.71 4.88 0.60
5 6898 20.25 6.27 0.66
10 7904 30.97 9.53 0.82
40 13936 98.48 30.25 1.78

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 561 2.44 1.16 0.20
2 742 3.38 1.73 0.22
3 912 4.36 2.33 0.24
5 1280 6.41 3.60 0.28
10 2174 12.13 7.25 0.40
54 10048 98.61 68.52 1.88

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 525 25.64 7.39 0.43
2 113 636 35.93 10.24 0.54
3 171 747 44.67 12.72 0.64
4 228 862 50.66 14.54 0.70
5 283 969 58.90 16.90 0.79
6 339 1081 77.01 21.62 0.98
7 393 1192 86.74 24.38 1.08
8 450 1303 96.39 27.04 1.18

Cost of Increment Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 1797 25.50 8.33 0.50
2 1928 27.07 9.48 0.52
3 2060 28.69 10.65 0.55
5 2339 32.43 13.17 0.61
10 3024 40.91 19.17 0.75
38 7288 97.93 56.26 1.67

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 601 23.99 7.61 0.43
2 799 26.94 9.08 0.47
3 930 28.50 10.18 0.49
5 1224 31.86 12.43 0.55
10 1962 41.38 18.39 0.70
40 6327 99.77 54.48 1.63

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 601 30.25 9.37 0.49
2 826 33.55 11.23 0.54
3 1020 33.47 11.96 0.55
5 1332 40.56 15.56 0.65
10 2031 47.82 21.25 0.78
32 5537 94.90 51.42 1.53

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 670 35.99 11.01 0.55
2 838 38.15 12.33 0.58
3 966 40.28 13.63 0.62
5 1288 46.04 16.87 0.70
10 2012 57.29 23.69 0.87
27 4471 97.94 47.69 1.48

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 5984 28.16 9.29 0.71
2 6160 38.43 12.73 0.82
3 6215 46.68 15.39 0.91
4 6359 56.36 18.55 1.02
5 6564 67.78 22.40 1.15
6 6728 77.27 25.52 1.25
7 6840 87.68 29.01 1.37
8 6963 97.37 32.13 1.47
9 6956 98.58 32.51 1.49

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTXO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
10 0 0 6091 20.78 6.84 0.64
10 1 57 6125 22.25 7.45 0.65
10 5 285 6261 30.51 10.66 0.75
10 20 1140 6771 62.46 23.05 1.12
10 30 1710 7113 84.03 31.40 1.37
10 36 2048 7313 96.35 36.21 1.51

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2025-02-04 13:27:48.655084947 UTC

Baseline Scenario

Number of nodes 1
Number of txs 300
Avg. Confirmation Time (ms) 4.345312430
P99 7.705150319999984ms
P95 5.3341553ms
P50 4.1335285ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 900
Avg. Confirmation Time (ms) 24.483058797
P99 51.37171623999996ms
P95 35.86587825ms
P50 21.8674645ms
Number of Invalid txs 0

Copy link

github-actions bot commented Feb 4, 2025

Test Results

  5 files  ±0  165 suites  ±0   31m 49s ⏱️ +29s
563 tests ±0  561 ✅ ±0  2 💤 ±0  0 ❌ ±0 
565 runs  ±0  563 ✅ ±0  2 💤 ±0  0 ❌ ±0 

Results for commit 3458f51. ± Comparison against base commit 1eb69fd.

♻️ This comment has been updated with latest results.

@locallycompact locallycompact requested a review from a team February 4, 2025 08:10
Copy link
Contributor

@noonio noonio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks fine; but need to understand and explain why the script sizes and such have changed.

Can you please investigate and let us know why? Thanks!

@locallycompact
Copy link
Contributor Author

The script sizes have changed because this is rebased on top of the aiken upgrade. #1816

@noonio noonio added this pull request to the merge queue Feb 4, 2025
Merged via the queue into master with commit 907d979 Feb 4, 2025
27 checks passed
@noonio noonio deleted the lc/update branch February 4, 2025 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Done ✔
Development

Successfully merging this pull request may close these issues.

2 participants