Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove test results from documentation #1832

Merged
merged 1 commit into from
Feb 7, 2025
Merged

Conversation

locallycompact
Copy link
Contributor

No description provided.

@locallycompact locallycompact linked an issue Feb 6, 2025 that may be closed by this pull request
@locallycompact locallycompact force-pushed the lc/remove-test-results branch 3 times, most recently from ec7c01b to 83abf34 Compare February 6, 2025 14:32
Copy link

github-actions bot commented Feb 6, 2025

Transaction cost differences

Script summary

Name Size (Bytes)
νInitial -
νCommit -
νHead -
μHead -
νDeposit -

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
40 - - - -

Commit transaction costs

UTxO Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
54 - - - -

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 - - - - -
2 - - - - -
3 - - - - -
4 - - - - -
5 - - - - -
6 - - - - -
7 - - - - -
8 - - - - -

Cost of Increment Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - +0.39 +0.09 -
5 - - - -
10 - +0.39 +0.09 +0.01
37 - - - -

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
40 - - - -

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
34 - - - -

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 - - - -
2 - - - -
3 - - - -
5 - - - -
10 - - - -
27 - - - -

FanOut transaction costs

UTxO, Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
(0, 10) - - - - -
(1, 10) - - - - -
(5, 10) - - - - -
(10, 10) - - - - -
(20, 10) - - - - -
(37, 10) - - - - -

Copy link

github-actions bot commented Feb 6, 2025

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2025-02-07 16:58:36.850484881 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial c8a101a5c8ac4816b0dceb59ce31fc2258e387de828f02961d2f2045 2652
νCommit 61458bc2f297fff3cc5df6ac7ab57cefd87763b0b7bd722146a1035c 685
νHead 0e35115a2c7c13c68ecd8d74e4987c04d4539e337643be20bb3274bd 14756
μHead 57166715eadb8d3135964325c016eea546c21e1c0aae974ca67df9a5* 5541
νDeposit ae01dade3a9c346d5c93ae3ce339412b90a0b8f83f94ec6baa24e30c 1102
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 6094 10.80 3.35 0.53
2 6294 13.13 4.07 0.56
3 6493 15.28 4.73 0.59
5 6897 19.76 6.10 0.66
10 7903 31.18 9.61 0.82
40 13936 98.61 30.29 1.78

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 561 2.44 1.16 0.20
2 742 3.38 1.73 0.22
3 923 4.36 2.33 0.24
5 1276 6.41 3.60 0.28
10 2173 12.13 7.25 0.40
54 10068 98.61 68.52 1.88

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 525 26.47 7.60 0.44
2 114 636 36.05 10.28 0.54
3 171 747 42.10 12.12 0.61
4 225 858 53.79 15.31 0.73
5 283 969 64.07 18.11 0.84
6 337 1081 75.25 21.20 0.96
7 392 1192 88.18 24.72 1.09
8 449 1303 99.68 27.86 1.21
9 504 1418 95.86 27.41 1.18

Cost of Increment Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 1802 25.11 8.24 0.49
2 1932 26.73 9.40 0.52
3 2059 28.34 10.57 0.55
5 2366 33.02 13.38 0.62
10 3225 44.60 20.56 0.80
38 7441 98.60 56.65 1.68

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 598 23.99 7.61 0.43
2 757 25.35 8.66 0.45
3 877 26.53 9.62 0.47
5 1244 33.00 12.75 0.56
10 1941 39.95 17.99 0.69
39 6453 99.87 53.85 1.63

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 651 30.95 9.67 0.50
2 791 32.80 10.91 0.53
3 1011 36.12 12.77 0.58
5 1164 35.78 13.80 0.59
10 1909 46.10 20.48 0.75
34 5644 96.57 52.97 1.56

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 681 35.95 11.00 0.55
2 832 38.19 12.34 0.58
3 991 41.07 13.96 0.63
5 1268 45.21 16.54 0.69
10 2030 58.10 24.01 0.88
28 4617 99.50 48.80 1.51

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 5981 28.23 9.31 0.71
2 6050 36.46 11.98 0.80
3 6208 44.55 14.69 0.89
4 6461 58.74 19.43 1.05
5 6505 66.09 21.81 1.13
6 6690 77.11 25.47 1.25
7 6746 83.17 27.43 1.32
8 6874 92.87 30.60 1.42

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTXO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
10 5 285 6262 30.77 10.75 0.75
10 10 568 6429 40.50 14.57 0.87
10 20 1138 6769 61.80 22.83 1.11
10 30 1708 7112 82.65 30.94 1.35
10 37 2102 7345 98.94 37.19 1.54

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2025-02-07 17:01:07.656383797 UTC

Baseline Scenario

Number of nodes 1
Number of txs 300
Avg. Confirmation Time (ms) 4.248785430
P99 8.115718979999983ms
P95 5.098932800000001ms
P50 4.078221ms
Number of Invalid txs 0

| Memory data |

2025-02-07 16:59:42.858580091 UTC
Used: 946M, Free: 5909M
2025-02-07 16:59:47.858562803 UTC
Used: 1047M, Free: 5715M
2025-02-07 16:59:52.858496969 UTC
Used: 1050M, Free: 5711M
2025-02-07 16:59:57.858522684 UTC
Used: 1056M, Free: 5705M
2025-02-07 17:00:02.858587701 UTC
Used: 1057M, Free: 5703M
2025-02-07 17:00:07.858577347 UTC
Used: 1060M, Free: 5700M

Three local nodes

Number of nodes 3
Number of txs 900
Avg. Confirmation Time (ms) 22.901154015
P99 117.25396187ms
P95 30.04532545ms
P50 20.22898ms
Number of Invalid txs 0

| Memory data |

2025-02-07 17:00:20.683669889 UTC
Used: 969M, Free: 5803M
2025-02-07 17:00:25.683845221 UTC
Used: 1162M, Free: 5609M
2025-02-07 17:00:30.683825033 UTC
Used: 1171M, Free: 5599M
2025-02-07 17:00:35.683716088 UTC
Used: 1177M, Free: 5591M
2025-02-07 17:00:40.683957021 UTC
Used: 1224M, Free: 5470M
2025-02-07 17:00:45.68375046 UTC
Used: 1243M, Free: 5379M
2025-02-07 17:00:50.683733482 UTC
Used: 1257M, Free: 5364M
2025-02-07 17:00:55.683718204 UTC
Used: 1265M, Free: 5355M
2025-02-07 17:01:00.683755749 UTC
Used: 1263M, Free: 5356M
2025-02-07 17:01:05.683781633 UTC
Used: 1263M, Free: 5355M

@locallycompact locallycompact force-pushed the lc/remove-test-results branch 2 times, most recently from 631b2ff to 0135d93 Compare February 6, 2025 18:11
@locallycompact locallycompact requested a review from a team February 6, 2025 19:07
Copy link
Contributor

@noonio noonio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks reasonable to me!

What do others thing; @ffakenz and @v0d1ch ; are you happy for this to be from our docs?

@noonio noonio force-pushed the lc/remove-test-results branch from 0135d93 to d260d3f Compare February 7, 2025 16:54
@noonio
Copy link
Contributor

noonio commented Feb 7, 2025

I'll update the right Expected ... tests once this is merged.

@noonio noonio added this pull request to the merge queue Feb 7, 2025
Merged via the queue into master with commit 9474c49 Feb 7, 2025
24 checks passed
@noonio noonio deleted the lc/remove-test-results branch February 7, 2025 17:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done ✔
Development

Successfully merging this pull request may close these issues.

Remove hspec results from the docs
2 participants