Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable Performance Testing / Monitoring / setup perf infra via tracerbench #1508

Closed
wants to merge 7 commits into from

Conversation

NullVoxPopuli
Copy link
Contributor

@NullVoxPopuli NullVoxPopuli commented Nov 27, 2023

Begins experimenting with perf testing.

Will need to merge before experimentation can continue as the workflow doesn't currently run on PRs.

This was copied and modified from: #1428 (comment)

It includes some exports changes to get the krausest app running. These exports are local-only, and are swill swapped by the existing publishConfig exports during publish time, so no consumers would see those changes.

To run locally:

git fetch origin
git checkout perf-testing
pnpm i
pnpm benchmark
# wait forever (250s)

@NullVoxPopuli NullVoxPopuli marked this pull request as ready for review December 4, 2023 15:54
@NullVoxPopuli NullVoxPopuli force-pushed the perf-testing branch 2 times, most recently from 1ff77df to a136d66 Compare December 4, 2023 18:48
@NullVoxPopuli NullVoxPopuli mentioned this pull request Dec 4, 2023
@NullVoxPopuli NullVoxPopuli force-pushed the perf-testing branch 5 times, most recently from 4df28df to e4713ac Compare December 4, 2023 20:39
lintfix

Upload artifacts

Update scripts

updates

Add minimal package.json changes to get the krausest benchmark to boot

update lockfile

Don't typecheck the bench.mjs

Don't type-check the bin/bench.mjs

Cleanup

Cleanup

cleanup

reduceLock

Update on

Update perf

eh

eh

eh

increase timeout for perf tests

Copy Analyze from the tracerbench action so that I can test locally

Remove all the local bench code

Hackity hack hack

Hackity hack hack

oof

oof

I see

eh

oof
@NullVoxPopuli NullVoxPopuli force-pushed the perf-testing branch 2 times, most recently from 7d09d62 to a5892a4 Compare December 4, 2023 22:53
@NullVoxPopuli
Copy link
Contributor Author

NullVoxPopuli commented Dec 5, 2023

I'm giving up on tracerbench, for now.

Gonna use js-framework-benchmark using

So far, here is the baseline (vm (published)):
image


Note on my hardware:

  • CPU: AMD Ryzen 9 7900X 12-Core @ 24x 4.7GHz
  • GPU: NVIDIA GeForce RTX 4080
  • RAM: 63438MiB

@NullVoxPopuli NullVoxPopuli deleted the perf-testing branch January 2, 2024 21:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant