Add failed EBT experiment #172
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Benchmark results
|
|
Ok, before closing, let me take a look at it to understand, and maybe we find another insight. |
|
How about we mark this PR as a draft to signal that it's not supposed to be merged? (you can undo the draft state if you disagree) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Yesterday I tried a thing. I noticed that EBT is one of the slowest indexes, and looking at it, it's pretty clear why, it basically has to store everything message in level. On my machine EBT is 12 seconds to index from scratch. I was wondering if I could use some of the same things as I used for ssb-friends on this index and tried that. This takes the full index time down to 7 seconds, but it adds a startup overhead of 700ms, so I don't think its worth it. It does reduce the size of the database from 24mb to 1.4mb.
So this PR is mainly a learning thing and can be closed.