Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bookshelf download time should not raise with the number of documents #173

Closed
benel opened this issue Apr 20, 2024 · 3 comments
Closed

Bookshelf download time should not raise with the number of documents #173

benel opened this issue Apr 20, 2024 · 3 comments

Comments

@benel
Copy link
Member

benel commented Apr 20, 2024

With current implementation: 11s for 865 documents (measured directly on the backend).

The delays exists only when reduce is enabled.

@benel
Copy link
Member Author

benel commented Apr 29, 2024

The problem is hard to reproduce...

The following command now runs (locally) in 1s for 337 CouchDB documents:

curl http://localhost:5984/hyperglosae/_design/app/_view/all_documents\?reduce\=true\&group\=true >/dev/null

More tests would be necessary.

Nizreenana added a commit that referenced this issue May 16, 2024
slowly with the number of documents (#173)
Nizreenana added a commit that referenced this issue May 16, 2024
slowly with the number of documents (#173)
Nizreenana added a commit that referenced this issue May 16, 2024
slowly with the number of documents (#173)
@benel
Copy link
Member Author

benel commented May 17, 2024

Although the download time doesn't raise as fast as we feared, the index should be paginated so that its download time is not proportional of the number of documents.

@benel benel changed the title Bookshelf download time should raise slowly with the number of documents Bookshelf download time should not raise with the number of documents May 17, 2024
Nizreenana added a commit that referenced this issue May 21, 2024
slowly with the number of documents (#173)
Nizreenana added a commit that referenced this issue May 21, 2024
slowly with the number of documents (#173)
@benel
Copy link
Member Author

benel commented Jul 16, 2024

The delay was probably caused by the "reduce" part of the view.

Commit 84e4e3e probably solved this (at least for now).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

No branches or pull requests

1 participant