Skip to content

Show page titles in page selection dropdown #2416

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 59 commits into from

Conversation

emma-sg
Copy link
Member

@emma-sg emma-sg commented Feb 20, 2025

Also updates styles a little.

To be rebased after #2412 is merged.

ikreymer and others added 30 commits February 18, 2025 17:22
- use group instead of distinct in unique page stats, page filename migration
- consolidate collection recompute stats into single function
- bump to 1.14.0-beta.2
add timeout for backend gunicorn worker

update
Also adds isMigrating, which we'll use in migration 0042
- Adds new optimize pages background job that updates crawl pages
and sets version on updated crawls to 2
- New job uses a new migration_job.yaml template with parallelism
set to 3
- Update BackgroundJob model and some ops methods to allow for
creating and retrying a background job with no oid
- Add new API endpoint to retry one specific background job that
isn't tied to a specific org (superuser-only)
Now that we have background jobs that aren't tied to a specific org,
much of the background_jobs module needs to be reworked to account
for that.

That will take some time, so for now, so that we can test the
migration, we just pass the default org to retry_background_job
if the job doesn't have an oid set.
Only include initialPages, pagesQueryUrl, and preloadResources in
replay.json responses for crawls and collections if all of the
relevant crawls have version set to 2.
- simplify group query for unique pages
- remove unused code
- convert array index to getter
ikreymer and others added 28 commits February 18, 2025 21:07
- move preloadResources to be precomputed in update_collection_counts_and_tags()
- only query list of crawls once, reuse ids
- remove facet from list_collection_pages(), support passing in crawlIds
- rename /urls -> /pageSnapshots
- remove facet, just return results
- frontend: update to new model, don't check total, just look at results list length
- rename list_collection_pages -> list_replay_query_pages to be used for replay page querying for collection or single crawl, no page totals
- use list_replay_query_pages in crawl /replay.json
… dialog until open (#2414)

Delays rendering contents of the collection settings dialog until
actually needed. Various fetches that internal components were running
were causing slowdowns in other parts of the app, so this should resolve
some of that.
@emma-sg
Copy link
Member Author

emma-sg commented Feb 27, 2025

Closing in favour of #2433

@emma-sg emma-sg closed this Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants