[Bug]: 1.4.3 errors in the backend: [ERROR] Exception in ASGI application after DB migration

[tuehlarsen]

Browsertrix Version

v1.14.3-9466e83

What did you expect to happen? What happened instead?

it looks like the DB migration to 1.4.3 went well and a crawl is running. But collections are still failing with:

There are now errors "Exception in ASGI application" in the log from the 'op' container in the browsertrix-backend pod.
See attached log:

logs-from-op-in-browsertrix-cloud-backend-64d9d56748-m574j.log

Reproduction instructions

see above

Screenshots / Video

No response

Environment

No response

Additional details

No response

[ikreymer]

@tuehlarsen this sounds like two separate issues, the first one seems like a corrupt crawljob object. We've had crawlerChannels for a while. Perhaps its an old crawl job that got stuck?

To solve that for now, you can: kubectl get cjs and view any crawl jobs, and delete them (assuming no crawls should be running). We'll add a fix so that this doesn't result in a crash in a future update.

For collection not showing up, also hard to say, but you can try. Purge Cache + Full Reload.
Is the URL you're trying to load a page, or just some image in a collection? The way collections are set up, you need to start with a page URL first, as its optimized for loading pages.

[tuehlarsen]

1. we have no old or new jobs running.
2. the collection worked ok in 1.13.2, but does not work any more after upgrade to 14.* - also after Purge Cache + Full Reload.