mdb_txn_begin: b'MDB_READERS_FULL: Environment maxreaders limit reached' (Please use a larger Environment(max_readers=) parameter)

[jameshowison]

getting this error when running harvester.

Any ideas?

See code in https://github.com/howisonlab/screenit-softcite

[jameshowison]

Seems to occur when the status bar gets up to about 126. Which googling the error tells me is the limit for these threads. However from what I can see there aren't any PDFs downloaded. So I think the error is probably a side effect of something not actually working in harvesting the PDFs, meaning that none of them ever return?

I only see one json file down in the data hierarchy (no PDFs).