DPR models for legal&financial documents

[kamilpz]

I've been using pair of facebook's dpr-question_encoder-single-nq-base and dpr-ctx_encoder-single-nq-base for dense passage retrieval but I feel like these are far from ideal for my domain related to legal+financial stuff. Do you suggest any other model that could be kind of better for that domain?

[julian-risch]

Hi @kamilpz there are no domain-specific DPR models available for the legal domain or finance domain. On the model hub, you can search for DPR models with the help of filters: https://huggingface.co/models?other=dpr

If you're interested to learn what is needed to create a training dataset and train such a domain-specific model yourself, I would recommend these two papers: https://arxiv.org/abs/2004.04906 https://arxiv.org/abs/2104.12741