Skip to content

Commit 1deb830

Browse files
Tsk 374 add jina colbert v2 (#378)
* feat: Added support for jina-colbert-v2 * chore: Generalized query marker and document marker * nit: remove github action on dispatch * chore: updated license * fix: Fix attention mask to be all 1 in xlmrobertatokenizer * feat: Added class for JinaColbertV2 * feat: Added jina colbert * chore: Change tolerance of the test * chore: Changed encoding of attention mask to 1 to be only in queries * chore: Changed the replacable token to be ' @' as its considered as one token * chore: Removed redundant functions * chore: Updated supported models docs * nit: Remove print statement * nit: visual stuff * fix: Fix dimention of jina colbert in description * fix: canonical query and document values for jina colbert
1 parent aba8fb4 commit 1deb830

File tree

5 files changed

+291
-111
lines changed

5 files changed

+291
-111
lines changed

0 commit comments

Comments
 (0)