Skip to content

Issues: embeddings-benchmark/mteb

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

153 Open 521 Closed
153 Open 521 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

New leaderboard banner
#1855 opened Jan 21, 2025 by Muennighoff
1
CDE models missing
#1851 opened Jan 21, 2025 by x-tabdeveloping
12
Missing models on leaderboards [WIP]
#1848 opened Jan 21, 2025 by KennethEnevoldsen
2
Renaming the New Leaderboard Space leaderboard issues related to the leaderboard
#1847 opened Jan 21, 2025 by x-tabdeveloping
8
Support for MTEB-ES (Spanish Benchmark)
#1844 opened Jan 20, 2025 by elsatch
1
New leaderboard filtering cross-encoders leaderboard issues related to the leaderboard
#1841 opened Jan 20, 2025 by Muennighoff
5
Missing results on new leaderboard leaderboard issues related to the leaderboard
#1840 opened Jan 20, 2025 by Muennighoff
2
Add LOTTE new benchmark Issues related to adding a new benchmark
#1836 opened Jan 19, 2025 by Samoed
[Main & MIEB] potential issues for multi-label classification
#1835 opened Jan 19, 2025 by gowitheflow-1998
1
[v2] Remove MultilingualTask
#1832 opened Jan 18, 2025 by Samoed
1
Optimize the slowest test for better performance
#1831 opened Jan 17, 2025 by sam-hey
3
Remove embedding layers when calculating number of parameters enhancement New feature or request leaderboard issues related to the leaderboard
#1828 opened Jan 17, 2025 by KennethEnevoldsen
Generalize Custom search() Method
#1826 opened Jan 17, 2025 by sam-hey
2
[MIEB] migrate results from tmp repo to results repo
#1823 opened Jan 16, 2025 by isaac-chung
[v2] Remove LANG_MAPPING
#1822 opened Jan 16, 2025 by Samoed
Leaderboard: jasper_en_vision_language_v1 has NaN on MSMARCO
#1816 opened Jan 15, 2025 by x-tabdeveloping
1
Leaderboard: What metric should we sort on? leaderboard issues related to the leaderboard
#1813 opened Jan 15, 2025 by Samoed
11
Leaderboard(Scandinavian) : Missing most results on DKHate bug Something isn't working leaderboard issues related to the leaderboard
#1808 opened Jan 15, 2025 by x-tabdeveloping
@x-tabdeveloping
6
[MIEB] Complete all model meta based on v2.0.0 schema mieb The image extension of MTEB
#1800 opened Jan 14, 2025 by isaac-chung
2
[MIEB] Fill out all task description stats metadata mieb The image extension of MTEB
#1799 opened Jan 14, 2025 by isaac-chung
2 tasks
2
Leaderboard: Missing results for C-MTEB
#1797 opened Jan 14, 2025 by x-tabdeveloping
22
Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
3 of 21 tasks
1
[v2] Refactor to Use Enums Instead of Literals
#1784 opened Jan 13, 2025 by sam-hey
8
Overwrite results when task revision changes enhancement New feature or request
#1782 opened Jan 13, 2025 by gaohongkui
1
Integrate Gene-MTEB new benchmark Issues related to adding a new benchmark
#1781 opened Jan 13, 2025 by Muennighoff
ProTip! Follow long discussions with comments:>50.