Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Allow aggregated tasks within benchmarks #1771

Merged
Changes from 1 commit
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
1338736
fix: Allow aggregated tasks within benchmarks
KennethEnevoldsen Jan 11, 2025
f2920ff
feat: Update task filtering, fixing bug on MTEB
KennethEnevoldsen Jan 13, 2025
12aaa97
format
KennethEnevoldsen Jan 13, 2025
1be8ed8
remove "en-ext" from AmazonCounterfactualClassification
KennethEnevoldsen Jan 13, 2025
8aab5d0
fixed mteb(deu)
KennethEnevoldsen Jan 13, 2025
4dfe2ec
fix: simplify in a few areas
KennethEnevoldsen Jan 13, 2025
cd87ebb
wip
KennethEnevoldsen Jan 14, 2025
450953d
Merge branch 'correct-mteb-eng' into KennethEnevoldsen/issue-Allow-ag…
KennethEnevoldsen Jan 14, 2025
87816f1
tmp
KennethEnevoldsen Jan 15, 2025
f73ffb7
sav
KennethEnevoldsen Jan 16, 2025
33578ec
Allow aggregated tasks within benchmarks
KennethEnevoldsen Jan 17, 2025
54d16f9
Merge remote-tracking branch 'origin' into KennethEnevoldsen/issue-Al…
KennethEnevoldsen Jan 17, 2025
b11f6b1
ensure correct formatting of eval_langs
KennethEnevoldsen Jan 17, 2025
0718389
ignore aggregate dataset
KennethEnevoldsen Jan 17, 2025
2bc375c
clean up dummy cases
KennethEnevoldsen Jan 17, 2025
5a9bd8c
add to mteb(eng, classic)
KennethEnevoldsen Jan 17, 2025
36cee38
format
KennethEnevoldsen Jan 17, 2025
8bb9026
clean up
KennethEnevoldsen Jan 17, 2025
60a8f0f
Allow aggregated tasks within benchmarks
KennethEnevoldsen Jan 17, 2025
f65c68e
added fixed from comments
KennethEnevoldsen Jan 19, 2025
76d511c
Merge branch 'main' of https://github.com/embeddings-benchmark/mteb i…
KennethEnevoldsen Jan 19, 2025
14f3ae1
fix merge
KennethEnevoldsen Jan 19, 2025
66fb570
format
KennethEnevoldsen Jan 19, 2025
063e357
Updated task type
KennethEnevoldsen Jan 21, 2025
6b1e190
Merge branch 'main' of https://github.com/embeddings-benchmark/mteb i…
KennethEnevoldsen Jan 28, 2025
6e37e07
Added minor fix for dummy tasks
KennethEnevoldsen Jan 28, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' of https://github.com/embeddings-benchmark/mteb i…
…nto KennethEnevoldsen/issue-Allow-aggregated-tasks-within-benchmarks
KennethEnevoldsen committed Jan 19, 2025

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
commit 76d511c0ca11569184a78022d275aab565e3d2eb

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.