Commit 4d1385f

committed

feat: add lock to hf backend to prevent concurrent generation with

conflicting weights

1 parent c67b90c commit 4d1385fCopy full SHA for 4d1385f

3 files changed

+538

-46

lines changed

mellea/backends
- huggingface.py
test/backends
- test_huggingface.py
- test_huggingface_generation_lock.py

3 files changed

+538

-46

lines changed

Comments

(0)