Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for code llama #29

Open
silvanmelchior opened this issue Aug 25, 2023 · 2 comments
Open

Add support for code llama #29

silvanmelchior opened this issue Aug 25, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@silvanmelchior
Copy link
Owner

silvanmelchior commented Aug 25, 2023

Would be great to support code llama. As of now, there is no huggingface-version, which prevents a trivial integration.

@silvanmelchior silvanmelchior added the enhancement New feature or request label Aug 25, 2023
@silvanmelchior
Copy link
Owner Author

There is a huggingface-version now, but I always have issues when I run it. Very often, the model starts to just generate whitespace and doesn't stop anymore. Might be an issue with the text generation inference service, or something else, not clear yet.

@silvanmelchior
Copy link
Owner Author

Added instructions to work with code llama.

On replicate, it works, but the largest model (34B) is not available instruction-finetuned.

With TGI, I still get an error, see huggingface/text-generation-inference#973

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant