Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🚀 [Feature]: Add support for Llama 3.1 Models #1385

Open
2 tasks done
rohitashwin opened this issue Jul 23, 2024 · 2 comments
Open
2 tasks done

🚀 [Feature]: Add support for Llama 3.1 Models #1385

rohitashwin opened this issue Jul 23, 2024 · 2 comments
Labels
👍 Accepting PR ✏️ Feature

Comments

@rohitashwin
Copy link

Feature Description

Add support for Llama 3.1 8B, 70B, and if possible 405B models.

Additional Context (optional)

No response

Checklist:

  • I have checked for existing issues that describe my suggestion prior to opening this one.
  • I understand that improperly formatted feature requests may be closed without explanation.
@gaby
Copy link
Member

gaby commented Jul 27, 2024

@rohitashwin PR's are welcome

@gaby
Copy link
Member

gaby commented Jul 27, 2024

Blocked by abetlen/llama-cpp-python#1625 and abetlen/llama-cpp-python#1618

This was referenced Jul 27, 2024
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
👍 Accepting PR ✏️ Feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gaby @rohitashwin