🦙💬 Llama 2 Chat

This chatbot is created using the open-source Llama 2 LLM model from Meta.

Particularly, we're using the Llama2-7B model deployed by the Andreessen Horowitz (a16z) team and hosted on the Replicate platform.

This app was refactored from a16z's implementation of their LLaMA2 Chatbot to be light-weight for deployment to the Streamlit Community Cloud.

Demo App

Prerequisite libraries

streamlit
replicate

Getting your own Replicate API token

To use this app, you'll need to get your own Replicate API token.

After signing up to Replicate, you can access your API token from this page.

Other Llama 2 models to try

As mentioned above, this chatbot implementation uses the Llama2-7B model that was trained on 7 billion parameters.

You can also try out the larger models:

• Llama2-13B
• Llama2-70B

Further Reading

• Llama 2 website
• Llama 2 technical overview
• Llama 2 blog
• Llama 2 research article
• Llama 2 GitHub repo