Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: Use a local GPT2 model as a fallback. #29

Open
lychees opened this issue Dec 9, 2022 · 1 comment
Open

Feat: Use a local GPT2 model as a fallback. #29

lychees opened this issue Dec 9, 2022 · 1 comment

Comments

@lychees
Copy link

lychees commented Dec 9, 2022

OpenAI is currently facing tremendous traffic, making the ChatGPT service often unavailable. There are other NLP model, e.g. GPT2 which is open-source and easy to get via the internet, can we add a fallback function so that when the connection is broken, the bot can still responding to user's input.

@MaikoTan
Copy link
Member

MaikoTan commented Dec 9, 2022

I don't think this is a good solution. This would not only break our conversation context maintaining state, but also makes the conversation unstable (as you see the GPT2 model you mentioned always behaves bad compare to ChatGPT).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants