Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Oatmeal always responds as python code? #38

Open
mybuddymichael opened this issue Jan 11, 2024 · 3 comments
Open

Oatmeal always responds as python code? #38

mybuddymichael opened this issue Jan 11, 2024 · 3 comments

Comments

@mybuddymichael
Copy link

mybuddymichael commented Jan 11, 2024

I'm happy to download the debug version and help figure out what's going on, but I was curious if there's a clear answer to why Oatmeal always responds to my questions with python code when other clients don't (using the same model, in this case Mistral via ollama)? No matter what I set the system message to (if generic), Oatmeal always wants to respond with Python code, even if the question has nothing to do with coding.

@dustinblackman
Copy link
Owner

Hey there!

This is likely related to #22. While Oatmeal works most text based LLM use cases, I had originally intended for it to be a coding assistant. In order for LLM's to respond with properly formatted code examples without overriding the system prompt, it appends "Add language to any code blocks" to your first prompt.

Why you're getting a lot of python code back is confusing. Do you have an example model and prompt you're using?

@florzanetta
Copy link

I just wanted to say, marginally related to this, that I really love your UI. The project is fantastic and that's why I was looking to make it my main app to interact with multiple models, some of which might not be used for coding.

I saw your branch to add support to customize the system prompt. I'd love that feature. I think it could work as a command line variable, maybe accept the prompt as a file, or have it be a command, like /sys. To maintain the original intent of the app, the current prompt would be the default.
Neovim users could have the current prompt as the default config when calling the setup function.

@dustinblackman
Copy link
Owner

dustinblackman commented Jan 31, 2024

Thanks a lot!

Not a bad idea at all! I had forgotten about that branch. I'd be down to turn that in to a feature. I'll add it to my TODOs. :) #44

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants