New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Add `choices` in `/generate` endpoint and add `min_new_tokens` in `sgl.gen()` #1564

Open

2 tasks done

TING2938 opened this issue Oct 4, 2024 · 1 comment

TING2938 commented Oct 4, 2024

Checklist

1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
2. Please use English, otherwise it will be closed.

Motivation

Add choices in /generate endpoint and add min_new_tokens in sgl.gen()

Related resources

No response

The text was updated successfully, but these errors were encountered:

Contributor

ByronHsu commented Oct 4, 2024

@merrymercy @Ying1123 I can help working on this if this makes sense to you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment