How to use guided decoding and regex in vLLM with outlines backend? #921

debraj135 started this conversation in General

debraj135
May 27, 2024

Please see vllm-project/vllm#5063 .

I believe this might be closely related to outlines.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment