Discussions

• 3 You must be logged in to vote

  🙏

  Is constraining and renormalizing the output logits an unbiased way to convert a free form LLM into a classifier?

  dhuynh95 asked Nov 11, 2023 in Q&A · Unanswered

  

  

  2
• 3 You must be logged in to vote

  🙏

  vllm API- add regex support

  mjsteele12 asked Dec 22, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🤖

  First readme.md example fails

  correctness Everything related to the generation correctness

  jloganolson started Dec 16, 2023 in Weird model output

  

  

  7
• 1 You must be logged in to vote

  💡

  Consider implementing advanced prompting techniques

  rlouf started Jan 4, 2024 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  🙏

  Using Outlines with vLLM/ FastChat

  question

  rounak610 asked Sep 27, 2023 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🤖

  Generating str/int/float/bool values with GPT2 using generate.json leads to absurd results

  question structured generation Linked to structured generation correctness Everything related to the generation correctness

  gaspard-dv started Dec 19, 2023 in Weird model output

  

  

  

  

  3
• 1 You must be logged in to vote

  🤖

  Sentence never ending

  question examples Linked to usage examples structured generation Linked to structured generation correctness Everything related to the generation correctness

  thomasfloqs started Dec 5, 2023 in Weird model output

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  How to change model download location?

  aalyousfi asked Dec 5, 2023 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Would this be the right tool if I want to enforce valid SQL on output?

  kgourgou asked Dec 8, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💡

  Azure OpenAI covering

  dhuynh95 started Dec 5, 2023 in Feature requests

  

  

  3
• 1 You must be logged in to vote

  🙏

  How can I specify temperature for model generation?

  aalyousfi asked Dec 5, 2023 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Similarities and comparison with LMQL, Guidance

  documentation Linked to documentation and examples

  ogencoglu asked Aug 15, 2023 in Q&A · Unanswered

  

  

  

  

  10
• 3 You must be logged in to vote

  💬

  Benchmarking model performance with and without Outlines

  MayankAgarwal started Nov 6, 2023 in General

  

  

  

  

  8
• 2 You must be logged in to vote

  🙌

  Guided generation to classify Python projects

  lmmx started Nov 19, 2023 in Show and tell

  

  

  1
• 1 You must be logged in to vote

  🙏

  What is the decode method here?

  AL-377 asked Nov 3, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💡

  Linear Temporal Logic over finite traces

  johnryan465 started Aug 15, 2023 in Feature requests

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  Stable Beluga/llama2?

  daveaitel started Aug 15, 2023 in General

  

  

  

  

  6
• 1 You must be logged in to vote

  💬

  json generation is giving an error with model=gpt-3.5-turbo

  MohammedYaseenZevi started Oct 6, 2023 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  🙏

  DeepSpeed Integration

  ramonpzg asked Sep 18, 2023 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💡

  JS/TS version

  enhancement

  clharman started Aug 24, 2023 in Feature requests

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  How adding a guidance affects model performance ?

  Vi-cs asked Aug 22, 2023 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to call an API-based LLM

  YuamLu asked Aug 20, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How does it handle unexpected answers from LLMs under the hood?

  gornostal asked Aug 19, 2023 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  Alternative json model depending on initial answer

  DiegoSVilla started Aug 17, 2023 in General

  

  

  2
• 1 You must be logged in to vote

  🙏

  Streaming via the OpenAI API?

  ericmjl asked Jul 28, 2023 in Q&A · Unanswered

  

  

  2