[Feature Request] LLM output token probabilities

[zanderjiang]

Would it be possible for the LLM tool to output the list of token probabilities of the output string? This feature would be quite useful to implement RAG flows with active retrieval.

[github-actions]

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!