Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support passing custom sampling function. #200

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

wang2yn84
Copy link
Collaborator

@wang2yn84 wang2yn84 commented Dec 1, 2024

Users can pass in custom sampling function now. But it's not per request sampling because it's hard to track all the sampling functions in the jitted function. It applies to all the batches. The changes on the JetStream side is pending, not in yet.

@wang2yn84 wang2yn84 requested a review from qihqi December 1, 2024 16:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants