New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] FusedMoE H200 tuning #2471

Open

2 tasks

zhyncs opened this issue Dec 12, 2024 · 0 comments

Assignees

Labels

Member

zhyncs commented Dec 12, 2024

Checklist

1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
2. Please use English, otherwise it will be closed.

Motivation

ref #2450
https://github.com/sgl-project/sglang/blob/main/benchmark/kernels/fused_moe_triton/README.md
DeepSeek V2, Mixtral 8x7B 8x22B, Qwen MoE etc

BTW Thanks @antferdom

Related resources

No response

zhyncs added the enhancement label

zhyncs self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment