Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add AIBrix(vllm) and llmaz: cloud native inference platform #4257

Merged
merged 1 commit into from
Mar 7, 2025

Conversation

pacoxu
Copy link
Contributor

@pacoxu pacoxu commented Mar 7, 2025

Both a cloud native inference platform for serving.

  • AIBrix is founded by ByteDance, and is now a vllm subproject which was open sourced recently. The maintainer Jeffwan is Kubernetes WG Serving co-chair and a maintainer of KubeRay.
  • llmaz is founded by kerthcet, who is Kubernetes SIG Scheduling approver and maintainer of LWS(LeaderWorkerSet) and Kueue.

More comparison can be found https://x.com/xu_paco/status/1897498600449687626.

Pre-submission checklist:

Please check each of these after submitting your pull request:

  • Are you only including a repo_url if your project is 100% open source? If so, you need to pick the single best GitHub repository for your project, not a GitHub organization.
  • Is your project closed source or, if it is open source, does your project have at least 300 GitHub stars?
  • Have you picked the single best (existing) category for your project?
  • Does it follow the other guidelines from the new entries section?
  • Have you added your SVG to hosted_logos and referenced it there?
  • Does your logo clearly state the name of the project/product and follow the other guidelines?
  • Does your project/product name match the text on the logo?
  • Have you verified that the Crunchbase data for your organization is correct (including headquarters and LinkedIn)?

AIBrix uses vLLM logo now as there is not a official logo yet and this project is from vLLM community.

Copy link

github-actions bot commented Mar 7, 2025

You can preview your changes by visiting this link.

Note

This feature is still experimental and may not work as expected in some cases. Please report any issues you find!

@caniszczyk caniszczyk added this pull request to the merge queue Mar 7, 2025
@caniszczyk
Copy link
Contributor

Thanks @pacoxu

Merged via the queue into cncf:master with commit 2f0243f Mar 7, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants