Skip to content

Pull requests: triton-inference-server/triton_distributed

New pull request New
28 Open 160 Closed
28 Open 160 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Create docs wokflow documentation Improvements or additions to documentation
#226 opened Feb 20, 2025 by nvda-mesharma Loading…
2
feat: Multi-stage VLLM Build
#225 opened Feb 20, 2025 by rmccorm4 • Draft
2 tasks
ci: read push options in ci trigger
#220 opened Feb 20, 2025 by nv-anants • Draft
20 tasks
feat: enable metrics polling
#219 opened Feb 20, 2025 by GuanLuo Loading…
20 tasks
6
feat: Add http support to vllm kv router example
#217 opened Feb 20, 2025 by alec-flowers Loading…
9 tasks
1
DO NOT MERGE: Add test commit
#214 opened Feb 19, 2025 by piotrm-nvidia Loading…
3
feat: planner
#210 opened Feb 19, 2025 by ryanolson • Draft
3 of 20 tasks
feat: naive heuristic disagg router
#209 opened Feb 19, 2025 by tedzhouhk • Draft
3 of 20 tasks
feat: Scripts to launch disagg using TRTLLM LLMAPI
#206 opened Feb 18, 2025 by NVShreyas Loading…
3 of 24 tasks
42
feat: event plane + count
#201 opened Feb 18, 2025 by ryanolson Loading…
2 of 20 tasks
@rmccorm4 @ishandhanani
74
feat: add two scripts to start disagg workers on a single node/multiple nodes
#200 opened Feb 18, 2025 by tedzhouhk • Draft
4 of 20 tasks
feat: zmq router + dealer
#197 opened Feb 17, 2025 by ryanolson • Draft
20 tasks
[feat, refactor] Weighted random endpoint selection; refactor request sending
#194 opened Feb 16, 2025 by jthomson04 • Draft
perf: [PoC] multi process Triton distributed runtime
#191 opened Feb 14, 2025 by kthui • Draft
20 tasks
@kthui
refactor: Proposal to refactor protocols using async-openai
#190 opened Feb 14, 2025 by paulhendricks • Draft
3 of 20 tasks
1
refactor: Remove secondary runtime and lease enhancement New feature or request
#185 opened Feb 14, 2025 by grahamking Loading…
1
1
feat: Monolith TensorRT-LLM rust example using pytorch workflow with TP=1 enhancement New feature or request
#182 opened Feb 14, 2025 by tanmayv25 • Draft
5 of 20 tasks
@rmccorm4
1
[DRAFT] feat(disaggregation): add nova-init scripts for VLLM disaggregation
#180 opened Feb 14, 2025 by ishandhanani • Draft
20 tasks
build(deps): bump transformers from 4.45.2 to 4.48.3 dependencies Pull requests that update a dependency file
#168 opened Feb 12, 2025 by dependabot bot Loading…
1
chore: moving to llm example folder
#163 opened Feb 11, 2025 by nnshah1 • Draft
20 tasks
nnshah1 objects 2 testing new UX
#162 opened Feb 11, 2025 by nnshah1 • Draft
20 tasks
[draft] deploy: remove duplicate common file
#131 opened Feb 7, 2025 by whoisj Loading…
feat: Add name validation for namespaces, components, and endpoints
#127 opened Feb 7, 2025 by jthomson04 Loading…
19 tasks
7
feat: Proc-macros for worker instantiation
#126 opened Feb 7, 2025 by jthomson04 Loading…
19 tasks
2
feat: TritonCore DistributedRuntime Worker Example
#121 opened Feb 6, 2025 by rmccorm4 • Draft
1
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.