Skip to content

Pull requests: triton-inference-server/triton_distributed

New pull request New
31 Open 114 Closed
31 Open 114 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: updating with minor fixes and support for custom types
#175 opened Feb 13, 2025 by nnshah1 Loading…
3 of 19 tasks
4
feat: Add tio your friendly cmd line uncle to run triton-llm services enhancement New feature or request
#174 opened Feb 12, 2025 by grahamking Loading…
7 tasks done
16
chore: Add CODEOWNERS
#170 opened Feb 12, 2025 by rmccorm4 Loading…
7
build(deps): bump transformers from 4.45.2 to 4.48.3 dependencies Pull requests that update a dependency file
#168 opened Feb 12, 2025 by dependabot bot Loading…
1
Improve testing harness using psutil process handling
#166 opened Feb 12, 2025 by piotrm-nvidia Loading…
3
chore: moving to llm example folder
#163 opened Feb 11, 2025 by nnshah1 • Draft
20 tasks
nnshah1 objects 2 testing new UX
#162 opened Feb 11, 2025 by nnshah1 • Draft
20 tasks
feat: Add KV publisher and receiver. Add KV aware routing example.
#157 opened Feb 11, 2025 by GuanLuo Loading…
20 tasks
13
[draft] deploy: remove duplicate common file
#131 opened Feb 7, 2025 by whoisj Loading…
Improve documentation for Events
#128 opened Feb 7, 2025 by piotrm-nvidia Loading…
feat: Add name validation for namespaces, components, and endpoints
#127 opened Feb 7, 2025 by jthomson04 Loading…
19 tasks
5
feat: Proc-macros for worker instantiation
#126 opened Feb 7, 2025 by jthomson04 Loading…
19 tasks
2
Introduce re-try for Triton client in test_mock_disaggregated_serving_kserve
#124 opened Feb 6, 2025 by piotrm-nvidia • Draft
feat: TritonCore DistributedRuntime Worker Example
#121 opened Feb 6, 2025 by rmccorm4 • Draft
1
docs: Add pre-requisites section in the main readme
#108 opened Feb 5, 2025 by piotrm-nvidia Loading…
3
[draft] feat: Add KV aware routing operator. Update llm example for KV aware example
#107 opened Feb 5, 2025 by GuanLuo Loading…
20 tasks
2
Merge main
#105 opened Feb 5, 2025 by piotrm-nvidia • Draft
feat: support for non tensors callable interface
#104 opened Feb 5, 2025 by nnshah1 • Draft
20 tasks
2
Update test_mock_disaggregated_serving to be omitted
#103 opened Feb 5, 2025 by piotrm-nvidia • Draft
2
deploy: improve api-server verification & CI integration
#98 opened Feb 4, 2025 by whoisj Loading…
1
deploy: add openai api-server chart tests
#95 opened Feb 4, 2025 by whoisj Loading…
deploy: add tests for vllm worker chart
#93 opened Feb 4, 2025 by whoisj Loading…
Normalize NATS.io host and port
#92 opened Feb 4, 2025 by piotrm-nvidia Loading…
13
Add draft launching script
#70 opened Jan 28, 2025 by piotrm-nvidia • Draft
9
feat(data-plane): improve NCCL data plane configuration
#69 opened Jan 28, 2025 by ishandhanani Loading…
20 tasks
10
ProTip! Filter pull requests by the default branch with base:main.