Skip to content

Issues: triton-inference-server/server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

415 Open 3,085 Closed
415 Open 3,085 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Feature Questions
#7244 opened May 20, 2024 by cha-noong
Build error when building new image on top of the nvcr.io/nvidia/tritonserver:24.04-py3-sdk container image from NGC
#7243 opened May 18, 2024 by jackylu0124
2
trt accelerator
#7238 opened May 17, 2024 by riyajatar37003
increase chunk size for streaming with tensorrtllm_backend
#7237 opened May 17, 2024 by avianion
Cant build python+onnx+ternsorrtllm backends r24.04 investigating The developement team is investigating this issue
#7236 opened May 17, 2024 by gulldan
3
Python backend status zombie but Tritonserver v2/health still return 200 OK
#7230 opened May 16, 2024 by burling
1
Model Management
#7228 opened May 16, 2024 by N-Kingsley
1
Questions about input and output shape in model configuration when batch size is 1 question Further information is requested
#7227 opened May 16, 2024 by jackylu0124
@tanmayv25
2
Question to huggingface model using triton
#7226 opened May 15, 2024 by geraldstanje
model analyser stucks investigating The developement team is investigating this issue
#7223 opened May 15, 2024 by riyajatar37003
2
Unable to use pytoch library with libtorch backend when using triton inference server In-Process python API help wanted Extra attention is needed question Further information is requested
#7222 opened May 15, 2024 by sivanantha321
@nnshah1
4
TensorRT 8.6.3.1 package in Python PyPy for Triton Nvidia Inference Server version > 24.01
#7221 opened May 15, 2024 by aptmess
3
Calling index search inside Triton python backend
#7220 opened May 15, 2024 by riyaj8888
1
repeated answer:When I use vllm with Qwen-7b-chat the generated text is x lnot end until the maength, with the repeated answer
#7215 opened May 14, 2024 by ChengShuting
1
Inference in Triton ensemble model is much slower than single model in Triton investigating The developement team is investigating this issue
#7214 opened May 14, 2024 by AWallyAllah
2
How to enable nsys when starting a Triton server using Python API question Further information is requested
#7209 opened May 11, 2024 by jerry605
1
Query Regarding Custom Metrics For Python Backend question Further information is requested
#7204 opened May 10, 2024 by AniForU
1
Perf_analyzer reported metrics for decoupled model question Further information is requested
#7203 opened May 10, 2024 by ZhanqiuHu
4
Triton Server OpenVINO backend not working with Tensorflow saved models bug Something isn't working
#7200 opened May 9, 2024 by atobiszei
5
triton infer server docker image not working on Jetson Orin NX 16 GB JP 5.1.1
#7199 opened May 9, 2024 by allan-navarro
2
Metrics Port Not Opening with Triton Inference Server's In-Process Python API
#7197 opened May 8, 2024 by yucai
1
GRPC infer returns null in outputs contents
#7191 opened May 7, 2024 by aohorodnyk
2
Memory leak with multiple GPU and BLS.
#7190 opened May 7, 2024 by kbegiedza
1
Unexpected reshaping of output
#7189 opened May 7, 2024 by lemousehunter
1
How to specify the TensorRT version in Triton Server for inference? question Further information is requested
#7188 opened May 7, 2024 by Gcstk
2
ProTip! no:milestone will show everything without a milestone.