triton-inference-server/client
View on GitHub ↗ ★ 704 C++
Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2022-12-15 · latest 2024-10-12
20082026
-
Make sure to check out the existing Triton client libraries: https://github.com/triton-inference-server/client
comment by kkielhofner · 2024-10-12 · in Zero-Shot Text Classification on a low-end CPU-only machine? -
…[3] - https://github.com/triton-inference-server/model_navigator [4] - https://github.com/triton-inference-server/client/blob/main/... [5] - https://github.com/triton-inference-server/dali_backend
comment by kkielhofner · 2024-02-09 · in OpenAI compatibility -
…- https://github.com/kserve/kserve [1] - https://github.com/triton-inference-server/server [2] - https://github.com/triton-inference-server/client [3] - https://github.com/triton-inference-server/model_analyzer
comment by kkielhofner · 2022-12-15 · in Show HN: Software for Remote GPU-over-IP