Hacker GitHub

← All repos

triton-inference-server/server

View on GitHub ↗ ★ 11,132 Python

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

7 mentions on Hacker News by 3 people: 0 stories, 7 comments · first 2020-09-14 · latest 2025-09-17

Mentions per year 7 mentions · busiest year 2023 (2)
20082026
AllStoriesComments NewestTopOldest
  1. Also it REALLY jams me up that this is a thing, complicating discussions: https://github.com/triton-inference-server/server
    comment by mdaniel · 2025-09-17 · in Gluon: a GPU programming language based on the same compiler stack as Triton
  2. …uses for very performant inference - even across multiple chassis over another network layer. [0] - https://github.com/triton-inference-server/server
    comment by kkielhofner · 2024-10-11 · in Scuda – Virtual GPU over IP
  3. …with these challenges today, I recommend taking a peek at nvidia's Triton inference server ( https://github.com/triton-inference-server/server ), which handles a lot of these details for you. It supports things like zero-copy sharing of…
    comment by inoop · 2024-09-28 · in Everything you need to know about Python 3.13 – JIT and GIL went up the hill
  4. …- https://towhee.io/ [1] - https://github.com/towhee-io/examples/tree/main/image/text_i... [2] - https://github.com/triton-inference-server/server [3] - https://news.ycombinator.com/item?id=35199418#35200266
    comment by kkielhofner · 2023-03-26 · in Vector database built for scalable similarity search
  5. …Triton Server is very impressive and I'm always surprised to see how relatively niche it is. [0] - https://github.com/triton-inference-server/server
    comment by kkielhofner · 2023-01-16 · in TensorFlow for Python is dying?
  6. …memory management and control, all kinds of stuff. [0] - https://github.com/kserve/kserve [1] - https://github.com/triton-inference-server/server [2] - https://github.com/triton-inference-server/client [3] -…
    comment by kkielhofner · 2022-12-15 · in Show HN: Software for Remote GPU-over-IP
  7. …in place to effectively make their CUDA compute available over the network using various APIs: https://github.com/triton-inference-server/server Going on just the name Triton is currently only available for inference but it provides the…
    comment by kkielhofner · 2020-09-14 · in Nvidia to Acquire Arm for $40B