Hacker GitHub

← All repos

tensorflow/serving

View on GitHub ↗ ★ 6,366 C++

A flexible, high-performance serving system for machine learning models

10 mentions on Hacker News by 9 people: 3 stories, 7 comments · first 2016-02-17 · latest 2023-06-13

Mentions per year 10 mentions · busiest year 2022 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …model series and significantly outperformed others [2]. Same trick basically like llama.cpp [1] https://github.com/tensorflow/serving [2] https://github.com/pjreddie/darknet
    comment by tension000 · 2023-06-13 · in Llama.cpp: Full CUDA GPU Acceleration
  2. ▲ 3
    TF Serving has been unavailable for 8 days
    story by willchang · 2022-07-27 · 1 comment
  3. Most likely it's a model server running something like https://github.com/tensorflow/serving and if there isn't a lot of load, the resource could kill some of its tasks. I wouldn't imagine it's sitting around pondering deep thoughts.
    comment by dekhn · 2022-06-13 · in Is LaMDA Sentient? – An Interview [pdf]
  4. https://github.com/tensorflow/serving https://thenewstack.io/tutorial-deploying-tensorflow-models-...
    comment by billconan · 2022-05-25 · in Ask HN: How to deploy a TensorFlow model for access through an HTTP endpoint?
  5. …and docs linked) is start building on top of the * -devel-mkl image. -masroor(author) [1] https://github.com/tensorflow/serving/tree/master/tensorflow...
    comment by human_afterall · 2019-03-26 · in We improved Tensorflow Serving performance by over 70%
  6. …source ML deployment packages: https://github.com/oracle/graphpipe https://github.com/eliorc/denzel https://github.com/tensorflow/serving https://github.com/ucbrise/clipper https://github.com/DLHub-Argonne/dlhub_sdk…
    comment by Michaelanjello · 2018-12-16 · in Michelangelo PyML: Uber’s Platform for Rapid Python ML Model
  7. ▲ 5
    RESTful API for TensorFlow Serving
    story by wjarek · 2018-06-11 · 0 comments
  8. ▲ 2
    TensorFlow Serving 0.5 Includes ModelServer PredictionService API and SavedModel
    story by wjarek · 2017-02-04 · 0 comments
  9. TensorFlow: https://www.tensorflow.org/ TensorFlow Serving: https://github.com/tensorflow/serving ReCeption (actually they call in Inception v3. Not sure where I got the ReCeption name - though I'm sure I read it somewhere?):…
    comment by nl · 2016-02-18 · in Google Cloud Vision API enters Beta
  10. …so tidy and clean. It just feels like a work of craftmanship, if that actually exists in software: https://github.com/tensorflow/serving/tree/master/tensorflow... OTOH, I have a strong prejudice against Javascript on the backend... And its…
    comment by swah · 2016-02-17 · in Running your models in production with TensorFlow Serving