tensorflow/serving
View on GitHub ↗ ★ 6,366 C++
A flexible, high-performance serving system for machine learning models
10 mentions on Hacker News by 9 people: 3 stories, 7 comments · first 2016-02-17 · latest 2023-06-13
20082026
-
…model series and significantly outperformed others [2]. Same trick basically like llama.cpp [1] https://github.com/tensorflow/serving [2] https://github.com/pjreddie/darknet
comment by tension000 · 2023-06-13 · in Llama.cpp: Full CUDA GPU Acceleration -
Most likely it's a model server running something like https://github.com/tensorflow/serving and if there isn't a lot of load, the resource could kill some of its tasks. I wouldn't imagine it's sitting around pondering deep thoughts.
comment by dekhn · 2022-06-13 · in Is LaMDA Sentient? – An Interview [pdf] -
https://github.com/tensorflow/serving https://thenewstack.io/tutorial-deploying-tensorflow-models-...
comment by billconan · 2022-05-25 · in Ask HN: How to deploy a TensorFlow model for access through an HTTP endpoint? -
…and docs linked) is start building on top of the * -devel-mkl image. -masroor(author) [1] https://github.com/tensorflow/serving/tree/master/tensorflow...
comment by human_afterall · 2019-03-26 · in We improved Tensorflow Serving performance by over 70% -
…source ML deployment packages: https://github.com/oracle/graphpipe https://github.com/eliorc/denzel https://github.com/tensorflow/serving https://github.com/ucbrise/clipper https://github.com/DLHub-Argonne/dlhub_sdk…
comment by Michaelanjello · 2018-12-16 · in Michelangelo PyML: Uber’s Platform for Rapid Python ML Model -
TensorFlow: https://www.tensorflow.org/ TensorFlow Serving: https://github.com/tensorflow/serving ReCeption (actually they call in Inception v3. Not sure where I got the ReCeption name - though I'm sure I read it somewhere?):…
comment by nl · 2016-02-18 · in Google Cloud Vision API enters Beta -
…so tidy and clean. It just feels like a work of craftmanship, if that actually exists in software: https://github.com/tensorflow/serving/tree/master/tensorflow... OTOH, I have a strong prejudice against Javascript on the backend... And its…
comment by swah · 2016-02-17 · in Running your models in production with TensorFlow Serving