mosecorg/mosec
View on GitHub ↗ ★ 904 Python
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
3 mentions on Hacker News by 1 person: 2 stories, 1 comment · first 2021-10-05 · latest 2022-10-20
20082026
-
…as a ML service, maybe you should try to compare it with other ML model serving frameworks like https://github.com/mosecorg/mosec or https://github.com/bentoml/BentoML . Flask/FastAPI are not built for ML services.
comment by urcyanide · 2022-10-20 · in PostgresML is 8-40x faster than Python HTTP microservices -
▲ 1
Python Machine Learning Service Can Run Way More Fasterstory by urcyanide · 2022-10-06 · 0 comments
-
▲ 4
Show HN: Mosec makes the machine learning model serving flexible and efficientstory by urcyanide · 2021-10-05 · 1 comment