cortexlabs/cortex on Hacker News

…of deploying models as prediction APIs, however. I work on an open source ML deployment platform ( https://github.com/cortexlabs/cortex ) and the problems we spend the most time on/teams struggle with the most don't seem to be written…

comment by calebkaiser · 2020-10-17 · in How to put machine learning models into production

▲ 190

Show HN: Build a DIY license plate reader with machine learning

story by calebkaiser · 2020-09-16 · 60 comments

▲ 1

Cortex 0.19: Model serving for ML engineering

story by calebkaiser · 2020-09-14 · 0 comments

…such a NLP-library-as-API endpoint, albeit with Hugging Face's Transformers, deployed via Cortex: https://github.com/cortexlabs/cortex/blob/master/examples/py...

comment by calebkaiser · 2020-09-10 · in Ask HN: Natural language processing to identify grammar in a text?

If you want to play with your own GPT-2 API, I put this together and shared it on HN yesterday: https://github.com/cortexlabs/cortex/tree/master/examples/py... You can run that and deploy your own GPT-2 API locally, or in the cloud. I'd…

comment by calebkaiser · 2020-09-09 · in Low-code, no-model recommendation system with GPT3

…This project uses a couple tools: - Cortex: An open source model serving platform I help maintain. https://github.com/cortexlabs/cortex - Hugging Face's Transformers: An open source library for using popular language models, like GPT-2.…

comment by calebkaiser · 2020-09-08 · in Show HN: Can't afford GPT-3 access? Self-host your own GPT-2 API

▲ 7

Show HN: Can't afford GPT-3 access? Self-host your own GPT-2 API

story by calebkaiser · 2020-09-08 · 1 comment

▲ 1

Cortex 0.19: Model serving for machine learning engineering

story by ChefboyOG · 2020-08-31 · 0 comments

…I maintain an open source project that automates DevOps for ML deployments, built on top of AWS: https://github.com/cortexlabs/cortex

comment by calebkaiser · 2020-08-30 · in Ask HN: How does your data science or machine learning team handle DevOps?

▲ 2

Cortex 0.19: Model serving for machine learning engineering

story by ChefboyOG · 2020-08-28 · 0 comments

▲ 1

Cortex 0.19: Build, deploy, and manage prediction APIs

story by ChefboyOG · 2020-08-25 · 0 comments

…summary of our entire philosophy. For example, instead of notebooks, our model serving platform ( https://github.com/cortexlabs/cortex ) uses YAML to structure deployments, and Python scripts to write inference APIs. It's still…

comment by calebkaiser · 2020-08-13 · in Show HN: Orchest – Data Science Pipelines

…instances you're deploying them on? I ask because I help maintain an open source ML infra project ( https://github.com/cortexlabs/cortex ) and we've recently done a lot of work around autoscaling multi-model endpoints. Always curious to…

comment by calebkaiser · 2020-07-27 · in Show HN: Neural text to speech with dozens of celebrity voices

…spent a ton of time on cost optimization for running GPU-intensive ML models, specifically on AWS: https://github.com/cortexlabs/cortex If you've done zero optimization so far, there is likely some real low-hanging fruit: 1. If GPU…

comment by calebkaiser · 2020-07-11 · in Ask HN: How can I quickly trim my AWS bill?

…but I'm a maintainer of Cortex, a model deployment platform that sounds like it might be useful: https://github.com/cortexlabs/cortex With DVC/Cortex, you can set things up so that all you have to do is run `dvc push` to update your model…

comment by calebkaiser · 2020-07-07 · in Show HN: Continuous Machine Learning – CI/CD for Machine Learning Projects

…a YAML file, and you deploy with the Cortex CLI. You can see a GIF of a deployment on the repo: https://github.com/cortexlabs/cortex In order to deploy the API, Cortex automates all the necessary cloud infrastructure. It spins up a k8s…

comment by calebkaiser · 2020-06-29 · in Cortex: API platform for machine learning engineers

▲ 5

Cortex: API platform for machine learning engineers

story by ChefboyOG · 2020-06-29 · 2 comments

▲ 1

Cortex 0.18: Build Machine Learning APIs

story by ChefboyOG · 2020-06-26 · 0 comments

…built specifically because of how incongruous the data science workflow is to software engineering: https://github.com/cortexlabs/cortex

comment by calebkaiser · 2020-06-24 · in What I learned from looking at every AI/ML tool I could find

I work on ML infrastructure ( https://github.com/cortexlabs/cortex ) and we originally wrote our CLI in Python. Rewriting it in Go has been a major win both in terms of performance and cross-platform support.

comment by calebkaiser · 2020-05-27 · in Diving into Go by building a CLI application

…hacky solutions to putting models into production. I'm biased in that I work on Cortex ( https://github.com/cortexlabs/cortex ), but I think that open source, modular tooling that removes the need to reinvent the wheel is going to have a…

comment by calebkaiser · 2020-04-28 · in We Need DevOps for ML Data

How is this different than Cortex? https://github.com/cortexlabs/cortex

comment by sheepstrat · 2020-04-22 · in Facebook AI, AWS partner to release new PyTorch libraries

…most of our users version control their code/configuration (we do that with our examples as well: https://github.com/cortexlabs/cortex/examples ), and it should be straightforward to integrate Cortex into an existing CI/CD workflow; the…

comment by calebkaiser · 2020-04-14 · in Show HN: Cortex – Open-source alternative to SageMaker for model serving

▲ 65

Show HN: Cortex – Open-source alternative to SageMaker for model serving

story by calebkaiser · 2020-04-14 · 19 comments

▲ 11

Cortex: An open source alternative to SageMaker

story by ChefboyOG · 2020-04-08 · 0 comments

▲ 15

Cortex v0.15: An Open Source Platform for Deploying ML Models

story by khabibthyme · 2020-04-04 · 0 comments

▲ 8

Cortex: Open-source infrastructure for applied machine learning

story by sheepstrat · 2020-03-25 · 0 comments

▲ 2

Ask HN: OSS maintainers, how are you dealing with GitHub hiding stars?

story by calebkaiser · 2020-03-23 · 0 comments

▲ 12

Cortex v0.14: Deploy machine learning models as APIs

story by calebkaiser · 2020-03-14 · 0 comments

▲ 5

Cortex v0.14: Deploy ML Models as JSON APIs

story by ChefboyOG · 2020-03-10 · 0 comments

▲ 3

Show HN: Cortex – the easiest way to build ML apps

story by calebkaiser · 2020-03-04 · 0 comments

▲ 1

Cortex: ML Platform for Developers

story by calebkaiser · 2020-02-21 · 0 comments

▲ 2

Cortex: Open-source alternative to SageMaker serving

story by calebkaiser · 2020-02-11 · 0 comments

…trained models as APIs and automates the underlying devops. It's also free and open source. GitHub: https://github.com/cortexlabs/cortex

comment by calebkaiser · 2020-02-04 · in Kubernetes the Easy Way

…the PyTorch blog about it: https://medium.com/pytorch/how-to-build-production-software-... GitHub: https://github.com/cortexlabs/cortex Full disclosure/shameless plug: I work on Cortex

comment by calebkaiser · 2020-01-30 · in Standardizing OpenAI’s deep learning framework on PyTorch

…(as well as other frameworks) as scalable APIs. It sounds perfect for what you're looking for: https://github.com/cortexlabs/cortex Cortex automates all of the devops work—from containerizing your model, to orchestrating Kubernetes, to…

comment by calebkaiser · 2019-12-22 · in Ask HN: How can I set up an ML model as a scalable API?

…if the configuration is declarative and tracked in git? I'd love to hear your feedback! (GitHub: https://github.com/cortexlabs/cortex | website: https://cortex.dev/ )

comment by ospillinger · 2019-11-12 · in Ask HN: What is your ML stack like?