cortexlabs/cortex on Hacker News

…I help maintain open source ML infra for GPU inference and think about compute spend way too much https://github.com/cortexlabs/cortex

comment by calebkaiser · 2021-01-06 · in Deep-learning text-to-speech tool for generating voices of various characters

…of deploying models as prediction APIs, however. I work on an open source ML deployment platform ( https://github.com/cortexlabs/cortex ) and the problems we spend the most time on/teams struggle with the most don't seem to be written…

comment by calebkaiser · 2020-10-17 · in How to put machine learning models into production

…such a NLP-library-as-API endpoint, albeit with Hugging Face's Transformers, deployed via Cortex: https://github.com/cortexlabs/cortex/blob/master/examples/py...

comment by calebkaiser · 2020-09-10 · in Ask HN: Natural language processing to identify grammar in a text?

If you want to play with your own GPT-2 API, I put this together and shared it on HN yesterday: https://github.com/cortexlabs/cortex/tree/master/examples/py... You can run that and deploy your own GPT-2 API locally, or in the cloud. I'd…

comment by calebkaiser · 2020-09-09 · in Low-code, no-model recommendation system with GPT3

…This project uses a couple tools: - Cortex: An open source model serving platform I help maintain. https://github.com/cortexlabs/cortex - Hugging Face's Transformers: An open source library for using popular language models, like GPT-2.…

comment by calebkaiser · 2020-09-08 · in Show HN: Can't afford GPT-3 access? Self-host your own GPT-2 API

…I maintain an open source project that automates DevOps for ML deployments, built on top of AWS: https://github.com/cortexlabs/cortex

comment by calebkaiser · 2020-08-30 · in Ask HN: How does your data science or machine learning team handle DevOps?

…summary of our entire philosophy. For example, instead of notebooks, our model serving platform ( https://github.com/cortexlabs/cortex ) uses YAML to structure deployments, and Python scripts to write inference APIs. It's still…

comment by calebkaiser · 2020-08-13 · in Show HN: Orchest – Data Science Pipelines

…instances you're deploying them on? I ask because I help maintain an open source ML infra project ( https://github.com/cortexlabs/cortex ) and we've recently done a lot of work around autoscaling multi-model endpoints. Always curious to…

comment by calebkaiser · 2020-07-27 · in Show HN: Neural text to speech with dozens of celebrity voices

…spent a ton of time on cost optimization for running GPU-intensive ML models, specifically on AWS: https://github.com/cortexlabs/cortex If you've done zero optimization so far, there is likely some real low-hanging fruit: 1. If GPU…

comment by calebkaiser · 2020-07-11 · in Ask HN: How can I quickly trim my AWS bill?

…but I'm a maintainer of Cortex, a model deployment platform that sounds like it might be useful: https://github.com/cortexlabs/cortex With DVC/Cortex, you can set things up so that all you have to do is run `dvc push` to update your model…

comment by calebkaiser · 2020-07-07 · in Show HN: Continuous Machine Learning – CI/CD for Machine Learning Projects

…a YAML file, and you deploy with the Cortex CLI. You can see a GIF of a deployment on the repo: https://github.com/cortexlabs/cortex In order to deploy the API, Cortex automates all the necessary cloud infrastructure. It spins up a k8s…

comment by calebkaiser · 2020-06-29 · in Cortex: API platform for machine learning engineers

…built specifically because of how incongruous the data science workflow is to software engineering: https://github.com/cortexlabs/cortex

comment by calebkaiser · 2020-06-24 · in What I learned from looking at every AI/ML tool I could find

I work on ML infrastructure ( https://github.com/cortexlabs/cortex ) and we originally wrote our CLI in Python. Rewriting it in Go has been a major win both in terms of performance and cross-platform support.

comment by calebkaiser · 2020-05-27 · in Diving into Go by building a CLI application

…hacky solutions to putting models into production. I'm biased in that I work on Cortex ( https://github.com/cortexlabs/cortex ), but I think that open source, modular tooling that removes the need to reinvent the wheel is going to have a…

comment by calebkaiser · 2020-04-28 · in We Need DevOps for ML Data

How is this different than Cortex? https://github.com/cortexlabs/cortex

comment by sheepstrat · 2020-04-22 · in Facebook AI, AWS partner to release new PyTorch libraries

…most of our users version control their code/configuration (we do that with our examples as well: https://github.com/cortexlabs/cortex/examples ), and it should be straightforward to integrate Cortex into an existing CI/CD workflow; the…

comment by calebkaiser · 2020-04-14 · in Show HN: Cortex – Open-source alternative to SageMaker for model serving

…trained models as APIs and automates the underlying devops. It's also free and open source. GitHub: https://github.com/cortexlabs/cortex

comment by calebkaiser · 2020-02-04 · in Kubernetes the Easy Way

…the PyTorch blog about it: https://medium.com/pytorch/how-to-build-production-software-... GitHub: https://github.com/cortexlabs/cortex Full disclosure/shameless plug: I work on Cortex

comment by calebkaiser · 2020-01-30 · in Standardizing OpenAI’s deep learning framework on PyTorch

…(as well as other frameworks) as scalable APIs. It sounds perfect for what you're looking for: https://github.com/cortexlabs/cortex Cortex automates all of the devops work—from containerizing your model, to orchestrating Kubernetes, to…

comment by calebkaiser · 2019-12-22 · in Ask HN: How can I set up an ML model as a scalable API?

…if the configuration is declarative and tracked in git? I'd love to hear your feedback! (GitHub: https://github.com/cortexlabs/cortex | website: https://cortex.dev/ )

comment by ospillinger · 2019-11-12 · in Ask HN: What is your ML stack like?

…re: cost. We tried a few different things out, but ultimately wound up sticking with Cortex https://github.com/cortexlabs/cortex/

comment by lev272 · 2019-11-12 · in Ask HN: What is your ML stack like?

…and we have full tutorial for deploying a sentiment classifier using BERT quickly and easily: https://github.com/cortexlabs/cortex/tree/master/examples/se...

comment by calebkaiser · 2019-10-25 · in Applying BERT models to Search

Agreed, but projects like Cortex are narrowing the gap around deployment imo https://github.com/cortexlabs/cortex

comment by ChefboyOG · 2019-10-10 · in The State of Machine Learning Frameworks