nebuly-ai/nos
View on GitHub ↗ ★ 688 Go
Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas - Effortless optimization at its finest!
9 mentions on Hacker News by 5 people: 1 story, 8 comments · first 2023-01-30 · latest 2023-03-01
20082026
-
…of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas. https://github.com/nebuly-ai/nos ChatLLaMA: Build faster and cheaper ChatGPT-like training process based on LLaMA architectures.…
comment by yarapavan · 2023-03-01 · in Nebullvm: Plug and play modules to optimize the performances of your AI systems -
…to borrow quotas of reserved resources from other teams as long as they are not using them. https://github.com/nebuly-ai/nos What is your thoughts on this project? :) Nos addresses some key challenges of Kubernetes tied to the fact that…
comment by michele_zanotti · 2023-02-09 -
…utilization by dynamically partitioning GPUs with NVIDIA MIG and MPS and leveraging Elastic Quotas. https://github.com/nebuly-ai/nos I hope this will be helpful to you as well. And let me know your feedback on this solution!
comment by michele_zanotti · 2023-02-06 -
Hi HN, my name is Michele Zanotti and I’ve just released an open-source called nos https://github.com/nebuly-ai/nos that enables to finally make GPU partitioning dynamic on Kubernetes! (and much more) You can think of the Dynamic GPU…
comment by zanotti · 2023-02-01 -
Hi HN, my name is Michele Zanotti and I’ve just released an open-source called nos https://github.com/nebuly-ai/nos that enables to finally make GPU partitioning dynamic on Kubernetes! (and much more) You can think of the Dynamic GPU…
comment by michele_zanotti · 2023-01-31 -
Hi HN, my name is Michele Zanotti and I’ve just released an open-source called nos https://github.com/nebuly-ai/nos that enables to finally make GPU partitioning dynamic on Kubernetes! (and much more) You can think of the Dynamic GPU…
comment by michele_zanotti · 2023-01-31 -
Hi HN, my name is Michele Zanotti and I’ve just released an open-source called nos https://github.com/nebuly-ai/nos that enables to finally make GPU partitioning dynamic on Kubernetes! (and much more) You can think of the Dynamic GPU…
comment by emilecourth · 2023-01-31 -
Hi HN, my name is Michele Zanotti and I’ve just released an open-source called nos https://github.com/nebuly-ai/nos that enables to finally make GPU partitioning dynamic on Kubernetes! (and much more) You can think of the Dynamic GPU…
comment by emilecourth · 2023-01-31