nebuly-ai/optimate
View on GitHub ↗ ★ 8,327 Python
A collection of libraries to optimise AI model performances
18 mentions on Hacker News by 9 people: 10 stories, 8 comments · first 2022-03-22 · latest 2023-03-22
20082026
-
How does it differentiate from the original ChatLLaMA? https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler...
comment by mikie92 · 2023-03-22 · in Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA -
Is this related in any way to the actual ChatLLama project that is developed here: https://github.com/nebuly-ai/nebullvm ?
comment by minxomat · 2023-03-22 · in Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA -
…set of SOTA optimization techniques to achieve the maximum inference speed-up on your hardware. https://github.com/nebuly-ai/nebullvm/blob/main/apps/acceler... Nos: Automatically maximize the utilization of GPU resources in a Kubernetes…
comment by yarapavan · 2023-03-01 · in Nebullvm: Plug and play modules to optimize the performances of your AI systems -
…and specifically chatllama, by themselves, are clearly OSS. They're licensed under Apache-2.0: https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... However, many models including LLaMA are not OSS (they have terms such as…
comment by dwheeler · 2023-02-27 · in Open source implementation for LLaMA-based ChatGPT -
There's an open source implementation of the paper in pytorch https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... by @diegofiori_ He also wrote an interesting thread on the memory usage of this algo versus backprop…
comment by emilecourth · 2023-01-15 · in Geoffrey Hinton publishes new deep learning algorithm -
Direct link to an implementation on GitHub: https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... -- The divulgational title is almost an understatement: the Forward-Forward algorithm is an alternative to backpropagation. Edit:…
comment by mdp2021 · 2023-01-12 · in Geoffrey Hinton publishes new deep learning algorithm -
…inference. I built a notebook to experiment with different optimization techniques using Speedster. https://github.com/nebuly-ai/nebullvm/blob/main/notebooks/sp... Here are some takeaways that I think are worth sharing: 1⃣ On both GPUs and…
comment by emilecourth · 2023-01-10 -
There's this new cool library on github for AI inference optimization. https://github.com/nebuly-ai/nebullvm As for the github readme, nebullvm is an open-source library takes your AI model as input and outputs an optimized version that…
comment by zzz_sleeping · 2022-04-11 · in An open-source that takes an AI model as input and outputs a much faster version