nebuly-ai/optimate
View on GitHub ↗ ★ 8,327 Python
A collection of libraries to optimise AI model performances
18 mentions on Hacker News by 9 people: 10 stories, 8 comments · first 2022-03-22 · latest 2023-03-22
20082026
-
How does it differentiate from the original ChatLLaMA? https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler...
comment by mikie92 · 2023-03-22 · in Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA -
Is this related in any way to the actual ChatLLama project that is developed here: https://github.com/nebuly-ai/nebullvm ?
comment by minxomat · 2023-03-22 · in Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA -
…set of SOTA optimization techniques to achieve the maximum inference speed-up on your hardware. https://github.com/nebuly-ai/nebullvm/blob/main/apps/acceler... Nos: Automatically maximize the utilization of GPU resources in a Kubernetes…
comment by yarapavan · 2023-03-01 · in Nebullvm: Plug and play modules to optimize the performances of your AI systems -
▲ 2
Nebullvm: Plug and play modules to optimize the performances of your AI systemsstory by yarapavan · 2023-03-01 · 1 comment
-
…and specifically chatllama, by themselves, are clearly OSS. They're licensed under Apache-2.0: https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... However, many models including LLaMA are not OSS (they have terms such as…
comment by dwheeler · 2023-02-27 · in Open source implementation for LLaMA-based ChatGPT -
▲ 289
Open source implementation for LLaMA-based ChatGPTstory by georgehill · 2023-02-27 · 115 comments
-
There's an open source implementation of the paper in pytorch https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... by @diegofiori_ He also wrote an interesting thread on the memory usage of this algo versus backprop…
comment by emilecourth · 2023-01-15 · in Geoffrey Hinton publishes new deep learning algorithm -
Direct link to an implementation on GitHub: https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... -- The divulgational title is almost an understatement: the Forward-Forward algorithm is an alternative to backpropagation. Edit:…
comment by mdp2021 · 2023-01-12 · in Geoffrey Hinton publishes new deep learning algorithm -
…inference. I built a notebook to experiment with different optimization techniques using Speedster. https://github.com/nebuly-ai/nebullvm/blob/main/notebooks/sp... Here are some takeaways that I think are worth sharing: 1⃣ On both GPUs and…
comment by emilecourth · 2023-01-10 -
▲ 2
Trending on GitHub/Python: Geoffrey Hintons ForwardForward Algorithm Open Sourcestory by emilecourth · 2022-12-30 · 0 comments
-
▲ 1
Nebullvm, new release Easy-to-use library to speed up AI inference by 2-30xstory by emilec___ · 2022-05-13 · 0 comments
-
▲ 1
Open source takes an AI model as input and outputs a version faster in inferencestory by emilec___ · 2022-04-22 · 0 comments
-
There's this new cool library on github for AI inference optimization. https://github.com/nebuly-ai/nebullvm As for the github readme, nebullvm is an open-source library takes your AI model as input and outputs an optimized version that…
comment by zzz_sleeping · 2022-04-11 · in An open-source that takes an AI model as input and outputs a much faster version -
▲ 3
An open-source that takes an AI model as input and outputs a much faster versionstory by zzz_sleeping · 2022-04-11 · 1 comment
-
▲ 2
Nebullvm open-source accelerator of AI inference. Feedback?story by emilec___ · 2022-03-24 · 1 comment
-
▲ 1
Nebullvm library You input an AI model,it optimizes it for running 5-20x fasterstory by emilec___ · 2022-03-23 · 0 comments
-
▲ 3
Almost no one knows how easily you can optimize your AI modelsstory by emilec___ · 2022-03-22 · 0 comments
-
▲ 3
Nebullvm, an open-source library to accelerate AI inference by 5-20xstory by emilec___ · 2022-03-22 · 0 comments