GoogleCloudPlatform/localllm
View on GitHub ↗ ★ 1,548 Python archived
4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2024-02-07 · latest 2024-02-08
20082026
-
…. > run LLMs locally on CPU and memory, right within the Google Cloud Workstation And in the code https://github.com/GoogleCloudPlatform/localllm/blob/main/qu... there's just a shebang halfway down? import sys def main(argv): pass if…
comment by IanCal · 2024-02-08 · in Localllm lets you develop gen AI apps on local CPUs -
I'm not thrilled about https://github.com/GoogleCloudPlatform/localllm/blob/main/ll... calling their Python package "llm" and installing "llm" as a CLI command, when my similar https://llm.datasette.io/ project has that namespace reserved…
comment by simonw · 2024-02-08 · in Localllm lets you develop gen AI apps on local CPUs -
https://github.com/GoogleCloudPlatform/localllm/blob/main/ll... I see llama.cpp in there, but I didn't go deeper than that. Ollama is not the same thing.
comment by andy99 · 2024-02-07 · in Localllm lets you develop gen AI apps on local CPUs -
…only from huggingface instead of the ollama repos. Thus maybe it is NOT a wrapper of ollama? [1] https://github.com/googlecloudplatform/localllm
comment by williamstein · 2024-02-07 · in Localllm lets you develop gen AI apps on local CPUs