simonw/llm
View on GitHub ↗ ★ 12,691 Python
Access large language models from the command-line
78 mentions on Hacker News by 53 people: 8 stories, 70 comments · first 2023-05-19 · latest 2026-08-05
20082026
-
Access LLMs from the command line: https://github.com/simonw/llm
comment by some1else · 2024-05-21 · in iTerm2 and AI Hype Overload -
…integrate AI capabilities into your workflow or automate tasks. - *Link*: [llm GitHub Repository]( https://github.com/simonw/llm ) ### 2. ttok `ttok` is a CLI tool for working with tokenizers. It's a tool under development aimed at helping…
comment by irthomasthomas · 2024-05-19 · in Show HN: Interactive Graph by LLM (GPT-4o) -
Thanks for sharing this! Direct link to the repo for those curious - https://github.com/simonw/llm
comment by tedmiston · 2024-04-27 · in Cleaning Up Speech Recognition with GPT -
…Ollama extension (2). The first one works well enough for when I have to paste multiple lines. 1. https://github.com/simonw/llm?tab=readme-ov-file 2. https://www.raycast.com/massimiliano_pasquini/raycast-ollama
comment by hiyer · 2024-04-26 · in A look at the early impact of Meta Llama 3 -
…use case, you might be able to do this if you've got a copy and paste on the command line with https://github.com/simonw/llm In between. An alias like pdfwtf translating to "paste | llm command | copy"
comment by IanCal · 2024-04-14 · in Show HN: I made a tool to clean and convert any webpage to Markdown -
I added support for this model to my LLM CLI tool via a new plugin: https://github.com/simonw/llm-command-r So now you can do this: pipx install llm llm install llm-command-r llm keys set cohere <paste Cohere API key here> llm -m…
comment by simonw · 2024-04-04 · in Command R+: A Scalable LLM Built for Business -
If you're willing to use the CLI, Simon Willison's llm library[0] should do the trick. [0] https://github.com/simonw/llm
comment by r_hendricks · 2024-03-04 · in Claude 3 model family -
…the plugin like this: llm install -U llm-mistral Relevant issue when I thought this didn't work: https://github.com/simonw/llm/issues/427
comment by simonw · 2024-02-26 · in Mistral Large -
…to see tools that radically simplify the developer-experience for local LLMs/foundation models. [1] https://github.com/simonw/llm [2] https://docs.nos.run/docs/blog/serving-llms-on-a-budget.html... [3] https://github.com/simonw/ospeak
comment by fzysingularity · 2024-01-25 · in Ollama releases Python and JavaScript Libraries -
…that Simon's llm library is nice because he designed it as both a library and a command line tool: https://github.com/simonw/llm
comment by nswanberg · 2023-11-28 · in Semantic Kernel -
…model="gpt-3.5-turbo-instruct", prompt="Write a tagline for an ice cream shop." ) More notes here: https://github.com/simonw/llm/issues/284
comment by simonw · 2023-09-19 · in OpenAI GPT-3.5-turbo-instruct released -
`llm` might be the closest thing to that right now. https://github.com/simonw/llm
comment by dave1010uk · 2023-09-17 · in Guidance: A guidance language for controlling large language models -
…per 1k tokens and using it via the command line llm[1] tool, though. That is a far better deal. [1] https://github.com/simonw/llm
comment by miki123211 · 2023-09-06 · in What OpenAI really wants -
…last week: - https://github.com/jmorganca/ollama (download & run LLMs locally - I'm a maintainer) - https://github.com/simonw/llm (access LLMs from the cli - cloud and local) - https://github.com/oobabooga/text-generation-webui (a web ui…
comment by jmorgan · 2023-08-28 · in ChatGPT Enterprise -
What is the advantage of this versus running something like https://github.com/simonw/llm , which also gives you options to e.g. use https://github.com/simonw/llm-mlc for accelerated inference?
comment by avivo · 2023-08-17 · in Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2 -
…llm command line utility that has a very thin underlying library, but which might grow eventually: https://github.com/simonw/llm
comment by zby · 2023-08-14 · in LangChain Agent Simulation – Multi-Player Dungeons and Dragons -
…out how to get that to install when the user runs "brew install simonw/llm/llm" - issue here: https://github.com/simonw/llm/issues/102
comment by simonw · 2023-07-19 · in Accessing Llama 2 from the command-line with the LLM-replicate plugin -
…arguments I had with myself about this here, across the course of 129 pull requests comments: https://github.com/simonw/llm/pull/65
comment by simonw · 2023-07-15 · in The Problem with LangChain -
https://github.com/simonw/llm
comment by williamjackson · 2023-06-03 · in Show HN: Automating daily reports, because fuck it -
…you can pass "-4" or "--gpt4" as an option. CORRECTION: Sorry, I was talking about my "llm" tool - https://github.com/simonw/llm - it looks like "mods" does indeed default to 4: https://github.com/charmbracelet/mods/blob/e6352fdd8487ff8fc..…
comment by simonw · 2023-05-19 · in CLI tools for working with ChatGPT and other LLMs