r2d4/openlm
View on GitHub ↗ ★ 371 Python
OpenAI-compatible Python client that can call any LLM
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2023-05-09 · latest 2023-06-19
20082026
-
I haven't tried that but https://github.com/abetlen/llama-cpp-python and https://github.com/r2d4/openlm exists
comment by rain1 · 2023-05-14 · in Run Llama 13B with a 6GB graphics card