Hellisotherpeople/llm_steer-oobabooga
View on GitHub ↗ ★ 46 Python
Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectors, now in oobabooga text generation webui!
6 mentions on Hacker News by 1 person: 2 stories, 4 comments · first 2024-03-21 · latest 2024-09-10
20082026
-
As it turns out, I wrote a whole extension for txgui that implemented some of what I wanted... https://github.com/Hellisotherpeople/llm_steer-oobabooga
comment by Der_Einzige · 2024-09-10 · in Is telling a model to "not hallucinate" absurd? -
…steering techniques to do this using control vectors. See this library as an example: https://github.com/Hellisotherpeople/llm_steer-oobabooga
comment by Der_Einzige · 2024-04-27 · in What can LLMs never do? -
I agree with you re:extensions. I know something of the extension ecosystem for it - I built one - https://github.com/Hellisotherpeople/llm_steer-oobabooga Oobabooga the closest thing we have to maximalism. It has exposure for by far the…
comment by Der_Einzige · 2024-04-01 · in Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally? -
…vectors is also really neat! You can play with steering vectors within oobabooga now: https://github.com/Hellisotherpeople/llm_steer-oobabooga
comment by Der_Einzige · 2024-03-26 · in Manipulating Chess-GPT's World Model