rbitr/llm.f90
View on GitHub ↗ ★ 68 Fortran
LLM inference in Fortran
19 mentions on Hacker News by 2 people: 9 stories, 10 comments · first 2023-09-03 · latest 2024-04-08
20082026
-
I'd like to think he took the name from my llm.f90 project https://github.com/rbitr/llm.f90 It was originally based off of Karpathy's llama2.c but I renamed it when I added support for other architectures. Probable a coincidence :)
comment by andy99 · 2024-04-08 · in Llm.c – LLM training in simple, pure C/CUDA -
…https://github.com/openai/gpt-2/blob/9b63575ef42771a015060c9... And the actual list of characters: https://github.com/rbitr/llm.f90/blob/dev/phi2/phi2/pretoken...
comment by andy99 · 2024-03-17 · in Parsing URLs in Python -
…now) on a LLM framework in Fortan. Sort of a spin out from work, firmly in hobby territory though: https://github.com/rbitr/llm.f90 There are lots of good free or open source tools, which is one of the things I like about fortran - support…
comment by andy99 · 2024-02-21 · in Winteracter – The Fortran GUI Toolset -
…one. And it's in Fortran but it should be easy to get gfortran if you don't have it installed. https://github.com/rbitr/llm.f90/tree/optimize16/purefortran
comment by andy99 · 2024-01-05 · in TinyLlama: An Open-Source Small Language Model -
…so this will help with learning. I can't help but also plug my own Mamba inference implementation. https://github.com/rbitr/llm.f90/tree/master/ssm For inference one token at a time everything simplifies considerably.
comment by andy99 · 2023-12-20 · in Implementation of Mamba in one file of PyTorch -
You may also be interested in https://github.com/rbitr/llm.f90/tree/master/ssm it's my inference only implementation of mamba which ends up being much simpler than the training code in the original repo
comment by andy99 · 2023-12-18 · in Guide to the Mamba architecture that claims to be a replacement for Transformers -
…projects exist, e.g. https://github.com/nlpodyssey/rwkv.f90 https://github.com/certik/fastGPT https://github.com/rbitr/llm.f90 (disclaimer, mine)
comment by andy99 · 2023-11-22 · in Fortran 2023 -
…It's nothing you couldn't do in C but I think Fortran is better suited for linear algebra. See also https://github.com/rbitr/llama2.f90 which is basically the same thing but for running llama models and has 16-bit and 4-bit options and a…
comment by andy99 · 2023-10-16 · in GPU Embedding with GGML -
…simplicity (complexity of llama.cpp had exploded) there is still room for competition I believe. https://github.com/rbitr/llama2.f90 Once I make it a bit easier to use I want to promote it more.
comment by andy99 · 2023-09-26 · in Ollama for Linux – Run LLMs on Linux with GPU Acceleration -
…for Mojo. If anyone is interested in Fortran for AI, I am working on a Fortran LLM project: https://github.com/rbitr/llama2.f90 It runs as fast as C but is generally a higher level language that makes it easier to work with matrices and…
comment by andy99 · 2023-09-10 · in Is Mojo the Fortran for AI Programming, or More? – The Next Platform