trholding/llama2.c
View on GitHub ↗ ★ 1,521 C
Llama 2 Everywhere (L2E)
24 mentions on Hacker News by 3 people: 10 stories, 14 comments · first 2023-08-26 · latest 2025-01-16
20082026
-
▲ 6
Llama2.c Running in a PDFstory by AMICABoard · 2025-01-16 · 1 comment
-
L2E Llama2.c in a PDF in a Shroedinger PNG Visit: https://github.com/trholding/llama2.c Download the header image from my repo, which is a Polyglot PNG (both a PNG and a PDF). Rename the extension from .png to .pdf and open it in Firefox…
comment by AMICABoard · 2025-01-16 · in L2E llama2.c running in a PDF in a Shroedinger PNG [pdf] -
▲ 6
L2E llama2.c running in a PDF in a Shroedinger PNG [pdf]story by AMICABoard · 2025-01-16 · 2 comments
-
…and a prompt, it continues to generate text. To get it to work, you need to clone and build this: https://github.com/trholding/llama2.c So the steps are like this: First you'll need to obtain approval from Meta to download llama3 models on…
comment by AMICABoard · 2024-07-24 · in Llama 3.1 in C -
…800B tokens. Can open a PR if people want :) [Edit: Just opened a PR! Apologies my C is very rusty! https://github.com/trholding/llama2.c/pull/14 ] https://github.com/trholding/llama2.c/blob/master/runq.c#L65... needs to be scaled with…
comment by danielhanchen · 2024-07-24 · in Llama 3.1 in C -
▲ 212
Llama 3.1 in Cstory by AMICABoard · 2024-07-24 · 36 comments
-
Okay if anyone wants to try Llama 3.1 inference on CPU, try this: https://github.com/trholding/llama2.c (L2E) It's a bit buggy but it is fun. Disclaimer: I am the author of L2E
comment by AMICABoard · 2024-07-23 · in Open source AI is the path forward -
▲ 1
Single C file Llama 3.1 Support in Llama 2 Everywherestory by AMICABoard · 2024-07-23 · 1 comment
-
Nice article. We did a demo for booting to LLM and also as Kernel Module: https://github.com/trholding/llama2.c The whole things was funny and buggy, but since then we have been developing in stealth, even trying to raise VC capital. Our…
comment by AMICABoard · 2024-03-15 · in What would an LLM OS look like? (2023) -
We are trying to create a proper OS that boots to an LLM. A toy demo is available in the releases: https://github.com/trholding/llama2.c Can we apply?
comment by AMICABoard · 2023-12-15 · in The Second Batch of the Open Source AI Grants -
Yes they do! https://github.com/jart/cosmopolitan/tree/master/third_party... and https://github.com/trholding/llama2.c
comment by AMICABoard · 2023-11-01 · in Cosmopolitan Third Edition -
…build just needs 512MB RAM and an x86_64 CPU. The ISO can be downloaded from the releases here: https://github.com/trholding/llama2.c/releases/tag/L2E_OS_v0... Currently it doesn't do much useful stuff except for stories. You could etch…
comment by AMICABoard · 2023-10-06 · in Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2 -
▲ 320
Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2story by jjwiseman · 2023-10-05 · 55 comments
-
▲ 1
Play a hidden framebuffer Doom on TempleDOSstory by AMICABoard · 2023-10-04 · 1 comment
-
I feel you! Here it is: https://github.com/trholding/llama2.c#new---l2e-os-linux-ker...
comment by AMICABoard · 2023-10-03 · in A Linux OS that boots to LLAMA2 and has a startrek like UI -
▲ 2
Show HN: Tiny OS that boots to LLAMA2, has DOOM and easter eggsstory by AMICABoard · 2023-10-03 · 0 comments
-
404? Try: https://github.com/trholding/llama2.c
comment by AMICABoard · 2023-10-03 · in OS that boots to LLAMA2 also runs LLAMA2 as kernel module -
▲ 73
A Linux OS that boots to LLAMA2 and has a startrek like UIstory by AMICABoard · 2023-10-03 · 35 comments
-
Release is here: https://github.com/trholding/llama2.c/releases/tag/L2E_OS_v0 ... Since it doesn't do much I have added a hidden Doom game and some Easter eggs such as Matrix and Mr Robot references :) This release is dedicated to the…
comment by AMICABoard · 2023-10-02 · in OS that boots to LLAMA2 also runs LLAMA2 as kernel module -
Screenshots here: https://twitter.com/VulcanIgnis/status/1708851772435968017 Release is here: https://github.com/trholding/llama2.c/releases/tag/L2E_OS_v0... Since it doesn't do much I have added a hidden Doom game and some Easter eggs…
comment by AMICABoard · 2023-10-02 · in I made an OS that boots into an LLM! -
▲ 1
I made an OS that boots into an LLM!story by AMICABoard · 2023-10-02 · 1 comment
-
If you add an issue you can do so on https://github.com/trholding/llama2.c I have a planned a web api. Are you looking for python binding? I'm interested to know. The issues would keep me organized.
comment by AMICABoard · 2023-08-26 · in Llama2.c L2E LLM – Multi OS Binary and Unikernel Release -
…suggestion, a comprehensive howto is planned. Feel free to add any issue / wants / suggestions to https://github.com/trholding/llama2.c , I'll address those as I get time. I'm stuck with bigger IRL projects, but if there is deep interest…
comment by AMICABoard · 2023-08-26 · in Llama2.c L2E LLM – Multi OS Binary and Unikernel Release -
▲ 76
Llama2.c L2E LLM – Multi OS Binary and Unikernel Releasestory by AMICABoard · 2023-08-26 · 29 comments