bennyschmidt/next-token-prediction
View on GitHub ↗ ★ 145 JavaScript
Next-token prediction in JavaScript - build fast language and diffusion models.
11 mentions on Hacker News by 4 people: 2 stories, 9 comments · first 2024-04-10 · latest 2024-09-03
20082026
-
…----- YC alum of: Brave, Checkr GitHub: https://github.com/bennyschmidt Neat project: https://github.com/bennyschmidt/next-token-prediction
comment by bschmidt1 · 2024-09-03 · in Ask HN: Who wants to be hired? (September 2024) -
…can run very easily in Chrome, so you don't have to rely solely on your amazing bullshit detector: https://github.com/bennyschmidt/next-token-prediction/tree/m... Don't forget to log the completions to prove that they aren't broken down by…
comment by bschmidt1 · 2024-09-02 · in Building LLMs from the Ground Up: A 3-Hour Coding Workshop -
…News, and am baffled as to why (and also the question "isn't this just n-grams, nothing more?"). https://github.com/bennyschmidt/next-token-prediction ^ If you look at this GitHub repo, should be obvious it's a token prediction library -…
comment by bschmidt1 · 2024-09-01 · in Building LLMs from the Ground Up: A 3-Hour Coding Workshop -
…I'm working on useful language models without taking the LLM approach: Next-token prediction: https://github.com/bennyschmidt/next-token-prediction Good for auto-complete, spellcheck, etc. AI chatbot: https://github.com/bennyschmidt/llimo…
comment by bschmidt1 · 2024-09-01 · in Building LLMs from the Ground Up: A 3-Hour Coding Workshop -
▲ 1
Ask HN: Good AI/LLM hiring communities?story by nopro · 2024-05-09 · 0 comments
-
…----- YC alum of: Brave, Checkr GitHub: https://github.com/bennyschmidt Neat project: https://github.com/bennyschmidt/next-token-prediction
comment by _akhe · 2024-05-02 · in Ask HN: Who wants to be hired? (May 2024) -
…example in this autocompletion/token-prediction library I wrote that uses an ngram language model ( https://github.com/bennyschmidt/next-token-prediction ), GPU is only needed for initial training on text data, but there's no inference…
comment by _akhe · 2024-04-24 · in Ask HN: How does deploying a fine-tuned model work -
…no less!) and putting it online! I'm going to use it in my auto-completion library (here: https://github.com/bennyschmidt/next-token-prediction/blob/m... ) instead of just `.split(' ')` as I'm pretty sure it will be more nuanced :) Awesome…
comment by _akhe · 2024-04-22 · in Show HN: LLaMA 3 tokenizer runs in the browser -
…scenarios. I recently added a browser example showing simple autocomplete using my library: https://github.com/bennyschmidt/next-token-prediction/tree/m... (video) And next I'm implementing 8-dimensional embeddings that are converted to…
comment by _akhe · 2024-04-18 · in Show HN: Next-token prediction in JavaScript -
Please change the title; it seems very misleading. It has nothing to do with LLMs. https://github.com/bennyschmidt/next-token-prediction/blob/d...
comment by georgehill · 2024-04-11 · in Show HN: Next-token prediction in JavaScript -
▲ 88
Show HN: Next-token prediction in JavaScriptstory by nopro · 2024-04-10 · 102 comments