Hacker GitHub

← All repos

bennyschmidt/next-token-prediction

View on GitHub ↗ ★ 145 JavaScript

Next-token prediction in JavaScript - build fast language and diffusion models.

11 mentions on Hacker News by 4 people: 2 stories, 9 comments · first 2024-04-10 · latest 2024-09-03

Mentions per year 11 mentions · busiest year 2024 (11)
20082026
AllStoriesComments NewestTopOldest
  1. …----- YC alum of: Brave, Checkr GitHub: https://github.com/bennyschmidt Neat project: https://github.com/bennyschmidt/next-token-prediction
    comment by bschmidt1 · 2024-09-03 · in Ask HN: Who wants to be hired? (September 2024)
  2. …can run very easily in Chrome, so you don't have to rely solely on your amazing bullshit detector: https://github.com/bennyschmidt/next-token-prediction/tree/m... Don't forget to log the completions to prove that they aren't broken down by…
    comment by bschmidt1 · 2024-09-02 · in Building LLMs from the Ground Up: A 3-Hour Coding Workshop
  3. …News, and am baffled as to why (and also the question "isn't this just n-grams, nothing more?"). https://github.com/bennyschmidt/next-token-prediction ^ If you look at this GitHub repo, should be obvious it's a token prediction library -…
    comment by bschmidt1 · 2024-09-01 · in Building LLMs from the Ground Up: A 3-Hour Coding Workshop
  4. …I'm working on useful language models without taking the LLM approach: Next-token prediction: https://github.com/bennyschmidt/next-token-prediction Good for auto-complete, spellcheck, etc. AI chatbot: https://github.com/bennyschmidt/llimo…
    comment by bschmidt1 · 2024-09-01 · in Building LLMs from the Ground Up: A 3-Hour Coding Workshop
  5. …----- YC alum of: Brave, Checkr GitHub: https://github.com/bennyschmidt Neat project: https://github.com/bennyschmidt/next-token-prediction
    comment by _akhe · 2024-05-02 · in Ask HN: Who wants to be hired? (May 2024)
  6. …example in this autocompletion/token-prediction library I wrote that uses an ngram language model ( https://github.com/bennyschmidt/next-token-prediction ), GPU is only needed for initial training on text data, but there's no inference…
    comment by _akhe · 2024-04-24 · in Ask HN: How does deploying a fine-tuned model work
  7. …no less!) and putting it online! I'm going to use it in my auto-completion library (here: https://github.com/bennyschmidt/next-token-prediction/blob/m... ) instead of just `.split(' ')` as I'm pretty sure it will be more nuanced :) Awesome…
    comment by _akhe · 2024-04-22 · in Show HN: LLaMA 3 tokenizer runs in the browser
  8. …scenarios. I recently added a browser example showing simple autocomplete using my library: https://github.com/bennyschmidt/next-token-prediction/tree/m... (video) And next I'm implementing 8-dimensional embeddings that are converted to…
    comment by _akhe · 2024-04-18 · in Show HN: Next-token prediction in JavaScript
  9. Please change the title; it seems very misleading. It has nothing to do with LLMs. https://github.com/bennyschmidt/next-token-prediction/blob/d...
    comment by georgehill · 2024-04-11 · in Show HN: Next-token prediction in JavaScript