Hacker GitHub

← All repos

jessevig/bertviz

View on GitHub ↗ ★ 8,214 Python

BertViz: Visualize Attention in Transformer Models

3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2023-01-23 · latest 2024-02-13

Mentions per year 3 mentions · busiest year 2023 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …GPTs have redundant, undercomplex attentions. See this issue in BertViz about attention in Llama: https://github.com/jessevig/bertviz/issues/128
    comment by Translationaut · 2024-02-13 · in StreamingLLM: tiny tweak to KV LRU improves long conversations
  2. It would be interesting to have attention visualized as well, similar to how it's done in BertViz: https://github.com/jessevig/bertviz
    comment by atgctg · 2023-09-06 · in Show HN: Fully client-side GPT2 prediction visualizer
  3. Maybe BertVIZ? https://github.com/jessevig/bertviz
    comment by larve · 2023-01-23 · in Perplexity.ai prompt leakage