Hacker GitHub

← All repos

zeroentropy-ai/zchunk

View on GitHub ↗ ★ 277 Python

A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.

4 mentions on Hacker News by 2 people: 2 stories, 2 comments · first 2024-11-15 · latest 2024-12-04

Mentions per year 4 mentions · busiest year 2024 (4)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    Show HN: I Used Llama-70B Logprobs for Better, Cheaper and Faster Chunking
    story by ghita_ · 2024-12-04 · 0 comments
  2. …even though we toss out the logprobs for that range. Details about the groupings are here: https://github.com/ZeroEntropy-AI/llama-chunk/blob/0cac10a34... -- No need to keep track of chunks that it's already made, we just want heatmap…
    comment by npip99 · 2024-11-15 · in LlamaChunk: Better RAG Chunking Than LlamaIndex
  3. Yep benchmarks are available at https://github.com/ZeroEntropy-AI/llama-chunk?tab=readme-ov-... , we used this dataset https://github.com/ZeroEntropy-AI/legalbenchrag which is a retrieval-focused version of LegalBench. It scored better…
    comment by npip99 · 2024-11-15 · in LlamaChunk: Better RAG Chunking Than LlamaIndex
  4. ▲ 15
    LlamaChunk: Better RAG Chunking Than LlamaIndex
    story by npip99 · 2024-11-15 · 5 comments