Hacker GitHub

← All repos

zeroentropy-ai/zchunk

View on GitHub ↗ ★ 277 Python

A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.

4 mentions on Hacker News by 2 people: 2 stories, 2 comments · first 2024-11-15 · latest 2024-12-04

Mentions per year 4 mentions · busiest year 2024 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …even though we toss out the logprobs for that range. Details about the groupings are here: https://github.com/ZeroEntropy-AI/llama-chunk/blob/0cac10a34... -- No need to keep track of chunks that it's already made, we just want heatmap…
    comment by npip99 · 2024-11-15 · in LlamaChunk: Better RAG Chunking Than LlamaIndex
  2. Yep benchmarks are available at https://github.com/ZeroEntropy-AI/llama-chunk?tab=readme-ov-... , we used this dataset https://github.com/ZeroEntropy-AI/legalbenchrag which is a retrieval-focused version of LegalBench. It scored better…
    comment by npip99 · 2024-11-15 · in LlamaChunk: Better RAG Chunking Than LlamaIndex