Hacker GitHub

← All repos

ashvardanian/StringZilla

View on GitHub ↗ ★ 3,579 C

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

31 mentions on Hacker News by 11 people: 4 stories, 27 comments · first 2023-08-26 · latest 2026-08-05

Mentions per year 31 mentions · busiest year 2025 (11)
20082026
  1. …StringZilla? It has highly optimized case-fold and case-insensitive Unicode search kernels as well: https://github.com/ashvardanian/Stringzilla
  2. …right! It took a lot of time to make sure that all 6 of ISA-specific versions of StringZilla ( https://github.com/ashvardanian/StringZilla/blob/main/includ... ) return the same output for both one-shot and incremental construction, and I’m…
  3. …via `vpshufb` AVX512BW-capable CPUs [1] or via `tbl` instructions on NEON-capable CPUs [2]. [1]: https://github.com/ashvardanian/StringZilla/blob/2f4b1386ca2... [2]: https://github.com/ashvardanian/StringZilla/blob/2f4b1386ca2...
    comment by ashvardanian · 2025-08-17 · in Counting Words at SIMD Speed
  4. …search or copy/move operation. In my projects, such as StringZilla, I often use mask K registers ( https://github.com/ashvardanian/StringZilla/blob/2f4b1386ca2... ) and an input-dependent mix of temporal and non-temporal loads and stores (…
    comment by ashvardanian · 2025-08-11 · in Faster substring search with SIMD in Zig
  5. …`#ifndef` https://github.com/eyalz800/zpp_bits/blob/main/zpp_bits.h - `stringzilla` `#ifndef` https://github.com/ashvardanian/StringZilla/blob/main/includ...
  6. …be < https://github.com/intel/hyperscan >, < https://github.com/simdutf/simdutf >, and my own < https://github.com/ashvardanian/StringZilla > :)
    comment by ashvardanian · 2025-07-05 · in The messy reality of SIMD (vector) functions
  7. …in case you are focused on ASCII, for vowel search, have you tried StringZilla’s `find_first_of` (< https://github.com/ashvardanian/StringZilla/blob/960967d78c7... >)? I think it should perform well ;)
  8. …but it should be faster than the standard libraries of most (or maybe all) programming languages. https://github.com/ashvardanian/StringZilla
    comment by ashvardanian · 2025-05-03 · in Strings Just Got Faster
  9. …land, and the next major release to come is precisely around Full-Text Search in StringZilla < https://github.com/ashvardanian/stringzilla >, and will be integrated into both USearch < https://github.com/unum-cloud/usearch > and somewhere…
    comment by ashvardanian · 2025-04-18 · in Less Slow C++
  10. …somewhat different project layouts & dispatch mechanisms: https://github.com/ashvardanian/SimSIMD , https://github.com/ashvardanian/StringZilla One big family not covered there, is sparse data-strictures and related algorithms. I’ve only…
    comment by ashvardanian · 2025-03-30 · in Towards fearless SIMD, 7 years later
  11. Here is the code I use to detect available CPU features at runtime and dispatch the correct kernels - https://github.com/ashvardanian/StringZilla/blob/main/c/lib.... There are also several AVX-512 kernels for different CPU generations, so…
  12. …I've had a variant that uses 768 bytes with some extra logic, but will deprecate that kernel soon. https://github.com/ashvardanian/StringZilla/blob/0d47be212c5...
    comment by ashvardanian · 2024-12-21 · in Dividing unsigned 8-bit numbers
  13. …quality and throughput on Arm, that was one of the key reasons to start a new library: https://github.com/ashvardanian/StringZilla/blob/91d0a1a02fa... Also not a huge fan of locale controls and wchar APIs :)
    comment by ashvardanian · 2024-07-15 · in I'm not a fan of strlcpy(3)
  14. …one can get a 3x boost over the native `wc` CLI on a modern CPU, memory-mapping a very average SSD: https://github.com/ashvardanian/StringZilla/tree/main/cli
  15. …some string operations - maybe they don't suck, but there's definitely room for improvement [1] - https://github.com/ashvardanian/StringZilla?tab=readme-ov-fi...
    comment by csjh · 2024-06-17 · in NumPy 2.0
  16. …LibC in substring search operations. The comparison table is still available in the older README: https://github.com/ashvardanian/StringZilla/tree/v2.0.2?tab=...
  17. Thank you! There are still a lot of good first issues: https://github.com/ashvardanian/StringZilla/issues?q=is%3Ais...
  18. …exceed 1 GB/s/core [4], so more research is needed. If you have any ideas - I am all ears! [1]: https://github.com/ashvardanian/StringZilla/blob/bc1869a8529... [2]: https://github.com/ashvardanian/StringZilla/blob/bc1869a8529... [3]:…
    comment by ashvardanian · 2024-02-04 · in How fast is rolling Karp-Rabin hashing?
  19. The author is also responsible for the StringZilla library that includes levenstein distance: https://github.com/ashvardanian/StringZilla
  20. …Stringzilla is a cool library if you want to see a clean implementation of these algorithms: https://github.com/ashvardanian/StringZilla See my reply here about the file being cached completely in memory after the first run:…
    comment by rockwotj · 2024-01-04 · in The One Billion Row Challenge
  21. …it has precomputed magic numbers and lookup tables for all 16-bit integers in the same repo. [1]: https://github.com/ashvardanian/StringZilla/blob/9f6ca3c6d3c... [2]: https://github.com/ridiculousfish/libdivide
    comment by ashvardanian · 2023-12-28 · in 4B If Statements
  22. …compilers are practically useless. As a proof, I wrote what is now the StringZilla library ( https://github.com/ashvardanian/stringzilla ) and we've spent weeks with an Intel team, tuning the compiler, no result. So if you are processing a…
    comment by ashvardanian · 2023-12-18 · in Python, C, Assembly – Faster Cosine Similarity
  23. …could go very very badly for longer needles. * It seems quite likely that your [confirmation step]( https://github.com/ashvardanian/Stringzilla/blob/fab854dc4fd... ) is going to absolutely kill performance for even semi-frequently…
  24. Opened an issue in case someone wants to contribute: https://github.com/ashvardanian/Stringzilla/issues/25
  25. …shows the vectorized functions which seems like they could be simply called from regular C, e.g.: https://github.com/ashvardanian/Stringzilla/blob/fab854dc4fd...
  26. the presentation: https://github.com/ashvardanian/Stringzilla/blob/main/bench/... provides more information (just in case you may have missed it)
  27. I took a look at Stringzilla ( https://github.com/ashvardanian/stringzilla ), and in addition to the impressive benchmarks, the API looks pretty straightforward. It's a new star in my collection! Thanks for open-sourcing this project!