Cyan4973/xxHash on Hacker News

Why BLAKE3? I hadn't thought too deeply about it but at some point I settled on https://github.com/Cyan4973/xxHash for similar things.

comment by duskdozer · 2026-09-01 · in uv: Deduplicate all files in the wheel cache

…C# or Java. What about you do xxHash? Should be quite basic, not a lot of complicated structures. https://github.com/Cyan4973/xxHash/blob/dev/xxhash.h Or what about you do an audio or video codec? Or an operating system? Not going to paste…

comment by jstimpfle · 2026-08-11 · in To save C, we must save ABI (2022)

Further down in the discussion, he also adds this comment, which is also good: https://github.com/Cyan4973/xxHash/issues/229#issuecomment-6...

comment by mriet · 2025-06-27 · in The probability of a hash collision (2022)

…uses of hashes and checksums that I've seen about hash collisions. I highely, highly recommend it: https://github.com/Cyan4973/xxHash/issues/229#issuecomment-5...

comment by mriet · 2025-06-27 · in The probability of a hash collision (2022)

…so you may already know what I'm about to say. This is a minor example, but since you asked... https://github.com/Cyan4973/xxHash/blob/dev/xxhash.h#L6432 That's an example of a fair number of accumulators that are stored as XXHash goes…

comment by benwills · 2025-05-17 · in New high-quality hash measures 71GB/s on M4

…it would be useful to understand the criteria that make it no longer a passing SMHasher3 entry. [1] https://github.com/Cyan4973/xxHash [2] https://rocksdb.org/blog/2022/07/18/per-key-value-checksum.h...

comment by thadt · 2024-12-13 · in Show HN: Rain hashes – well designed, simple and fast variable sized hashes

https://github.com/Cyan4973/xxHash/issues/450 This person's testing has blake3 at 250 cycles for small hashes. It's not a thousand times slower. And for a lot of uses, 250 cycles is plenty fast. That's like one uncached memory access. That…

comment by Dylan16807 · 2024-11-03 · in Breaking CityHash64, MurmurHash2/3, wyhash, and more

…sha256'd the lines to build the map? I'm going to guess "badly"? Maybe something like this in CUDA: https://github.com/Cyan4973/xxHash ?

comment by MuffinFlavored · 2024-04-13 · in The One Billion Row Challenge in CUDA

…Comment XXH3 (SSE2), 31.5 GB/s, 133.1, 10, FNV64, 1.2 GB/s, 62.7, 5, Poor avalanche properties [0]: https://github.com/Cyan4973/xxHash Also ETag is exactly the kind of thing non-cryptographic hashes are meant for, but if you can't convince…

comment by f_devd · 2024-04-11 · in ETag and HTTP Caching

…possibly. It seems a pretty decent contender, hashing speed-wise, to trade off of secure hashing: https://github.com/Cyan4973/xxHash

comment by redsaz · 2023-11-06 · in Fdupes: Identify or delete duplicate files

…If you need a non cryptographic hash, the xxhash family is crazy fast. https://github.com/Cyan4973/xxHash

comment by eyegor · 2023-07-26 · in Google abandons work to move Assistant smart speakers to Fuchsia

If you're only using the hash for non-cryptographic applications, there are much faster hashes: https://github.com/Cyan4973/xxHash SHA1 and MD5 are the most widely accessible, though, and I agree it's fine to use them if you don't care…

comment by 0xbadcafebee · 2022-12-15 · in NIST is announcing that SHA-1 should be phased out by Dec. 31, 2030

…(≥3.2?) support xxHash and xxHash3: * https://github.com/WayneD/rsync/blob/master/checksum.c * https://github.com/Cyan4973/xxHash * https://news.ycombinator.com/item?id=19402602 (2019 XXH3 discussion)

comment by throw0101a · 2022-07-02 · in How does rsync work?

…switch to xxh3 if performance is a concern, but FNV is certainly competitive for integer-size keys. https://github.com/Cyan4973/xxHash/wiki/Performance-comparis...

comment by vlmutolo · 2022-05-11 · in A Simple Hash for Perlin Noise

…use versus xxhash which is used by LZ4 internally and in databases all over the place. [1] https://github.com/Cyan4973/xxHash [2] https://github.com/google/cityhash

comment by jolynch · 2022-05-07 · in Use fast data algorithms (2021)

check out https://github.com/Cyan4973/xxHash for I use it for performance sensitive non-crypto stuff.

comment by rowanG077 · 2022-01-23 · in BLAKE2: “Harder, Better, Faster, Stronger” Than MD5 (2014)

(No relation to XXHash (XXH32, XXH64, XXH128, XXH3): https://github.com/Cyan4973/xxHash )

comment by loeg · 2021-12-14 · in XXH: Bring your favorite shell wherever you go through the SSH

…Performance Comparison page is last updated in 2021, and in that page XXH3 is faster than MeowHash: https://github.com/Cyan4973/xxHash/wiki/Performance-comparis...

comment by pepoluan · 2021-10-29 · in Meow Hash (2018)

XXHash author last updated the following page on Aug 10 of this year: https://github.com/Cyan4973/xxHash/wiki/Performance-comparis...

comment by pepoluan · 2021-10-29 · in Meow Hash (2018)

The README for xxhash has benchmarks covering fast hashes including Meow: https://github.com/Cyan4973/xxHash/wiki/Performance-comparis...

comment by chalst · 2021-10-29 · in Meow Hash (2018)

How does it compare to XXH3? https://github.com/Cyan4973/xxHash https://github.com/rurban/smhasher#readme says XXH3 is 16GB/s while meow is 17GB/s.

comment by wolf550e · 2021-10-29 · in Meow Hash (2018)

I might be dumb about estimating throughput. According to https://github.com/Cyan4973/xxHash , the best hash function can only do 100s M hashes per second, how can a local cache run at such throughput? I assume when measuring cache…

comment by 1a1a11a · 2021-04-15 · in Segcache: A memory-efficient and scalable key-value cache for small objects [pdf]

…is that xxhash is much faster than good old MD5. You can find some numbers at it's site here: https://github.com/Cyan4973/xxHash

comment by jcynix · 2020-12-04 · in Pg-shortkey: YouTube-Like Short IDs as Postgres Primary Keys

Or maybe xxHash would work for duplicate finding? https://github.com/Cyan4973/xxHash

comment by peterhil · 2020-10-26 · in Deprecating SHA1

…all other variants and prior versions have shitty collision ratios, equivalent to a ~50 bits hash : https://github.com/Cyan4973/xxHash/wiki/Collision-ratio-comp...

comment by telendram · 2020-07-29 · in XXH3, world's fastest hash algorithm, has reached stable status

▲ 74

XXH3, world's fastest hash algorithm, has reached stable status

story by telendram · 2020-07-28 · 18 comments

Also in the super fast, but not designed to be cryptographically secure category: xxhash ( https://github.com/Cyan4973/xxHash ) with 32/64 bit output. The latest version, xxh3, supports up to 128 bit output. meow hash (…

comment by eadan · 2020-05-29 · in SHA-1 collisions now cost $45k [pdf]

…you are looking at XXH64 and XXH32, which is the old version. The new version XXH3 is located in https://github.com/Cyan4973/xxHash/blob/dev/xxh3.h which exposes the public prototypes `XXH3_64bits()` and `XXH3_128bits()` (and variants with…

comment by terrelln · 2019-03-15 · in XXH3 – a new speed-optimized hash algorithm

So it took me a while to find the actual algorithm. As far as I can tell it is here: https://github.com/Cyan4973/xxHash/blob/dev/xxh3.h Is there a description of the algorithm, the C-source is not only highly optimised, it is also highly…

comment by adrianratnapala · 2019-03-15 · in XXH3 – a new speed-optimized hash algorithm

…are many portable hash functions that are faster (and I think this is due to their bit size.) See: https://github.com/Cyan4973/xxHash and https://github.com/leo-yuriev/t1ha So, my initial assumption was wrong. I'll be trying Meow Hash and…

comment by GolDDranks · 2018-10-20 · in Meow Hash: A high-speed non-cryptographic hash function

…speed of Huffman coding with compression rate of arithmetic coding [4] (ANS) seems interesting. [1] https://github.com/Cyan4973/xxHash [2] https://github.com/rurban/smhasher [3] https://news.ycombinator.com/item?id=9613098 [4]…

comment by rektide · 2016-08-31 · in Smaller and faster data compression with Zstandard

…is pretty slow compared to others, about 20x slower than the fastest hash algorithms out there. https://github.com/Cyan4973/xxHash You would think, that if it's just being used as a checksum, anything that passes…

comment by ghshephard · 2015-09-23 · in Backblaze B2 Cloud Storage

How does it compare to xxHash? https://github.com/Cyan4973/xxHash Comparing MetroHash to CityHash is not really fair. Why would anyone use CityHash in 2015?

comment by jedisct1 · 2015-05-27 · in MetroHash: Faster, Better Hash Functions