confluentinc/parallel-consumer
View on GitHub ↗ ★ 301 Java
Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.
4 mentions on Hacker News by 3 people: 1 story, 3 comments · first 2022-07-22 · latest 2025-10-30
20082026
-
…consumer for each key, but with global parallelism. here's the equivalent in parallel-consumer: https://github.com/confluentinc/parallel-consumer?tab=readme...
comment by rileymichael · 2025-10-30 · in Kafka is Fast – I'll use Postgres -
…on this so you'll be on your own to figure out all of the quirks. the only notable example is https://github.com/confluentinc/parallel-consumer which is effectively abandoned
comment by rileymichael · 2025-10-30 · in Kafka is Fast – I'll use Postgres -
Check out the parallel consumer: https://github.com/confluentinc/parallel-consumer It processes unrelated keys in parallel within a partition. It has to track what offsets have been processed between the last committed offset of the…
comment by singron · 2025-04-25 · in What If We Could Rebuild Kafka from Scratch? -
▲ 2
Kafka Parallel Consumerstory by antonmry · 2022-07-22 · 1 comment