pystorm/streamparse
View on GitHub ↗ ★ 1,505 Python
Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
8 mentions on Hacker News by 2 people: 1 story, 7 comments · first 2014-05-11 · latest 2021-07-13
20082026
-
…sub-second latencies by combining Storm and Kafka with our open source Python project, streamparse. https://github.com/Parsely/streamparse The core problems Storm solves: modeling data processing as a computation graph; high-speed network…
comment by pixelmonkey · 2021-07-13 · in Apache Heron: A realtime, distributed, fault-tolerant stream processing engine -
…and streamparse, which help Python programmers make use of Storm for large-scale stream processing: https://github.com/Parsely/streamparse . We also wrote pykafka, which is a Kafka client for Python: https://github.com/Parsely/pykafka --…
comment by pixelmonkey · 2016-04-12 · in Apache Storm 1.0 released -
…But my team at Parse.ly has been hard at work building those in open source. Help us! [1]: https://github.com/Parsely/streamparse [2]: https://github.com/Parsely/pykafka
comment by pixelmonkey · 2015-08-05 · in Apache Kafka, Samza, and the Unix Philosophy of Distributed Data -
…via our online documentation[3], e.g. here is our detailed Python API documentation[4]. [1]: https://github.com/Parsely/streamparse [2]: https://www.youtube.com/watch?v=ja4Qj9-l6WQ [3]: http://streamparse.readthedocs.org/en/stable/ [4]:…
comment by pixelmonkey · 2015-08-05 · in Apache Kafka, Samza, and the Unix Philosophy of Distributed Data -
…while beating Python's multi-core limitations (the GIL, etc.) [1]: https://storm.apache.org/ [2]: https://github.com/Parsely/streamparse [3]: https://www.youtube.com/watch?v=ja4Qj9-l6WQ
comment by pixelmonkey · 2015-07-18 · in Ask HN: What equivalents of Erlang/OTP exist for other languages? -
https://github.com/Parsely/streamparse
comment by pixelmonkey · 2015-04-20 · in DARPA Has Open-Sourced 'Dark Web' Search Tech -
Really cool -- we've been working on a similar framework at Parse.ly called streamparse: https://github.com/Parsely/streamparse http://blog.parsely.com/post/1172/streamparse/ Will really look forward to evaluating this and seeing how the…
comment by pixelmonkey · 2014-10-15 · in Pyleus: An Open-source Framework for Building Storm Topologies in Pure Python