Hacker GitHub

← All repos

pystorm/streamparse

View on GitHub ↗ ★ 1,505 Python

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

8 mentions on Hacker News by 2 people: 1 story, 7 comments · first 2014-05-11 · latest 2021-07-13

Mentions per year 8 mentions · busiest year 2015 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …sub-second latencies by combining Storm and Kafka with our open source Python project, streamparse. https://github.com/Parsely/streamparse The core problems Storm solves: modeling data processing as a computation graph; high-speed network…
    comment by pixelmonkey · 2021-07-13 · in Apache Heron: A realtime, distributed, fault-tolerant stream processing engine
  2. …and streamparse, which help Python programmers make use of Storm for large-scale stream processing: https://github.com/Parsely/streamparse . We also wrote pykafka, which is a Kafka client for Python: https://github.com/Parsely/pykafka --…
    comment by pixelmonkey · 2016-04-12 · in Apache Storm 1.0 released
  3. …But my team at Parse.ly has been hard at work building those in open source. Help us! [1]: https://github.com/Parsely/streamparse [2]: https://github.com/Parsely/pykafka
    comment by pixelmonkey · 2015-08-05 · in Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
  4. …via our online documentation[3], e.g. here is our detailed Python API documentation[4]. [1]: https://github.com/Parsely/streamparse [2]: https://www.youtube.com/watch?v=ja4Qj9-l6WQ [3]: http://streamparse.readthedocs.org/en/stable/ [4]:…
    comment by pixelmonkey · 2015-08-05 · in Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
  5. …while beating Python's multi-core limitations (the GIL, etc.) [1]: https://storm.apache.org/ [2]: https://github.com/Parsely/streamparse [3]: https://www.youtube.com/watch?v=ja4Qj9-l6WQ
    comment by pixelmonkey · 2015-07-18 · in Ask HN: What equivalents of Erlang/OTP exist for other languages?
  6. https://github.com/Parsely/streamparse
    comment by pixelmonkey · 2015-04-20 · in DARPA Has Open-Sourced 'Dark Web' Search Tech
  7. Really cool -- we've been working on a similar framework at Parse.ly called streamparse: https://github.com/Parsely/streamparse http://blog.parsely.com/post/1172/streamparse/ Will really look forward to evaluating this and seeing how the…
    comment by pixelmonkey · 2014-10-15 · in Pyleus: An Open-source Framework for Building Storm Topologies in Pure Python
  8. ▲ 75
    Streamparse: Pythonic processing of real-time data streams using Apache Storm
    story by msukmanowsky · 2014-05-11 · 4 comments