Hacker GitHub

← All repos

nathanmarz/storm

View on GitHub ↗ ★ 8,754 Java

Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more

31 mentions on Hacker News by 22 people: 4 stories, 27 comments · first 2011-09-19 · latest 2014-06-01

Mentions per year 31 mentions · busiest year 2012 (16)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    Why Storm is Important (2011)
    story by baken · 2014-06-01 · 0 comments
  2. Here's the root wiki: https://github.com/nathanmarz/storm/wiki Here's the system architecture: https://github.com/nathanmarz/storm/wiki/Concepts Here's non JVM languages (specifically python) for building spouts/bolts…
    comment by agibsonccc · 2013-07-07 · in Ask HN: Fast, In-Memory, Distributed data analysis and machine learning?
  3. …ttp://www.ibm.com/developerworks/library/os-twitterstorm/ http://www.infoq.com/presentations/Zolodeck https://github.com/nathanmarz/storm/wiki/Rationale
    comment by ihsw · 2013-07-04 · in AT&T Invents Programming Language for Mass Surveillance (2007)
  4. When I saw the project name, the first thing I thought of was: https://github.com/nathanmarz/storm
    comment by dylanz · 2013-05-21 · in A command line tool to manage your ssh connections
  5. …(Backtype) with a successful exit to Twitter. [1] http://www.crunchbase.com/company/backtype [2] https://github.com/nathanmarz/storm
    comment by dpritchett · 2013-03-16 · in Leaving Twitter
  6. …which is a JRuby DSL & integration to the Storm engine. https://github.com/colinsurprenant/redstorm https://github.com/nathanmarz/storm - Redis is used as a queue server. - On the frontend side: Node.js, CoffeeScript, JavaScript,…
    comment by colinsurprenant · 2012-11-29 · in Realtime top hashtags on Twitter with Storm + JRuby + CoffeeScript + D3.js
  7. I believe this is the problem that Storm was supposed to solve ( https://github.com/nathanmarz/storm ). Or Amazon's SWF ( http://aws.amazon.com/swf/ ). They work in the case where you can define the flow between all of the tasks.
    comment by JeffJenkins · 2012-11-15 · in Asynchronous Processing in Web Apps, Part 1: A Database Is Not a Queue
  8. ▲ 30
    Storm : a Realtime Computation System Similar to Hadoop
    story by EzGraphs · 2012-10-22 · 8 comments
  9. https://github.com/nathanmarz/storm/wiki
    comment by scotty79 · 2012-09-20 · in Storm's first birthday
  10. Actually transactional topologies are superseded by Trident, which is much easier to use: https://github.com/nathanmarz/storm/wiki/Trident-tutorial Here's an explanation on how Trident achieves fully fault-tolerant, idempotent semantics:…
    comment by nathanmarz · 2012-09-20 · in Storm's first birthday
  11. …They are dependent on a spout that is repeatable- where you can request the failed input again. https://github.com/nathanmarz/storm/wiki/Transactional-topol...
    comment by mattmcknight · 2012-09-20 · in Storm's first birthday
  12. …that every message will be processed, and this is in direct contrast with other systems like S4." https://github.com/nathanmarz/storm/wiki/Rationale
    comment by djb_hackernews · 2012-09-20 · in Storm's first birthday
  13. …cases. They are more complimentary and in fact storm has a spout implementation for kafka[3]. [1] https://github.com/nathanmarz/storm/blob/master/src/clj/back... [2] https://github.com/nathanmarz/storm/blob/master/src/jvm/back... [3]…
    comment by djb_hackernews · 2012-09-20 · in Storm's first birthday
  14. …and browse the source code. It is IMO the nicest, cleanest, most exciting OSS project out there. https://github.com/nathanmarz/storm
    comment by djb_hackernews · 2012-09-19 · in Storm's first birthday
  15. ▲ 2
    Storm team develops new abstraction for real-time computing
    story by nburger · 2012-08-03 · 0 comments
  16. …batch-processing a la Hadoop is simply unnecessary for a lot of incredibly useful algorithms. [1] https://github.com/nathanmarz/storm [2] http://www.spark-project.org/
    comment by fiatmoney · 2012-05-29 · in Dempsy: Distributed Elastic Message Processing System
  17. A really good framework built around ZeroMQ is Storm, which does exactly that: https://github.com/nathanmarz/storm
    comment by conflagration · 2012-05-06 · in One major difference - ZeroMQ and Erlang.
  18. …seems like it would fit. It uses Zookeeper to manage state and maintains strong ordering[2]. 1. https://github.com/nathanmarz/storm/wiki 2. https://github.com/nathanmarz/storm/wiki/Transactional-topol...
    comment by mattdeboard · 2012-05-05 · in Distributing Work Without Celery
  19. Storm is built in clojure -- https://github.com/nathanmarz/storm
    comment by y3di · 2012-04-07 · in Notch live coding 0x10c
  20. …good example of small projects going big (perhaps not research wise, but building new stuff). https://github.com/nathanmarz/storm They did some other stuff to accommodate their needs.
    comment by krunaldo · 2012-02-22 · in Paul Graham: Why Y Combinator Replaces The Traditional Corporation
  21. Cerery doesn't do workflows with dependencies, just tasks. This is more like Storm: https://github.com/nathanmarz/storm
    comment by JeffJenkins · 2012-02-22 · in Amazon Simple Workflow - Cloud-Based Workflow Management
  22. Github repo: https://github.com/nathanmarz/storm Strange Loop presentation: http://www.infoq.com/presentations/Storm
    comment by jhawk28 · 2011-11-10 · in ØMQ: Mission Accomplished
  23. https://github.com/nathanmarz/storm
    comment by lpgauth · 2011-11-10 · in ØMQ: Mission Accomplished
  24. …that have failed. Check out the wiki for more information about how Storm works and how to use it: https://github.com/nathanmarz/storm/wiki Some of the things that Storm does are non-trivial, especially guaranteeing data processing. I…
    comment by nathanmarz · 2011-09-20 · in Storm: distributed and fault-tolerant realtime computation (slides)
  25. …it require much memory to run. In fact, it's quite straightforward to spin up a Storm cluster (see https://github.com/nathanmarz/storm/wiki/Setting-up-a-Storm-... ) and Storm has a local mode where you can develop/test topologies on your…
    comment by nathanmarz · 2011-09-19 · in Twitter's Storm (complex event processing system) is now open source
  26. …any programming language. I still need to finish the documentation on this, but I have notes here: https://github.com/nathanmarz/storm/wiki/Using-non-JVM-langu... The gist is: Storm topologies are just Thrift structures, and Storm can…
    comment by nathanmarz · 2011-09-19 · in Twitter's Storm (complex event processing system) is now open source
  27. …fails to be processed, the tuple(s) that triggered that tuple are replayed from the spout. See https://github.com/nathanmarz/storm/wiki/Guaranteeing-messag... for more info on that. In that sense, Storm is an at-least-once delivery system…
    comment by nathanmarz · 2011-09-19 · in Twitter's Storm (complex event processing system) is now open source
  28. …few weeks. I write all my topologies in Clojure using a small Clojure DSL that ships with Storm: https://github.com/nathanmarz/storm/blob/master/src/clj/back...
    comment by nathanmarz · 2011-09-19 · in Twitter's Storm (complex event processing system) is now open source
  29. …you to a few resources: I've written a lot of documentation on the wiki, which you can find here: https://github.com/nathanmarz/storm/wiki There's a few companion projects to Storm. These are: One-click deploy for Storm on EC2:…
    comment by nathanmarz · 2011-09-19 · in Twitter's Storm (complex event processing system) is now open source
  30. …a little buried in the github wiki, but this 'Rationale' page is a good overview of the project - https://github.com/nathanmarz/storm/wiki/Rationale
    comment by michaelbuckbee · 2011-09-19 · in Twitter's Storm (complex event processing system) is now open source
  31. ▲ 461
    Twitter's Storm (complex event processing system) is now open source
    story by harrigan · 2011-09-19 · 56 comments