Yelp/mrjob
View on GitHub ↗ ★ 2,613 Python
Run MapReduce jobs on Hadoop or Amazon Web Services
8 mentions on Hacker News by 6 people: 1 story, 7 comments · first 2011-01-10 · latest 2016-10-19
20082026
-
…[3] - https://engineeringblog.yelp.com/2010/10/mrjob-distributed-c... [4] - https://github.com/Yelp/mrjob [5] - https://engineeringblog.yelp.com/2015/03/using-services-to-b... [6] - https://engineeringblog.yelp.com/2016/08/more-than-j
comment by Goosey · 2016-10-19 · in Streaming Messages from Kafka into Redshift in Near Real-Time -
…and it seemed fragile at the time, so I can understand your inclination to divest from it. [1]: https://github.com/Yelp/mrjob/releases
comment by __derek__ · 2016-04-19 · in Lesser-Known Python Data Analysis Libraries -
Good point. https://github.com/Yelp/mrjob/pull/677 (merged.)
comment by stevejohnson · 2013-07-24 · in Mrjob: A Python 2.5+ package that helps you write and run Hadoop Streaming jobs -
Here's the code that's doing the actual line parsing: https://github.com/Yelp/mrjob/blob/master/mrjob/protocol.py#... It's just splitting on tab for input and re-joining on tab for output. Some extra logic for lines without tabs. EDIT: The…
comment by stevejohnson · 2013-01-07 · in A Guide to Python Frameworks for Hadoop -
…Dave and I moved on. [2] http://mrjob.readthedocs.org/en/latest/guides/concepts.html#... [3] http://www.github.com/yelp/mrjob/issues/new
comment by stevejohnson · 2013-01-07 · in A Guide to Python Frameworks for Hadoop -
…ground and running with MapReduce: http://engineeringblog.yelp.com/2010/10/mrjob-distributed-co... https://github.com/Yelp/mrjob
comment by derwiki · 2011-06-24 · in Write your first MapReduce program in 20 minutes -
See also: https://github.com/bwhite/hadoopy and https://github.com/Yelp/mrjob
comment by bretthoerner · 2011-01-20 · in Dumbo - Python module that allows you to easily write and run Hadoop programs -
▲ 30
mrjob - Run MapReduce jobs on Hadoop or Amazon Web Servicesstory by coderdude · 2011-01-10 · 0 comments