node-js-libs/node.io
View on GitHub ↗ ★ 1,790 JavaScript
14 mentions on Hacker News by 8 people: 1 story, 13 comments · first 2011-01-22 · latest 2013-08-25
20082026
-
…used node.io but 3 months isn't that old. Also, if you check the issues page for the project ( https://github.com/chriso/node.io/issues ), the author seems to be responding to any open issues with the latest comment by author being a month…
comment by nacs · 2013-08-25 · in Use Node.js to Extract Data from the Web -
Have you played around with node.io? https://github.com/chriso/node.io Encapsulates all this functionality in an easy to use interface.
comment by nodesocket · 2013-08-25 · in Use Node.js to Extract Data from the Web -
This article should have mentioned node.io ( https://github.com/chriso/node.io ) for completeness. It hasn't been updated in a while and I'm not sure if other frameworks have popped up, but I've had a pleasure using it for some big…
comment by lopatin · 2012-12-30 · in Web scraping with Node.js -
…be Node.js. It's pretty good at it and you have a few libraries that can help you: * Node.io ( https://github.com/chriso/node.io ) * Phantomjs-node for dynamic content ( https://github.com/sgentle/phantomjs-node ) * Cheerio for a jQuery…
comment by philipDS · 2012-09-28 · in Ask HN: How to create a Web crawler? -
If you really want to scrape pages, you should use something like https://github.com/chriso/node.io/ which batches things in jobs, helps with error handling, io, etc...
comment by latchkey · 2012-08-06 · in Using Node.js and JQuery to Crawl Public Tweets -
https://github.com/chriso/node.io looking forward to being able to distribute jobs across multiple machines
comment by petsounds · 2012-06-17 · in Web crawling and downloading ebooks with phantomJS -
…uses a faster and more forgiving parser if you can survive with a subset of jQuery functionality ( https://github.com/chriso/node.io/wiki/API---CSS-Selectors-a... )
comment by chrisohara · 2012-04-23 · in Web scraping: Reliably and efficiently pull data from pages that don't expect it -
…I like Javascript as a language. Node.JS was also a perfect fit for the scraping framework I wrote: https://github.com/chriso/node.io At one stage I had the same train of thought that you have ( http://chris6f.com/synchronous-nodejs /…
comment by chrisohara · 2011-08-05 · in Node.js - A Giant Step Backwards -
…alternative parser. Set the following two options: jsdom: 1 external_resources: 1 Watch this space: https://github.com/chriso/node.io/blob/master/lib/node.io/do...
comment by chrisohara · 2011-04-15 · in Scraping the web with Node.io -
…requests, recursing similar URLs, concurrent requests, etc. - just add one of the many options ( https://github.com/chriso/node.io/wiki/API---Job-Options )
comment by chrisohara · 2011-04-15 · in Scraping the web with Node.io -
…there's been many improvements added to node-soupselect and node.io though - the API is here: https://github.com/chriso/node.io/wiki/API---CSS-Selectors-a...
comment by chrisohara · 2011-01-23 · in Pro scraping with Node.JS -
I was intrigued to see what CSS selector engine it was using... https://github.com/chriso/node.io uses https://github.com/harryf/node-soupselect https://github.com/harryf/node-soupselect is a port of my https://github.com/simonw/soupselect…
comment by simonw · 2011-01-23 · in Pro scraping with Node.JS -
▲ 60
Pro scraping with Node.JSstory by chrisohara · 2011-01-23 · 18 comments
-
I suggest taking a look at node.io ( https://github.com/chriso/node.io ) - a scraping framework written for NodeJS. It uses htmlParser rather than jsdom and scales nicely. It also has support for handling timeouts, retries, etc.
comment by chrisohara · 2011-01-22 · in Scraping made easy with jQuery and SelectorGadget (and Node.js!)