Hacker GitHub

← All repos

hollingsworthd/ScreenSlicer

View on GitHub ↗ ★ 157 Java

Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JSON API. Currently unmaintained! DO NOT USE THIS CODE unless you know what you're doing.

8 mentions on Hacker News by 1 person: 1 story, 7 comments · first 2014-10-06 · latest 2017-07-06

Mentions per year 8 mentions · busiest year 2015 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …back plain text from the page I would like to have someone (a Java or Kotlin developer) take over https://github.com/MachinePublishers/ScreenSlicer and rework it. It's a project that intends to do exactly this. You enter a url, it finds a…
    comment by logn · 2017-07-06 · in Ask HN: As a Developer, what API would you like to use, but does not exist?
  2. …The trick to turning Jersey into a web server (for static files) is along the lines of this: https://github.com/MachinePublishers/ScreenSlicer/blob/maste...
    comment by logn · 2015-09-30 · in Ask HN: What stack would you use to build a CRUD web app on the JVM today?
  3. …onsite travel ok) Web scraping, crawling, text munging, browser hackery. Java, JS, Ruby, Linux. https://github.com/MachinePublishers/ScreenSlicer https://github.com/MachinePublishers/jBrowserDriver Contact: https://github.com/hollingsworthd
    comment by logn · 2015-04-01 · in Ask HN: Freelancer? Seeking freelancer? (April 2015)
  4. …corrupted control characters from bad encoding) as well as left-behind html tags/entities [3]. 1. https://github.com/MachinePublishers/ScreenSlicer 2. https://github.com/mathiasbynens/he 3. https://github.com/MachinePublishers/ScreenSlicer/…
    comment by logn · 2015-03-30 · in Web Scraping Indeed for Key Data Science Job Skills
  5. SEEKING WORK (remote) Web scraping, crawling, text munging, browser hackery. https://github.com/MachinePublishers/ScreenSlicer https://github.com/MachinePublishers/jBrowserDriver Contact: https://github.com/hollingsworthd
    comment by logn · 2015-03-01 · in Ask HN: Freelancer? Seeking freelancer? (March 2015)
  6. …option is Scrapy: http://scrapy.org/ And an unknown web scraping option (and shameless plug): https://github.com/MachinePublishers/ScreenSlicer For browser automation see Phantom JS or Selenium: http://phantomjs.org/…
    comment by logn · 2014-12-18 · in Sentiment Analysis on Web-Scraped Data
  7. …an http 200 for the entire page (excluding intermediate 200's for things such as images). Example: https://github.com/MachinePublishers/ScreenSlicer/blob/maste... The best approach for this would probably be to tie into a page unload event…
    comment by logn · 2014-10-31 · in Fetching.io: Search the full text of every web page you visit