Hacker GitHub

← All repos

scrapinghub/portia

View on GitHub ↗ ★ 9,500 Python archived

Visual scraping for Scrapy

8 mentions on Hacker News by 8 people: 0 stories, 8 comments · first 2014-04-01 · latest 2017-11-14

Mentions per year 8 mentions · busiest year 2016 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …had some success using portia[1]. Its a visual wrapper over scrapy, but is actually quite useful. https://github.com/scrapinghub/portia
    comment by Karupan · 2017-11-14 · in Ask HN: What are best tools for web scraping?
  2. Any evidence that it is in fact a fork of portia? https://github.com/scrapinghub/portia
    comment by kasbah · 2017-04-21 · in Show HN: WrapAPI v2 – Build APIs, scrapers, bots on any website
  3. Sounds good. Another way could be to feed the ToS URL into a visual web scraper (e.g https://github.com/scrapinghub/portia , scrape, then compare and notify via email.
    comment by philippnagel · 2016-05-24 · in Terms and conditions word by word
  4. Three more: https://github.com/scrapinghub/portia/ (our open source equivalent of Kimonolabs) http://scrapy.org (allows to scrape more complex sites; also OSS) http://scrapinghub.com (for a cloud-based platform and a smart proxy rotator)…
    comment by ddebernardy · 2016-02-16 · in Palantir acquires Kimono
  5. …something that the UI can't handle it's not a problem, you can extend it with a little python. [1] https://github.com/scrapinghub/portia [2] https://scrapinghub.com
    comment by rurai · 2016-02-15 · in Palantir acquires Kimono
  6. Text version https://github.com/scrapinghub/portia (written in Python)
    comment by mtmail · 2015-02-22 · in Show HN: Portia, extract info from websites, the easy way
  7. We released a similar open source tool for visual scraping, earlier this year, called Portia: https://github.com/scrapinghub/portia It's been getting quite a bit of traction and we're currently working on the integration with Scrapinghub…
    comment by pablohoffman · 2014-11-06 · in Show HN: Scrape.it – Change-Resilient Web Scraper
  8. …an April Fool's joke and found something pleasantly awesome and useful instead. Source is here: https://github.com/scrapinghub/portia
    comment by bsilvereagle · 2014-04-01 · in Portia, an open-source visual web scraper