scrapy/scrapely
View on GitHub ↗ ★ 1,882 HTML
A pure-python HTML screen-scraping library
7 mentions on Hacker News by 6 people: 1 story, 6 comments · first 2013-09-02 · latest 2018-07-10
20082026
-
Their ML approach is most likely based on their https://github.com/scrapy/scrapely project, which uses instance-based learning (as I understand it, lightweight ML) to scrape other pages from a few examples.
comment by RossM · 2018-07-10 · in Lessons learned scraping 100B product pages -
…https://github.com/scrapy/loginform https://github.com/TeamHG-Memex/Formasaurus https://github.com/scrapy/scrapely https://github.com/scrapinghub/webpager https://moz.com/devblog/benchmarking-python-content-extracti... Scrapy (and also lo
comment by predius · 2016-03-10 · in How Web Scraping Is Revealing Lobbying and Corruption in Peru -
Wrapper induction library is separated from Scrapy: https://github.com/scrapy/scrapely . It is used in Portia under the hood. Portia can be seen as a tool to annotate scrapely templates and define crawling rules and post-processing rules.…
comment by kmike84 · 2016-02-05 · in Python 3 comes to Scrapy -
…). It does exactly what you mean. You may also be interested in this library: https://github.com/scrapy/scrapely
comment by stummjr · 2016-01-20 · in Scrapy Tips from the Pros -
Are you actually using scrapy[1] or scrapely[2]? [1] http://scrapy.org/ [2] https://github.com/scrapy/scrapely
comment by webmaven · 2014-07-29 · in Ask HN: Do I really need an incubator/accelerator? -
Portia uses https://github.com/scrapy/scrapely library for data extraction. It doesn't use XPaths for learning. There are some links to papers in scrapely README; scrapely is largely based on ideas from these papers, but there are many…
comment by kmike84 · 2014-04-01 · in Portia, an open-source visual web scraper