nathell/skyscraper
View on GitHub ↗ ★ 412 Clojure
Structural scraping for the rest of us.
12 mentions on Hacker News by 1 person: 2 stories, 10 comments · first 2015-08-13 · latest 2024-02-20
20082026
-
…loads at the moment – it could be enhanced to support that kind of workflow rather easily. [0]: https://github.com/nathell/skyscraper
comment by nathell · 2024-02-20 · in Web Scraping in Python – The Complete Guide -
I plan to port my scraping framework (Skyscraper, https://github.com/nathell/skyscraper ) to babashka one day. I’m not sure how easy it will be, though, since it uses core.async (which I believe bb has limited support for) and SQLite via…
comment by nathell · 2022-12-08 · in Babashka is a fast-starting scripting environment for Clojure -
…counterparts to Beautiful Soup), but the principles should be readily transferable everywhere. [0]: https://github.com/nathell/skyscraper
comment by nathell · 2021-08-11 · in Mastering Web Scraping in Python: Crawling from Scratch -
Skyscraper, my scraping and restructuring framework: https://github.com/nathell/skyscraper I’ve used it to build datasets for various research purposes, and also an archive tool for the now-extinct soup.io:…
comment by nathell · 2021-06-12 · in Ask HN: Tools you have made for yourself? -
I've created a Clojure library to facilitate scraping scenarios like this one: https://github.com/nathell/skyscraper Writeup of a sample data acquisition + analysis usecase: http://blog.danieljanus.pl/2020/05/08/making-of-clojure-depe...
comment by nathell · 2020-05-15 · in Show HN: A tool to scrape senators' stock transactions for your own analysis -
▲ 6
Show HN: Skyscraper, a Clojure framework for structural scraping of whole sitesstory by nathell · 2020-02-17 · 1 comment
-
…a circleci/config.yml, which is... technically correct, I guess, but less than useful. [1]: https://github.com/nathell/skyscraper/ [2]: http://pliki.danieljanus.pl/appinspector-skyscraper/
comment by nathell · 2020-01-28 · in Microsoft Application Inspector -
…I'm rewriting it to be based on core.async, but it has a less functional feel to it. [1]: https://github.com/nathell/skyscraper
comment by nathell · 2018-03-03 · in Clojure Don’ts: Lazy Effects (2015) -
I wrote a Clojure library that facilitates writing this sort of scripts in a relatively robust way: https://github.com/nathell/skyscraper
comment by nathell · 2017-10-24 · in Introduction to web scraping with Python -
…Java libraries for certain tasks (MALLET comes to mind), but these are few and far between. [1]: https://github.com/nathell/skyscraper/
comment by nathell · 2016-02-16 · in R, the master troll of statistical languages (2012) -
Wow, never heard of Scrapy! Looks like I've reinvented it in Clojure: https://github.com/nathell/skyscraper/
comment by nathell · 2016-01-20 · in Scrapy Tips from the Pros -
▲ 4
Show HN: Skyscraper, a Clojure library for structural scraping of whole sitesstory by nathell · 2015-08-13 · 1 comment