Hacker GitHub

← All repos

gocolly/colly

View on GitHub ↗ ★ 25,571 Go

Elegant Scraper and Crawler Framework for Golang

21 mentions on Hacker News by 19 people: 13 stories, 8 comments · first 2017-10-05 · latest 2023-11-12

Mentions per year 21 mentions · busiest year 2018 (8)
20082026
AllStoriesComments NewestTopOldest
  1. …Does it have more/less features or is it more suited for a different use case? (Which one?) [0] https://github.com/gocolly/colly
    comment by moehm · 2023-11-12 · in Show HN: Flyscrape – A standalone and scriptable web scraper in Go
  2. Sounds cool, but how is this different from Colly: https://github.com/gocolly/colly ?
    comment by akhayam · 2023-04-30 · in New modern web crawling tool
  3. I've heard https://github.com/gocolly/colly#readme mentioned fondly, but I've never used it
    comment by mdaniel · 2022-06-08 · in Beautiful Soup
  4. …30 mins using a combo of the wonderful gofeed ( https://github.com/mmcdole/gofeed ) and colly ( https://github.com/gocolly/colly ) libraries. When loading the front page, you're loading a 1-minute-cached HTML page of it that was…
    comment by cylo · 2022-02-23 · in Show HN: The Brutalist Report – A rolling snapshot of the day’s headlines
  5. …it's very intuitive but comes with overhead of running chromium browser even if its headless. [1] https://github.com/gocolly/colly [2] https://github.com/go-rod/rod
    comment by Abishek_Muthian · 2021-08-12 · in Mastering Web Scraping in Python: Crawling from Scratch
  6. …from 32 cores being maxed for 100 concurrent workers to... A 10-15% usage spike on a 4 core XPS :) https://github.com/gocolly/colly
    comment by genidoi · 2020-11-11 · in Show HN: Dead easy Python for executing many HTTP requests asynchronously
  7. …know anything about the organization and how long they'll be around. We're gonna give Colly a try: https://github.com/gocolly/colly .
    comment by brentadamson · 2018-05-03 · in Show HN: A search engine that doesn't track you, where users vote for results
  8. …Colly[0][1] which is a young but decent scraping framework for Golang. [0] http://go-colly.org/ [1] https://github.com/gocolly/colly
    comment by teremin · 2017-11-14 · in Ask HN: What are best tools for web scraping?