Hacker GitHub

← All repos

bluedragonz/bad-bot-blocker

View on GitHub ↗ ★ 368

Block bad, possibly even malicious web crawlers (automated bots) using htaccess.

3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2013-02-07 · latest 2014-02-23

Mentions per year 3 mentions · busiest year 2013 (2)
20082026
  1. I've found this GitHub project to be an invaluable resource for blocking bad bots: https://github.com/bluedragonz/bad-bot-blocker
    comment by agwa · 2014-02-23 · in Google's robots.txt
  2. I have found this set of htaccess rules to be extremely useful in blocking bad crawling behavior: https://github.com/bluedragonz/bad-bot-blocker
    comment by agwa · 2013-10-18 · in Who exactly is crawling my site?
  3. https://github.com/bluedragonz/bad-bot-blocker
    comment by smartwater · 2013-02-07 · in Ask HN: What is this FHScan thing?