bluedragonz/bad-bot-blocker
View on GitHub ↗ ★ 368
Block bad, possibly even malicious web crawlers (automated bots) using htaccess.
3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2013-02-07 · latest 2014-02-23
20082026
-
I've found this GitHub project to be an invaluable resource for blocking bad bots: https://github.com/bluedragonz/bad-bot-blocker
comment by agwa · 2014-02-23 · in Google's robots.txt -
I have found this set of htaccess rules to be extremely useful in blocking bad crawling behavior: https://github.com/bluedragonz/bad-bot-blocker
comment by agwa · 2013-10-18 · in Who exactly is crawling my site? -
https://github.com/bluedragonz/bad-bot-blocker
comment by smartwater · 2013-02-07 · in Ask HN: What is this FHScan thing?