holysoles/bot-wrangler-traefik-plugin
View on GitHub ↗ ★ 21 Go
A Traefik Middleware Plugin that helps you manage and enforce your robots.txt
3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2025-11-15 · latest 2026-03-29
20082026
-
…to a tool like this, I wrote a Traefik plugin that can block or proxy requests based on useragent. https://github.com/holysoles/bot-wrangler-traefik-plugin
comment by holysoles · 2026-03-29 · in Miasma: A tool to trap AI web scrapers in an endless poison pit -
Continuing to add new features for my traefik plugin that manages bot traffic: https://github.com/holysoles/bot-wrangler-traefik-plugin Also working on getting Nix setup on my devices, including a PR for the official installer to support…
comment by holysoles · 2025-12-15 · in Ask HN: What Are You Working On? (December 2025) -
…or even send them to a markov babbler if you've set one up. I've been using nepenthes [2]. [1] https://github.com/holysoles/bot-wrangler-traefik-plugin [2] https://zadzmo.org/code/nepenthes/
comment by holysoles · 2025-11-15 · in Messing with scraper bots