Hacker GitHub

← All repos

holysoles/bot-wrangler-traefik-plugin

View on GitHub ↗ ★ 21 Go

A Traefik Middleware Plugin that helps you manage and enforce your robots.txt

3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2025-11-15 · latest 2026-03-29

Mentions per year 3 mentions · busiest year 2025 (2)
20082026
  1. …to a tool like this, I wrote a Traefik plugin that can block or proxy requests based on useragent. https://github.com/holysoles/bot-wrangler-traefik-plugin
  2. Continuing to add new features for my traefik plugin that manages bot traffic: https://github.com/holysoles/bot-wrangler-traefik-plugin Also working on getting Nix setup on my devices, including a PR for the official installer to support…
  3. …or even send them to a markov babbler if you've set one up. I've been using nepenthes [2]. [1] https://github.com/holysoles/bot-wrangler-traefik-plugin [2] https://zadzmo.org/code/nepenthes/
    comment by holysoles · 2025-11-15 · in Messing with scraper bots