Hacker GitHub

← All repos

janreges/siteone-crawler

View on GitHub ↗ ★ 998 Rust

SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).

6 mentions on Hacker News by 2 people: 3 stories, 3 comments · first 2024-08-19 · latest 2026-03-17

Mentions per year 6 mentions · busiest year 2024 (3)
20082026
  1. …(after adding repo) cargo install siteone-crawler # from source, any platform # Windows: https://github.com/janreges/siteone-crawler/releases This crawls every page, scores it across 5 categories (Security, Performance, SEO, Accessibility,…
  2. …offers 2 open-source tools: 1) command-line version (which is the core of the crawler itself): https://github.com/janreges/siteone-crawler 2) a graphical application for Win/macOS/Linux, which is just a wrapper over the command-line…
    comment by janreges · 2024-10-04 · in SiteOne Crawler – big tool with no users
  3. It seems to contain the crawler: https://github.com/janreges/siteone-crawler/blob/main/src/Cr...
    comment by mistaken · 2024-10-04 · in SiteOne Crawler – big tool with no users