janreges/siteone-crawler
View on GitHub ↗ ★ 998 Rust
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
6 mentions on Hacker News by 2 people: 3 stories, 3 comments · first 2024-08-19 · latest 2026-03-17
20082026
-
…(after adding repo) cargo install siteone-crawler # from source, any platform # Windows: https://github.com/janreges/siteone-crawler/releases This crawls every page, scores it across 5 categories (Security, Performance, SEO, Accessibility,…
comment by janreges · 2026-03-17 · in Show HN: SiteOne Crawler – Single-binary CI/CD gate for web quality regressions -
▲ 3
Show HN: SiteOne Crawler – Single-binary CI/CD gate for web quality regressionsstory by janreges · 2026-03-17 · 2 comments
-
▲ 2
Show HN: Turn Any Website into Clean Markdown for LLMs/RAG with SiteOne Crawlerstory by janreges · 2025-11-30 · 0 comments
-
…offers 2 open-source tools: 1) command-line version (which is the core of the crawler itself): https://github.com/janreges/siteone-crawler 2) a graphical application for Win/macOS/Linux, which is just a wrapper over the command-line…
comment by janreges · 2024-10-04 · in SiteOne Crawler – big tool with no users -
It seems to contain the crawler: https://github.com/janreges/siteone-crawler/blob/main/src/Cr...
comment by mistaken · 2024-10-04 · in SiteOne Crawler – big tool with no users -
▲ 32
Show HN: SiteOne Crawler – in-depth website analyzer and exporter (open-source)story by janreges · 2024-08-19 · 2 comments