SiteOne Crawler
Choose SiteOne when you want a command-line audit that can also produce a report another person can open.
Community support
Upvotes come from SearchEngineAnswer members. GitHub stars and reader reviews are counted separately.
Claim this tool if you maintain it.
- Best for
- Site audits
- Setup required
- Native binary; browser for rendered checks
- Costs to check
- Hardware/hosting, integration and maintenance time; optional services are separate
- License in catalog
- MIT
Project screenshot
GitHub repository
- GitHub stars
- 998
- Forks
- 95
- Last push
- 2026-09-27
- Primary language
- Rust
GitHub snapshot from . Stars count GitHub bookmarks. Reader ratings appear separately below.
How to install SiteOne Crawler
-
On macOS with Homebrew, install the project’s package. On other systems, choose the documented release binary for your platform.
brew install janreges/tap/siteone-crawler - Run the binary without arguments to open its wizard. Choose a crawl scope and an output location.
First tutorial for SiteOne Crawler
- Run a crawl for one subdirectory and export the report.
- Open the report separately and confirm it links a known redirect or missing page to the URL that triggered the finding.
Where SiteOne Crawler fits
Produce a portable site audit from the command line and share the report with a developer.
- When to choose another tool
- Choose SEOnaut if you need an interface for recurring audit reviews. Use Playwright if the question is how a specific page behaves after a browser interaction.
- First evaluation
- Crawl a small subdirectory containing a redirect, a broken link and one excluded path. Compare the reported URLs with the intended scope, then open the exported report on another machine.
- How to interpret the result
- Record which checks and crawl limits you enabled. Treat an absent finding as unresolved when the crawler did not reach the relevant page.
Reviews and discussion
Reader reviews
Be the first to share your experience with this tool.
Discussion
Ask a question or share a setup tip.
Flag an outdated detail
Include the field that needs updating and a source link. Copy your draft, then use the corrections policy to contact the editorial team.
Write a review or join the discussion