Colly
Build a Go crawler that visits selected URLs and collects page or link evidence.
Community support
Upvotes come from SearchEngineAnswer members. GitHub stars and reader reviews are counted separately.
Claim this tool if you maintain it.
- Best for
- Crawling
- Setup required
- A Go project with module support and a version compatible with Colly v2.
- Costs to check
- Budget for development and request volume. The library runs locally.
- License in catalog
- Apache-2.0
GitHub repository
- GitHub stars
- 25,584
- Forks
- 1,856
- Last push
- 2026-10-16
- Primary language
- Go
GitHub snapshot from . Stars count GitHub bookmarks. Reader ratings appear separately below.
How to install Colly
- Create a small Go module and install the documented v2 dependency with go get github.com/gocolly/colly/v2.
- Import the v2 package and configure a collector restricted to your fixture host.
First tutorial for Colly
- Register an HTML callback for links and have the collector visit a fixture page with one known internal link.
- Log the referring URL and destination and check that the intended destination is visited without leaving the host.
Where Colly fits
Use it when a team wants custom crawl rules and structured output in an existing Go workflow.
- When to choose another tool
- Use a browser crawler if the target links only appear after scripts execute.
- First evaluation
- Follow one internal link on a test site and confirm the source and destination appear in the crawl output.
- How to interpret the result
- A link is discoverable by this crawler under its configuration. Coverage depends on entry points and scope.
Reviews and discussion
Reader reviews
Be the first to share your experience with this tool.
Discussion
Ask a question or share a setup tip.
Flag an outdated detail
Include the field that needs updating and a source link. Copy your draft, then use the corrections policy to contact the editorial team.
Write a review or join the discussion