← Tool directory
TOOL PROFILE

Colly

Build a Go crawler that visits selected URLs and collects page or link evidence.

Open source

Community support

Upvotes come from SearchEngineAnswer members. GitHub stars and reader reviews are counted separately.

Claim this tool if you maintain it.

Best for
Crawling
Setup required
A Go project with module support and a version compatible with Colly v2.
Costs to check
Budget for development and request volume. The library runs locally.
License in catalog
Apache-2.0

GitHub repository

GitHub stars
25,584
Forks
1,856
Last push
2026-10-16
Primary language
Go

GitHub snapshot from . Stars count GitHub bookmarks. Reader ratings appear separately below.

How to install Colly

  1. Create a small Go module and install the documented v2 dependency with go get github.com/gocolly/colly/v2.
  2. Import the v2 package and configure a collector restricted to your fixture host.

First tutorial for Colly

  1. Register an HTML callback for links and have the collector visit a fixture page with one known internal link.
  2. Log the referring URL and destination and check that the intended destination is visited without leaving the host.

Official installation and usage documentation ↗

Where Colly fits

Use it when a team wants custom crawl rules and structured output in an existing Go workflow.

When to choose another tool
Use a browser crawler if the target links only appear after scripts execute.
First evaluation
Follow one internal link on a test site and confirm the source and destination appear in the crawl output.
How to interpret the result
A link is discoverable by this crawler under its configuration. Coverage depends on entry points and scope.

Reviews and discussion

Reader reviews

Be the first to share your experience with this tool.

Discussion

Ask a question or share a setup tip.

Write a review or join the discussion

Reviews should describe your own experience. All submissions are moderated.

Flag an outdated detail

Include the field that needs updating and a source link. Copy your draft, then use the corrections policy to contact the editorial team.