← Tool directory
TOOL PROFILE

advertools

This is a strong starting point for SEO analysts who already work in Python.

Open source

Community support

Upvotes come from SearchEngineAnswer members. GitHub stars and reader reviews are counted separately.

Claim this tool if you maintain it.

Best for
Crawling
Setup required
Python
Costs to check
Hardware/hosting, integration and maintenance time; optional services are separate
License in catalog
MIT

Project screenshot

Local run with sample data: Splitting sample URLs into domain and path
Source documentation ↗

GitHub repository

GitHub stars
1,502
Forks
268
Last push
2026-06-30
Primary language
Python

GitHub snapshot from . Stars count GitHub bookmarks. Reader ratings appear separately below.

How to install advertools

  1. Create a Python virtual environment and install advertools.
    python3 -m pip install advertools
  2. Start with a small public sitemap you control. Save the sitemap output and the crawl results to separate files.

First tutorial for advertools

  1. Read the sitemap with the documented sitemap function and crawl a few known URLs. Join both datasets on a normalized URL key.
  2. Check the row count and explain differences such as redirects or URLs excluded from the crawl.

Official installation and usage documentation ↗

Where advertools fits

Turn a sitemap and crawl data into a Python analysis you can rerun and inspect.

When to choose another tool
Choose a dedicated crawler when your team needs ready-made reports. Choose Scrapy when you need custom request or extraction behavior.
First evaluation
Start with a small sitemap and five URLs whose status and canonical targets you know. Join the sitemap inventory to the crawl output and account for each URL that is missing from the results.
How to interpret the result
Define URL normalization before joining the data. Redirects and query parameters can otherwise create false gaps or duplicates.

Reviews and discussion

Reader reviews

Be the first to share your experience with this tool.

Discussion

Ask a question or share a setup tip.

Write a review or join the discussion

Reviews should describe your own experience. All submissions are moderated.

Flag an outdated detail

Include the field that needs updating and a source link. Copy your draft, then use the corrections policy to contact the editorial team.