Cloudflare Redirects for AI Training: Test Canonicals Before Turning 301s On
Cloudflare can redirect verified AI training crawlers to a same-origin canonical URL. Test the first 256 KB, redirect order, logs, and rollback before enabling it.
From this desk
Start with the most useful page
The featured page offers a strong introduction. The remaining cards help readers move through this editorial section without turning the archive into a service menu.
Start with the editorial guide
Choose the desk that matches your question
Use the subject desks for focused browsing, or continue to the complete chronological archive below.
SEO
Crawling, content, and measurement
Reporting and practical analysis for technical, on-page, content, and publishing decisions.
AEO & AI Search
Answers, citations, and visibility
Platform changes, retrieval behavior, source attribution, and measurement without unsupported promises.
Research
Tests, methods, and evidence
Original protocols, observations, evidence reviews, and the limits on what each result establishes.
Workflows
APIs, automation, and verification
Implementation stories with reproducible inputs, failure states, evidence, and stopping conditions.
Complete archive
Every story, newest first
Open a story for its complete evidence, examples, limitations, author information, and reader discussion.
-
-
Google-InspectionTool User-Agent Correction: Audit Exact-Match WAF Rules
Google corrected an erroneous semicolon in its Google-InspectionTool user-agent documentation. Audit copied exact-match WAF and parser rules.
-
Cloudflare Crawl-to-Referral Ratios: What the Metric Can and Cannot Prove
Cloudflare now exposes crawl-to-referral ratios by operator. The ratio measures request imbalance, not citation, training use, revenue, or causal value.
-
Perplexity MCP Server 1.0 Migration: Test Citations, Streaming and Cancellation
Migrate to Perplexity MCP Server 1.0 with contract tests for citations, streaming events, progress, cancellation, configuration, and failures.
-
Schema.org 30.0 Is Not a Google Rich Result Update
Schema.org 30.0 expanded the vocabulary, but a vocabulary release does not automatically create Google rich-result support. Audit the two layers separately.
-
Bing’s AI-Guided Image Search: A Publisher Testing Protocol
Bing announced an opt-in AI-guided image experience on US desktop. Use this protocol to test grouping, labels, sources, and publisher representation.
-
Kagi Search API Adds Related Searches and Link-Preserving Extraction
Kagi’s July API update adds related searches and preserves original links in extracted documents. Update schemas, fixtures, and evidence exports carefully.
-
Microsoft Web IQ: How to Audit Evidence Objects Without Trusting Vendor Benchmarks
Microsoft Web IQ returns structured web evidence for grounded AI applications. Audit the evidence objects separately from Microsoft’s benchmark claims.
-
Perplexity Gateway API vs Agent API: Which One Actually Provides Web Grounding?
Perplexity Gateway provides model access, while Agent API is the documented route for grounded answers and citations. Choose by evidence requirements.
A useful standard
What every story should make clear
SearchEngineAnswer is an independent publication. Stories should help a reader understand what changed, what the evidence supports, and what to do next.
The reader job is explicit
A story should answer a focused question or support a concrete decision rather than merely announce a topic.
Sources remain inspectable
Material facts stay close to current primary documentation, reproducible evidence, or clearly attributed reporting.
Updates retain context
Meaningful changes, uncertainty, corrections, and publication dates remain visible so readers can judge freshness.
References and next steps