Do AI Crawlers Request Markdown? Test the Accept Header First
Test crawler Accept headers, negotiated Content-Type and cache variation before claiming an AI bot receives Markdown.
Topic tag · Research
Methods for measuring AI-search visibility, citations, referrals, outcomes, and uncertainty.
Tagged collection
Open an article for the complete method, evidence, limitations, and a focused reader discussion.
Test crawler Accept headers, negotiated Content-Type and cache variation before claiming an AI bot receives Markdown.
Beginning August 30, Google says site-reputation manual actions will have different effects inside and outside the EEA. The policy remains in force, and third-party sections can still be separated to rank independently.
Promptwatch and an independent sample found a steep ChatGPT decline. A separate 7.3-million-citation report found Reddit stable or rising elsewhere, so the percentages cannot be combined.
A 900-person US browsing study observed fewer result clicks and more session endings when AI Overviews appeared. Here is the denominator, study design, and limit behind the 1% source-click figure.
Measure web/app citation drift with paired prompts, repeated runs, preserved URLs, overlap distributions, answer-use labels, change control, and a reusable observation ledger.
A 2026 U.S. desktop study separates ChatGPT’s session-level outbound-click rate from an estimated 9.4% reduction in traditional search use.
Three prominent 2026 findings use different samples, treatments and outcomes. Here is the denominator-safe comparison.
Compare OpenAI’s browser pixel and server-side Conversions API by reliability, consent, deduplication, view-through attribution and release QA.
Use date-filtered search to find candidates, then inspect snapshots, page updates, related modules, metadata conflicts and leakage severity before admitting evidence.
The Answer Brief
Get practical SEO and AI-search guidance, new experiments, and the workflows worth keeping.
Unsubscribe anytime. Your inbox stays yours.
Practical, evidence-based answers for earning visibility in search engines and AI answers.
Get the Chrome extension Read the living case study
Independent publication. Sources, corrections, authorship, and commercial relationships are disclosed openly.
Search the publication
Search reporting, guides, research, checklists, and browser tools.
SearchEngineAnswer app
Install the site on your home screen for a focused, standalone reading experience. No app-store account is required.
On iPhone or iPad, open the browser Share menu and choose “Add to Home Screen.” On other devices, use your browser’s Install option when available.
Privacy controls
Required for security, saved controls, and remembering this choice.
No analytics service is currently configured.
No advertising or behavioral targeting is currently configured.