Do AI Answers Cite YouTube Videos Outside Google’s Top 100? A Test Protocol
A preregistered protocol for comparing AI-answer video citations with Google’s top 100 web results without turning a vendor claim into a universal search rule.
Protocol status: This page defines a study and contains no independent finding. The motivating lead is a Reddit AMA in which an Ahrefs representative said that 18% of AI Overview cited URLs outside the top 100 in its analysis were YouTube. That number belongs to the vendor’s sample and method, not to SearchEngineAnswer.
The research question is narrower: for a fixed query set, environment, and date, which cited video URLs appear in the collected AI answers, and are those normalized destinations present in the corresponding top 100 Google web results?
Preregister the query sample
Choose topics where video could plausibly provide first-hand demonstration, instruction, review, news footage, or explanation. Include queries with and without obvious video intent. Freeze language, country, device, account state, safe-search setting, and collection date before inspection.
| Artifact | Fields | Boundary |
|---|---|---|
| AI answer | Answer, cited URL, placement, passage | One product surface and run |
| Web results | Positions 1–100 and destination URLs | Same query environment and date |
| Video entity | Watch URL, channel, video ID, canonical | Declared normalization rule |
| Outcome | Present, absent, ambiguous, unavailable | No causal inference |
Normalize video and result URLs
Define how the study handles watch URLs, Shorts, mobile URLs, embeds, tracking parameters, redirects, translated URLs, channel pages, playlists, timestamps, and mirrored uploads. Match by stable video identifier where possible and preserve the original observed URL.
Decide whether a video carousel, dedicated video result, or blended module counts as part of the “web top 100.” If the motivating claim refers specifically to ordinary web results, collect that surface separately and do not mix positions from incompatible result types.
Retain inaccessible or region-restricted videos as observed citations with an accessibility flag. Do not silently remove them from the denominator.
Collect paired observations
- Capture the AI answer and every citation before opening destinations.
- Collect the top 100 result destinations for the same query environment.
- Resolve redirects and record canonical destinations without overwriting the raw URLs.
- Classify each cited video as inside top 100, outside top 100, ambiguous, or not comparable.
- Verify that the video actually supports the cited claim.
- Retain queries with no AI answer, no citations, no video citation, or fewer than 100 retrievable results.
Where automated collection conflicts with terms, access controls, or stable rendering, use a compliant manual sample and publish that limitation.
Report the sample, not a rule
Publish the query list, date, environment, URL-normalization code or rules, duplicate handling, exclusions, missing data, and adjudication notes. Report the count and share of cited video destinations inside and outside the collected result set with the correct denominator.
An outside-top-100 citation would show that one AI-answer retrieval path surfaced a video not present in one corresponding web-result sample. It would not prove that video is privileged, that conventional ranking is irrelevant, or that a publisher can force citation by uploading to a video platform.
Add a passage-support review before counting the citation as useful. A linked video can be topically related but fail to support the specific statement, or the relevant evidence may appear only in the description, transcript, channel page, or a different upload. Record publication date, creator, title, transcript availability, cited claim, supporting timestamp, and whether the destination remained accessible at review time. Keep source usefulness separate from outside-top-100 status.
Use the small experiment method for the observation card and the citation-ready passage test for claim support.
Ask a question or join the discussion