Knowledge base
Guides for the answer-engine era.
Practical, no-fluff explanations of how AI crawlers work and how to make sure your site gets cited.
Every AI Crawler in 2026: What They Do and Which Ones Matter
A practical reference to 19 AI crawlers — who runs them, whether they collect for training or search, and whether you should allow or block each.
Read guide → GuideHow to Get Cited in Google AI Overviews (Practical Guide)
A practical, no-guarantee checklist for improving your chances of being cited in Google AI Overviews — from crawlability to answer-first content.
Read guide → GuideThe 12-Point AI Visibility Audit Checklist for 2026
A practical, linkable 12-point audit for AI answer-engine visibility: robots.txt, llms.txt, schema, content structure, mentions, and monitoring.
Read guide → GuideGoogle-Extended Explained: Does Blocking It Hide You From AI Overviews?
Google-Extended controls AI training use, not Googlebot or AI Overviews. Here is the precise distinction and what to actually do.
Read guide → GuideGPTBot and robots.txt: How to Allow or Block OpenAI's Crawler
GPTBot, OAI-SearchBot and ChatGPT-User do different jobs. Learn the exact robots.txt rules to allow or block each, and how to verify them.
Read guide → Guidellms.txt Explained: What It Is and How to Add It (2026)
What llms.txt is, what it genuinely does, and how to add it to your site. Includes a complete copy-paste example and honest limitations.
Read guide → GuideHow to Get Cited by Perplexity AI: A Step-by-Step Guide
Perplexity is built around citations. Learn how crawler access, content structure, and authoritative mentions affect whether your pages get cited.
Read guide → GuideWhy Am I Not Showing Up in ChatGPT? (7 Real Reasons)
Not showing up in ChatGPT? Here are seven concrete reasons — from robots.txt blocks to thin content — and how to diagnose each one in minutes.
Read guide →Start with a free check.
Guides tell you what to do. The checker shows what's actually wrong on your site.