Knowledge base

Guides for the answer-engine era.

Practical, no-fluff explanations of how AI crawlers work and how to make sure your site gets cited.

Guide

Every AI Crawler in 2026: What They Do and Which Ones Matter

A practical reference to 19 AI crawlers — who runs them, whether they collect for training or search, and whether you should allow or block each.

Read guide →
Guide

How to Get Cited in Google AI Overviews (Practical Guide)

A practical, no-guarantee checklist for improving your chances of being cited in Google AI Overviews — from crawlability to answer-first content.

Read guide →
Guide

The 12-Point AI Visibility Audit Checklist for 2026

A practical, linkable 12-point audit for AI answer-engine visibility: robots.txt, llms.txt, schema, content structure, mentions, and monitoring.

Read guide →
Guide

Google-Extended Explained: Does Blocking It Hide You From AI Overviews?

Google-Extended controls AI training use, not Googlebot or AI Overviews. Here is the precise distinction and what to actually do.

Read guide →
Guide

GPTBot and robots.txt: How to Allow or Block OpenAI's Crawler

GPTBot, OAI-SearchBot and ChatGPT-User do different jobs. Learn the exact robots.txt rules to allow or block each, and how to verify them.

Read guide →
Guide

llms.txt Explained: What It Is and How to Add It (2026)

What llms.txt is, what it genuinely does, and how to add it to your site. Includes a complete copy-paste example and honest limitations.

Read guide →
Guide

How to Get Cited by Perplexity AI: A Step-by-Step Guide

Perplexity is built around citations. Learn how crawler access, content structure, and authoritative mentions affect whether your pages get cited.

Read guide →
Guide

Why Am I Not Showing Up in ChatGPT? (7 Real Reasons)

Not showing up in ChatGPT? Here are seven concrete reasons — from robots.txt blocks to thin content — and how to diagnose each one in minutes.

Read guide →

Start with a free check.

Guides tell you what to do. The checker shows what's actually wrong on your site.

Check my site →