How it works Crawlers Myths What works Checklist FAQ
AI Search · Practitioner Guide

How to Get Cited by ChatGPT, Google AI Overviews & Perplexity in 2026

What actually earns citations in AI search — and the GEO tactics Google has now explicitly told us do nothing. Including the crawler setting most sites get wrong.

How to get cited by ChatGPT, Claude, Google AI Mode and AI Overviews — illustration of AI answer engines citing web sources
Citations in AI search are earned through classic retrievability — not through special files or AI-specific markup.

Quick share

Useful for anyone still buying llms.txt as a ranking factor.

Get a summary from AI

Short on time? Open this article in an answer engine and have it summarised for you.

The short version
  • Google ignores llms.txt. Its own documentation says these files neither help nor harm visibility in Google Search.
  • There is no special AI schema. Structured data is not required for generative AI features — keep it for rich results, not as an AI trick.
  • You do not need to chunk your content. Google says there is no requirement to break pages into tiny pieces.
  • Crawler access is the real gate. Block OAI-SearchBot and you will not appear in ChatGPT search answers, full stop.
  • AI Overviews run on normal Search. They use retrieval-augmented generation on top of Google's core ranking systems — so classic SEO is the substrate, not a separate discipline.

Most of what circulates as "GEO strategy" is guesswork that hardened into folklore. Someone published a theory in 2024, it got repeated in a hundred LinkedIn carousels, and it is now sold as a service.

The useful thing about 2026 is that we no longer have to guess about all of it. Google has published direct guidance on optimising for its generative AI features, and OpenAI documents exactly which of its crawlers controls what. Some widely sold tactics are explicitly contradicted by those documents.

This guide separates the two. Everything in the "myths" section is sourced to primary documentation, not opinion.

1. How AI search actually retrieves content

Before optimising for something, it helps to know what it does. The three systems people lump together as "AI search" work differently enough that the distinction changes your priorities.

Google AI Overviews and AI Mode

This is the one with the clearest documentation, and the answer is less exotic than the industry assumes. Google describes its generative features as rooted in its core Search ranking and quality systems. Two mechanics do the work:

Why this matters

If retrieval runs on core Search infrastructure, then being retrievable in classic Search is the prerequisite for being cited in AI Overviews. There is no side door. A page that cannot rank cannot be retrieved, and a page that is not retrieved cannot be summarised.

Query fan-out has a practical consequence that most keyword-led strategies miss: you are not competing for one phrase. You are competing to be a good answer to a cluster of related sub-questions the system generates on its own. That rewards depth across a topic far more than exact-match optimisation of a single page.

ChatGPT search

OpenAI operates a separate crawler for search surfacing, and its documentation is unusually blunt about the consequence of blocking it. More on that in section 3, because it is the single most common own-goal I find in audits.

Perplexity

Perplexity leans heavily on live retrieval and cites sources inline by design — its interface is built around attribution in a way the others are not. In practice this makes it the most sensitive of the three to clean, extractable page structure, because it is pulling specific passages to attribute rather than synthesising a general answer.

2. SEO vs GEO vs AIO vs AEO

Four acronyms, and most of the time three of them describe the same work. Briefly, so we can stop tripping over vocabulary:

TermStands forWhat it actually means in practice
SEOSearch Engine OptimizationBeing retrievable and rankable. Still the foundation — AI retrieval sits on top of it.
GEOGenerative Engine OptimizationBeing selected and cited inside a generated answer, not just ranked in a list.
AEOAnswer Engine OptimizationLargely the same objective as GEO, coined earlier around featured snippets and voice.
AIOAI OptimizationUmbrella term. Often used to include ChatGPT and Perplexity, not just Google.

My honest position: GEO, AEO and AIO are not separate disciplines with separate playbooks. They are a shift in what the search result looks like. The work that makes you citable is mostly the work that made you rankable, plus a sharper focus on extractability, entity clarity and having something to say that is not already on twenty other pages.

Be suspicious of anyone selling GEO as a wholly new service with wholly new tactics. Ask what specifically differs from good SEO. If the answer is "we add special AI markup", read the next section.

3. Crawler access: the part most sites get wrong

This is the least glamorous section and the highest-impact one. You can write the best page on the internet; if the retrieval crawler cannot fetch it, none of it counts.

The critical distinction — and the one I most often find misconfigured — is between OpenAI's crawlers, because they do different jobs and blocking the wrong one silently removes you from ChatGPT search.

User agentOperatorWhat it controls
OAI-SearchBotOpenAISearch surfacing. Sites opted out of this will not be shown in ChatGPT search answers.
GPTBotOpenAIModel training. Disallowing it signals your content should not be used to train foundation models.
ChatGPT-UserOpenAIOn-demand fetches when a user acts. Not used to determine whether content appears in Search.
Google-ExtendedGoogleGoverns use of your content for Gemini grounding. Blocking it does not affect classic Search ranking.
PerplexityBotPerplexityPerplexity's indexing crawler.
ClaudeBotAnthropicAnthropic's crawler.
CCBotCommon CrawlOpen dataset that feeds many downstream models.
The expensive mistake

Plenty of sites blocked everything OpenAI-shaped in 2023–24 to protect content from training. Reasonable at the time — but if that block included OAI-SearchBot, you also removed yourself from ChatGPT's search answers. You can refuse training and still be discoverable. Disallow GPTBot, allow OAI-SearchBot.

A robots.txt that opts into visibility

If your goal is to be found in AI answers, this is the shape you want. Note the deliberate asymmetry — training and search surfacing are separate decisions:

User-agent: *
Allow: /

# Search surfacing in ChatGPT — required to appear in answers
User-agent: OAI-SearchBot
Allow: /

# Gemini / AI Overviews grounding
User-agent: Google-Extended
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: ClaudeBot
Allow: /

# Model training — allow or disallow, it is a business decision
# and it does NOT affect search surfacing above
User-agent: GPTBot
Allow: /

Sitemap: https://example.com/sitemap.xml

Two operational notes. OpenAI says robots.txt changes can take roughly 24 hours to register, so do not judge a fix in an afternoon. And ChatGPT-User requests are user-initiated, so they do not always follow standard robots rules — do not use its traffic as evidence your configuration is right.

The other access blocker: JavaScript

Google renders JavaScript. Most AI crawlers largely do not. If your content only exists after a client-side framework boots, a non-rendering crawler receives an effectively empty page.

This is the quiet reason many well-built React, Vue and Angular sites are invisible to AI assistants while ranking perfectly well in Google. Check it directly:

curl -s https://yoursite.com/ | wc -w

If that returns a few dozen words when your page shows two thousand, your content is JavaScript-dependent. Server-side rendering or static generation is the real fix; a meaningful pre-rendered fallback in the HTML is the pragmatic one.

4. Four myths Google has explicitly debunked

Each of these is contradicted by Google's own published guidance on generative AI features. Not inference — direct statements.

Myth 1: "Add an llms.txt file so AI can read your site"

Google states you do not need to create machine-readable files, AI text files, markup or Markdown to appear in Google Search — and that such files will neither harm nor help visibility or rankings, because Google Search ignores them.

Google Search Central, guidance on optimising for generative AI features

That is about as unambiguous as Google gets. llms.txt is a proposed convention, not a standard any major search engine has committed to consuming.

Is it therefore worthless? Not quite, and I want to be precise rather than dismissive: it costs almost nothing, and some non-Google tools do read it. But it should be filed under "cheap experiment", never sold as a ranking factor or presented as the reason a site will appear in AI answers. If an agency's AI-search proposal leads with llms.txt, that tells you how current their information is.

Myth 2: "There is special schema for AI"

Google is direct: structured data is not required for generative AI search, and there is no special schema.org markup you need to add for it.

Keep your structured data. It earns rich results, it clarifies entities, it is good practice. Just stop paying for "AI schema" as a distinct product — it does not exist.

Myth 3: "Chunk your content so AI can parse it"

Google says there is no requirement to break content into tiny pieces for AI to understand it, and that its systems can understand multiple topics on a page and surface the relevant portion.

Note what this does not say. Clear structure still helps — headings, sections, scannable answers. That is good writing, and it helps humans first. What is unnecessary is the artificial fragmentation some tools recommend: shredding a coherent page into disconnected micro-sections for a parser that did not need it.

Myth 4: "Publish variations of pages to catch more AI queries"

Producing near-duplicate pages to target query variants runs into Google's scaled content abuse policy. Query fan-out already expands one question into many — you do not need a page per phrasing, and manufacturing them is a risk rather than a tactic.

5. What actually earns citations

With the myths cleared, here is what the evidence and the guidance actually support.

Information gain — having something that is not already online

Google's guidance repeatedly emphasises unique, non-commodity content with a distinctive perspective — a first-hand review rather than a summary of other reviews.

This is the single hardest and most valuable lever, and it is the reason a generated article summarising ten existing articles rarely gets cited: a system that synthesises sources has no reason to cite a page that is itself a synthesis. Give it something only you have — original data, a documented test, a real client outcome, a photograph of the actual thing, a number nobody else published.

Extractable, quotable passages

Generated answers lift specific passages. Content that is easy to lift gets lifted. In practice:

Entity clarity and consistency

AI systems resolve entities before they answer. If your brand, person and business details are inconsistent across your site, your profiles and your listings, you are a fuzzy entity — and fuzzy entities get skipped in favour of unambiguous ones.

Topic authority over single keywords

Because of query fan-out, being the best answer to one phrase is much weaker than being consistently good across a topic. Ranking for a single term does not mean you own the subject — and the fan-out mechanism means the system will ask itself several adjacent questions before answering. Depth across a cluster beats a single optimised page.

Third-party mentions

Retrieval draws on the whole web, not only your domain. Being discussed on sites the system already trusts — industry publications, forums, communities, reputable directories — raises the odds of appearing in an answer that never touches your homepage. Unglamorous, slow, and it works.

Freshness, where freshness matters

RAG exists partly to improve the recency of answers. For anything time-sensitive, visible and accurate dates matter: publication and modified dates in the markup, dates in the copy, and genuine updates rather than a changed timestamp.

Original media

Google's guidance explicitly mentions including high-quality images and video. Original media is also, conveniently, one of the hardest things for a competitor to replicate — a screenshot of your actual dashboard is evidence, a stock photo is decoration.

6. How to measure AI visibility

Measurement has historically been the weakest part of AI-search work — a lot of assertion, very little data. This has improved.

Search Console

Google now points to a Generative AI performance report in Search Console for monitoring how you appear in these features. Whatever else you do, start here — it is first-party data from the source, rather than a third-party tool's estimate.

GA4: treat AI assistants as a channel

Referral traffic from AI assistants arrives with identifiable referrers. Segment it deliberately rather than letting it disappear into Direct or Referral:

Manual prompt testing

Unfashionable but honest: keep a fixed set of 20–50 prompts a real buyer would type, run them monthly across each assistant, and log whether you were mentioned, cited with a link, or absent. Same prompts, same schedule, screenshots kept. Over six months that becomes the only trend data about your own brand that you fully control.

7. The 25-point AI-Ready audit

This is close to the checklist I work through on client audits. Ordered by impact, not effort.

Access — fix first

  • OAI-SearchBot is allowed in robots.txt
  • Google-Extended is allowed, if you want Gemini and AI Overview grounding
  • PerplexityBot, ClaudeBot and CCBot access is a deliberate decision, not an accident
  • Core content is present in the raw HTML without JavaScript execution
  • No unintentional noindex on commercially important pages
  • An XML sitemap exists, is current, and is referenced in robots.txt
  • Canonical tags resolve to live URLs on the primary domain
  • One hostname is canonical, with everything else 301'd to it

Entity clarity

  • Organization or Person schema exists with a stable @id
  • sameAs lists every real profile you control
  • Name, address and phone are identical across site, Google Business Profile and citations
  • alternateName covers the variants people actually search
  • An About page states plainly who you are, where you are and what you do
  • Author entities exist and are consistent across articles

Content

  • Every important page contains at least one thing found nowhere else
  • Headings are phrased as the questions people ask
  • Each section answers in its opening two sentences before elaborating
  • Comparisons are in tables, not prose
  • Claims are self-contained enough to survive being quoted alone
  • Original images or video, not stock
  • Publication and modified dates are visible and truthful
  • Topic coverage is deep enough to answer adjacent questions, not just the head term

Measurement

  • Search Console generative AI reporting is being monitored
  • GA4 segments AI-assistant referrals as their own channel
  • A fixed prompt set is tested on a schedule and logged
If you only do three things

1. Confirm OAI-SearchBot is not blocked. 2. Confirm your content exists in the HTML without JavaScript. 3. Publish one thing this quarter that nobody else could have written. The first two are afternoons. The third is what actually compounds.

8. Frequently asked questions

Does llms.txt help with Google?

No. Google's documentation states it ignores these files and that they neither help nor harm your visibility or rankings in Google Search. It costs little to publish one for other tools that may read it, but it should never be presented as a ranking factor.

What is the difference between OAI-SearchBot and GPTBot?

OAI-SearchBot controls whether your site can be surfaced in ChatGPT's search answers. GPTBot is used for training OpenAI's models. They are separate decisions — you can disallow training while remaining fully visible in ChatGPT search.

Is there special schema markup for AI search?

No. Google states structured data is not required for generative AI search and there is no special schema.org markup for it. Keep structured data for rich results and entity clarity, but treat "AI schema" products with scepticism.

Do I need to break my content into chunks?

No. Google says there is no requirement to break content into tiny pieces, and its systems can understand multiple topics on one page. Clear headings and structure still help — artificial fragmentation does not.

Can a page be cited in AI Overviews without ranking in Google?

It is unlikely by design. AI Overviews use retrieval-augmented generation on top of Google's core ranking systems, so retrievability in classic Search is effectively the prerequisite. Query fan-out means the ranking that matters may be for an adjacent question rather than your target keyword.

Why does my site rank in Google but never appear in ChatGPT?

Two usual causes. Either OAI-SearchBot is blocked in robots.txt, or your content is rendered client-side and the crawler receives an empty page. Google renders JavaScript; most AI crawlers largely do not. Check both before assuming it is a content problem.

Want this checked on your site?

An AI-Ready SEO Audit runs this entire checklist against your domain — crawler access, rendering, entity consistency, extractability and measurement — and returns a prioritised fix list.

Request an AI-Ready Audit →
Jayant Solanki

Jayant Solanki

AI-Ready SEO, GEO & AIO strategist based in Indore, India, working with eCommerce, local service and global brands across India, the UAE and the US. Ranked a client #1 for a 45,000/month commercial keyword; builds the measurement and automation behind the work.

More about Jayant →