AI Search Engine Optimization, Minus the Guesswork

Why the same page gets cited in Perplexity but invisible in Google AI Overviews. A tested framework, not hacks. See what actually moves the needle.

Richard

Richard

Richard leads SEO at RankSpiral. He spent years ranking his own niche sites before helping anyone else with theirs.

October 30, 2026 · 20 min read

AI Search Engine Optimization, Minus the Guesswork

The AI Search Panic, Explained

Somewhere right now, a marketing manager is refreshing ChatGPT for the ninth time, trying to work out why a competitor got cited and they didn't.

If that's you, welcome.

Pull up a chair.

You're in very good (and very confused) company.

Search changed shape fast.

Google AI Overviews and Google AI Mode now summarize answers at the top of results. ChatGPT Search, Microsoft Copilot, and Perplexity answer questions directly, with sources tucked into footnotes.

Often the user gets what they need before a single click happens.

So the internet did what the internet does.

It produced a flood of "GEO hacks" promising guaranteed inclusion in AI answers.

Add these magic phrases.

Chop your content into tiny chunks.

Upload a special file.

Most of it is educated guessing dressed up as certainty.

This guide takes a different angle.

Think of it as an operating system for AI search engine optimization, built on what the platforms have actually documented, what research has shown, and what you can measure yourself.

Speculation gets labeled as speculation.

Promise.

One thing most guides get wrong right out of the gate: they treat "AI search" as one system.

It isn't.

Different engines use different crawlers, different retrieval sources, and different ranking signals.

A page can be cited constantly in Perplexity and be completely invisible in Google AI Overviews.

Same page. Same week.

The goal isn't to "rank in AI." It's to be retrievable, understandable, and worth quoting across several different systems, and to measure which ones are actually working for you.

By the end, you won't just have a pile of tactics. You'll have a measurement framework you can run every month, so you stop guessing and start seeing patterns.

Sound good? Let's get to it.

What AI Search Optimization Actually Means

Here's the slightly anticlimactic truth: AI search engines are mostly standing on the shoulders of good old-fashioned search indexes. The shiny chatbot on top gets the headlines.

The boring index underneath does the heavy lifting.

AI search optimization is the practice of making your content retrievable, understandable, and citation-worthy across AI-powered answer surfaces, not just ranked in a list of blue links. It covers Google's AI features, standalone assistants like ChatGPT and Perplexity, and anything else that generates an answer and credits sources.

Most of these systems use something called retrieval-augmented generation (RAG). Instead of answering purely from memory, the model runs searches (often called grounding queries), pulls back relevant pages, and builds its answer from them. Your page has to be found in that retrieval step before it can be quoted.

No retrieval, no citation.

That's why crawlability and indexability still matter so much. Google has stated plainly that there are no special technical requirements for appearing in AI Overviews or AI Mode beyond being indexed and eligible to show a snippet in regular Search.

If Googlebot can't reach your page, no amount of clever phrasing will save it.

What does change is the definition of winning.

In classic SEO, success meant ranking: your URL sitting in position three. In AI search, success means being selected and quoted.

Those are genuinely different metrics, and conflating them is how teams end up celebrating rankings while their AI visibility quietly flatlines.

AI SEO vs Traditional SEO

Traditional SEO optimizes a page to rank for a query. AI SEO optimizes the passages, facts, and entities on that page to be pulled into a generated answer.

The page is still the container, but the unit of competition shrinks to a paragraph, a table row, or a single statistic.

The foundations overlap heavily.

Clean internal linking, fast pages, sensible site architecture, and strong E-E-A-T signals (experience, expertise, authoritativeness, trust) help in both worlds. The difference is in what you measure and how you write individual sections so they can stand on their own when lifted out of context.

Comparison table, Traditional SEO vs AI SEO. Goal — Traditional SEO: Rank a URL in blue links; AI SEO: Get selected and…

Quick check-in: notice that last row?

The foundation is identical.

That's the single most reassuring thing in this entire article.

Your SEO work wasn't wasted.

GEO, AEO, LLMO... Same Thing?

Mostly, yes.

The industry has produced more acronyms than a government agency, and they largely point at the same idea.

Generative engine optimization (GEO) comes from a 2023 Princeton-led research paper studying how content gets surfaced in generative answers. Answer engine optimization (AEO) predates it and originally focused on featured snippets and voice assistants.

Large language model optimization (LLMO) emphasizes how models understand and represent your brand.

The labels differ in emphasis, not substance.

Whatever your agency calls it on the invoice, the work is the same: be findable, be clear, be worth citing, and measure the results honestly.

How AI Engines Decide What to Cite

Why does an AI engine quote one page and ignore another that seems just as good?

It's not magic, and it's not random.

It's a pipeline, and your content can fall out at any stage.

The Visibility Pipeline

Picture a talent show with nine rounds of auditions.

Most contestants never make it past the first door. Here's how the rounds break down:

Crawlability comes first: can the engine's bot actually reach your page? Then indexing: has the page been stored and deemed eligible?

Next is retrieval, where the system pulls candidate pages for a grounding query, followed by reranking, where those candidates are scored and reordered by relevance and quality.

After that comes context selection, where only the best passages fit into the model's working window. Then answer generation, citation (does your source get credited?), prominence (is it a top inline link or buried in a "more sources" dropdown?), and finally the click or conversion.

Step-by-step diagram, The AI Visibility Pipeline Simplified. 1. Crawl — Bots can reach the page; 2. Index — Stored and…

The practical lesson? Diagnose where you're dropping out.

A page that never gets indexed needs technical fixes. A page that's indexed but never cited needs better content.

Those are completely different problems with completely different solutions.

Why Engines Don't Agree

Each engine fills its retrieval step from a different well. That's why the same question can produce wildly different sources across tools.

Google AI Overviews and AI Mode draw primarily from Google's own index. AI Mode also uses what Google calls "query fan-out," splitting one question into many related sub-searches, which means pages answering adjacent sub-questions can get pulled in.

ChatGPT Search uses OpenAI's own crawler (OAI-SearchBot) alongside third-party search providers and licensed content partnerships, with Bing widely reported as one of those providers. Perplexity runs its own crawler, PerplexityBot, and maintains its own index while also drawing on live web results.

Microsoft Copilot is built on Bing.

On top of different sources, each system weights authority and freshness differently. Perplexity tends to favor recent pages for news-adjacent queries, while Google leans on its long-established quality signals.

So yes, your page can be a citation star in one engine and a ghost in another.

If you've only checked Google, you've checked one engine. If you're blocking Bingbot or OAI-SearchBot in robots.txt, you may have opted out of others without realizing it.

Speaking of which: audit your robots.txt.

Blocking GPTBot (used for model training) is a separate decision from blocking OAI-SearchBot (used for ChatGPT's search feature). And Google-Extended controls Gemini model training, not whether you appear in Google Search or AI Overviews.

People mix these up constantly.

Structured Data and llms.txt

This is where honesty matters most, because it's where the hype runs hottest. Let's separate what's documented from what's hopeful.

Documented and worth doing: crawlable HTML where the main content doesn't depend on heavy client-side JavaScript to render.

Clear entity information, meaning who you are, what you do, and who wrote the content, stated plainly on the page.

And structured data, which Google supports for helping systems understand page content, as long as it matches what's visibly on the page.

Bing representatives have also said publicly that schema markup helps their systems understand content. That's useful machine-readable content work, and it pays off in regular search too.

Just know that Google has said no special schema is required to appear in AI features.

Experimental or unverified: the llms.txt file, proposed in 2024 as a way to give language models a curated map of your site. As of 2026, Google has said it doesn't use it, and no major engine has confirmed it as a ranking or citation signal.

It's cheap to add, so there's little harm, but don't expect miracles.

Same caveat for aggressive "content chunking," splitting pages into tiny fragments to make them easier for AI to digest. There's no confirmed evidence it improves citations, and it often makes pages worse for humans.

More on that shortly.

What Actually Earns AI Citations

Good news: the things AI engines like to quote are, broadly, the things humans like to read.

Specific answers. Real numbers. Clear comparisons. Evidence someone actually did the thing.

The Princeton GEO study found that adding citations, quotations, and statistics improved source visibility by up to 40% in its test environment.

Let's break down what that looks like in practice.

Content Formats Worth Quoting

When a model needs a quotable sentence to support its answer, it reaches for content that's self-contained and verifiable. These formats show up again and again:

  • Direct-answer passages. A section that opens with a clear, one-sentence answer to the question in its heading is easy to lift. "A Roth IRA is funded with after-tax dollars" beats three sentences of throat-clearing every time.
  • Original data. Survey results, internal benchmarks, pricing studies, or test results that exist nowhere else make you the primary source. AI engines can't cite a statistic to anyone but the person who produced it.
  • Comparison tables. Well-structured HTML tables with real values (prices, specs, timelines) are easy for retrieval systems to parse and for models to summarize accurately.
  • Clear definitions. When someone asks "what is X," the engine wants a crisp definition it can attribute. Definitions buried in paragraph six rarely make the cut.
  • First-hand expert testimony. Content showing first-hand experience ("we tested this on 40 client sites") carries signals that generic summaries can't fake. It's also the E-E-A-T "experience" factor in action.

Why Third-Party Proof Wins

Here's a slightly uncomfortable truth: what other people say about you often matters more than what you say about yourself.

AI models lean on corroboration.

If five independent sources agree, the claim feels safe to repeat.

  • Trust-sensitive topics raise the bar. For finance, health, legal, and "best X for Y" recommendation queries, engines are cautious. A brand mentioned across reviews, news coverage, and expert roundups looks far safer to cite than one that only praises itself.
  • Backlinks still count. Links remain a core quality signal in the indexes that feed AI retrieval. A well-linked page is more likely to clear the reranking stage.
  • Unlinked mentions matter too. Models learn associations between brands and topics from text across the web. Consistent mentions in relevant contexts strengthen your entity SEO, even without a hyperlink.
  • Consistency beats volume. Your business name, description, and expertise should match across your site, directories, social profiles, and press. Conflicting information makes engines less confident about who you are.

The AI Filler Problem

Can you use AI to write content? Sure.

Should you publish 400 AI-generated articles next Tuesday? Please don't.

The web is drowning in interchangeable text, and engines are getting very good at ignoring it.

  • Originality is the whole point. If your page says exactly what 50 other pages say, there's no reason to cite you specifically. AI-assisted drafts need something only you can add: data, examples, opinions, experience.
  • Factual verification is non-negotiable. Models hallucinate. Publishing a confident wrong statistic damages trust with readers and with engines that cross-check claims.
  • Editorial review still matters. A human expert reading, correcting, and improving the draft is what separates useful content from filler. Google's guidance focuses on quality and helpfulness, not on whether AI was involved.
  • Disclosure builds trust. Being transparent about how content was produced, and who reviewed it, supports trust signals rather than undermining them.
  • Scaled commodity content carries risk. Google's spam policies explicitly target "scaled content abuse," meaning mass-produced pages made mainly to manipulate rankings. That can mean being ignored at best, and penalized at worst.
  • Don't write "machine bait." Over-optimized passages chopped into robotic fragments, stuffed with repeated question phrasing, read terribly. And they often get rejected anyway, because rerankers reward coherent, helpful content.

Takeaway worth remembering: write for a smart human first, then check that each key section can stand on its own.

That's the sweet spot.

Measuring and Scaling AI Visibility

Here's where most AI search strategies quietly fall apart. Teams make changes, check ChatGPT once, see their brand mentioned, and declare victory.

That's like weighing yourself once after a big glass of water and calling it a diet plan.

Measurement is what turns AI search engine optimization from guesswork into a system. And it starts with knowing what you're actually measuring.

From Mention to Conversion

Not all AI visibility is equal.

A mention without a link is nice. A prominent citation that drives a sale is better.

Think of it as a ladder:

1
Mention.
Your brand is named in the AI answer, with or without a link. Good for awareness, hard to attribute.
2
Citation.
Your URL appears as a source. This is where your citation share (the percentage of tracked prompts where you're cited) becomes a meaningful metric.
3
Prominent citation.
You're a top or inline source, not buried in an expandable "more sources" list. Prominence heavily affects whether anyone clicks.
4
Referral click.
Someone actually visits your site. You can track this in analytics via referrers like chatgpt.com and perplexity.ai.
5
Assisted or branded conversion.
The user later searches your brand name, signs up, or buys. Rising branded search demand and assisted conversions are often where AI visibility shows its real value.
Diagram, The AI Visibility Outcome Ladder. Mention — Brand named in the answer; Citation — Your URL is a source; Prominent…

Most AI visibility trackers only measure the first two rungs.

That's a problem, because a brand can be mentioned constantly and convert nobody.

One more wrinkle: Google Search Console counts AI Overviews and AI Mode traffic inside the overall Web search report, without a separate breakdown.

So you'll need to combine several data sources to see the full ladder.

A Repeatable Testing Method

AI answers vary.

Ask the same question twice and you might get different sources.

That's not a reason to give up on measurement... it's a reason to measure systematically.

Here's a method you can run monthly with nothing fancier than a spreadsheet:

1
Build a fixed prompt set.
Pick 20 to 50 queries that matter to your business, mixing informational, comparison, and buying-intent questions. Keep this list stable so results are comparable over time.
2
Test across engines.
Run every prompt in Google AI Overviews, Google AI Mode, ChatGPT Search, Perplexity, and Microsoft Copilot. Remember, they don't share sources.
3
Vary phrasings.
Real users don't all type the same words. Test two or three versions of each core question, such as "best CRM for small law firms" and "which CRM should a five-person law firm use."
4
Control location and session.
Use logged-out or incognito sessions to reduce personalization, and note the location you tested from. Local and personalized results can skew everything.
5
Log dates consistently.
Record when each test ran. Answers shift as indexes update, so dated logs let you connect changes to your content updates.
6
Record the full ladder.
For each prompt and engine, log: mentioned (yes or no), cited (yes or no), citation position, which competitor got cited, and the specific URL. Then match it against referral traffic in analytics.
7
Look for patterns, not single results.
One missed citation means nothing. Being absent from Perplexity on 80% of comparison queries for three straight months means something.

Check-in time: does that feel like a lot?

Start with ten prompts and two engines.

A small, consistent log beats an ambitious one you abandon in week three.

Small Brand, Big Visibility

Big brands get cited a lot. They have years of links, press coverage, and name recognition.

So how does a ten-person company compete?

Not by copying the big players' playbook. By being undeniably the best source on something specific.

  • Own a narrow topic. Instead of competing on "accounting software," aim to be the definitive source on "bookkeeping for independent veterinary clinics." Deep topical authority in a tight niche is achievable in months, not years.
  • Publish original data. A survey of 150 customers or a benchmark from your own operations gives AI engines a fact they can only attribute to you. Big brands rarely bother with small, specific studies.
  • Put real experts on the byline. Named authors with verifiable credentials and author pages strengthen trust signals, especially for health, finance, and legal topics.
  • Write what only you can write. Specific first-hand content (real project numbers, real mistakes, real photos) is exactly what generic, corporate content lacks.

Pulling this together into one repeatable process is the hard part.

A workflow like RankSpiral's shows how the pieces connect: topical authority mapping identifies which subtopics you need to cover and how they should interlink, a six-pass fact-checked writing process makes sure claims are verified and sources are clear before publishing, and Retrolink content refresh revisits older pages to update facts and strengthen internal links.

That ties technical SEO, entity clarity, and citation-worthy evidence into one system instead of three disconnected projects.

Whatever tools you use, refresh time is limited. Prioritize it like this:

  • Pages already getting impressions or citations. They've cleared the retrieval stage. Improving them is far easier than starting from zero.
  • Pages with factual drift. Outdated prices, old statistics, or retired product names make engines less likely to trust you, and they confuse readers.
  • Pages answering only part of a multi-step query. If users ask "how do I choose, set up, and price X," and your page only covers choosing, AI Mode's query fan-out will pull the rest from competitors. Fill the gaps.

Your AI Search Questions, Answered

How do I learn SEO as a beginner?

Start with Google's free SEO Starter Guide and Search Console, then practice on a real website. Learn crawling, indexing, keyword research, and on-page basics first.

Those foundations still power AI search, so nothing you learn is wasted.

Is SEO dead now with AI?

No, SEO is not dead.

AI search engines rely heavily on traditional search indexes to retrieve sources, so crawlable, well-ranked pages are still the entry ticket.

What has changed is how success is measured: citations and conversions now matter alongside rankings.

Optimise for AI search by making pages crawlable, answering questions directly, and adding original data and expert evidence.

Earn third-party mentions to build trust.

Then test a fixed set of prompts monthly across engines to see what's working.

What is AI SEO called now?

AI SEO is most commonly called generative engine optimization (GEO). You'll also see answer engine optimization (AEO) and large language model optimization (LLMO).

The terms overlap heavily and describe the same core goal of being cited in AI answers.

What is the difference between SEO and AI SEO?

Traditional SEO aims to rank a page in search results, while AI SEO aims to have specific passages selected and quoted in AI-generated answers.

Both share the same technical foundation.

The difference lies mostly in content structure and measurement.

How do I optimize my website for AI search engines?

Optimize your website for AI search engines by checking that robots.txt allows search crawlers like Googlebot, Bingbot, OAI-SearchBot, and PerplexityBot.

Use clean HTML, accurate structured data, and clear author and business information.

Then strengthen content with verifiable facts.

Get recommended by ChatGPT by being crawlable by OAI-SearchBot, indexed in the search sources it draws on, and widely mentioned by credible third parties. Reviews, press coverage, and expert roundups help most.

No one can guarantee inclusion.

What is generative engine optimization?

Generative engine optimization is the practice of making content more likely to be retrieved and cited by AI systems that generate answers. The term comes from 2023 academic research, which found that adding statistics, quotations, and citations improved visibility.

The Bottom Line

There is no guaranteed-inclusion trick.

Not a magic file, not a secret phrase, not a chunking formula.

Anyone selling certainty in AI search is selling something else.

What works is less exciting and far more reliable: crawlable pages, well-sourced claims, genuinely useful content, and honest measurement across the full ladder from mention to conversion.

Boring? Maybe. Effective? Very.

Here's your one action for today.

Pick your three most important pages and ask: can AI engines even reach them, and is there a clear, quotable answer on each one?

Fix what's broken.

Then set up your prompt-testing spreadsheet before chasing a single new tactic.

Measure first, optimize second, and the guesswork disappears.

You probably have page-two articles earning nothing right now

Connect your site and RankSpiral shows every keyword you rank 11–30 for, priced by what closing it is worth — then writes the rewrite. Your first two articles are on us, no card.

Get started for free
Richard

Richard

Richard leads SEO at RankSpiral. He spent years ranking his own niche sites before helping anyone else with theirs.

Keep reading