AEO, GEO and AI search guides
Practical guides to technical SEO, AI crawler access, structured data, site performance, and local search. Find the issue you are investigating, check the supporting sources, and use the relevant fix guide before changing your site.
Two companions to these guides: our study of AI-crawler blocking across the live web (original 2026 data), and the 14 free tools that check one thing each in seconds: crawler access, schema, llms.txt, answer readiness, and more.
Explore the State of AI Crawler Access for the study's scope, measured sample, and data download.
Get cited by the AI engines
Answer engines usually quote from indexed or previously crawled pages, not from a continuous live browse of your site. Some systems also support user-triggered fetches (for example OpenAI documents ChatGPT-User requests). These guides cover crawler access, readable HTML and quotable passages for each major engine.
- How to get cited by ChatGPT Allow OAI-SearchBot, serve plain HTML, lead with a quotable passage.
- How to show up in Google AI Overviews Be eligible for Search first; the same fundamentals apply.
Crawler access and the files that control it
Crawler access is worth checking, but this audit does not establish why a site was omitted from an AI answer. Our crawler study measures declared access and probe responses, not the causes of missing citations.
- GPTBot and robots.txt: allow or block the AI crawlers The full token reference, and the training-versus-retrieval split.
- What is llms.txt, and do you need it? An honest read: optional, and not a Google ranking factor.
Diagnose and fix
- Why isn't my site showing up in AI search? The five most common reasons, and how to check each one.
- Why am I not showing in AI Overviews? Work the layers in order; most sites fail before the AI part.
- How to check your AI search visibility A repeatable protocol, not a one-off vibe check.
- How to check the SEO of a website The seven checks that matter, by hand or in one minute.
- The AuditLamp Fix Library Step-by-step fixes for every problem our audit finds.
For specific checks: how Bing indexes websites and how to check Core Web Vitals.
The Fix Library, step by step
Fix guides written in plain English. Each one names the problem, the documentation behind it, and the exact change to make. One of the most common: a canonical error that quietly splits ranking power between duplicate pages.
- How to fix soft 404 errors
- How to allow AI search crawlers to read your site
- How to get your site indexed in Bing for AI search
- How to fix canonical tag errors
- How to fix duplicate content
- How to fix heading structure
- How to fix a site still on HTTP
- How to fix a website that doesn't render without JavaScript
- How to fix keyword cannibalization
- How to fix a missing meta description
- How to add an author bio that builds credibility
- How to fix missing internal links
- How to fix missing structured data (JSON-LD)
- How to fix mobile usability errors
- How to fix an accidental noindex tag
- How to fix a slow Largest Contentful Paint
- What causes Cumulative Layout Shift and how to fix it
- What INP is and how to fix a slow one
- How to make your content extractable for AI
- How to fix XML sitemap errors
- How to fix thin content
- Why you should self-host your web fonts
- How to fix your title tag for search and AI
Local search, minus the folklore
Local SEO is where the worst advice lives. These guides separate what Google's Business Profile rules actually say from the tricks that end in suspension.
- Local SEO: the whole picture, minus the folklore Start here. The pillar guide: Google's three documented factors, mapped to every lever.
- Business Profile categories, chosen right Legit and documented. The relevance input most owners fumble.
- NAP consistency: hygiene, not a subscription Right-sized. What matters, what the resellers oversell.
- Why your Business Profile got suspended The accidental triggers, in plain English, with the fix-first appeal.
SEO myths, checked against the docs
Old rules that outlived their evidence. We take each one back to what Google actually documents, so you stop spending on folklore.
- Checking Google PageRank for keywords? Debunked. Public PageRank died in 2016; every checker invents its number.
Compare SEO tools
Start with the SEO tool comparison guide, or compare AuditLamp with Ahrefs, Semrush, and Screaming Frog.
The big tools price for agencies and meter everything. If you are an owner who just wants to know what is broken, read these before renewing.
- Semrush feels too expensive: your real options What you actually use, and what that should cost.
- How to cancel Semrush The exact steps, plus what to export before you go.
- Ahrefs raised prices and added credits. Now what? What the credit system changes for small teams.
- SEO tools with flat pricing and no credits Who still sells a price that stays a price.
- BrightLocal vs AuditLamp Different jobs. We state our bias and draw the line honestly.
- The Semrush AI Toolkit: cost vs what it does A paid add-on that tracks. Tracking is a thermometer, not medicine.
Notes from the team
Short reads on what just changed in search and AI, with the source linked in every note.
- What percentage of websites have an llms.txt file? In our July 2026 scan of the 1,000 most-visited websites, 11.9% had an llms.txt file. What the number means...
- One in eight scanned sites blocks AI at the edge without knowing We pulled the latest scan for each of the 105 business sites that have run our engine and compared two...
- We scanned 105 business sites. Three had an answer AI could quote. The short answer: we pulled the latest scan for each of the 105 domains that have run our engine and looked...
- How to do an SEO audit step by step (2026) An SEO audit is seven checks run in a fixed order: reachability, indexation, JavaScript dependence, AI...
- How much does an SEO audit cost (and what you actually get) An SEO audit costs anywhere from nothing to five figures, and both ends of that range can be legitimate.
- Before/after proof: what real SEO work looks like Real SEO work leaves physical evidence on your website: rewritten titles, restructured headings, corrected...
- Read an SEO report in 10 minutes without being fooled You do not need to understand SEO to check an SEO report.
- Agency accountability scorecard You are paying someone for SEO or "AI visibility." The monthly report looks busy.
- 10 questions your SEO agency should be able to answer this month The short answer: if you are paying for SEO and your traffic has not moved, you do not need to become an SEO...
- Is the SEO work real? A 90-second check The short answer: you do not have to trust a report.
- Mentions beat backlinks now. Here is the data, and what to do without an SEO budget. The short answer: for showing up in AI answers, how often your brand is *mentioned* across the web matters...
- "You have no reviews yet." Google's second reviews bug in a week, and the one thing an owner can actually do about it. If you opened your Google Business Profile this week and were told you have no reviews, you are not alone...
The basics, defined
Clear definitions, no jargon for its own sake. Start here if the acronyms are new.
- Canonicalization: diagnose and fix canonical errors
- Schema markup: what it does and how to add it
- AEO vs SEO: what's the difference? Same foundation, different finish line.
- How to read PageSpeed Insights Which number Google actually uses, without being a developer.
- The full AEO and GEO glossary Plain-English definitions, from RAG to the great decoupling.
The glossary, term by term
Definitions with a dedicated page for each term. Every acronym the industry throws at you, in plain English.
No guides match that search. Try a broader topic or clear the search to browse every guide.