The short answer
You cannot control what search engines or AI assistants say about your organisation, but four things make the accurate answer easy to find: a consistent identity, readable content, search eligibility and deliberate crawler choices. Google says its AI Overviews and AI Mode need no special markup and Google Search ignores llms.txt. Be wary of anyone selling a shortcut.
1. A consistent identity
They build a picture of you from many sources; conflicts blur it.
One name, one description
One form of your organisation's name and one short description of what you do.
Service area stated
Say plainly where you serve: "across Nigeria" or specific states and cities.
Identical contact details
The same details on your website, business listings and social profiles.
A clear About page
Who you are and what you offer, without puffery.
Local listings and structured data
- If customers visit you or you serve a local area, keep your Google Business Profile complete. Google says businesses with complete and accurate information are more likely to show in local results.
- Organisation structured data can help Google understand details such as your logo and contact information. Google lists no required properties and does not promise to display it.
2. Readable content
One page per topic
Each service or topic on its own page, with a descriptive title and headings.
Answer buyer questions
What it is, who it suits, how it works, what affects cost, what happens next.
Facts in text
Key information in text, not only in images, videos or PDFs.
Semantic HTML
Real headings, lists and tables, as Google's generative AI guidance recommends.
People first
Original, useful information from people who know the subject.
Built for phones
Many buyers read on a mobile connection: light pages, key facts near the top.
Google favours people-first content; its spam policies treat mass-produced pages written mainly for search engines, such as near-identical "service in every city" pages, as scaled content abuse or doorways.
3. Search eligibility
To appear in Google's AI features, a page must be indexed and eligible to be shown with a snippet. Keep important pages crawlable and indexable, and use noindex for pages you want out of search: robots.txt manages crawling, not indexing. The checklist below covers the rest.
4. Search and training crawlers are separate choices
Several AI companies run separate crawlers per job, so robots.txt can allow one and block another.
| Company | Search or answers | Model training | Notes |
|---|---|---|---|
| OpenAI | OAI-SearchBot (ChatGPT search) | GPTBot | ChatGPT-User for user requests; settings independent |
| Perplexity | PerplexityBot (search, not training) | None listed | Perplexity-User for user-initiated visits |
| Googlebot (Search, including AI features) | Google-Extended token | No effect on inclusion or ranking in Google Search |
Blocking a search crawler usually stops that service citing or linking to you. Blocking a training crawler is a policy decision about how your content may be used and does not by itself remove you from search.
Before you edit robots.txt
OpenAI says robots.txt changes can take about a day to reach its search results. User agents and behaviour change, so check each provider's current documentation first.
5. What you can and cannot measure
| Source | What you can see |
|---|---|
| Google Search Console | Generative AI performance report: impressions in AI Overviews and AI Mode, no clicks |
| Bing Webmaster Tools | AI Performance report (public preview): citations, cited pages, grounding queries |
| Other assistants | Little or nothing; some visits show as referrals, others as direct traffic or not at all |
Reporting is limited and nobody can promise citations or rankings; say so plainly to anyone expecting precision, and ask any tool claiming a precise "AI share" how it collects data. Track impressions where reported, AI referrals in analytics, and how new enquiries found you.
Checklist
Identity
- One organisation name and one short description, used everywhere.
- Service area stated plainly on the site.
- Contact details identical on the website and all listings.
- Business listings claimed, complete and accurate where relevant.
Content
- A page for each main service, with a clear title and headings.
- Key facts in HTML text, not only in images or PDFs.
- Buyer questions answered on the relevant pages.
- Pages light, fast and easy to read on a phone.
Eligibility
- Important pages indexable, not blocked by robots.txt or stray
noindex. noindex, not robots.txt, used for pages kept out of search.- Pages load reliably; main content needs no clicks to appear.
- Unique, descriptive title and meta description on every page.
- Sitemap submitted in Google Search Console and Bing Webmaster Tools.
Crawlers and measurement
- A written decision on search crawlers and, separately, training crawlers.
- robots.txt reviewed against current provider documentation.
- AI impression and citation reports checked monthly where available.
- "How did you hear about us?" recorded for new enquiries.
Limitations
This covers foundations and cannot promise results: each AI product decides independently what to show and cite, and changes quickly. Recheck the linked documentation, current at review, before significant changes.
Next step
For how buyer research is shifting, see how AI assistants are changing the way buyers find information. If your website needs clearer structure, faster pages or better content, see web development.
Sources and further reading
Product capabilities and guidance change. These are the primary sources this article relies on, checked on the review date above.
- AI features and your website, Google Search Central
- Guidance on generative AI features on Google Search, Google Search Central
- Creating helpful, reliable, people-first content, Google Search Central
- Introduction to robots.txt, Google Search Central
- Google's common crawlers (Google-Extended), Google Crawling Infrastructure
- Overview of OpenAI crawlers, OpenAI
- Perplexity crawlers, Perplexity
- Generative AI performance report, Google Search Console Help
- Introducing AI Performance in Bing Webmaster Tools (public preview), Microsoft Bing Webmaster Blog
- Tips to improve your local ranking on Google, Google Business Profile Help
- Spam policies for Google web search, Google Search Central
This article is general information, not legal, accounting or security advice for your specific situation. Examples are hypothetical unless stated otherwise.