--- title: "How to Optimize Your Website for ChatGPT and Perplexity" description: "Let the right crawlers in, answer each question in its first lines, back it with sources, and get named where AI looks. What works in ChatGPT and Perplexity." url: https://proofofpixel.agency/blog/ai-search-optimisation author: "Yannis Spanenburg" published: 2026-08-02T09:00:00Z modified: 2026-10-27T18:13:10Z --- # How to Optimize Your Website for ChatGPT and Perplexity *Let the right crawlers in, answer each question in its first lines, back it with sources, and get named where AI looks. What works in ChatGPT and Perplexity.* By Yannis Spanenburg · 2026-08-02 · 7 min read ChatGPT and Perplexity run a search, read a handful of pages, lift the passage that answers the question and name the source. Optimizing for them means becoming that passage, on a page they are allowed to read. ## What does it mean to optimize a website for ChatGPT and Perplexity? Optimizing a website for ChatGPT and Perplexity means letting their search crawlers read it, then writing each section so it answers one question completely in its first lines, with sources, figures and named quotes an AI can lift. It is classic SEO discipline, aimed at being quoted as well as ranked. ### Key takeaways - ChatGPT search reads websites through OAI-SearchBot and Perplexity through PerplexityBot; blocking GPTBot only stops OpenAI from training on your content. - In the generative engine optimization (GEO) study presented at KDD 2024, adding citations, quotations and statistics raised a page's visibility in AI answers by 30 to 40 percent. - Keyword stuffing gave little to no improvement in the same study, so writing for AI means writing more precisely. - Google says AI Overviews and AI Mode need no special files, markup or schema: indexed pages that can show a snippet are eligible. - For questions about which company or product is best, AI answers are built from directories and roundups, so being named there matters as much as your own page. ## Which crawlers need access to your website? ChatGPT search reads your site with OAI-SearchBot, Perplexity with PerplexityBot, and Google's AI features with the normal Googlebot. Allow those three and you can appear in all of them. GPTBot and Google-Extended control model training, so blocking them does not remove you from AI search answers. [OpenAI's crawler documentation](https://developers.openai.com/api/docs/bots) is explicit that each setting is independent: a site can allow OAI-SearchBot to appear in search results while disallowing GPTBot. Sites that block OAI-SearchBot are not [shown in ChatGPT search answers](/blog/cloudflare-openai-discovery-pilot-2026), and a robots.txt change takes about 24 hours to reach them. Perplexity describes PerplexityBot the same way: it surfaces and links websites in its answers and is not used to train AI models. [Check more than robots.txt](/blog/ai-crawler-access-study-2026). Cloudflare announced in July 2025 that it blocks known AI crawlers by default on every new domain, which keeps a new site out of AI answers until someone changes the setting. Our [guide to AI crawlers like GPTBot and ClaudeBot](/blog/block-ai-crawlers-gptbot-claudebot-2026) covers the trade-offs of each one. - Allow OAI-SearchBot, PerplexityBot and Googlebot in robots.txt. - Decide on GPTBot, ClaudeBot and Google-Extended separately, because they govern model training. - Check the bot settings of your content delivery network (CDN) or firewall as well as robots.txt. - Serve the answer in the HTML itself, so a crawler that does not run JavaScript can still read it. ## How do ChatGPT and Perplexity choose what to cite? Both run a web search, read the top results and compose an answer from the passages that address the question most directly. Pages that state the answer early, back it with sources and figures, and read cleanly out of context are the ones that get quoted. Neither company has published a ranking formula beyond that. The best public evidence is the [GEO study by researchers from Princeton and IIT Delhi](https://arxiv.org/abs/2311.09735), presented at KDD 2024. Across a benchmark of 10,000 queries, adding citations, quotations and statistics lifted a page's visibility in generated answers by 30 to 40 percent, while keyword stuffing offered little to no improvement. The gains were largest for pages that ranked lower in the underlying search: for the source ranked fifth, adding citations more than doubled its visibility. In our client work we see the same pattern from the other side: the pages that get quoted are rarely the longest, and they answer the exact question in their first two sentences before proving it. ## How to optimize your website for ChatGPT and Perplexity in 6 steps 1. Allow OAI-SearchBot, PerplexityBot and Googlebot in robots.txt and in your CDN's bot settings, then give ChatGPT a day to pick up the change. 2. List the twenty questions your buyers ask before they contact you, phrased the way they would type them. 3. Give each question its own H2, worded like the question, on the page that should own the answer. 4. Open every one of those sections with a 40 to 60 word answer that makes sense on its own. 5. Back each answer with a dated figure, a named source or a short quote, and link the source. 6. Keep your name, services and locations identical on your site, your profiles and every directory that lists you. ## Does schema markup or an llms.txt file get you cited? Neither one gets you cited on its own. Google's documentation says AI Overviews and AI Mode need no special files, markup or structured data, only pages that are indexed and eligible to show a snippet. Schema still earns rich results and helps machines read your details, so add it where it fits a result type. In [Google's words](https://developers.google.com/search/docs/appearance/ai-features), there are no additional requirements to appear in AI Overviews or AI Mode, nor other special optimizations necessary. The same logic applies to text files written for AI. Our look at [whether you need an llms.txt file](/blog/llms-txt-ai-search-2026) explains why it is optional at best. ## Why do AI answers name other companies instead of you? For questions about which agency or product is best, AI answers are assembled from directories, review sites and roundups. If you are not named on the pages an answer is built from, your own page never enters the comparison, however good it is. When we checked best agency questions for Dubai, New York, London, Antwerp and Kuala Lumpur in September 2026, the answers were built from Clutch, Semrush Agencies, Sortlist and DesignRush listings, never from an agency's own site. Keep your details identical on each of them, so every mention points to the same business. > Proof of Pixel's position: you win AI answers by being the clearest page on one question and the same, consistent name everywhere AI reads. Proof of Pixel is a marketing and consulting agency for businesses that live on enquiries and orders, building the website, the tracking and the follow-up as one system, with offices in Dubai, New York, London, Antwerp and Kuala Lumpur. [Our SEO and AI search work](/services/seo) starts from exactly these steps. ## How do you know if it is working? Watch three signals: visits from ChatGPT, Perplexity and other assistants in Google Analytics 4 (GA4), your performance in Google's AI features in Search Console, and whether you are named when you ask the assistants your buyers' questions. Check monthly, because AI answers vary from one run to the next. GA4 now groups most of that traffic in its AI Assistant channel, and our walkthrough on [how to track ChatGPT and AI traffic in GA4](/blog/track-chatgpt-ai-traffic-ga4-2026) shows where to look. Google added generative AI performance reports to Search Console in June 2026, so the Google side no longer has to be guessed. ## Your first hour Open your robots.txt and your CDN's bot settings and make sure OAI-SearchBot, PerplexityBot and Googlebot can get in. Then ask ChatGPT and Perplexity the five questions your best clients asked before they hired you, and note who gets quoted and which page of theirs. That list is your rewrite plan. If you want a second pair of eyes on it, [talk to us](/contact). ## Frequently asked questions ### How do I optimize my website for ChatGPT and Perplexity? Allow OAI-SearchBot and PerplexityBot to crawl your site, then give each buyer question its own section that answers it in the first 40 to 60 words. Back the answers with dated figures and named sources, and keep your business details the same everywhere you are listed. ### Does blocking GPTBot keep my site out of ChatGPT search? No, blocking GPTBot does not keep your site out of ChatGPT search, because ChatGPT search uses OAI-SearchBot and OpenAI treats the two as independent settings. GPTBot collects training data, so you can block it and still appear in ChatGPT search as long as OAI-SearchBot is allowed. ### How do you optimize content for Perplexity AI search? Allow PerplexityBot, which Perplexity uses to surface and link sites in its answers, and write sections that answer one question completely in their first lines. Perplexity quotes passages, so a clear, sourced paragraph beats a long page that builds up to its point. ### How long does it take for ChatGPT to pick up changes to my site? OpenAI says robots.txt changes take about 24 hours to reach ChatGPT search. Content changes are picked up when OAI-SearchBot recrawls the page, so keep the same URL, put the change in the HTML itself, and link to the page from pages that already get visits. ### Is optimizing for ChatGPT search different from SEO? Optimizing for ChatGPT search is mostly the same discipline as SEO with a different reward: SEO earns a position, AI search earns a quotation. Crawl access, clear structure and authority carry over; the difference is writing each section so it can be lifted on its own with its evidence attached. ## Keep reading - [Should You Block AI Crawlers Like GPTBot and ClaudeBot From Your Site?](https://proofofpixel.agency/blog/block-ai-crawlers-gptbot-claudebot-2026) - [How to Migrate a Shopify Store Without Losing Google Rankings](https://proofofpixel.agency/blog/shopify-migration-seo-checklist-2026) - [What Google's September 2026 Spam Update Means for Your Site](https://proofofpixel.agency/blog/google-september-2026-spam-update) ## Where this fits - [SEO](https://proofofpixel.agency/services/seo): how POP does this work - [Pristine Smile](https://proofofpixel.agency/work/pristinesmile): case study - [Hertebos](https://proofofpixel.agency/work/hertebos): case study - [Get named by AI search](https://proofofpixel.agency/guides/ai-search): free field guide - [SEO vs GEO](https://proofofpixel.agency/compare/seo-vs-geo): comparison Proof of Pixel: marketing and consulting agency. Dubai, New York, London, Antwerp, Kuala Lumpur. [business@proofofpixel.agency](mailto:business@proofofpixel.agency) - [Home](https://proofofpixel.agency/) - [Services](https://proofofpixel.agency/services) - [Ecommerce & Websites](https://proofofpixel.agency/services/websites) - [SEO](https://proofofpixel.agency/services/seo) - [Marketing](https://proofofpixel.agency/services/marketing) - [Automation & AI](https://proofofpixel.agency/services/automation) - [Strategy & Consulting](https://proofofpixel.agency/services/strategy) - [Merch](https://proofofpixel.agency/services/merch) - [Work](https://proofofpixel.agency/work) - [Pricing](https://proofofpixel.agency/pricing) - [Blog](https://proofofpixel.agency/blog) - [Free field guides](https://proofofpixel.agency/guides) - [POP Playbooks](https://proofofpixel.agency/playbooks) - [Help](https://proofofpixel.agency/help) - [About](https://proofofpixel.agency/about) - [Careers](https://proofofpixel.agency/careers) - [Referral program](https://proofofpixel.agency/refer) - [Contact](https://proofofpixel.agency/contact) - [Free audit](https://proofofpixel.agency/free-audit) - [AI crawler checker](https://proofofpixel.agency/ai-crawler-checker) - [Compare](https://proofofpixel.agency/compare) - [Terms and Conditions](https://proofofpixel.agency/terms) - [Privacy Policy](https://proofofpixel.agency/privacy) POP Playbooks - [Every flow. Every email. Written.](https://proofofpixel.agency/playbooks/email-flows) - [Count every sale once.](https://proofofpixel.agency/playbooks/tracking) - [Get named by AI answers.](https://proofofpixel.agency/playbooks/ai-search) - [A site that sells.](https://proofofpixel.agency/playbooks/website) - [Claude, set up as a system.](https://proofofpixel.agency/playbooks/claude-business-system) - [Build your audience from your texts.](https://proofofpixel.agency/playbooks/stanley-course) Who we build for - [Dentists](https://proofofpixel.agency/for/dentists) - [Real estate](https://proofofpixel.agency/for/real-estate) - [Construction](https://proofofpixel.agency/for/construction) - [Studios and coaches](https://proofofpixel.agency/for/studios) - [Online shops](https://proofofpixel.agency/for/ecommerce) - [YouTube creators](https://proofofpixel.agency/for/youtube-creators) - [Law and accounting](https://proofofpixel.agency/for/law-firms) - [Agencies](https://proofofpixel.agency/for/agencies) - [Clinics](https://proofofpixel.agency/for/clinics) - [Home services](https://proofofpixel.agency/for/home-services) - [Hospitality](https://proofofpixel.agency/for/hospitality) Where we work - [Locations](https://proofofpixel.agency/locations) - [Dubai](https://proofofpixel.agency/locations/dubai) - [Belgium](https://proofofpixel.agency/locations/belgium) - [Netherlands](https://proofofpixel.agency/locations/netherlands) - [London](https://proofofpixel.agency/locations/london) - [New York](https://proofofpixel.agency/locations/new-york) - [Kuala Lumpur](https://proofofpixel.agency/locations/malaysia) - [Web design in Dubai](https://proofofpixel.agency/web-design-dubai) - [SEO in Dubai](https://proofofpixel.agency/seo-agency-dubai) - [SEO in New York](https://proofofpixel.agency/seo-agency-new-york) - [Web design in New York](https://proofofpixel.agency/web-design-new-york) - [SEO in London](https://proofofpixel.agency/seo-agency-london) - [Web design in London](https://proofofpixel.agency/web-design-london) - [Web design in Antwerp](https://proofofpixel.agency/web-design-antwerp) - [SEO in Kuala Lumpur](https://proofofpixel.agency/seo-agency-malaysia)