ChatGPT Crawler Simulator
Test how OpenAI's ChatGPT and GPTBot see your website. Ensure your content is accessible for AI-powered answers and citations.
Test your site with ChatGPT Fetch
Enter your URL to see how ChatGPT Fetch views your website.
What is ChatGPT Fetch?
ChatGPT uses several crawlers to access web content: GPTBot for training data collection, ChatGPT-User for real-time web browsing in ChatGPT Plus, and OAI-SearchBot for SearchGPT. When users ask ChatGPT questions, it may fetch your website content to provide accurate, up-to-date answers. If your site blocks these crawlers or serves JavaScript-only content, ChatGPT won't be able to cite your website in its responses.
Why Allow ChatGPT Fetch?
ChatGPT Fetch robots.txt Configuration
Control how ChatGPT Fetch accesses your website using robots.txt directives. Add these rules to your robots.txt file at the root of your domain.
Allow ChatGPT Fetch
# Allow ChatGPT and OpenAI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: /
Block ChatGPT Fetch
# Block ChatGPT and OpenAI crawlers User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: /
User-Agent String: Mozilla/5.0 (compatible; ChatGPT-User/1.0; +https://openai.com/)
ChatGPT Fetch FAQ
Related Crawler Simulators
Make Your Site Crawlable
JavaScript websites often have indexing issues. LovableHTML pre-renders your SPA into crawler-friendly HTML so ChatGPT Fetch and other bots can read your content.
