All Crawler Simulators
DuckDuckBot

DuckDuckBot Crawler Simulator

Test how DuckDuckGo's crawler indexes your website. Optimize for the privacy-focused search engine and DuckAssist AI.

Test your site with DuckDuckBot

Enter your URL to see how DuckDuckBot views your website.

What is DuckDuckBot?

DuckDuckBot is DuckDuckGo's web crawler that indexes content for their privacy-focused search engine. DuckDuckGo also has DuckAssistBot for their AI-powered DuckAssist feature. With growing privacy concerns, DuckDuckGo's user base continues to expand, making optimization worthwhile.

Why Allow DuckDuckBot?

Rank in DuckDuckGo search results
Reach privacy-conscious users
Get cited by DuckAssist AI feature
Diversify search traffic sources
Appear in DuckDuckGo's !bang searches

DuckDuckBot robots.txt Configuration

Control how DuckDuckBot accesses your website using robots.txt directives. Add these rules to your robots.txt file at the root of your domain.

Allow DuckDuckBot

# Allow DuckDuckGo crawlers
User-agent: DuckDuckBot
Allow: /

User-agent: DuckAssistBot
Allow: /

Block DuckDuckBot

# Block DuckDuckGo crawlers
User-agent: DuckDuckBot
Disallow: /

User-agent: DuckAssistBot
Disallow: /

User-Agent String: DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)

DuckDuckBot FAQ

Make Your Site Crawlable

JavaScript websites often have indexing issues. LovableHTML pre-renders your SPA into crawler-friendly HTML so DuckDuckBot and other bots can read your content.

All Crawlers