OpenAI
ChatGPT-User
User-triggered fetches when ChatGPT opens a page.
A compact reference of crawler identities that matter for public SaaS docs and programmatic SEO pages — plus how ReelsRadar helps agents discover the product.
User-triggered fetches when an assistant opens a page to answer a person.
OpenAI
User-triggered fetches when ChatGPT opens a page.
Anthropic
User-triggered fetches when Claude opens a page.
Perplexity
User-triggered fetches for answers and citations.
User-triggered fetcher for AI product experiences.
Microsoft
User-triggered Copilot fetches for AI answers.
DuckDuckGo
Real-time crawler for AI-assisted answers.
Crawlers that discover and refresh content for search / answer indexes.
Primary Search indexing crawler.
OpenAI
Surfaces sites in ChatGPT search results.
Anthropic
Discovers content for Claude search.
Perplexity
Keeps Perplexity's index fresh.
Microsoft
Bing Search indexing crawler.
Public-content crawlers associated with model training datasets.
OpenAI
May collect public content for future models.
Anthropic
Public content crawler for Claude.
Controls Gemini training/grounding usage.
Common Crawl
Builds open web crawl datasets.
ByteDance
Public-content crawler.
ReelsRadar publishes llms.txt, markdown docs twins, OpenAPI, and programmatic SEO landings so answer engines can cite accurate product facts — not just crawl a homepage.
Read the agent docs