# sellmychat crawler policy. Free result bodies are public and rate limited; paid bodies need a purchase. # Search crawlers are welcome on the html pages: they link people back to a result. Result previews are public. # Assistants fetching a page for a person may also read the markdown versions (add .md to a browse, category or result address). # Training crawlers are blocked: our terms say results are used as context and never to train models. # Do not crawl, mirror or bulk-download result bodies. Get them through the MCP get tool. Guide: /llms.txt and /for-ai. User-agent: Googlebot User-agent: Bingbot User-agent: Applebot User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /for-ai.md Disallow: /admin Disallow: /ops Disallow: /my Disallow: /me Disallow: /account Disallow: /credits Disallow: /signin Disallow: /agree Disallow: /signout Disallow: /auth Disallow: /api Disallow: /confirm Disallow: /open Disallow: /upload Disallow: /share Disallow: /out-of-credits Disallow: /connected Disallow: /search Disallow: /md Disallow: /r-text Disallow: /mcp Disallow: /browse*.md Disallow: /c/*.md Disallow: /place/*.md User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /for-ai.md Disallow: /admin Disallow: /ops Disallow: /my Disallow: /me Disallow: /account Disallow: /credits Disallow: /signin Disallow: /agree Disallow: /signout Disallow: /auth Disallow: /api Disallow: /confirm Disallow: /open Disallow: /upload Disallow: /share Disallow: /out-of-credits Disallow: /connected Disallow: /search Disallow: /md Disallow: /r-text Disallow: /mcp User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot User-agent: Bytespider User-agent: Applebot-Extended User-agent: Meta-ExternalAgent User-agent: FacebookBot User-agent: Amazonbot User-agent: anthropic-ai User-agent: Claude-Web User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Diffbot User-agent: Omgilibot User-agent: Timpibot User-agent: AI2Bot User-agent: PanguBot User-agent: ImagesiftBot User-agent: Webzio-Extended Content-Signal: ai-train=no Disallow: / User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /for-ai.md Disallow: /admin Disallow: /ops Disallow: /my Disallow: /me Disallow: /account Disallow: /credits Disallow: /signin Disallow: /agree Disallow: /signout Disallow: /auth Disallow: /api Disallow: /confirm Disallow: /open Disallow: /upload Disallow: /share Disallow: /out-of-credits Disallow: /connected Disallow: /search Disallow: /md Disallow: /r-text Disallow: /mcp Allow: /browse*.md Disallow: /r/*.md$ Disallow: /c/*.md Disallow: /place/*.md Sitemap: https://sellmychat.com/sitemap.xml