User-Agent: * Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: Googlebot Allow: / Allow: /blog/ Allow: /discover/ Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ Disallow: /llms.txt Disallow: /llm-index.json Disallow: /rss.xml Disallow: /blog/*/markdown Disallow: /discover/*/markdown User-Agent: Googlebot-Image Allow: / Allow: /blog/ Allow: /discover/ Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ Disallow: /llms.txt Disallow: /llm-index.json Disallow: /rss.xml Disallow: /blog/*/markdown Disallow: /discover/*/markdown User-Agent: Bingbot Allow: / Allow: /blog/ Allow: /discover/ Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ Disallow: /llms.txt Disallow: /llm-index.json Disallow: /rss.xml Disallow: /blog/*/markdown Disallow: /discover/*/markdown User-Agent: msnbot Allow: / Allow: /blog/ Allow: /discover/ Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ Disallow: /llms.txt Disallow: /llm-index.json Disallow: /rss.xml Disallow: /blog/*/markdown Disallow: /discover/*/markdown User-Agent: GPTBot Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: ChatGPT-User Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: PerplexityBot Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: ClaudeBot Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: anthropic-ai Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: Bytespider Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: Applebot Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: Applebot-Extended Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: cohere-ai Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: YouBot Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ User-Agent: Meta-ExternalAgent Allow: / Allow: /blog/ Allow: /discover/ Allow: /llms.txt Allow: /llm-index.json Allow: /blog/*/markdown Allow: /discover/*/markdown Disallow: /api/ Disallow: /dashboard/ Disallow: /login Disallow: /_next/ Disallow: /app/ Disallow: /review/ Sitemap: https://mycheck.co/sitemap.xml