robots.txt
we use Shopify as our ecommerce platform
Sitemap: https://magicmind.com/sitemap.xml
Allow OpenAI’s GPTBot
User-agent: GPTBot Disallow:
Allow Anthropic’s ClaudeBot
User-agent: ClaudeBot Disallow:
Allow Google-Extended (used for Bard/Gemini training)
User-agent: Google-Extended Disallow:
Allow Common Crawl
User-agent: CCBot Disallow: