# robots.txt # Block Bingbot User-agent: Bingbot Disallow: / # Block Amazonbot User-agent: Amazonbot Disallow: / # Block Applebot User-agent: Applebot Disallow: / # Block Meta external agent User-agent: meta-externalagent Disallow: / # Block Baiduspider User-agent: Baiduspider Disallow: / # Allow all other crawlers User-agent: * Allow: /