Answers for "robots txt"

0

robots txt

# Group 1
User-agent: Googlebot
Disallow: /nogooglebot/

# Group 2
User-agent: *
Allow: /

Sitemap: http://www.example.com/sitemap.xml
Posted by: Guest on February-19-2021

Browse Popular Code Answers by Language