#Default robots.txt file (which asks all bots to crawl slowly but still index everything). User-agent: MJ12bot Disallow: / User-agent: * Allow: / Sitemap: http://www.baraha.com/sitemap.xml