# Disallow MJ12bot User-Agent: MJ12bot Disallow: / # Allow all other bots but deny access to admin directory User-Agent: * Disallow: Crawl-delay: 60 Disallow: /catalog/admin/ Disallow: /catalog/includes/configure.php