User-agent: slurp Disallow: /js/ User-agent: * Disallow: /js/ Disallow: /_admin/ Disallow: /_staff/ Disallow: /qa/ Disallow: /srqa/ Disallow: /temp/