User-agent: * Disallow: /archive/ Disallow: /Scripts/ Disallow: /Library/ Disallow: /Templates/ # # Disallow whois.sc robot from checking domain status User-agent: SurveyBot Disallow: /