# Don't let these Unwanted Robots see anything. # If that fails and you don't follow Robots Exclusion, we'll ban you. # Just try us! User-agent: SurveyBot Disallow: / User-agent: larbin Disallow: / User-agent: larbin_2.6.3 Disallow: / User-agent: LinkWalker Disallow: / User-agent: lwp-trivial Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial/1.35 Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: seekercenter.net Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: ExtractorPro Disallow: / User-agent: ecollector Disallow: / User-agent: EmailCollector/1.0 Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf 1.00 Disallow: / User-agent: Mozilla/2.0 (compatible; NEWT ActiveX; Win32) Disallow: / User-agent: Indy Library Disallow: / User-agent: NameProtect Disallow: / User-agent: TurnitinBot Disallow: / User-agent: webreaper Disallow: / User-agent: WebCopy Disallow: / User-agent: Wget Disallow: / User-agent: jobo Disallow: / # For everyone else unless we find misbehavers later. # Note /email-addresses/ is a robots trap to find misbehavors who review robots.txt but ignore it. User-agent: * Disallow: /stats/ Disallow: /email-addresses/