# http://www.robotstxt.org/wc/robots.html User-agent: WDG_SiteValidator User-agent: W3C_Validator User-agent: W3C-checklink Disallow: User-agent: Googlebot Disallow: /backup/ Disallow: /images/ Disallow: /cgi-bin/ User-agent: EmailSiphon User-agent: EmailWolf 1.00 User-agent: ExtractorPro User-agent: Mozilla/2.0 (compatible; NEWT ActiveX; Win32) User-agent: Bullseye/1.0 User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: CherryPickerSE/1.0 User-agent: CherryPickerElite/1.0 User-agent: WebBandit/3.50 User-agent: NICErsPRO User-agent: Microsoft URL Control - 5.01.4511 User-agent: EmailCollector/1.0 Disallow: / User-Agent: * Disallow: /