# All Robots User-Agent: * Disallow:/cgi-bin Disallow:/style # For AllTheWeb User-agent: Fast-Webcrawler Disallow:/cgi-bin Disallow:/style # For Alexa User-agent: ia_archiver Disallow:/cgi-bin Disallow:/style # For AltaVista User-agent: Scooter Disallow:/cgi-bin Disallow:/style # For Exactseek.com User-agent: exactseek-pagereaper Disallow:/cgi-bin Disallow:/style # For Htdig.org User-agent: htdig Disallow:/cgi-bin Disallow:/style # For Google User-agent: Googlebot Disallow:/cgi-bin Disallow:/style # For Google Mediapartners User-agent: Mediapartners-Google Disallow:/cgi-bin Disallow:/style # For GoForIt.com User-agent: GoForIt.com Disallow:/cgi-bin Disallow:/style # For Gigabot User-agent: Gigabot Disallow:/cgi-bin Disallow:/style # For Jeeves User-agent: Jeeves Disallow:/cgi-bin Disallow:/style # For Inktomi Slurp User-agent: Inktomi-Slurp Disallow:/cgi-bin Disallow:/style # For Kellysearch User-agent: semanticdiscovery Disallow:/cgi-bin Disallow:/style # For LinkWalker User-agent: LinkWalker Disallow:/cgi-bin Disallow:/style # For Looksmart User-agent: WISENutbot Disallow:/cgi-bin Disallow:/style # For MSN User-agent: MSNBot Disallow:/cgi-bin Disallow:/style # For Mirago [UK] User-agent: mirago Disallow:/cgi-bin Disallow:/style # For Mozdex User-agent: mozDex Disallow:/cgi-bin Disallow:/style # For Nameprotect User-agent: NPBot Disallow:/cgi-bin Disallow:/style # For Nutch User-agent: NutchCVS Disallow:/cgi-bin Disallow:/style # For ObjectsSearch User-agent: ObjectsSearch Disallow:/cgi-bin Disallow:/style # For Picsearch User-agent: psbot Disallow:/cgi-bin Disallow:/style # For Turnitin.com User-agent: TurnitinBot Disallow:/cgi-bin Disallow:/style # For Walhello.com User-agent: appie Disallow:/cgi-bin Disallow:/style Disallow:/form # For Wget User-agent: Wget Disallow:/cgi-bin Disallow:/style # For Wotbox.com User-agent: Wotbox Disallow:/cgi-bin Disallow:/style # For Yahoo User-agent: Yahoo-MMCrawler Disallow:/cgi-bin Disallow:/style # - de Robots - # For www.peerbot.com User-Agent: PEERbot Disallow:/cgi-bin Disallow:/style # - CN+TW+KR Robots - # For cn Baidu, Sohu; Naver.com kr; Openfind tw User-Agent: Baiduspider+ User-Agent: sohu-search User-Agent: NaverBot User-Agent: Openbot Disallow:/cgi-bin Disallow:/style # - BY Robots- User-Agent: All.by Disallow: / # - RU Robots- User-Agent: Aport User-Agent: StackRambler Disallow: / User-Agent: yandex Disallow:/cgi-bin Disallow:/style Disallow:/form