# robot for searchme.com SE User-agent: Baiduspider User-agent: Googlebot-Image User-agent: ia_archiver User-agent: ICC-Crawler User-agent: IRLbot User-agent: larbin User-agent: MSIECrawler User-agent: msnbot-media User-agent: Nutch User-agent: OmniExplorer_Bot User-agent: PRCrawler User-agent: sogou spider # Sproose is a SE but nobody uses it User-agent: Sproose # Useless SE User-agent: Speedy User-agent: SurveyBot User-agent: TMCrawler User-agent: twiceler User-agent: VisBot Disallow: / User-agent: * Disallow: /awl/errors/ Disallow: /awl/nb/ Disallow: /awl/post/ Disallow: /awl/Post/Abuse.ashx Disallow: /nb/