User-agent: * Disallow: /user Disallow: /map Disallow: /c.pl Disallow: /r.php Disallow: /cc.pl Disallow: *map Disallow: *edit Disallow: /redirect.php Disallow: /scripts Disallow: /security Disallow: /resources User-agent: BecomeBot Disallow: / # http://www.baidu.com/search/spider.htm User-agent: baiduspider Disallow: / User-agent: dotbot Disallow: / User-agent: Yeti Disallow: / User-agent: NaverBot Disallow: /