Code: Show/Hide User-agent: Googlebot
Disallow: /makecrap.php Disallow: /makepost.php Disallow: /ignore.php Disallow: /search.php Disallow: /templates Disallow: /images Disallow: /download.php Disallow: /privmsg.php Disallow: /login.php Disallow: /memberlist.php Disallow: /profile.php Disallow: /admin Allow: / Crawl-delay: 20 User-Agent: OmniExplorer_Bot Disallow: / User-Agent: Fuck you Omni Explorer Bot, seriously, FUCK YOU Disallow: / User-agent: ia_archiver Disallow: /makepost.php Disallow: /ignore.php Disallow: /search.php Disallow: /privmsg.php Disallow: /login.php Disallow: /memberlist.php Disallow: /profile.php Disallow: /admin Allow: / Crawl-delay: 20 User-agent: * Disallow: /makecrap.php Disallow: /makepost.php Disallow: /ignore.php Disallow: /search.php Disallow: /templates Disallow: /images Disallow: /download.php Disallow: /privmsg.php Disallow: /login.php Disallow: /memberlist.php Disallow: /profile.php Disallow: /admin Allow: / Crawl-delay: 20 |
Code: Show/Hide Disallow: /makepost.php
Disallow: /ignore.php Disallow: /search.php Disallow: /templates Disallow: /images Disallow: /download.php Disallow: /privmsg.php Disallow: /login.php Disallow: /memberlist.php Disallow: /profile.php Disallow: /admin Allow: / Crawl-delay: 20 User-Agent: OmniExplorer_Bot Disallow: / User-Agent: Fuck you Omni Explorer Bot, seriously, FUCK YOU Disallow: / User-agent: ia_archiver Disallow: /makepost.php Disallow: /ignore.php Disallow: /search.php Disallow: /privmsg.php Disallow: /login.php Disallow: /memberlist.php Disallow: /profile.php Disallow: /admin Allow: / Crawl-delay: 20 User-agent: * Disallow: /makecrap.php Disallow: /makepost.php Disallow: /ignore.php Disallow: /search.php Disallow: /templates Disallow: /images Disallow: /download.php Disallow: /privmsg.php Disallow: /login.php Disallow: /memberlist.php Disallow: /profile.php Disallow: /admin Allow: / Crawl-delay: 20 |
Maverick wrote: |
makecrap.php ? :) |
Sonic VI wrote: |
Fixed :-D |