diff options
| author | wushin <pasekei@gmail.com> | 2016-03-16 00:22:18 -0500 |
|---|---|---|
| committer | wushin <pasekei@gmail.com> | 2016-03-16 00:22:18 -0500 |
| commit | b8daf8a84049d6e8d7a7f0a489dac82e17f572fa (patch) | |
| tree | 70696d194ee5ce870a957e62d0780b452873bb28 | |
| parent | 3e30b9f0f5d6cd4f587d186aa9ea6308bcfdd3cf (diff) | |
| download | website-b8daf8a84049d6e8d7a7f0a489dac82e17f572fa.tar.gz website-b8daf8a84049d6e8d7a7f0a489dac82e17f572fa.tar.bz2 website-b8daf8a84049d6e8d7a7f0a489dac82e17f572fa.tar.xz website-b8daf8a84049d6e8d7a7f0a489dac82e17f572fa.zip | |
Update robots settings
| -rw-r--r-- | robots.txt | 15 |
1 files changed, 7 insertions, 8 deletions
@@ -2,14 +2,6 @@ User-Agent: Alexabot disallow: User-agent: * -disallow: /extensions/ -disallow: /config/ -disallow: /index.php? -disallow: /index.php/Help -disallow: /index.php/MediaWiki -disallow: /index.php/Special: -disallow: /index.php/Template -disallow: /skins/ allow: /index.php/Main_Page allow: /index.php/Dev:Main allow: /index.php/How_to_Develop @@ -29,6 +21,13 @@ allow: /index.php/Monster_Reference allow: /index.php/Reporting_Bugs allow: /index.php/Servers allow: /robots.txt +disallow: /extensions/ +disallow: /config/ +disallow: /index.php? +disallow: /index.php/Help +disallow: /index.php/MediaWiki +disallow: /index.php/Special: +disallow: /index.php/Template sitemap: http://themanaworld.org/sitemap.xml host: themanaworld.org |