diff options
| author | wushin <pasekei@gmail.com> | 2014-12-15 21:25:07 -0600 |
|---|---|---|
| committer | wushin <pasekei@gmail.com> | 2014-12-15 21:25:07 -0600 |
| commit | f9094642f5e39b93a0a0a3e69c532ff91d76ed4e (patch) | |
| tree | a903f1825c5e7967e1a881df3aa6d7e161c9d973 | |
| parent | 723c12ee8dd0ab0b4c17f2c1425ee2cd787c2cea (diff) | |
| download | website-f9094642f5e39b93a0a0a3e69c532ff91d76ed4e.tar.gz website-f9094642f5e39b93a0a0a3e69c532ff91d76ed4e.tar.bz2 website-f9094642f5e39b93a0a0a3e69c532ff91d76ed4e.tar.xz website-f9094642f5e39b93a0a0a3e69c532ff91d76ed4e.zip | |
Update Robots to clean up indexed pages
| -rw-r--r-- | robots.txt | 7 |
1 files changed, 6 insertions, 1 deletions
@@ -1,7 +1,12 @@ User-agent: * disallow: /extensions/ disallow: /config/ -disallow: /index.php/Special:Search +disallow: /index.php? +disallow: /index.php/Help +disallow: /index.php/MediaWiki +disallow: /index.php/Special: +disallow: /index.php/Template +disallow: /skins/ allow: /index.php/Main_Page allow: /index.php/Dev:Main allow: /index.php/How_to_Develop |