QUOTE(Alison @ Fri 12th September 2008, 6:15pm)
Hi all.
This could be useful and interesting. The Robots.txt file - associated with Google spidering, etc - is now available to edit by administrators. Link to enwiki file
here.
This means that admins should have a whole lot more control over what goes in there and what doesn't, without having to hassle a dev to go in to change it. Should be fun ...
Kool, progress. Although I'm sure the malcontents will disagree and descend on this thread posthaste, furiously waving their hands and proselytizing about the evils of Wikipedia and how it is unsalvageable.
Hey Awbrey, you're needed, bring the koolaid
QUOTE(Rootology @ Fri 12th September 2008, 7:07pm)
Thank God. Now lets exclude:
User:*
User talk:*
Wikipedia:*
Wikipedia talk:*
Talk:*
User talk is excluded. see
WP:AN