Last commit for robots.txt: e4965ace3a3374b59d43c84c719d773b505cec0b

Forbid robots on news feed pages, a=chris

Chris Pollett [2012-09-08 10:11:54]
Forbid robots on news feed pages, a=chris
# Okay to crawl, just don't query all the indexes
# Dumb agents that don't understand *, we hope you
# are too slow to bother excluding
User-agent: *
Disallow: /*?*q=
ViewGit