continued code reorganization, getting rid of globals, a=chris
# Okay to crawl, just don't query all the indexes
# Dumb agents that don't understand *, we hope you
# are too slow to bother excluding
User-agent: *
Disallow: /*?*q=
Disallow: /*?*s=news