User-Agent: *
Disallow: /?crawler=yes
Disallow: /unused/
Allow: /