User-agent: * Disallow: /scp/ Disallow: /about/contact.html Disallow: /about/legal.html Disallow: /web/