User-agent: * Disallow: /admin/login Disallow: /404errorpage Disallow: /cgi-bin/ Disallow: /*?page=* Disallow: /*?keyword=*