User-agent: * Disallow: /404.php Disallow: /cgi-bin/