User-agent: Gigabot Disallow: /cgi-bin/ User-agent: googlebot Disallow: /cgi-bin/search/dex.cgi?frameset=1&action=ReportDead&fid=* User-agent: JetBot Disallow: /cgi-bin/ User-agent: Project Kolinka Disallow: /speak/ User-agent: Slurp Disallow: /speak/ User-agent: spider Disallow: / User-agent: robot Disallow: / User-agent: crawl Disallow: /