User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: email.htm #This code bars all robots from the cgi-bin and images directories and instructs spiders that it can not download email.htm