# Simple exclusion file to prevent spiders from indexing non-content folders. User-Agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /js/ Disallow: /style/ Disallow: /webmail/ User-Agent: Googlebot-Image Disallow: / Allow: /images/ #Disallow: /images/*/comic/ #Disallow: /images/*/gallery/