User-agent: * Disallow: /awstats Disallow: /cgi-bin Disallow: /download Disallow: /htmlares Disallow: /phpthumb