# Google AdSense Allow User-agent: Mediapartners-Google* Disallow: # Block unmodified Teleport/Pro UAs User-agent: Teleport Pro Disallow: / # Block unmodified Teleport-Pro UAs User-agent: Teleport-Pro Disallow: / # Block unmodified BlackWidow UAs User-agent: BlackWidow Disallow: / # Block unmodified Brutus UAs User-agent: Brutus/AET Disallow: / # Block unmodified Brutus UAs User-agent: Brutus Disallow: / # Block unmodified wget UAs User-agent: wget Disallow: / # Block unmodified SiteSnag UAs User-agent: SiteSnag Disallow: / # Block unmodified GoZilla UAs User-agent: GoZilla Disallow: / # Block unmodified WebZip UAs User-agent: WebZip Disallow: / # Block unmodified GetRight UAs User-agent: GetRight Disallow: / # Block unmodified WebSnake UAs User-agent: WebSnake Disallow: / # Allow all other robots to browse everywhere except indicated User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /Resume/ Disallow: /Mine/ Disallow: /EBAY/