User-agent: * User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: libwww-perl User-agent: Teleport Pro Disallow: /images Disallow: /plugins Disallow: /html/admin Disallow: /html/images Disallow: /scripts/user/image.aspx Disallow: *image.aspx Disallow: *.jpg.xml Disallow: /sounds Disallow: /temp Disallow: /w3c Disallow: /_mmServerScripts Disallow: /stylesheets Disallow: /test Disallow: /aspnet_client # updated 2006-09-09 (rearranged as per Charley's advice)