User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /*.mp3/ User-agent: Fish43.search.aol.com Disallow: / User-agent: ArchitextSpider Disallow: / User-agent: Slurp Disallow: / User-agent: asterias Disallow: / User-agent: ia_archiver Disallow: /