# Robot Exclusion File -- robots.txt

User-agent: *
Disallow: /cgi-bin

User-agent: psbot
Disallow: /

User-agent: ia_archiver
Disallow: /