# friggin: robots.txt # This file is used to allow crawlers to index our site. # It is NOT used for any other purpose, such as filtering # impressions or clicks. User-agent: * Disallow: User-agent: googlebot Disallow: *.swf Disallow: *.zip Disallow: *.rar