# For domain: http://www.9maand.com # All robots will spider the domain User-agent: twiceler Disallow: * User-agent: * Disallow: /admin Disallow: /cgi-bin Disallow: /images Disallow: /includes Disallow: /link