# Robots.txt file for http://tvnz.co.nz # Sitemap: http://tvnz.co.nz/system/tvnz/sitemap-IF.txt # IF static sitemap User-agent: Mediapartners-Google Disallow: Disallow: /search/ User-agent: Slurp Disallow: /cda/ Disallow: /view-preempt/ Disallow: /search/ Crawl-delay: 1 User-agent: Googlebot Disallow: /cda/ Disallow: /view-preempt/ Disallow: /search/ Crawl-delay: 1 User-agent: msnbot Disallow: /cda/ Disallow: /view-preempt/ Disallow: /search/ Crawl-delay: 1 User-agent: * Disallow: /cda/ Disallow: /view-preempt/ Disallow: /search/ Crawl-delay: 1 User-Agent: MJ12bot Disallow: /cda/ Disallow: /view-preempt/ Disallow: /search/