####################################################### # iRobots.txt SEO # All Bots User-agent: * Disallow: /online/cgi-bin Disallow: /online/wp-admin/ Disallow: /online/wp-includes/ Disallow: /online/wp-content/ Disallow: /online/readme.html Disallow: /online/license.txt Disallow: /online/search/ Disallow: /online/*? Disallow: /online/*.php$ Disallow: /online/*.js$ Disallow: /online/*.inc$ Disallow: /online/*.css$ Disallow: /online/*.gz$ Disallow: /online/*.wmv$ Disallow: /online/*.cgi$ Disallow: /online/*.xhtml$ Disallow: /online/*rurl=* Allow: /online/sitemap.xml.gz$ Allow: /online/wp-content/uploads/ Disallow: /online/tag/ Disallow: /online/category/ Disallow: /online/*?* # Google Image User-agent: Googlebot-Image Disallow: / # Yahoo Multimedia User-agent: Yahoo-MMCrawler Disallow: / # Bing Picture Search User-agent: psbot Disallow: / # Dugg Mirror User-agent: duggmirror Disallow: / # Sitemap Sitemap: http://hardrockhaven.net/online/sitemap.xml.gz ####################################################### # # Robots.txt file generated by iRobots.txt SEO v1.1.2 # by Mark Beljaars # # _ _ _ _ | |_ _ |. _ _ _ _ _ _ _ _ # | | |(_|| |< |_)(/_||(_|(_|| _\.(_(_)| | | # _| # http://markbeljaars.com/plugins/irobotstxt-seo # ####################################################### # # Note: # The Allow directive and wildcards (*) in filenames are # not standard robots.txt syntax, however they are # supported by most search engines.