# This script specifies the files and folders the website that shouldn't # be indexed by search engine spiders. #User-agent field specifies the robot, for example googlebot. In this case all robots User-agent: * #Disallow prevents the robot from indexing/downloading the specified folders Disallow: /non_web_graphics/ Disallow: /admin/ Disallow: /images/ Disallow: /admin/includes/ Disallow: /newyear/ Disallow: /js/ Disallow: /photo-gallery/ Disallow: /photo-gallery_old/ Disallow: /aspnet_client/ Disallow: /admin/FCKeditor/ Disallow: /FCKeditor/ Disallow: /includes/ Disallow: /spa/ Disallow: /admin/source/ Disallow: /css/ Disallow: /ssp_director/ Disallow: /linkmachine/ Disallow: /Webins/ Disallow: /_notes/ Disallow: /templates/ Disallow: /admin/img/ Disallow: /Scripts/ #Disallow prevents the robot from indexing any dynamic urls #Disallow: /? Sitemap: http://www.roughcreek.com/sitemap.xml