############################### # # http://www.it-advanced.com/robots.txt # # addresses all user agents User-agent: * # list folders robots are not allowed to index # Disallow: /sitefolder/ # # End of robots.txt file # ###############################