# sample robots.txt file for this website ## addresses all robots by using wild card *#User-agent: *# list folders robots are not allowed to indexDisallow: /cgi-bin/Disallow: /members/Disallow: /webdata/## list specific files robots are not allowed to index#Disallow: /zenbmg.cssDisallow: /tutorials/custom_error_page.html## End of robots.txt file