# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /books/Bill%20Crider%e2%80%99s%20Pop%20Culture%20Magazine Disallow: /%ea%b8%b0%ec%a1%b4 Disallow: /interviews/* Disallow: /downloads/* Disallow: /books/*/download/*