###################################### #robots file for the Knovel website User-agent: * # # Do not allow any folder to be indexed ###Disallow commented out by MRD on 02/24/08 to allow search engines to crawl ###portal site. Note that Disallow is active on the Resin Servers. Disallow: /web/portal/knovel_content*/ Disallow: http://www.knovel.com/knovel/databook/pdf/* # # ######################################