# See http://www.robotstxt.org/wc/norobots.html # for documentation on how to use the robots.txt file user-agent: * disallow: /ssi-public/ disallow: /cgi-bin/ disallow: /ssi-public-bis/ disallow: /ssi-public-cook/