# robots.txt for http://www.tebweb.com/ User-agent: * Disallow: /test/ Disallow: /auction/ Disallow: /private/ Disallow: /blahdocs/