# In general, don't index our manuals, and the private stuff User-agent: * Disallow: /pgi/ Disallow: /manuals/ Disallow: /apache/ Disallow: /cgi-bin/ Disallow: /private/ Disallow: /usage/ Disallow: /mrtg/ # The KULeuven robot is allowed to index everything, except the private stuff User-agent: kulwebmanage Disallow: /cgi-bin/ Disallow: /private/