# exclude help system from robots User-agent: * Disallow: /manual/ Disallow: /doc/ Disallow: /gif/ Disallow: /referenz Disallow: /produkt Disallow: /news Disallow: /navmain Disallow: /maqdemo Disallow: /leistung Disallow: /kontakt Disallow: /job Disallow: /inhalt Disallow: /impressum Disallow: /images Disallow: /css Disallow: /firma Disallow: /images Disallow: /skripte Disallow: /start # but allow htdig to index our doc-tree User-agent: susedig Disallow: # disallow stress test user-agent: stress-agent Disallow: /