# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # For now disallow all we can modify this as needed to allow certain crawlers. # User-agent: * Disallow: /cgi-bin/ Disallow: /password_please/ Disallow: /php/ Disallow: /script/ Disallow: /bearbeiten/ Disallow: /agb.shtml Disallow: /agb2.shtml Disallow: /impressum.shtml Disallow: /order/?com=add