# Robots Text file allowing all spider robots access to all parts of site User-Agent: * Disallow: /cgi-bin/