# All robots will spider the domain # applies to all robots User-agent: * Disallow: