# All robots will spider the domain User-agent:* Disallow: User-agent: * Disallow: /lab/ User-agent: GoogleBot Disallow: /*.php$