What Will The Following Robots.txt File Do

What Will The Following Robots.txt File Do


  • 6 Dec, 2011

    User-agent:GooglebotDisallow:/*?User-agent:ScooterDisallow:► a. It will allow Google to crawl any of the dynamically generated pages. It will also allow the AltaVista scooter bot to access every page ► b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the AltaVista scooter bot from accessing any page ► c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page ► d. None of the abovec. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page

    Comments Received:
    Please give your suggestions and feedback:

2009-2016 downloadmela.com. All rights reserved.