Posts

Showing posts with the label robots.txt

Why is Google Looking to Stop No Index Directive in Robots.txt? Reasons Unveiled

It’s the official statement by Google that the robot.txt no index rules do not exist anymore as these are unsupportive and unpublished rules as per the exclusive protocol. Now there won’t be any index directives listed within the robots.txt files. There were many speculations arising since last many days amongst people. “ Is Google going to stop supporting noindex directive in robots.txt? ”  But now when it has come, people have to look for other options other than using no index options in robot.txt. Some had though like robots.txt is no more. But this is a misconception as they have to clearly understand the things before creating hype for the same. The day this announcement was made that Google will stop supporting robots.txt noindex, people were left vulnerable on how to handle things when they need to disallow the pages and functions to get crawled by the search engine. Is There Any alternative to No Index directive? As per Google, here are the certain alternati...