Google Had Discussed Allowing Noindex In Robots.txt
Google’s John Mueller responded to a question on LinkedIn to discuss the use of an unsupported noindex directive on the robots.txt of his own personal website. He explained the pros and cons of search engine support for the directive and offered insights into Google’s internal discussions about supporting it. John Mueller’s Robots.txt Mueller’s robots.txt has … Read more
