Wednesday, September 21, 2022
HomeMarketingGoogle Website Verifier Consumer Agent Added To Google Crawlers

Google Website Verifier Consumer Agent Added To Google Crawlers


Google has added a brand new Google crawler, a brand new consumer agent, to the Google spider record. Its title is Google Website Verifier Consumer Agent. This consumer agent ignores robots.txt guidelines, by the way in which, and I assume it’s used for verifying websites with Search Console and different Google instruments and providers.

Google posted the brand new consumer agent over right here within the Google Crawlers assist documentation.

The consumer agent token is: Google-Website-Verification

The complete consumer agent string is: Mozilla/5.0 (suitable; Google-Website-Verification/1.0)

And Google famous with a “warning” that the “Google Website Verifier ignores robots.txt guidelines.”

So hold a watch out for it in a really restricted foundation.

Discussion board dialogue at Twitter.

Replace: My assumption that this was for Search Console verification was appropriate however John Mueller of Google stated the consumer agent is just not new, the brand new half is that it was added to the docs:



RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -
Google search engine

Most Popular

Recent Comments