Google’s John Mueller confirmed that the GoogleProber and the GoogleProducer (which we coated right here) are each legit Googlebot consumer brokers and crawlers. “These are official Google requests with a user-agent particular to the Google Information config in Writer Heart so if they’re blocked the feeds you arrange might not work correctly,” John added.
John did admit there is a matter with one or each of those bots crawling an excessive amount of (both for his web site or on the whole). John stated, “We now have discovered a difficulty that has effects on you the place we’re making too frequent requests and this will probably be fastened shortly.” John additionally stated “We’ll additionally work on fixing the damaged info-link.”
Listed here are these tweets for extra context:
Hello @searchliaison @dannysullivan @JohnMu we’re seeing loads of visitors to writer’s websites with a brand new user-agent ‘GoogleProducer; (+https://t.co/5l7Fm3K043) ‘. Our WAF is at present blocking it, nevertheless it’s origin is definitely Google Proxy hosts. Is that this legit visitors? Thanks! pic.twitter.com/twVlVI5gqJ
— Hernán Marsili (@hmarsili) January 31, 2023
Thanks, additionally, from the identical IPs we’ve determine elevated exercise from GoogleProber UA. pic.twitter.com/J8eN3pRK32
— Hernán Marsili (@hmarsili) February 1, 2023
… We now have discovered a difficulty that has effects on you the place we’re making too frequent requests and this will probably be fastened shortly. We’ll additionally work on fixing the damaged info-link.
— johnmu is a rating issue and so are you 🐀 (@JohnMu) February 7, 2023
Discussion board dialogue at Twitter.
