Gary Illyes from Google introduced on the Google Search Central Dwell in Singapore yesterday that Googlebot, Google, can now crawl from outdoors of the US. He stated, in keeping with stories, that the system to deal with that is at present stay however is probably not utilized in all circumstances or it is probably not used in any respect on your web site.
Replace, this report isn’t 100% precisely correct. Gary posted on Mastodon after he noticed this story saying “that is not fairly what I stated. I stated that the IP blocks are allotted and you may verify the nations they’re assigned to, and we could use them sooner or later for native crawls.”
no he did not
— Gary 鯨理／경리 Illyes (@methode) November 25, 2022
Right here is the remainder of the unique story as I beforehand reported it. However please keep in mind the replace from Gary above.
Kenichi Suzuki, who was on the occasion, posted on Twitter saying “Googlebot can crawl from a rustic the place the server is positioned (i.e. from outdoors US). The system has already gone stay however is probably not used (in any respect). As well as, it turns into efficient solely in a situation the place entry from outdoors of the nation is blocked.”
Right here is that tweet:
Googlebot can crawl from a rustic the place the server is positioned (i.e. from outdoors US). The system has already gone stay however is probably not used (in any respect). As well as, it turns into efficient solely in a situation the place entry from outdoors of the nation is blocked. #SearchCentralLive https://t.co/1hPl67NPw8
— Kenichi Suzuki🇺🇦鈴木謙一 (@suzukik) November 24, 2022
We heard rumors that this would possibly occur earlier on this 12 months from Google’s John Mueller. John stated then “I may see this [where Google crawls from] increasing over time if we see a broader want.” So it seems like we’re there.
Take note, that is most likely used for websites that (a) block Googlebot entry from US areas, (b) present totally different content material from totally different nations and (c) Google suspects one thing fishy primarily based on geo-targeting.
Google beforehand stated that it didn’t discover any profit to crawling from outdoors of the US again in 2017. There are nevertheless instances Google will crawl from a particular area however it’s uncommon.
Discussion board dialogue at Twitter.
