Google has up to date the Googlebot assist doc on crawling to make clear that the 15MB fetch measurement restrict applies to every fetch of the person subresources referenced within the HTML as nicely, resembling JavaScript and CSS information.
Google initially added details about this 15MB restrict a number of months in the past, which prompted quite a lot of concern within the search engine optimization business, so ensure to learn that story.
The assist doc now reads:
Googlebot can crawl the primary 15MB of an HTML file or supported text-based file. Every useful resource referenced within the HTML resembling CSS and JavaScript is fetched individually, and every fetch is sure by the identical file measurement restrict. After the primary 15MB of the file, Googlebot stops crawling and solely considers the primary 15MB of the file for indexing. The file measurement restrict is utilized on the uncompressed information. Different Google crawlers, for instance Googlebot Video and Googlebot Picture, might have totally different limits.
It beforehand learn:
Googlebot can crawl the primary 15MB of an HTML file or supported text-based file. Any assets referenced within the HTML resembling pictures, movies, CSS, and JavaScript are fetched individually. After the primary 15MB of the file, Googlebot stops crawling and solely considers the primary 15MB of the file for indexing. The file measurement restrict is utilized on the uncompressed information. Different Google crawlers might have totally different limits.
Gary added on LinkedIn, “PSA from my inbox: The 15MB useful resource fetch threshold applies on the JavaScript assets, too, so in case your JavaScript information are bigger than that, your web site may need a nasty time in Google Search. See googlebot.com for details about the fetch options and limitations. Sure, there are JavaScript assets on the market which might be bigger than 15MB. No, it isn’t a good suggestion to have JavaScript information which might be that giant.”
Listed here are some feedback on early suggestions from the search engine optimization group on this:
Are you operating into 15mb Don measurement? That is fairly a bit.
— johnmu just isn’t a chatbot but 🐀 (@JohnMu) March 19, 2023
The 15mb is nearly fetching, it’s very separate from the indexing facet.
— johnmu just isn’t a chatbot but 🐀 (@JohnMu) March 19, 2023
Discussion board dialogue at LinkedIn.
