Yandex, The Popular Russian Search Engine, Begins Crawling JavaScript & CSS
Yandex warns webmasters to not block their JavaScript and CSS files because they are starting to crawl those resources for indexing.
Yandex, the large Russian search engine, announced (in Russian) that they are now crawling, as a test, through CSS and JavaScript files. The purpose is for Yandex to better understand web pages and the content on those web pages that are designed for more modern browsers. They are starting to test this crawl process on a small subset of known pages, but they plan to expand it later to a larger set of the index.
Because of this effort, Yandex is informing webmasters to make sure their CSS and JavaScript files are not blocking the Yandex crawler. In the same way, Google and Bing have recommended you do not block their bots from crawling your CSS and JavaScript files and resources.
The Russian Search blog summarized this also in English, since they speak fluent Russian, and I do not. They added, “this change in Yandex’s indexing routines can possibly have effects on Yandex SEO, at least in the long run.”
Related stories
New on Search Engine Land
About the author
In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the "US Search Personality Of The Year," you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O'Clock.
Barry can be followed on X here and you can learn more about Barry Schwartz over here or on her personal site.