Cyrillic characters in page content AND Google Spiders. Windows-1251 or UTF-8?
May 11th, 2009
No comments
According to one of my problem, I find that other also have same situation, here is the quotation:
“…I have a page in Russian language. I have the charset and language in the META set to “Windows-1251″ and respectively “RU”. When running the Google Spider-simulator, it ignores all the Cyrillic characters in the page content, while those in TITLE, DESCRIPTION and KEYWORDS are crawled ok. In the page content only the latin characters are crawled. I’ve checked whether the Spider crawls all the page content to the end and this is actually the case…”
When I switch to charset UTF-8, everything go fine.
Unique visitors to post: 2
