| Question: |
Good afternoon.Faced with the problem of indexing of website pages in Yandex.of our website removed by Yandex pages from the indexed list. Already remade, adjusted critical moments. But the problem is not going away - the number of indexed pages smoothly tends to zero (now**) when you Google them for more than three thousand. Saw that the server hosting our site are located in Ukraine. I found many articles on the Internet about the sanctions imposed by Ukraine on Yandex. Please tell me can this time affect indexing of the website by Yandex? |
| Answer: |
Hello. Your server is in Germany. we have VPS servers in Ukraine. |
| Question: |
Checked here - https://*.*.*.*/And also here - http://*.*ip.*geoip/**.***.***.***/autoIP - **.***.***.***Server location - Ukraine |
| Question: |
And another question. With us there are sites on this IP or are we alone? |
| Answer: |
you have a vps server. he completely belongs only to You, it is not and can not be of sites in addition to yours. you have full root rights Ana server. service pr-cy.ru free extremely inadequate. there have been cases of provision of false data from the cache here`s the real information about your ip https://whatismyipaddress.com/ip/**.***.***.*** |
| Question: |
We tested a few services, not only in *.*.Only one showed Germany, the rest Ukrainophone then Yandex, we don`t like and removes it from the search? |
| Answer: |
your server is physically in Germany. maybe once upon a time this ip was recorded on ukrainsi pool, ip change owners. but we have to have this ip for more than a year and never in Ukraine they weren`t. You provide information from kakog the cache. with Ukraine, Your server does not physically linked. |
| Question: |
we did not understand the reason for the removal of pages from Yandex. Google are all OK.Maybe the Germans imposed sanctions on Yandex? |
| Answer: |
no , we have et like vps and hosting servers in Germanii. pdobnaya no complaints. write in their video training Yandex, Plato is quite quick respond |
| Question: |
Wrote and got a response of this nature -the fact that at the time of application of the robot to the pages Your server to return the document size * bytes, in this regard, the pages have not been indexed and the search results are not involved. On the occurrence of this problem, please contact the administrator of Your server. If at the time of the next call robot situation will not happen again, pages will be indexed and the search database updates will appear in the search. |
| Answer: |
what page to apply the robot? check the size of this page. check the location on the server UOM if necessary providied cleaning |
| Question: |
This applies to all pages with the goods, at the moment, Yandex has been kicked out of almost the entire site remains ** page from ****. Website whole life has been in the top **, and today he`s not in the search ... |
| Answer: |
we checked the places you plenty on the server. utochnyat what changes were made by you on the website before the problem occurred. |
| Question: |
No.Google **** pages. Obviously the connection problem to the site Yandex. First, the status * * * the next day * |
| Answer: |
these pages are available when checking in the browser? |
| Question: |
Yes.If there was a problem accessing the site through a browser, we would have opened another ticket with another theme |
| Answer: |
how they offer proirity ? need a way to test their robot. |
| Question: |
Here is their otvetilo that at the time of application of the robot to the pages Your server to return the document size * bytes, in this regard, the pages have not been indexed and the search results are not involved. On the occurrence of this problem, please contact the administrator of Your site or server. If at the time of the next call robot situation will not happen again, pages will be indexed and the search database updates will appear in the search. |
| Question: |
Any proposals not received |
| Answer: |
that`s what we want to check. but we are not the robot maps and in the browser You yourself say that the server response is correct. |
| Question: |
Try to prompt the scan options |
| Answer: |
Yes, it is just required. to understand why Yandex receives a malformed response |
| Question: |
|
| Answer: |
please Wait, the request is sent to the administrator. |
| Answer: |
nothing is Your server not have to Ukraine. Question about providing an incorrect answer Dolgan to be to the services that You ecoproductive. we didn`t know it. namesvect where the server is physically located and the normal services it koretke misleading Your server is accessible segunda. we have monitored all servers of clients on accessibility of essential services. the network does not drop. Restart tsitsa few easy seconds what Yong does affect indexing . on your server there are other sites? with them the same problem? |
| Question: |
on the server only one site. We began these problems after migrating site to your hosting. Here`s an example:http://*.*/The history of its bypass by Yandex robot:the Status in the database search: ***OK, the version of the page: **.**.**** – **:**Last crawled:*&#****;/&#****;*the Document does not contain texture page: **.**.**** – **:**In the code, no changes were made.Further, on the same page, but with another category. First, had the status of ***. * * has become ***OK to return.There is an obvious problem with the connection. Have a list of ip addresses that blocks your hosting and which bypasses the Yandex robot?Either the robot does not see your server? We just do not know what to do. Support of Yandex says that all of them in order that the problem can be on the server itself (your).Agree that it is easier to change the server than Yandex? |
| Answer: |
You do not have hosting, You vps server. where You full root on the server by default, no blocks, no server blocks. on the server there is by default no programs blocking access, so the problem certainly not connected to any locks. |
| Question: |
Maybe a connection problem.We don`t know already what to bind. Can server to change to check? Left ** pages, Yandex every day cut pages from a search, because can not get through to them. |
| Answer: |
they have not given the check option ? |
| Question: |
no. They only have emulation verification of the server`s response. But they write, that it does not simulate the real robot work, so ***% believing the test result is impossible :(( |
| Answer: |
this emulator is everything all right? |
| Question: |
so far, Yes. already times *** test page, the answer to which the robot has not received a response. all *** approx. Therefore, we assumed that the ip from which the Golem can`t reach the server. A list of ip nobody will. They have even stated this:\"IP addresses from which come the robots Yandex, too many, and they change frequently. We therefore do not disclose their list and filtering based on them.\"is this black box that it is unclear why can not get response from the page from which the answer was yesterday. |
| Answer: |
a very difficult problem, because all the logs and all the tests all fine. no block you don`t have a server-side |
| Question: |
What if you try to go to another server to test?Take the website, change the * address. Wait while Yandex gobble them.Then send pages to personhood. If everything is OK, and it will stay on the new server.And if not, go back (the VPS will not yet cleaned) and we will think further. Really options anymore, what could be the problem.Is day * - *. |
| Answer: |
ask on any other server? |
| Question: |
any NOT vps, just to test |
| Answer: |
please register an account to test |
| Question: |
conducted research. Found in the server log files server connections.See the affiliate`s personal account statistics bypass for **.**.****:Link \"/blog**/\"***.In the log found the request Yandex-bot to this link:**.*.***.** - - [**/*/****:**:**:** +****] \"*blog**/ HTTP/*.*\" *** *** \"-\" \"*/*.* (*YandexBot/*.*; +http://yandex.*)\"As you can see, the robot returned status code ***, everything is OK. Also looked at other relpacement clients links which Yandex has not received a response (quick filter): query Yandex robot in the log is not found on these pages, although in a personal account shows that Yandex was trying to access the pages and got no response.It is likely that Yandex-the robot is just not getting through to the server? Then I can assume that some ip robots do not see our server and need to move the website to another ip ? |
| Answer: |
we checked the availability of the site worldwide https://www.host-tracker.com/InstantCheck/*/*d******-*a**-e***-a******ff*****a the availability of complete but if moved to another ip the website will nedostupen not yet updated DNS |
| Question: |
Well, we have no more options. The problem is floating and apparently caused by a problem robots search server :( |
| Answer: |
you can specify this option in Yandex? from nikogo unit no. |
| Question: |
just trying to clarify. They have requested these logs to check. Here I prosledovali, send a response as You. Waiting for an answer |
| Answer: |
OK, please tell us the result. |
| Answer: |
can you give an example page which recently nebylo indexed? |
| Question: |
/*/ This page yesterday Yandex walked around, got *** OK, before that, got from the status page of the * |
| Answer: |
and those which are NA from the last here`s a test tekuma https://www.host-tracker.com/InstantCheck/*/**ee***a-*d**-e***-a**a-****ff****cc |
| Question: |
/*/here is the link today * got.We do not argue that everything is OK with the connections our and your.We also tested various pages, never received errors.But why is it some ip of Yandex robots do not see the server.And Yandex in Russia is very important because most visits the site through it (previously it was). And we want it back |
| Answer: |
we also obaaama retispora p that would help to identify and solve the problem. Yandex answered about your last question? |
| Question: |
Did not answer.I think only tomorrow will answer. Why they ceased to respond quickly. |
| Answer: |
maybe they need lie Agla analysis elevatros not be solved in a standard way. we`re already proveriai all the standard possible problems |
| Question: |
While they only give advice on what and where to look to check. But this does not lead to anything. Analysis they haven`t. |
| Answer: |
ie, the next answer is analysis? |
| Question: |
Unfortunately no :(the Answer of Yandex:the pages Themselves are actually available to the robot and meet the code *** OK, the obstacles are accessed does not occur, however, the page does not give any content, which the robot cannot load them in the search.It is possible that the contents do not is given by the IP addresses of our robots. In this situation, we recommend you to check all possible blocking of IP data, grouping them by the User* or the reverse *-request, as I recommended earlier. |
| Answer: |
on the server there is no blokirovki just physically. it never existed. And meaning it has. if the page meets the robot *** but without any content then the problem may be only on the side of the site. proverit please is there any kaki elibo configure caching on the site itself |
| Question: |
we tested the Yandex services, the content is always returned. And the robots, when they got no content status is always *, not *** |
| Answer: |
your website has no security modules which can odonatologen or maybe you have incorrectly configured robots.txt? check please |
| Question: |
security modules is definitely not.*.* checked too. There is nothing wrong there. Google also goes on the website normally.If it were the case, the robot Yandex has been steadily falling while getting pages, and they now get a page, and tomorrow do not get. The same should not be, if it is in the page code. |
| Answer: |
absolutely, it is more than unclear. the answer is empty or there are some errors. can`t be *** and never happened. |
| Question: |
today we will try to disable all third-party chat scripts, sliders, scripts, robots.txt clean put. It is unlikely that will help, but purely for the sake of experiment in order to exclude it and to stake out the problem of finding robots to the server. And then have to transfer the website to another server, which does not want to do |
| Answer: |
I don`t think the problem is in the server if the same server correctional the page in a browser |
| Question: |
We do not claim that the problem is in the server.Likely, the robots are buggy.But we can`t fix this bug robots have the server change |
| Answer: |
ok |
| Question: |
Good afternoon. Yandex said, We checked once more that the inspection confirmed the previous theory: turning robots Yandex is given to a blank document. Here`s what shows checking cURL:curl*http://*.*HTTP/*.* *** OK*: */*.*.*< *: *, ** * **** **:**:** *: *html*-*< *: *< *: *: PHP/*.*.**-*+****< ***: *: *, ** * **** **:**:** *: *=******< *: *Cookie: PHPSESSID******************************; *, **-*-**** **:**:** *: *, ** * **** **:**:** *: *The problem is likely associated with blocking some IP addresses because the problem regularly occurs when handling certain IP, while other pages are downloaded correctly. We recommend you to contact support hosting provider - possibly under the lock accidentally fell not all robots Yandex, and some private IP. |
| Answer: |
the Question referred to the administrator, wait for amp. |
| Answer: |
on your server, there are no locking mechanisms. you don`t have anything that could babylicious. you have no block. *no not neichego blocks because there is nothing to block |
| Question: |
football at it)) to Yandex say that we need to contact hosting, hosting knocked on Yandex( A negative result only for us, we lost almost all the pages :( |
| Answer: |
we need only the data to check, how do they get we have curl -v `http://alt-cigaret.ru/` -o from different servers normal page loading. in addition , if they govoriat about the unit then the unit arises hotwet *** can not be. repousse no answer or *** . so it`s not the power even. try to remember what nadsroic on the website was pricestovali problem. maybe you have the SEO module installed |
| Question: |
***OK this is an example of the page that the robot with some ip is not pushed to the server (just the same, nothing got response, status *). And Yandex from your ip checked the answer on this page and got *** OK. If it was the settings of the module, and they would also would have received status *. |
| Answer: |
*** this is the server`s response that the website is available. so block no. if as suggested by Yandex and you had a unit that either have no answer or would be the answer otlichny from ***. and if the answer *** the problem on the part of young servers. the server can`t block at all. server ENET no blockers, the server can not do it. the server responds *** and the content gives your website. so the site does not give conetnt robot |
| Question: |
you probably do not want to understand)) what got rid of Yandex as a test is a positive test with a response status ***.And the robot, referring to this page, got no response (status *, is not ***OK!!!!) |
| Answer: |
where you see N/A ? we see the answer *** curl -v `http://alt-cigaret.ru/` -o
< HTTP/*.* *** OK
< Server: nginx/*.*.*
< Date: Thu, ** Apr **** **:**:** GMT
< Content-Type: text/html; charset=UTF-*
< Content-Length: *
< Connection: keep-alive
< X-Powered-By: PHP/*.*.**-*+deb*u*
< P*P: CP=\"CAO PSA OUR\"
< Expires: Thu, ** Apr **** **:**:** GMT
< Cache-Control: max-age=******
< Pragma: no-cache
< Set-Cookie: PHPSESSID=d*e*fbf*e*a***c****d**d*******a*; expires=Sat, **-May-**** **:**:** GMT; path=/
< Last-Modified: Thu, ** Jan **** **:**:** GMT
< Vary: Accept-Encoding but see that an empty page Content-Length: * the server responded correctly - *** and the site gave a blank page tell Yandex that on the server there are no locks. missing in principle. question about the lock not even considered. what else can be the options, tell them what your engine and plugins |
| Question: |
Then we got all confused. We in Yandex see on this page, status *, not *** OK. The engine didn`t change for a long time. even the scripts were cut off, but nothing helped :((( |
| Answer: |
we see an example of Yandex. they said that the answer is *** but the size starnicy * and confirmed it. price it`s just they do it.Yu we have checked with different servers and is similar to Yong managed .the website otvechat normal that even mass proverka https://www.host-tracker.com/InstantCheck/*/f*******-be*d-e***-a**a-****ff*****a nowhere is there * and on\\times nikogo block sostorony server is not and cannot be . content gives your website. the server responds with ***, the content website pays the same. |
| Question: |
Good afternoon.Once analysed the problem with Yandex.Found sharp remove all pages from indexing. * Dec **** year to **** pages.to ** December search left only *** pages.Further, for a further ** days number of pages fell to ** pages.Found a letter from your technical support, from * December **** informed about the change of the ip address of the server. Perhaps this was the reason for removal by Yandex pages from search? Painfully obvious coincidence.Also read in Google that this problem can be caused by incorrect server configuration. Is there a way to check server settings? it might still have problems? |
| Answer: |
the Question referred to the administrator, wait for amp. |
| Answer: |
Hello. change the ip of the server is not priceit.to the ip is not taken into account during indexing. stockitems \"incorrect server configuration\" ?your website documen all . have you checked the module settings of the site? |
