| Question: |
Good evening.I found that on our website there is a file robots.txt .He did not allow search engine robots comes to our site. And our site because it is not indexed.Please tell in brief, why we have a file robots.txt that does not allow visits to our site robots and our website is not indexed because of it.Who wrote it and put it on our site? Thanks in advance. |
| Answer: |
Hello. file robots.txt is not intended to prohibit works visits the site and for managing work.&We have no idea where you got the gun. perhaps it is part of the engine of your website. in that file you have spelled out the address of your site, therefore it belongs to the site. we do not see there is no ban except CA cdla admin folder and in this folder, the search engines do absolutely nothing. as we see in the file a link to the xml file structure of the site which still helps search engines to index the website |
| Question: |
Thanks for the clarification.Then, if there is no ban, why when I type in the Google search engine, our website is the announcement, as it was previously, there is a phrase that robots.txt does not allow to index our site.You will excuse me for stupid questions. Trying to figure out what`s what.Thank you in advance for your help |
| Answer: |
on this question You need to consult directly with Google. this question is directly to the hosting not the case. file robots.txt and its syntax is described in sufficient detail. http://robotstxt.org.ru |
| Question: |
Thank you very much. |
| Answer: |
OK
|
