Welcome to Hedir community. Hedir is a community helping to rank the sites on the basis of real customer feedback. Ranking is not based on automated checking of site properties but on the basis of experience with the site/business as a whole. Explore more about Hedir.
Posted: Mon Apr 23, 2007 10:14 am Post subject: Robots.txt wierdness - Webmaster Central
Ok, maybe i'm just seeing some funnies happening here, but logged into the webmaster central tools the other day to look up on the crawling of some of our clients sites, and noticed that crawling was put on hold for a number of pages among the various clients due to the robots.txt file missing???
It kept losing my site maps a few months ago. I don't know what effect it had but some of my pages in the cache are very old versions. _________________ Devon Business Directory
All times are GMT
Page 1 of 1
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You can vote in polls in this forum You cannot attach files in this forum You cannot download files in this forum
Search
Register
Login