the above content by TTleyuanbaby original writing, please indicate the source link: daily Le Parenting Network 贵族宝贝leyuanbaby贵族宝贝/ thank you
to allow other search engines display snapshot, but only to prevent the love Shanghai display, please use the following tags:
robots file is actually a spider like warning file, as we all know, when spider crawling our website, is to check your site robots.txt does not have such a file, the file is written to you don’t want to be included in the search engine’s content. Of course, if your site does not exist in the content, do not establish a robots file like this, otherwise… Oh…
not to me, is actually very simple, only need to set the robots.txt file, so how to set up the robots file, I would like to introduce the following:
1.robots.txt file in
perhaps, these points set for most of the webmaster is not very useful, because more Adsense or want the site to be included in search engines, this knowledge may be useless soldiers. The above is only a little knowledge of my recent study, as experience and harvest and share with you.
robots.txt file in the root directory of the site should be relatively easy to find, and also can do, such as your URL 贵族宝贝leyuanbaby贵族宝贝 (my site, for example, by the way), then your robots.txt files should be in 贵族宝贝leyuanbaby贵族宝贝/robots.txt, which defines a spider to read a range of robot.
2. prohibited search engines display snapshot in the search results, but only on the web pages indexed by setting the "love Shanghai support meta, to prevent search engines display a snapshot of the site. The method is as follows: to prevent all search engines display a snapshot of your site, please send this page into Meta Tags:
every one of Shanghai dragon, simply said as long as have a website, no one does not want their website is not indexed by search engines, of course this is correct, but some other factors when we site some confidential data or website do not want to be included in the search engine and what should we do? How to prevent search engines