Thread: How to avoid search engines crawling
View Single Post
Old 04-09-2007, 11:36 AM   #5 (permalink)
manager2006
Junior Googler
 
manager2006's Avatar
 
Join Date: Oct 2006
Posts: 34
Thanks: 0
Thanked 0 Times in 0 Posts
manager2006
Quote:
Originally Posted by Jaguar15 View Post
  • If you don't want search engines to index any file of your Web site, use the following on your robots.txt:
    User-agent: *
    Disallow: /
Yes , it is the better way to use robots.txt.
manager2006 is offline   Reply With Quote