Robot.txt file??

paknettech · 06-16-2008, 07:37 AM

I want to know that what is robot file and how we can create this file? Also is it important for getting seo results ??

skysoldier · 06-16-2008, 09:03 AM

robot.txt is used to block web spider in crawling certain folder in a website. This is good in ca way to block unrelated folders in your site to be crawled.

06-16-2008, 07:37 AM	#1 (permalink)
paknettech Noogle Join Date: Jul 2007 Posts: 24 Thanks: 1 Thanked 1 Time in 1 Post	Robot.txt file?? I want to know that what is robot file and how we can create this file? Also is it important for getting seo results ??

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Robot.txt	RLHS76	All About Google	1	10-09-2007 03:54 AM
Googlebot requests robot.txt over 100 times a day	zthomasz	Search Engine Optimization Forum	0	07-02-2007 04:12 PM
Need to know google robot.	ammarin	All About Google	4	05-31-2007 10:42 AM
A question about robot.txt	anversli	Search Engine Optimization Forum	5	01-23-2006 08:11 PM
A question about robot.txt	anversli	Search Engine Optimization Forum	5	01-01-1970 02:14 PM

06-16-2008, 09:03 AM	#2 (permalink)
skysoldier Google Freak Join Date: Aug 2007 Posts: 282 Thanks: 0 Thanked 2 Times in 2 Posts	robot.txt is used to block web spider in crawling certain folder in a website. This is good in ca way to block unrelated folders in your site to be crawled.

GoogleCommunity Sponsor


Sponsored Links