View Single Post
Old 04-07-2007, 09:55 AM   #1 (permalink)
alex-party
Elite Googler
 
alex-party's Avatar
 
Join Date: Oct 2006
Location: Ireland
Posts: 1,085
Thanks: 0
Thanked 2 Times in 2 Posts
alex-party is an unknown quantity at this point
Thumbs up Crawl Rate & Page Rank Connection Analysis !!!

Hello friends,

I have 10 web sites in my Google Sitemaps Account and I've compared their crawl rate against some factors.
Well, here's what I've found!

-----------------------------------------------------------------
[ Web Site Page Rank = 1 ( 20 page views daily ) ]
.................................................. Maximum Average Minimum
Number of pages crawled per day:....6________2_______1
Number of KB downloaded per day:...29_______5_______0
Time spent downloading a page(ms):.401_____162_____68


[ Web Site Page Rank = 4 ( 1600 page views daily )]
Number of pages crawled per day:.....35______5_______1
Number of KB downloaded per day:....6158____247_____0
Time spent downloading a page(ms):.13149___758_____150

-----------------------------------------------------------------
BOTH WEB SITES are similar in size, and around 10 pages per site.

So, eliminating the size factor, the only factor that is different is PR and Ammount of Traffic!

Ok, now let's dig deeper.... we need to know what affects CRAWL RATE, is it Amount of Traffiic or PR?
I also have 4 web sites with PR1 that similar in size, but different Traffic and THE MORE TRAFFIC - THE HIGHER CRAWL RATE!

Here you go!
Conclusion: TRAFFIC AFFECTS CRAWL RATE, BUT NOT PR or WEB SIZE!

Am I Right?
Comments are welcome,

Last edited by alex-party; 04-07-2007 at 11:43 AM.
alex-party is offline   Reply With Quote