Slow indexing

[SweeT EviL]

Hi all!

I recently started a website and its up 2-3 months. At the beginning every day google index 50 pages~ and now if it 2-3 I say grace.
The problem is that I have A LOT of pages(above 50K) and I even saw at the webmasters tool that google crawl between 2.5K-5K pages per day. But still I have only 350~ pages indexes. I also added sitemaps (xml and in the web) but it seems that it doesnt help very much.

How can I increase the speed of the indexing (100-1000 per day)..?

I dont have html errors.
I have some crawl errors (access denied/timeout/not found) - but they are all old errors that where fixed.
I cant give the site but it build in directories method (categories -> sub categories -> the info pages).

[SweeT EviL]

Or maybe its not slow.
I search in google site:Website Hosting - Mysite.com

And some times I get 8500 index pages but most of the time I get 350 pages index - What does it mean?

[alex-party]

You know your first mistake:

Mistake 1: You try to "clone" something that is on the web for hundred years. Internet is a big "junk" of information and Google is trying to filter out only quality contents, no hard feelings, but millions of people do what you do, and Google knows that, most advanced brains on earth work every day just to filter sites like yours out of search results and I'm about here to tell you that.

Regards,
Alex

[SweeT EviL]

Originally Posted by alex-party

You know your first mistake:

Mistake 1: You try to "clone" something that is on the web for hundred years. Internet is a big "junk" of information and Google is trying to filter out only quality contents, no hard feelings, but millions of people do what you do, and Google knows that, most advanced brains on earth work every day just to filter sites like yours out of search results and I'm about here to tell you that.

Regards,
Alex

What you mean by sites like mine?

[alex-party]

I mean sites "with above 50K" pages and sturcture like "categories -> sub categories -> the info pages", which was started "2-3 months" ago = qualifies for "links-farm" website. Unless it's all 50k pages quality content.

[SweeT EviL]

Originally Posted by alex-party

I mean sites "with above 50K" pages and sturcture like "categories -> sub categories -> the info pages", which was started "2-3 months" ago = qualifies for "links-farm" website. Unless it's all 50k pages quality content.

"its up 2-3 months". I have some writers.
Not all the pages is filled with content - for now.. but in time it will.

You want to tell me that until I wont fill this pages they wont be indexed(and therefore the index number jumping)?

[wuzzy]

As soon as new content is added to the website, webmasters should try to use social bookmarking site like Digg, Stumbleupon, Technorati to bookmark. I have noticed Google indexes Digg pages in less than 2 hours!

[SweeT EviL]

Originally Posted by wuzzy

As soon as new content is added to the website, webmasters should try to use social bookmarking site like Digg, Stumbleupon, Technorati to bookmark. I have noticed Google indexes Digg pages in less than 2 hours!

So your saying that every page I update I should post link to that in social bookmarking sites?

[alex-party]

Hello,

I just want to say, that it's sometimes better to have 1 single, frequently updated, well maintained page, than thousands of pages which no one visits. If you make an interesting topic, then promote it and submit it to social networks, people will come to you and share this link with others. You won't have to do anything, than just support this page.

When you done that, you can add more pages, making it more interesting to read.

The deeper your hide your article in the sitemap, like:
home > category > subcategory > my article
the less chance someone finds it and less page rank they will receive.

Finally, answering your question: "why google visits your site less often" ?
Answer: reduce amount of pages and keep them "fresh" all the time, that means if you have 50k pages, you might get 50k writers to maintain and update articles....otherwise throw away "dead" content, it's useless and makes only harm for your site.

Hope that helps,

[alex-party]

Ok, I will use simple logic to explain how it works, it's very simple:

Imagine I'm an internet user, I came from work and I want to browse an internet for interesting topics, lets say about "food" or new "recepies".

What do I do?
> I go google.

What do I enter in search box?
> I type "new recepies"

I see first 1 to 5 top results and I click one of them. Let's say the link leads to one of your articles and what do I see?

> I see some info, I see nothing else, a dead end!
> Where is people opinions?
> What if I want to ask a question? Who will help ?
> Maybe I want to talk to people and tell about another ways to make the same dish with different ingredients....who will reply to me? One of your writers? Are they qualified enough to talk about it?

So what do I do next?
> I close your page and move to another link.
More than that, If I suspect that your site is just a "link-farm" I will close this page immediately without even looking further.

So, my point, don't make websites for google, do it for your own pleasure, create a topic you or your writers are good at...like food, or cars or clothes or anything...just keep it interesting, new and fresh.....promote and support it! Then you'll be fine.

Regards,
Alex