Dynamic URLs and Spiders / Crawlers

wasim_at_drushti · 07-01-2006, 05:30 AM

There are many CMS systems are coming into play. Many organizations, firms are using Content Management Systems for their websites. In this case, the major issue in front of them is the URLs of the websites. The URL of CMS systems are dynamic & (as said in many forums and articles) Crawlers or Spiders don't crawl dynamic URLs. In this case what would the CMS user would do to Optimize his site for Google.
I've have a site. Its a CMS the URLs of the sites are similar to:
http://mysitename.com/index.php?opti...=641&Itemid=42

Now, Spiders don't crawl these links. What shall I do to Optimize my site.
Please let me know your views on this.

generationtalk · 07-02-2006, 01:46 AM

Your using joomla or mambo arent you!?!

Under global configuration, there is a 'search engine friendly' option, in which you need to change the name of the htaccess.txt file to .htaccess...
... but I am yet to get this working

wasim_at_drushti · 07-06-2006, 04:32 AM

You are absolutely right.brI have already done he same but the Spiders doesn't crawl & index the inner pages what must be the issue. I still can't figure it out.

pedrotuga · 07-08-2006, 03:56 PM

The answer is:brbrmod_rewritebrbrbr

07-01-2006, 05:30 AM	#1 (permalink)
wasim_at_drushti Senior Googler Join Date: Jun 2006 Posts: 139 Thanks: 0 Thanked 0 Times in 0 Posts	Dynamic URLs and Spiders / Crawlers There are many CMS systems are coming into play. Many organizations, firms are using Content Management Systems for their websites. In this case, the major issue in front of them is the URLs of the websites. The URL of CMS systems are dynamic & (as said in many forums and articles) Crawlers or Spiders don't crawl dynamic URLs. In this case what would the CMS user would do to Optimize his site for Google. I've have a site. Its a CMS the URLs of the sites are similar to: http://mysitename.com/index.php?opti...=641&Itemid=42 Now, Spiders don't crawl these links. What shall I do to Optimize my site. Please let me know your views on this.

07-06-2006, 04:32 AM	#3 (permalink)
wasim_at_drushti Senior Googler Join Date: Jun 2006 Posts: 139 Thanks: 0 Thanked 0 Times in 0 Posts	You are absolutely right. You are absolutely right.brI have already done he same but the Spiders doesn't crawl & index the inner pages what must be the issue. I still can't figure it out.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Any correlation between spiders visit & web page rank?	montyauto	Web Design, Coding & Programming Forum	1	02-20-2007 06:28 AM
Google accepts dynamic urls	Aboo	All About Google	1	12-22-2006 02:53 PM
Google Spiders and .php files	roseyman	All About Google	5	09-29-2006 05:00 PM
URLs restricted by robots.txt	fbg	All About Google	10	08-18-2006 05:28 AM
Javascript and spiders	maritimer	Search Engine Optimization Forum	4	10-29-2005 10:36 PM

07-02-2006, 01:46 AM	#2 (permalink)
generationtalk Junior Googler Join Date: Jun 2006 Posts: 25 Thanks: 0 Thanked 0 Times in 0 Posts	Your using joomla or mambo arent you!?! Under global configuration, there is a 'search engine friendly' option, in which you need to change the name of the htaccess.txt file to .htaccess... ... but I am yet to get this working

07-08-2006, 03:56 PM	#4 (permalink)
pedrotuga Noogle Join Date: Jul 2006 Posts: 3 Thanks: 0 Thanked 0 Times in 0 Posts	The answer is:brbrmod_rewritebrbrbr

GoogleCommunity Sponsor
Use coupon "forum" for 50% Off!


Sponsored Links