Dynamic page indexing

hame22 · 05-06-2005, 08:21 AM

Iv successfully installed phpdig onto my web server.

Iv set up htaccess to make use of the mod_rewrite which writes my dynamic urls to a standard format

/activities/resource1.html rather than /activities/page.php?product_id=1

I have a link in my index.html page to the rewritten url

when i spider index.htm all standard pages are spidered but the modified dynamic url isnt.

Does anyone have any ideas as to why this has not happened?

thanks

alex

hame22 · 05-06-2005, 08:36 AM

I think i have found out why, the dynamic pages I wanted to spider were PHP pages that generated XML. I have since spidered a dynamic php page with no xml content.

Does anybody know why the page with xml content was not spidered and how I can get this to happen??

thanks all

Charter · 05-10-2005, 11:07 AM

Do the XML pages send a mime-type of application/xhtml+xml? If so, then PhpDig doesn't understand the files, so it doesn't index them. If you want to index application/xhtml+xml mime-types, then you may find this thread useful.

05-06-2005, 08:21 AM	#1
hame22 Green Mole Join Date: Apr 2005 Posts: 3	Dynamic page indexing Iv successfully installed phpdig onto my web server. Iv set up htaccess to make use of the mod_rewrite which writes my dynamic urls to a standard format /activities/resource1.html rather than /activities/page.php?product_id=1 I have a link in my index.html page to the rewritten url when i spider index.htm all standard pages are spidered but the modified dynamic url isnt. Does anyone have any ideas as to why this has not happened? thanks alex

05-10-2005, 11:07 AM	#3
Charter Head Mole Join Date: May 2003 Posts: 2,539	Do the XML pages send a mime-type of application/xhtml+xml? If so, then PhpDig doesn't understand the files, so it doesn't index them. If you want to index application/xhtml+xml mime-types, then you may find this thread useful. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Trying to index some dynamic sites	guillaume	Troubleshooting	2	08-08-2007 06:40 AM
indexing a dynamic page	r2b2_ry	How-to Forum	0	12-13-2006 06:56 PM
indexing dynamic pages	attriel	Troubleshooting	2	01-14-2005 08:06 PM
Indexing Dynamic Content	greenman	How-to Forum	0	11-11-2004 06:40 AM
problem indexing dynamic links.	orbitalz	Troubleshooting	3	04-30-2004 08:47 PM

05-06-2005, 08:36 AM	#2
hame22 Green Mole Join Date: Apr 2005 Posts: 3	I think i have found out why, the dynamic pages I wanted to spider were PHP pages that generated XML. I have since spidered a dynamic php page with no xml content. Does anybody know why the page with xml content was not spidered and how I can get this to happen?? thanks all