|
10-25-2006, 10:46 AM | #1 |
Green Mole
Join Date: Oct 2006
Posts: 1
|
Mod-rewrite = spidering / URL problems
Hello,
Couldn't quite get to the bottom of this via a search, but it seems that others have been there ... Our rewrite rule renders .../index.php?section=4 to .../r-section-4 Spidering is getting confused and not getting into sub-pages, and search results often include a trailing slash (e.g., ".../r-section-4/"). The good news is that all of our rewritten url's begin with "r-", so I should be able to capture these, were I clever! The bad news is that I ain't that clever. Would be happy to be pointed to an applicable thread, etc. Thanks! |
10-26-2006, 09:38 AM | #2 |
Head Mole
Join Date: May 2003
Posts: 2,539
|
Untested but find in the phpdigRewriteUrl function:
Code:
// phpdig 1.8.9 rc1 $retour['path'] = mb_ereg_replace('(.*[^/])/?$','\1/',mb_ereg_replace('^/(.*)','\1',mb_ereg_replace("/+","/",$path))); // phpdig 1.8.8 $retour['path'] = ereg_replace('(.*[^/])/?$','\1/',ereg_replace('^/(.*)','\1',ereg_replace("/+","/",$path))); Code:
// phpdig 1.8.9 rc1 $retour['path'] = mb_ereg_replace('^/(.*)','\1',mb_ereg_replace("/+","/",$path)); // phpdig 1.8.8 $retour['path'] = ereg_replace('^/(.*)','\1',ereg_replace("/+","/",$path));
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension. |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Not spidering mod rewritten pages | wineo | Troubleshooting | 1 | 02-22-2006 07:53 PM |
Spidering problems | Dave A | Troubleshooting | 8 | 08-21-2005 07:46 AM |
Looking for Url submission mod for 1.8.7 | Gam-Man | Mod Requests | 0 | 06-04-2005 01:52 PM |
Problem with spidering with url tex list :-( | claudiomet | Troubleshooting | 1 | 09-07-2004 03:32 PM |
Problems with URL parsing | apdejong | Troubleshooting | 6 | 11-20-2003 02:35 AM |