|
02-08-2005, 03:15 PM | #1 |
Green Mole
Join Date: Feb 2005
Posts: 5
|
tricky indexing problem
hello,
wow this engine is really great, my testpage is at yoohoo.lu, but now i have a problem, if i set define('LIMIT_TO_DIRECTORY',false); the spider finds all documents in the folder www.bighost.com/userfolder/ and the documents in www.bighost.com/userfolder/subfolder/ but then he starts to spider www.bighost.com/ which is not good cause there are thousends of "userfolders". If i set define('LIMIT_TO_DIRECTORY',true); the spider only goes to www.bighost.com/userfolder/ but he does not include www.bighost.com/userfolder/subfolder01/ or www.bighost.com/userfolder/subfolder02/ ... which is a problem ... any idea? thx chris |
02-08-2005, 03:21 PM | #2 |
Green Mole
Join Date: Feb 2005
Posts: 5
|
ups i had not read this http://www.phpdig.net/forum/showthread.php?t=1749 it helped me
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Problem with indexing | Raghavendra | Script Installation | 3 | 09-25-2006 09:52 PM |
Indexing problem... | afrim_05 | Troubleshooting | 3 | 11-24-2005 04:51 AM |
Indexing problem | deshaye7 | Troubleshooting | 1 | 06-01-2005 07:57 AM |
Yet another indexing problem | sbhikes | Troubleshooting | 4 | 05-17-2004 11:20 AM |
indexing problem?? | Chris2 | Troubleshooting | 2 | 02-21-2004 08:23 AM |