![]() |
|
![]() |
#1 |
Green Mole
Join Date: Oct 2003
Posts: 6
|
Spider Directories
I just installed PhpDig...am impressed with its search speed, but have one problem. It spidered only two of my subdirectories, and when I try to spider these, I see the message that this domain was spidered recently.
http://mydomain.com - root - was spidered http://mydomain.com/directory1&2 were spidered.... but http://mydomain.com/directory3,4 etc. were not spidered. How do I accomplish this? Thanks for your time. |
![]() |
![]() |
![]() |
#2 |
Head Mole
Join Date: May 2003
Posts: 2,539
|
Hi. Are there links from mydomain.com to directories three and four? Do you get the message that the site was recently indexed? If so, you might try changing define('LIMIT_DAYS',7); to define('LIMIT_DAYS',1); in the config file.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension. |
![]() |
![]() |
![]() |
#3 |
Green Mole
Join Date: Oct 2003
Posts: 6
|
Hi Charter,
Thanks for your prompt response. Yes, I'm getting the message the site was recently indexed, so I changed define('LIMIT_DAYS',7); to define('LIMIT_DAYS',1); in the config file....still same result...site was recently indexed. But you bring up an interesting point...many of these subdirectories are linked from the home page, but only through a dhtml/javascript menu navigation. Perhaps that is part of my problem? |
![]() |
![]() |
![]() |
#4 |
Head Mole
Join Date: May 2003
Posts: 2,539
|
Ah, Javascript. Perhaps this thread might help.
Also, if you want to try reindexing from scratch, you might find this thread useful. You could also try setting define('LIMIT_DAYS',1); to define('LIMIT_DAYS',0);
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension. |
![]() |
![]() |
![]() |
#5 |
Green Mole
Join Date: Oct 2003
Posts: 6
|
Thanks again for the help.
I was able to spider the remaining directories, except for one that does not have an html link. I could just create the link temporarily if it is that important. Thanks for the good utility! - it's nice to be off of the web-based, outsourced search. ![]() |
![]() |
![]() |
![]() |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Indexing sub directories | mlisondra | How-to Forum | 0 | 02-22-2008 06:55 AM |
Spider Indexing and htaccess directories | webmaster_k | Troubleshooting | 0 | 10-01-2007 10:50 AM |
Restricting Directories | vorbian | How-to Forum | 1 | 09-29-2004 06:02 PM |
Not Indexing Sub-Directories | jayhawk | Troubleshooting | 3 | 02-11-2004 02:41 PM |
Indexing Directories | emcclary | Troubleshooting | 5 | 01-29-2004 06:28 PM |