|
03-15-2004, 05:03 AM | #1 |
Green Mole
Join Date: Feb 2004
Posts: 9
|
Spidering a directory - timeout after 10 documents
Hi here is my config:
+ PhpDig 1.8.0 + PHP Version 4.2.3 + safe_mode: off + mysql 3.23.49 + Server API: CGI + System: Linux infong 2.4.21 #1 SMP Wed Jul 30 09:58:54 CEST 2003 i686 unknown + Directories admin/temp, includes & text_content permissions set to 777. + Database holds the following tables: engine, excludes, keywords,logs, sites, spider & tempspider. + not behind any firewall config.php: define('SPIDER_MAX_LIMIT',300); //max recurse levels in spider define('SPIDER_DEFAULT_LIMIT',300); //default value define('RESPIDER_LIMIT',300); //recurse limit for update define('PHPDIG_DEFAULT_INDEX',true); I try to spider a directory called "glossar" with 24 documents. Beginning to spider with Search depth: 1 And after ca. 1 Minute the prozess stopped and only 10 documents were spidered. What can I do? thx for support tams (hamburg - germany) |
03-15-2004, 07:47 AM | #2 |
Purple Mole
Join Date: Jan 2004
Posts: 694
|
It sounds like your settings are all correct. I found the first time that I spidered my site, the process seemed to hang like that. However, I cleared all the tables and started over. The second time, the spidering seemed to work fine.
Try doing that, and let us know how it goes. |
03-15-2004, 11:31 AM | #3 |
Green Mole
Join Date: Feb 2004
Posts: 9
|
i respidered and everything is ok.
thx you t. |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
spider documents without extensions | jguert | External Binaries | 0 | 08-17-2006 08:39 AM |
Documents disappear | kzant | Troubleshooting | 7 | 07-30-2005 08:26 AM |
How to scan XML documents | batman1056 | How-to Forum | 1 | 05-19-2005 08:34 AM |
no timeout? | miguelangelo | How-to Forum | 2 | 07-27-2004 02:42 AM |
Duplicate Documents Problem... | vonbrocklin | Troubleshooting | 3 | 11-25-2003 02:16 PM |