|
10-25-2003, 09:23 PM | #1 |
Orange Mole
Join Date: Oct 2003
Posts: 30
|
Script running on its own?
Hi,
Yesterday, I ran the spider to crawl one site. But then something weird happened. When I checked back, I refreshed the admin page and saw that four sites were being crawled at the same time because their URL's had the *locked* symbol beside them. Is this supposed to happen? |
10-26-2003, 09:15 AM | #2 |
Purple Mole
Join Date: Sep 2003
Location: Kassel, Germany
Posts: 119
|
CGI-Time-out at first indexing ! The big problem of phpdig:
In the current version the spider try to index the complete site. If you have NO root-server (webspace at provider) you can't change the CGI-timeout from the Webserver. Default in Apache and IIS it is 300 Sec. But in 300 Seconds spider.php is NOT indexing > 100 Sites. so you get CGI-Timeout - URL's had the *locked* Feature Solution: The spider.php must stop and start a new Session, before 300 Seconds, because this is default in all Webservers with Save_mode. -Roland- |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Running phpdig | cloefke | Troubleshooting | 0 | 07-05-2007 12:00 PM |
Running with old version of MySQL? | paulsv | How-to Forum | 0 | 01-03-2006 11:09 AM |
Running PHP in error_reporting(E_ALL) | corsc | Troubleshooting | 7 | 06-01-2005 11:24 PM |
trouble running the spider | bforsyth | Troubleshooting | 2 | 12-20-2004 03:33 PM |
running out of memory | tomas | External Binaries | 11 | 02-19-2004 11:12 AM |