|
Download -
PHP Reference -
Links -
Demo 1.8.9 RC1 -
API
License - Credits - Copying - Changelog - Documentation |
|
|
03-14-2004, 01:03 AM
|
#1 |
|
Green Mole
Join Date: Mar 2004
Location: Russia
Posts: 21
|
Logical bug and stopping spidering
When browser stops by user or timeout at the time of retrieving of urls some urls won't be save cause page was marked as indexed and won't be search again for links after refreshing. Am I right? So it's not a problem when you have no limit of time and start spidering by command line, but for browser or timeout...
|
|
|
 |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Do i need help or is it a bug? | se7en | Troubleshooting | 2 | 03-16-2006 07:23 AM |
| Spider Crawl stopping too early | X-Warlock | Troubleshooting | 5 | 05-19-2005 08:01 AM |
| Bug when spidering | julien | Troubleshooting | 3 | 03-01-2005 11:21 PM |
| Bug when spidering subdomains | cybercox | Bug Tracker | 1 | 04-01-2004 12:48 AM |
| "tempspider" table fills itself without stopping | laurentxav | Troubleshooting | 1 | 01-21-2004 10:09 AM |
