PhpDig.net - View Single Post

delavega · 10-27-2006, 05:49 AM

Hello,
I installed PHPDIG and it works fine on our web site.
The spider crawled almost all the web site, but it seems to be stop right now and the database table called "tempspider" is not empty.
Records inside looks like url not yet crawled ?
Do you have an idea why the spider stop processing that table and how can i make him processing again ?
the spider already crawled over 5000 pages.
Thanks a lot for help.

10-27-2006, 05:49 AM	#1
delavega Green Mole Join Date: Oct 2006 Posts: 1	Tempspider notempty Hello, I installed PHPDIG and it works fine on our web site. The spider crawled almost all the web site, but it seems to be stop right now and the database table called "tempspider" is not empty. Records inside looks like url not yet crawled ? Do you have an idea why the spider stop processing that table and how can i make him processing again ? the spider already crawled over 5000 pages. Thanks a lot for help.