WAMP - Spidering became crazy

totobeloeil · 04-09-2006, 05:46 AM

Hello,

The configuration first :
Windows 2000 Professional / Apache 2.0.55 / PHP 5.1.2 / MySQL 5.0.19 / localhost
As I couldn't create a site inside the sites table by the spider.php, I tried different tricks before I understand that spider.php was the normal way to do it.
So, I finally made the 'dirty change' proposed by Sealless
http://www.phpdig.net/forum/showthread.php?t=2350
and spider.php created the site into the sites and site-page tables. OK.
But then, the spidering became crazy because the site was locked.
I had to stop spidering.
I think perhaps it is because the site has just been created, but as I am quite web-unexperienced ...
This happens with localhost as well (!) as with external sites.
In spider.php, I modified the print-command (line 261) to check it was the origin of the problem, and it is.

The problem doesn't appear when I try to spider one of the sites which are already in the sites table. The spidering doesn't work in this case, but I think my parameters are not all right ...
Anyway, perhaps a how-to-forum question ...

totobeloeil · 04-09-2006, 07:30 AM

As I didn't find any 'update_db_to_1_8_9_rc1.sql' file, I considered that there was no update to do.
But the DB-type was InnoDB, instead of MyISAM.
So it couldn't work ...
Now, Spidering is not crazy anymore. But I become to be ...

Perhaps Apache parameters are not all right ... Any Idea ?

totobeloeil · 04-12-2006, 04:58 AM

I'm confused :
In phpDig V1.8.9, I didn't understand that there were a crash while spidering :

Une exception d'application s'est produite :
App : (pid=1980)
Lorsque : 11/04/2006 @ 09:56:12.591
Numéro d'exception : c0000005 (violation d'accès)

Perhaps is it a problem similar to the one which was reported by GunMuse (but on linux) :

http://www.phpdig.net/forum/showthread.php?t=2378

I tried to debug but finally installed phpDig V1.8.8 .

04-09-2006, 05:46 AM	#1
totobeloeil Green Mole Join Date: Apr 2006 Location: France Posts: 12	WAMP - Spidering became crazy Hello, The configuration first : Windows 2000 Professional / Apache 2.0.55 / PHP 5.1.2 / MySQL 5.0.19 / localhost As I couldn't create a site inside the sites table by the spider.php, I tried different tricks before I understand that spider.php was the normal way to do it. So, I finally made the 'dirty change' proposed by Sealless http://www.phpdig.net/forum/showthread.php?t=2350 and spider.php created the site into the sites and site-page tables. OK. But then, the spidering became crazy because the site was locked. I had to stop spidering. I think perhaps it is because the site has just been created, but as I am quite web-unexperienced ... This happens with localhost as well (!) as with external sites. In spider.php, I modified the print-command (line 261) to check it was the origin of the problem, and it is. The problem doesn't appear when I try to spider one of the sites which are already in the sites table. The spidering doesn't work in this case, but I think my parameters are not all right ... Anyway, perhaps a how-to-forum question ...

04-09-2006, 07:30 AM	#2
totobeloeil Green Mole Join Date: Apr 2006 Location: France Posts: 12	SOLVED - MySQL wasn't updated (InnoDB instead of MyISAM) As I didn't find any 'update_db_to_1_8_9_rc1.sql' file, I considered that there was no update to do. But the DB-type was InnoDB, instead of MyISAM. So it couldn't work ... Now, Spidering is not crazy anymore. But I become to be ... Perhaps Apache parameters are not all right ... Any Idea ?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
WAMP - Not spidering	totobeloeil	How-to Forum	3	04-18-2006 09:56 AM

04-12-2006, 04:58 AM	#3
totobeloeil Green Mole Join Date: Apr 2006 Location: France Posts: 12	I'm confused : In phpDig V1.8.9, I didn't understand that there were a crash while spidering : Une exception d'application s'est produite : App : (pid=1980) Lorsque : 11/04/2006 @ 09:56:12.591 Numéro d'exception : c0000005 (violation d'accès) Perhaps is it a problem similar to the one which was reported by GunMuse (but on linux) : http://www.phpdig.net/forum/showthread.php?t=2378 I tried to debug but finally installed phpDig V1.8.8 .