Fighting back server load

grassmonster · 07-16-2007, 08:12 AM

Has anyone else noticed the locked problem relative to server load?

I am running phpdig 1.85 and I guess it does beg the question from anyone in the know ... "are sites supposed to remain locked in the site list after a job has run" or is this a bug in the version I am learning.

I found that the sites were remaining locked in the web admin.
The server was running wild with load.

When I stopped the the domains remaining locked after being spidered, the load average was under 0.25 including all other activities and acceptable during a spider session of 38 domains in a called text file.

I expect after reading the forums for a week or so, that some of you experienced users with large setups might see a variation on the server load but does any one have a thought on the locked scenareo mentioned above

thanks

obottek · 08-08-2007, 06:44 AM

I'm not quiet sure if I understand, what your problem is. Can you try to describe a little more detailed what you mean?

Highest cpu load with multiple spiders running in parallel should be on the database.

07-16-2007, 08:12 AM	#1
grassmonster Green Mole Join Date: Jul 2007 Posts: 3	Fighting back server load Has anyone else noticed the locked problem relative to server load? I am running phpdig 1.85 and I guess it does beg the question from anyone in the know ... "are sites supposed to remain locked in the site list after a job has run" or is this a bug in the version I am learning. I found that the sites were remaining locked in the web admin. The server was running wild with load. When I stopped the the domains remaining locked after being spidered, the load average was under 0.25 including all other activities and acceptable during a spider session of 38 domains in a called text file. I expect after reading the forums for a week or so, that some of you experienced users with large setups might see a variation on the server load but does any one have a thought on the locked scenareo mentioned above thanks __________________ Art is making something out of nothing and selling it. Frank Zappa === Art is making sense out of hidden posts that reveal nothing and sharing it. Grassmonster

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
No Digging on same server	robertlyman	Troubleshooting	1	07-05-2005 06:22 PM
Moving to a new server	ezytrak	How-to Forum	1	03-03-2005 09:11 AM
Hello, I use a Windows Server	ClausBrell	The Mole Hole	2	09-30-2004 05:35 AM
Test Server	RaGe	Mod Requests	0	05-10-2004 05:01 PM
installing on IIS Server....	ronyotz	Script Installation	3	03-03-2004 07:22 PM

08-08-2007, 06:44 AM	#2
obottek Green Mole Join Date: Sep 2003 Posts: 15	I'm not quiet sure if I understand, what your problem is. Can you try to describe a little more detailed what you mean? Highest cpu load with multiple spiders running in parallel should be on the database.