Fork in background during the spidering...

BulForce · 01-18-2005, 05:07 PM

I wish to see ability to fork the spider in background during the spidering.

jmitchell · 01-18-2005, 07:22 PM

can you explain more?

BulForce · 01-19-2005, 05:58 AM

Okay
lets say that i type in the shell #php -f spider.php sites.txt >> sites.log

And then close the connection with the host, but spider keep indexing.

Charter · 01-19-2005, 06:14 AM

Code:

php -f spider.php sites.txt >> sites.log &

jmitchell · 01-19-2005, 09:17 AM

so charter, if I cd to the phpdig/admin dir, and then do the code you put, I can close down my ssh connection, and it will keep spidering?

btw, after you reply you will have 2,000 posts - congrats!

jmitchell

Charter · 01-19-2005, 09:53 AM

Run in background:

Code:

php -f spider.php sites.txt >> sites.log &

Run in background and log off:

Code:

nohup php -f spider.php sites.txt >> sites.log &

jmitchell · 01-19-2005, 12:59 PM

ok, thanks

01-18-2005, 05:07 PM	#1
BulForce Orange Mole Join Date: Aug 2004 Location: none Posts: 33	Fork in background during the spidering... I wish to see ability to fork the spider in background during the spidering.

01-18-2005, 07:22 PM	#2
jmitchell Orange Mole Join Date: Dec 2004 Location: Tennessee Posts: 60	can you explain more? __________________ 60,000 pages indexed!!!!! http://www.sharemylink.com

01-19-2005, 06:14 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Code: php -f spider.php sites.txt >> sites.log & __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-19-2005, 09:17 AM	#5
jmitchell Orange Mole Join Date: Dec 2004 Location: Tennessee Posts: 60	so charter, if I cd to the phpdig/admin dir, and then do the code you put, I can close down my ssh connection, and it will keep spidering? btw, after you reply you will have 2,000 posts - congrats! jmitchell __________________ 60,000 pages indexed!!!!! http://www.sharemylink.com

01-19-2005, 09:53 AM	#6
Charter Head Mole Join Date: May 2003 Posts: 2,539	Run in background: Code: php -f spider.php sites.txt >> sites.log & Run in background and log off: Code: nohup php -f spider.php sites.txt >> sites.log & __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

01-19-2005, 05:58 AM	#3
BulForce Orange Mole Join Date: Aug 2004 Location: none Posts: 33	Okay lets say that i type in the shell #php -f spider.php sites.txt >> sites.log And then close the connection with the host, but spider keep indexing.

01-19-2005, 12:59 PM	#7
jmitchell Orange Mole Join Date: Dec 2004 Location: Tennessee Posts: 60	ok, thanks __________________ 60,000 pages indexed!!!!! http://www.sharemylink.com

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
mutilple spider via fork()	ragnoroc	Mod Requests	1	05-18-2004 03:21 AM
how to run spider.php in background mode	123av	How-to Forum	1	04-10-2004 12:29 PM
background color	ultraman	How-to Forum	3	02-27-2004 07:53 PM