How To call spider from command line with debth options?

jburnett · 01-12-2005, 05:34 AM

Just as the title says.

I know I can specify the debth options when I dig a page from the admin section, but how do I specify the debth options when adding a domain from the command line.

Basically I ran spider from the command line php-f spider.php http://www.jrbtech.com/ and it did a pretty darn good job of indexing. I need to get to a page that I know is linked everywhere on my site, but it wasn't indexed. ( from what I could tell ).

Is there a way to index the whole shabang? I'm I doing something wrong ?
Oh, and this has to be done from the command line as my site has 1000's of pages.

http://www.jrbtech.com/search/

Thanks in advance, and good job with php Dig

Charter · 01-12-2005, 01:03 PM

Set the default options you want to use in the config file.

http://www.phpdig.net/navigation.php?action=doc#toc4

01-12-2005, 05:34 AM	#1
jburnett Green Mole Join Date: Jan 2005 Location: staunton, virginia Posts: 1	How To call spider from command line with debth options? Just as the title says. I know I can specify the debth options when I dig a page from the admin section, but how do I specify the debth options when adding a domain from the command line. Basically I ran spider from the command line php-f spider.php http://www.jrbtech.com/ and it did a pretty darn good job of indexing. I need to get to a page that I know is linked everywhere on my site, but it wasn't indexed. ( from what I could tell ). Is there a way to index the whole shabang? I'm I doing something wrong ? Oh, and this has to be done from the command line as my site has 1000's of pages. http://www.jrbtech.com/search/ Thanks in advance, and good job with php Dig

01-12-2005, 01:03 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Set the default options you want to use in the config file. http://www.phpdig.net/navigation.php?action=doc#toc4 __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
spider from command line	twanoo	Troubleshooting	3	01-14-2005 10:04 AM
Spider.php is killed at the command line	bforsyth	Troubleshooting	2	12-05-2004 01:09 PM
Problem running spider from Command Line	joshuag200	Troubleshooting	17	09-13-2004 07:57 PM
Command Line Spider spiders all sites	Wayne McBryde	Troubleshooting	3	01-27-2004 05:15 PM
Spider in command line : 3 errors	Yannick	Troubleshooting	2	12-19-2003 03:01 AM