|
10-02-2006, 08:49 AM | #1 |
Green Mole
Join Date: Oct 2006
Posts: 2
|
Search Depth using cron
Hi,
I put together the command line string that I wish to call via crontab. I have first tried to exeute the job myself first at the prompt. No errors occur, and the spider.log is empty. I am wondering whats going on, and can only assume the I need to set the "search depth" and " links per" some where in the config script. Please respond if you have any info on this. I have been going throught the forums and havn't been able to find anthing. Which make me assume its somthing simple. My setup: /usr/bin/php -f /var/www/domain/search/admin/spider.php all /var/www/domain/search/list.txt > /var/www/domain/search/log/spider.log everything has the right permissions Thanks -HIram |
10-02-2006, 09:16 AM | #2 |
Green Mole
Join Date: Oct 2006
Posts: 2
|
A couple of more questions:
should I be able to spider in both shell and browser at the same time? should I be able to run the a command line spider w/o cron? should explicitly state to user browser or shell spidering? What possible reasons would the spider.log file be empty? Thanks again. Hiram |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
custom depth of search per site in cgi (including urllist) | b2l_grefix | Mod Submissions | 0 | 07-17-2004 11:49 AM |
Different search depths for different cron jobs | lighthouse | How-to Forum | 1 | 03-30-2004 08:15 AM |
Changing the search depth | Brain | How-to Forum | 1 | 03-17-2004 03:34 AM |
Search Depth using PhpDig with command line | bazarin | How-to Forum | 1 | 02-20-2004 06:53 AM |
Add search depth limit to the sites table | peter | Mod Requests | 0 | 01-03-2004 09:14 PM |