View Single Post
Old 02-18-2004, 09:13 AM   #1
alivin70
Orange Mole
 
alivin70's Avatar
 
Join Date: Sep 2003
Posts: 40
Managing CRON and max_pages

We added a new feature to manage from Phpdig admin area:
-crontab list
-the max number of pages indexed per site .

Setting the field "Days" with a value > 0 you set the number of days cron must wait befor reindex a page.
The php script write a text file named "phpdig_cron". Here is an example:
0 0 1-31/1 * * /path/to/phpdig_cron
0 0 1-31/1 * * php -f /path/to/spider.php http://www1.smfn.unical.it/
0 0 1-31/3 * * php -f /path/to/spider.php http://www.miriane.it/
0 0 1-31/4 * * php -f /path/to/spider.php http://www.vinsoft.it/

As you can see, in the first line crontab reload the list daily, so you can apdate it from the admin area and wait 1 night to see your sites updated automatically.
Then you have the list of the site you want to automatically reindex.
The site www.miriane.it is reindexed every 3 days, www.vinsoft.it every 4 days.

If some of you is interested to the source code we can post it here (ask me or Jygius)

You can see a demo HERE

Enter in admin using default user/password
click on Statistics -> Pagespersite

Enjoy
Alivin70
alivin70 is offline   Reply With Quote