Thread: Max indexing ?
View Single Post
Old 12-31-2004, 10:44 AM   #2
rAdoN
Green Mole
 
Join Date: Oct 2004
Posts: 27
pretend update sites look like this with cron
Code:
ID  URL              Days   Links  Depth
1   www.domain1.com  [ 0 ]  [ 1 ]  [ 2 ]
2   www.domain2.com  [   ]  [   ]  [   ]
3   www.domain3.com  [   ]  [   ]  [   ]
or pretend update sites look like this with no cron
Code:
ID  URL              Links  Depth
1   www.domain1.com  [ 1 ]  [ 2 ]
2   www.domain2.com  [   ]  [   ]
3   www.domain3.com  [   ]  [   ]
either way

notch yes - use update sites value for 1 domain - use search depth and links per for 2 3 domain

notch no - ignore use update sites value - use search depth and links per for all 1 2 3 domain

in fr-language you make your words for remember

max index - search depth 20 links per 0 LIMIT_TO_DIRECTORY false

look config
PHP Code:
define('SPIDER_MAX_LIMIT',20);          //max recurse levels in spider
define('RESPIDER_LIMIT',5);             //recurse respider limit for update
define('LINKS_MAX_LIMIT',20);           //max links per each level
define('RELINKS_LIMIT',5);              //recurse links limit for an update

//for limit to directory, URL format must either have file at end or ending slash at end
//e.g., http://www.domain.com/dirs/ (WITH ending slash) or http://www.domain.com/dirs/dirs/index.php
define('LIMIT_TO_DIRECTORY',true);      //limit index to given (sub)directory, no sub dirs of dirs are indexed 
__________________
rAdoN was here
rAdoN is offline   Reply With Quote