PhpDig.net - View Single Post

Charter · 11-12-2003, 08:08 AM

Hi. Just curious, how long does the crawl take with 20 levels, or do you stop the crawl?

You could try using the PHPDIG_EXCLUDE_COMMENT and PHPDIG_INCLUDE_COMMENT values set in the config to exclude part of a page, each on their own line, or you could move certain scripts to their own directory and exlude that directory from the admin panel or via a robots.txt file.

In the admin panel, if you click a site, click the update button, and click a red exclude symbol for a certain path, that path shouldn't be included in a reindex. To reindex, click a site, click the update button, and click a green check mark.

11-12-2003, 08:08 AM	#5
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Just curious, how long does the crawl take with 20 levels, or do you stop the crawl? You could try using the PHPDIG_EXCLUDE_COMMENT and PHPDIG_INCLUDE_COMMENT values set in the config to exclude part of a page, each on their own line, or you could move certain scripts to their own directory and exlude that directory from the admin panel or via a robots.txt file. In the admin panel, if you click a site, click the update button, and click a red exclude symbol for a certain path, that path shouldn't be included in a reindex. To reindex, click a site, click the update button, and click a green check mark. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.