PhpDig.net - View Single Post

Charter · 12-16-2003, 08:53 AM

Hi. If the TOC page is the only page that contains the links to the other pages, PhpDig will need to crawl it to find the links to the other pages. You could make a text file of URLs, one per line, and crawl via shell to avoid the TOC page. You could also crawl the TOC page, and when indexing is done, go to the control panel, choose a site, click the update button, click a blue arrow, and on the right side click the related red X to delete the TOC page.

12-16-2003, 08:53 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. If the TOC page is the only page that contains the links to the other pages, PhpDig will need to crawl it to find the links to the other pages. You could make a text file of URLs, one per line, and crawl via shell to avoid the TOC page. You could also crawl the TOC page, and when indexing is done, go to the control panel, choose a site, click the update button, click a blue arrow, and on the right side click the related red X to delete the TOC page. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.