PhpDig.net

PhpDig.net (http://www.phpdig.net/forum/index.php)
-   How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)
-   -   Limit of spidering external domains (http://www.phpdig.net/forum/showthread.php?t=2687)

Vadim 11-17-2006 09:53 AM

Limit of spidering external domains
 
My first steps with phpdig went well. I spidered a domain and the subs was always indexed. OK,that can i limit in the config. And inthe first test-runs the spider went not outside this (given domain and his subdomains). On the actuall spidering of a website the spider goes outside the domain and indexes the foreign domain with the same settings of depth and links. What i want is
1. Spider the given domain
OR Spider the given domain and his subs.
2. Go not outside the given domain(s)

I have read the config-file more than once and searched here in the forum but did not found a solution.

Thanks for help / answering

Vadim


All times are GMT -8. The time now is 08:48 PM.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.