![]() |
Limit of spidering external domains
My first steps with phpdig went well. I spidered a domain and the subs was always indexed. OK,that can i limit in the config. And inthe first test-runs the spider went not outside this (given domain and his subdomains). On the actuall spidering of a website the spider goes outside the domain and indexes the foreign domain with the same settings of depth and links. What i want is
1. Spider the given domain OR Spider the given domain and his subs. 2. Go not outside the given domain(s) I have read the config-file more than once and searched here in the forum but did not found a solution. Thanks for help / answering Vadim |
All times are GMT -8. The time now is 08:48 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.