![]() |
Indexing outside root domain
Hello,
could anybody provide me the info how to allow the spider to jump domain names aka following all links. Would be great if somebody could let me know how to do this :) |
Hi. Do you mean that your page has links to a third party domain that you'd lik to crawl?
|
yes, that's what i mean. I would like to be able to crawl third party sites too (I am aware of the high traffic / sql load this will cause)
|
In the robots_function.php
Change phpdigCompareDomains($url1,$url2) - - - - - else { return true; Change the last line from False to True..... |
Thanks a lot :)
|
Hi. Also see this post.
|
All times are GMT -8. The time now is 05:15 PM. |
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.