redirect to external domains

sf44 · 07-03-2004, 09:41 AM

I have read previous threads, but i did not help me. I have download phpdig ver. 1.8.0

I need to index redirections to external domain but it does not function.

<meta http-equiv='refresh'content='0;url=http://external_domain.com/?something1/something2>

I have set up PHPDIG_IN_DOMAIN and also phpdigComapreDomains function.

The problem is that does not exists
links in http://external_domain.com/ like http://external_domain.com/?something1/something2

and

http://external_domain.com/?something1/something2
need to be indexed as one special page.

Any ideas?

Slavomir

vinyl-junkie · 07-03-2004, 10:47 AM

Welcome to the forum, Slavomir.

PhpDig will not index a domain that is external to the one you're currently indexing. What you'd need to do is index that content separately, with a search depth of zero.

Hope this helps.

sf44 · 07-03-2004, 11:12 PM

I do not understand.

phpDig is possible to index external sites if I set up define('PHPDIG_IN_DOMAIN',true); in config and also phpdigCompare Domain function.

Maybe the problem is that my redirect link is type

http://domain.com/?something/something2

Ordinary redirection - I have tested with OK - is type

http://domain.com/file.htm?something

Slavomir

vinyl-junkie · 07-03-2004, 11:48 PM

The way you worded your original post, it sounded like the redirected page is to a domain other than the one you're currently indexing. That's not the case?

If you're wondering why phpdig won't index something whose redirection is coming from a meta refresh, there's nothing in the documentation that says phpdig will follow such a link. What you can do though to get that page indexed is just specify its full path in your index administration process. Or else you can just include a normal link to it on your site so phpdig will pick it up.

Hope this helps.

sf44 · 07-04-2004, 12:56 AM

Please look also at the thread 663 - problems with redirection. It is possible to index external domains and redirections.

The problem is, that I am no able to specify its full path in my index administration process, because the site is special - it is like database with no links.

I need to index somethink like this
www.doman.com/?1
www.domain.com/?2
...
www.domain.com/?20000

There is no possibility to index it manually.
But I have built special file with all urls.

As I have found, the problem is in phpdigGetSiteFromUrl function, which is not able to handle special urls.

$pu = parse_url($url);

http.doman.com/?test/test - is not regular url, because there is no regular path and no regular file.

Slavomir.

07-03-2004, 09:41 AM	#1
sf44 Green Mole Join Date: Jul 2004 Posts: 9	redirect to external domains I have read previous threads, but i did not help me. I have download phpdig ver. 1.8.0 I need to index redirections to external domain but it does not function. <meta http-equiv='refresh'content='0;url=http://external_domain.com/?something1/something2> I have set up PHPDIG_IN_DOMAIN and also phpdigComapreDomains function. The problem is that does not exists links in http://external_domain.com/ like http://external_domain.com/?something1/something2 and http://external_domain.com/?something1/something2 need to be indexed as one special page. Any ideas? Slavomir

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Limit of spidering external domains	Vadim	How-to Forum	0	11-17-2006 10:53 AM
spidering external links	websearch	How-to Forum	1	01-11-2005 09:39 AM
External link	pirw3t	How-to Forum	6	09-24-2004 04:11 PM
Problems with HTTP to HTTPS Redirect	nklineg	Bug Tracker	1	04-14-2004 02:48 PM
Searching external domains/links	kenazo	How-to Forum	3	03-14-2004 03:55 PM

07-03-2004, 10:47 AM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Welcome to the forum, Slavomir. PhpDig will not index a domain that is external to the one you're currently indexing. What you'd need to do is index that content separately, with a search depth of zero. Hope this helps.

07-03-2004, 11:12 PM	#3
sf44 Green Mole Join Date: Jul 2004 Posts: 9	I do not understand. phpDig is possible to index external sites if I set up define('PHPDIG_IN_DOMAIN',true); in config and also phpdigCompare Domain function. Maybe the problem is that my redirect link is type http://domain.com/?something/something2 Ordinary redirection - I have tested with OK - is type http://domain.com/file.htm?something Slavomir

07-03-2004, 11:48 PM	#4
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	The way you worded your original post, it sounded like the redirected page is to a domain other than the one you're currently indexing. That's not the case? If you're wondering why phpdig won't index something whose redirection is coming from a meta refresh, there's nothing in the documentation that says phpdig will follow such a link. What you can do though to get that page indexed is just specify its full path in your index administration process. Or else you can just include a normal link to it on your site so phpdig will pick it up. Hope this helps.

07-04-2004, 12:56 AM	#5
sf44 Green Mole Join Date: Jul 2004 Posts: 9	Please look also at the thread 663 - problems with redirection. It is possible to index external domains and redirections. The problem is, that I am no able to specify its full path in my index administration process, because the site is special - it is like database with no links. I need to index somethink like this www.doman.com/?1 www.domain.com/?2 ... www.domain.com/?20000 There is no possibility to index it manually. But I have built special file with all urls. As I have found, the problem is in phpdigGetSiteFromUrl function, which is not able to handle special urls. $pu = parse_url($url); http.doman.com/?test/test - is not regular url, because there is no regular path and no regular file. Slavomir.