Indexing links inside hosts

bazarin · 02-22-2004, 04:15 AM

In my site I have a page with some other people sites like:

My page: www.bazarin.com/links.htm

inside links.htm I have two links (for example only):

http://www.sharyne.com/ and http://www.fine-art.com/

I expected when PhpDiging www.bazarin.com with deep 10 (for example) that the sites http://www.sharyne.com/ and http://www.fine-art.com/ could be PhpDiged also, but this did not happens. Is this a PhpDig feature or should I configure PhPDig for that?

Regards,

Wagner Bazarin

vinyl-junkie · 02-22-2004, 07:55 AM

Just enter the root directory for the site that you want to index and select a search depth of zero. That will put just the root directory for the site and nothing else into your search engine.

vinyl-junkie · 02-22-2004, 08:00 AM

Um, I did that just now with an external link on my site. Now I notice that my site is listed as locked!

Charter · 02-23-2004, 10:35 AM

>> In my site I have a page with some other people sites like...

Hi. To crawl outside your own domain, set PHPDIG_IN_DOMAIN to true in the config file and apply the code change in this thread.

02-22-2004, 04:15 AM	#1
bazarin Green Mole Join Date: Feb 2004 Location: Sao Paulo - Brazil Posts: 8	Indexing links inside hosts In my site I have a page with some other people sites like: My page: www.bazarin.com/links.htm inside links.htm I have two links (for example only): http://www.sharyne.com/ and http://www.fine-art.com/ I expected when PhpDiging www.bazarin.com with deep 10 (for example) that the sites http://www.sharyne.com/ and http://www.fine-art.com/ could be PhpDiged also, but this did not happens. Is this a PhpDig feature or should I configure PhPDig for that? Regards, Wagner Bazarin

02-22-2004, 07:55 AM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Re: Indexing links inside hosts Just enter the root directory for the site that you want to index and select a search depth of zero. That will put just the root directory for the site and nothing else into your search engine.

02-23-2004, 10:35 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	>> In my site I have a page with some other people sites like... Hi. To crawl outside your own domain, set PHPDIG_IN_DOMAIN to true in the config file and apply the code change in this thread. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Maximum Hosts?	pgzn	The Mole Hole	0	07-13-2006 04:35 PM
Blocking particular hosts or domains?	cewyattjr	How-to Forum	0	06-09-2006 12:49 PM
probleming outputing html inside while loop	tiger007	Coding & Tutorials	0	02-11-2006 06:48 PM
Spidering inside a cluster.	mdavila	Troubleshooting	0	11-30-2005 11:54 AM
Less hosts than I put	noel	Troubleshooting	1	11-06-2005 02:08 PM

02-22-2004, 08:00 AM	#3
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Um, I did that just now with an external link on my site. Now I notice that my site is listed as locked!