it founds all the link but does not follow them all

Fking · 10-03-2004, 09:50 AM

well it founds them all, around 400 files, (400 pluses)
but follows and index only 7 of them
all files are in one directory and they do not have other links, just text

i have set the depth to 20, and "links per" to 500 (I edited little bit the admin panel to do that)

how to make it index them all?

vinyl-junkie · 10-03-2004, 10:33 AM

Try increasing the depth from 20 to 40 and see if that helps.

If those pages can be reached from the start page, phpdig should be able to find and index them.

asanad · 10-06-2004, 08:19 AM

On the Homepage i have an index.htm page that has 50 links to documents in my website. PHPDig indexes the Homepage file, but, does not index the links of that file. If I put the complete documents path into PHPDig, it will index it. Also, I am sure that I made the 20 deep and links 0.

Any clue or help,

10-03-2004, 09:50 AM	#1
Fking Green Mole Join Date: Sep 2004 Posts: 22	it founds all the link but does not follow them all well it founds them all, around 400 files, (400 pluses) but follows and index only 7 of them all files are in one directory and they do not have other links, just text i have set the depth to 20, and "links per" to 500 (I edited little bit the admin panel to do that) how to make it index them all?

10-06-2004, 08:19 AM	#3
asanad Green Mole Join Date: Sep 2004 Posts: 11	Same case, Searches the Homepage only On the Homepage i have an index.htm page that has 50 links to documents in my website. PHPDig indexes the Homepage file, but, does not index the links of that file. If I put the complete documents path into PHPDig, it will index it. Also, I am sure that I made the 20 deep and links 0. Any clue or help,

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Will not follow links	td234	Troubleshooting	2	01-27-2005 05:37 AM
spider.php will NOT follow link	barik	Troubleshooting	0	10-23-2004 06:07 PM
Making Search Spider Follow Links?	demo	Coding & Tutorials	1	08-08-2004 05:22 PM
don't follow link	Onno	How-to Forum	1	03-05-2004 09:45 AM
Mod to follow header redirects	Charter	Mod Submissions	0	02-25-2004 10:33 AM

10-03-2004, 10:33 AM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Try increasing the depth from 20 to 40 and see if that helps. If those pages can be reached from the start page, phpdig should be able to find and index them.