PhpDig.net - View Single Post

WebSpider · 02-08-2005, 02:19 PM

Thanks.

I changed the depth limit to 60 and now i try to rerun the spider over the same domain so it will add the rest of links not spidered beyond the initial 20 hops, however it won't spider any link but the very first page and then stop.

Ideas?

02-08-2005, 02:19 PM	#5
WebSpider Green Mole Join Date: Feb 2005 Posts: 16	Thanks. I changed the depth limit to 60 and now i try to rerun the spider over the same domain so it will add the rest of links not spidered beyond the initial 20 hops, however it won't spider any link but the very first page and then stop. Ideas?