indexing directories

iconeweb · 12-01-2005, 06:24 AM

Hello,

How can i get phpdig stop spiderind directories ?

THanks

Stefan

Dave A · 12-04-2005, 01:27 AM

Not sure about the directories being spidered but it may be that your indexing too deeply, try going in less deep it may work by not spidering so deeply.

12-01-2005, 06:24 AM	#1
iconeweb Green Mole Join Date: Nov 2005 Posts: 2	indexing directories Hello, How can i get phpdig stop spiderind directories ? THanks Stefan

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Indexing sub directories	mlisondra	How-to Forum	0	02-22-2008 06:55 AM
Spider Indexing and htaccess directories	webmaster_k	Troubleshooting	0	10-01-2007 10:50 AM
Indexing new directories	bugmenot	How-to Forum	1	03-28-2006 03:33 AM
Not Indexing Sub-Directories	jayhawk	Troubleshooting	3	02-11-2004 02:41 PM
Indexing Directories	emcclary	Troubleshooting	5	01-29-2004 06:28 PM

12-04-2005, 01:27 AM	#2
Dave A Purple Mole Join Date: Aug 2004 Location: North Island New Zealand Posts: 170	Not sure about the directories being spidered but it may be that your indexing too deeply, try going in less deep it may work by not spidering so deeply.