PhpDig.net - View Single Post

ASHM · 03-06-2006, 04:40 PM

Hi, I just want to exclude certain paths from the spider and couldn't find anything in the documentation.

I came to the forum and signed up in the hope that the answer would appear but the only results were filled with hidden replies by admins.

Surely this is a base function of PHPDig and its method shouldn't be excluded from those whose organisations are too cheap to pay the $5 registration fee.

I'd hoped it might be as simple as adding a - before the URLs but this doesn't seem to work. I know I managed to do this before but for the life of me can't rediscover how to do it through the admin or config file.

For example I want to spider domain.org.au but exclude the following paths and URL matches:

- ashm.org.au/admin
- ashm.org.au/module.php?id=

Could someone who's not an admin please reply to this or send me an email?

Thanks in advance!

03-06-2006, 04:40 PM	#1
ASHM Green Mole Join Date: Mar 2006 Posts: 2	Exclude paths for spider Hi, I just want to exclude certain paths from the spider and couldn't find anything in the documentation. I came to the forum and signed up in the hope that the answer would appear but the only results were filled with hidden replies by admins. Surely this is a base function of PHPDig and its method shouldn't be excluded from those whose organisations are too cheap to pay the $5 registration fee. I'd hoped it might be as simple as adding a - before the URLs but this doesn't seem to work. I know I managed to do this before but for the life of me can't rediscover how to do it through the admin or config file. For example I want to spider domain.org.au but exclude the following paths and URL matches: - ashm.org.au/admin - ashm.org.au/module.php?id= Could someone who's not an admin please reply to this or send me an email? Thanks in advance!