Exclude paths : -'*' -@NONE@

BootsWalker · 10-19-2004, 10:22 AM

phpDig is working fine searching my mambo site

but it will not search my Oracle site

.

The error is similar to one I've read about lots here in the forums except it has a '*' before the @NONE@ line.

SITE : http://busdev3.odoc5.odoc.state.ok.us/
Exclude paths :
- '*'
- @NONE@
1:http://busdev3.odoc5.odoc.state.ok.u...IDNG_LIST.show

I'm trying to index a single page that has about 250 links.
Only the one page gets indexed.

Any of the 250 linked pages can be added as a site and indexed.

Links are set to 0
http depth is 5
shell depth is 20

With these same setting I can fully index the mambo site along with PDF, word and excel files, no problem.

No luck with the oracle site.

Any help is greatly appreciated.

Thank you.

vinyl-junkie · 10-19-2004, 06:27 PM

Welcome to the forum, BootsWalker. We're glad to have you here.

I think I can answer part of your question but not all of it. You have a lot of javascript links that are of the type that phpdig does not follow. Check the Phpdig Features in the documentation and you'll see what I mean.

There are other plain old href links that I think phpdig would follow, unless there is a limit on the URL length, and I wouldn't know anything about that. Perhaps that is the reason those pages aren't being indexed.

Hope this helps.

BootsWalker · 10-20-2004, 07:12 PM

Thanks for the warm welcome and tips. I have tried your suggestions, still, with no luck.

The second link above and the links 1 level deep http://busdev3.odoc5.odoc.state.ok.u...IDNG_LIST.show
is what I'm trying to index. It's a special report without any javascript.

10-19-2004, 10:22 AM	#1
BootsWalker Green Mole Join Date: Oct 2004 Posts: 2	*Exclude paths : -'' -@NONE@** phpDig is working fine searching my mambo site but it will not search my Oracle site . The error is similar to one I've read about lots here in the forums except it has a '' before the @NONE@ line. SITE : http://busdev3.odoc5.odoc.state.ok.us/ Exclude paths : - '' - @NONE@ 1:http://busdev3.odoc5.odoc.state.ok.u...IDNG_LIST.show I'm trying to index a single page that has about 250 links. Only the one page gets indexed. Any of the 250 linked pages can be added as a site and indexed. Links are set to 0 http depth is 5 shell depth is 20 With these same setting I can fully index the mambo site along with PDF, word and excel files, no problem. No luck with the oracle site. Any help is greatly appreciated. Thank you.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
exclude filenames	felyx	Troubleshooting	0	11-20-2006 10:29 PM
Exclude paths for spider	ASHM	How-to Forum	2	03-06-2006 06:32 PM
New Exclude Option	josegringo	How-to Forum	2	02-17-2005 03:48 PM
Can't exclude few pages	mleray	Troubleshooting	2	11-19-2004 01:25 AM
exclude doesn't really work?	manute	Troubleshooting	15	10-20-2003 03:20 AM

10-19-2004, 06:27 PM	#2
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	Welcome to the forum, BootsWalker. We're glad to have you here. I think I can answer part of your question but not all of it. You have a lot of javascript links that are of the type that phpdig does not follow. Check the Phpdig Features in the documentation and you'll see what I mean. There are other plain old href links that I think phpdig would follow, unless there is a limit on the URL length, and I wouldn't know anything about that. Perhaps that is the reason those pages aren't being indexed. Hope this helps.

10-20-2004, 07:12 PM	#3
BootsWalker Green Mole Join Date: Oct 2004 Posts: 2	Thanks for the warm welcome and tips. I have tried your suggestions, still, with no luck. The second link above and the links 1 level deep http://busdev3.odoc5.odoc.state.ok.u...IDNG_LIST.show is what I'm trying to index. It's a special report without any javascript.