can't exclude the path

Psykotik · 04-01-2004, 03:19 PM

Hello,

I've read carefully the forum, but in despite a lot of threads talk about my problem, I haven't found any solution.

I need to exclude a path from the spider indexing (not only the search engine), some internal links made for the website administration.

The "Banned" option doesn't work, and I cannot figure how to use the PHPDIG_EXCLUDE_COMMENT (if it's the way to do).

Let's say my links have this structure :

index.php?welcome=yes&admin=yes&what=1
index.php?welcome=yes&admin=yes&what=2

and so on. What I would to get, is to erase from the spidering the 2 last options, keeping the first one only.

Is there any solution ?

Thanks in advance.

Charter · 04-01-2004, 07:40 PM

Hi. Do you want to have index.php?welcome=yes instead of index.php?welcome=yes&admin=yes&what=1? If so, just modify the code in this post.

Psykotik · 04-02-2004, 02:37 AM

Hi Charter, thanks for responding.

This code is not what I'm looking for, since it doesn't forbid the link crowl to every page with admin=yes&what=1. Moreover, I get a lot of errors when indexing :

Quote:

Warning: eregi() [function.eregi.html]: REG_EMPTY: in e:\***\admin\phpdig\admin\robot_functions.php on line 942
Warning: eregi() [function.eregi.html]: REG_EMPTY: pempty (sub)expression in e:\***\admin\phpdig\admin\robot_functions.php on line 942

Any other possibility ?

Charter · 04-10-2004, 12:10 PM

Hi. It looks like whatever regex you used, it's not correct code so that may be why it's not working. It should strip &admin=yes&what=number from the query string.

Psykotik · 04-23-2004, 03:30 PM

Well, I don't know what I've done the first time, but as I'm stubborn, I've tried a second time and now it works.

Thanks a lot, Charter ;-)

04-01-2004, 03:19 PM	#1
Psykotik Green Mole Join Date: Dec 2003 Posts: 3	can't exclude the path Hello, I've read carefully the forum, but in despite a lot of threads talk about my problem, I haven't found any solution. I need to exclude a path from the spider indexing (not only the search engine), some internal links made for the website administration. The "Banned" option doesn't work, and I cannot figure how to use the PHPDIG_EXCLUDE_COMMENT (if it's the way to do). Let's say my links have this structure : index.php?welcome=yes&admin=yes&what=1 index.php?welcome=yes&admin=yes&what=2 and so on. What I would to get, is to erase from the spidering the 2 last options, keeping the first one only. Is there any solution ? Thanks in advance.

04-01-2004, 07:40 PM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. Do you want to have index.php?welcome=yes instead of index.php?welcome=yes&admin=yes&what=1? If so, just modify the code in this post. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

04-10-2004, 12:10 PM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. It looks like whatever regex you used, it's not correct code so that may be why it's not working. It should strip &admin=yes&what=number from the query string. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Upgrade path not good for me.	Dave A	Troubleshooting	0	01-03-2006 09:21 AM
search_function.php: allow to exclude path(s) [based on 1.8.7]	blueyed	Mod Submissions	0	01-27-2005 04:13 AM
Excluding/Including by Path	djwm	How-to Forum	2	01-02-2005 05:13 AM
Relative path	Dave A	Script Installation	9	08-18-2004 10:10 PM
cmd line path?	digitalbart2k	Troubleshooting	4	08-03-2004 12:31 PM

04-23-2004, 03:30 PM	#5
Psykotik Green Mole Join Date: Dec 2003 Posts: 3	Well, I don't know what I've done the first time, but as I'm stubborn, I've tried a second time and now it works. Thanks a lot, Charter ;-)