PhpDig.net - Ban features

Page 2 of 2

Show 40 post(s) from this thread on one page

PhpDig.net (http://www.phpdig.net/forum/index.php)

- How-to Forum (http://www.phpdig.net/forum/forumdisplay.php?f=33)

- - Ban features (http://www.phpdig.net/forum/showthread.php?t=1659)

jmitchell

12-30-2004 06:26 PM

what if you are indexing other sites?

rAdoN

12-30-2004 06:30 PM

use admin update - "Click on the noway sign to exclude from future indexings" - "Click on the cross to delete the branch" - "Click on the cross to delete a document" - that delete for links indexed not wanted - use FORBIDDEN_EXTENSIONS to prevent for sites - run the cleans - index

ps - no listen :bang:

Slider

12-31-2004 06:07 AM

Hello rAdoN,

I apoligize for being such a pain. :)
You really know your stuff and I will never doubt what I hear from you again.
Thank you so much for being here. Maybe I can return the favor in some way in the future.

Slider

12-31-2004 01:49 PM

I added this line to the config:

Code:

I added this code to spider.php (the part in bold red is the addition)

Code:

//test content-type of this page if not excluded

                           $result_test_http = '';

                           if (!phpdigReadRobots($exclude,$temp_path) && !eregi(FORBIDDEN_EXTENSIONS,$temp_file) && !eregi(FORBIDDEN_PATH,$temp_path)) {

                                $result_test_http = phpdigTestUrl($url_indexing,'date',$cookies);

                           }

I tried the code you gave and even tried variations of it and never was able to get it to ignore a path or directory. This code should be added to the next phpdig version. it's a neccessity if you want to have a little more control over the content that is being indexed and reduce the MySql database.

rAdoN

01-01-2005 12:56 PM

hoorah - instead use book.cgi you make mod - good for path - i mod your mod :smoke:

PHP Code:


		
			
//test content-type of this page if not excluded

$result_test_http = '';

if (!phpdigReadRobots($exclude,$temp_path.$temp_file) && !eregi(FORBIDDEN_EXTENSIONS,$temp_path.$temp_file)) {

     $result_test_http = phpdigTestUrl($url_indexing,'date',$cookies);

}

Slider

01-01-2005 04:12 PM

I'm not familiar with the book.cgi you were talking about.
The new code you posted would have made it work for the path and filename Congrats!

Thank you very much

All times are GMT -8. The time now is 03:14 PM.

Page 2 of 2

Show 40 post(s) from this thread on one page