Mod to follow header redirects

02-25-2004, 10:33 AM

Charter

Head Mole

Join Date: May 2003

Posts: 2,539

Mod to follow header redirects

Hi. This is a mod for PhpDig 1.8.0 so that if you crawl http://www.domain.com, and there is a header location redirect to say http://www.domain.com/file.php?query=string, the spider should now follow the redirect. To apply this mod to PhpDig 1.8.0 just use the attached file in place of the robot_functions.php file.

EDIT: This mod is included in 1.8.1+ so do not overwrite 1.8.1+ with this mod.

Attached Files

robot_functions.zip (12.3 KB, 144 views)

__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

« Previous Thread | Next Thread »

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is Off HTML code is Off

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Fix for handling HTTP => HTTPS redirects	blueyed	Bug Tracker	0	08-29-2007 02:53 AM
skipping header and footer	joelstein	How-to Forum	1	10-19-2005 07:55 AM
Will not follow links	td234	Troubleshooting	2	01-27-2005 05:37 AM
footer/header with php	shinji	How-to Forum	3	03-18-2004 07:59 PM
don't follow link	Onno	How-to Forum	1	03-05-2004 09:45 AM

All times are GMT -8. The time now is 01:23 AM.