View Single Post
Old 02-23-2005, 04:06 AM   #3
vispa
Green Mole
 
Join Date: Feb 2005
Posts: 4
Hi Charter,

I have tried that, but it still appears to be allowing .com/.net web sites etc to be spidered and indexed :/

This is what I have got (I am using 1.8.7).

define('FORBIDDEN_EXTENSIONS','\.(net|com|rm|ico|cab|swf|css|gz|z|tar|zip|t gz|msi|arj|zoo|rar|r[0-9]+|exe|bin|pkg|rpm|deb|bz2)$');
vispa is offline   Reply With Quote