PhpDig.net - View Single Post

Dave A · 01-08-2005, 12:52 PM

The spider does index domains with that extension (.info)
I have used it to index quite a few myself so it may be the robots.txt file or htaccess that is blocking you.

01-08-2005, 12:52 PM	#9
Dave A Purple Mole Join Date: Aug 2004 Location: North Island New Zealand Posts: 170	Re indexing of Info domains. The spider does index domains with that extension (.info) I have used it to index quite a few myself so it may be the robots.txt file or htaccess that is blocking you.