Quote:
|
Originally Posted by rispbiz
Here is what the problem was, Which makes no sense.
The website had a robot.txt file in the that only had this line.
Disallow: 4.15.191.215
I had webmaster remove the robots.txt and it indexed fine.
How come the Disallow: is causing a problem with the sipder?
Thank You,
2-Surf.net
|
That is not standard robots.txt format.
__________________
Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.
|