I seem to be having the vary same problem.
I had tried everything posted in this thread and still same thing.
I have no problem indexing most websites but a few come up with this problem.
Spidering in progress...
--------------------------------------------------------------------------------
SITE :
http://www.hotdial.net/
Exclude paths :
-
- @NONE@
No link in temporary table
--------------------------------------------------------------------------------
links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !
I had tried changing the config file, deleting the site, all different levels and links.
Tried having webmaster for the site to delete the robots.txt file and tried adding the allow to the robots text file. also checked permissions.
I also have XAV se and it indexes this site without error.
There only a few sites that I seem to have this problem with. Strangly enough one of the others off hand is
http://www.hotmail.com
HUH is it possiable the hot has anything to do with it?
I am stumped!
Oh I am running newest version 1.8.3
Thanks
2-surf.net