Hi, for the last few days I've been spidering without a single hitch, until today. The last website I tried to spider has the .ph domain and I wonder if that could be the reason it could not be spidered. If you could try it out for me, the URL is
http://www.birdwatch.ph ..
And lastly, I also noticed that when I spider a site that is hosted under Geocities, the site_url becomes
www.geocities.com without including the folder where the site really is. (e.g.
www.geocities.com/mysite). Is there a way around this? It may seem like a weird request but I really really need it to be this way coz I'm working on a hack that will benefit from it. Thanks in advance!!