Excellent results using Putty SSH client and nohup command
 

I have an url text with more than 10.000 URLS. The Cron Jobs via cpanel doesn't work well (always 0 pages indexed and very slow indexing... and via web browser was worst), Now I'm using Putty SSH client and in the console I write:

cd $HOME/public_html/admin
nohup php -f spider.php urls.txt &

And I closed mi session and turned off my PC. (It was the last week)...

Now I check the nohup.out file and the spidering was very fast, a lot of pages indexed and no problems...

Thanks for the report on that. I'm in the process of moving my site to another hosting company where, among other things, I'll have shell access for the first time. My new host recommends Putty SSH, so I think I'll give that a try. :)

What about something that will work fast using a Mac? I am getting very slow indexing. Maybe around 1 minute per page.