|
Normaly I'm using depth of 2 or three ... But I tried 1 and I only see what the spider "done" when it is finished.
On my Providers Server (Linux) I see the "xxxxxxxxx" and on my Win2000/Apache/PHP i see what the spider has done, when it's done.
So when there is a large site I don't know what the spider is doing ... and I saw that the spider is downloading/fetching/spidering the sites with 1-3 kb / Sec. !
|