Ah right ok so the answer is that in order to index the folders that never got indexed, I can just type the URL into the text box, that should be fine.
When I do that, say, for a particular folder, does the spider try to index just that folder and not any subfolders if Limit_to_directory is set to "true"? And if I set it to false, will it follow links out of that instead? Sorry if it's obvious, just want to make sure
The only other thing is that I don't quite understand the "Search depth" and "links per" numbers that I can select. Ideally I want it to spider as much as it can and just follow links everywhere until it beleives it has already indexed everything, so what's the best setting?
Cheers for all your help, really appreciate it! I'm so pleased this is working out and I am beginning to understand now cos this is exactly what my website needs