PhpDig.net - View Single Post - Invision power board

george · 12-02-2003, 03:49 AM

The spidering of the threads that contain "showforum" and "showtopic" are OK. I don't really want it to spider anything else.

It would good to be able to limit spidering depending on the words in the url. Or conversely, to refuse to spider pages that contain certain phrases in the url.

I will try to spider some other boards and see what happens.

Thanks charter.
george

12-02-2003, 03:49 AM	#11
george Green Mole Join Date: Nov 2003 Posts: 10	The spidering of the threads that contain "showforum" and "showtopic" are OK. I don't really want it to spider anything else. It would good to be able to limit spidering depending on the words in the url. Or conversely, to refuse to spider pages that contain certain phrases in the url. I will try to spider some other boards and see what happens. Thanks charter. george Last edited by george; 12-02-2003 at 04:11 AM.