I think it is a problem right now running multiple instances of spider.php. I'm trying to do the same thing, and I used the wrapper in this thread:
http://www.phpdig.net/showthread.php?threadid=662 but it still has problems. Hopefully (hint hint) charter will make it easy to do this in the next version.
