[arena75]

This is in my robots.txt :

User-agent: PhpDig
Disallow: /pcs/philboard_reply.asp
Disallow: /pcs/messagecompose.asp
Disallow: /pcs/nologin.asp

as you can see there are more sites I don't want to index.
But it's not working, I started spiderring again, and still all those pages are spiderred.

levels 2...
Meta Robots = NoIndex, or already indexed : Geen inhoud geindexeerd
3:http://www.xxxxxxxx.com/pcs/philboar...50&recordnum=0
(tijd : 00:00:45)
+ + + +
levels 3...
Meta Robots = NoIndex, or already indexed : Geen inhoud geindexeerd
4:http://www.xxxxxxx.com/pcs/nologin.a...50&recordnum=0
(tijd : 00:00:59)
+ + +
levels 4...
Meta Robots = NoIndex, or already indexed : Geen inhoud geindexeerd
5:http://www.xxxxxxx.com/pcs/philboard...50&recordnum=0
(tijd : 00:01:13)
+ +
levels 5...
Meta Robots = NoIndex, or already indexed : Geen inhoud geindexeerd
6:http://www.xxxxxx.com/pcs/nologin.as...50&recordnum=0
(tijd : 00:01:26)
+
levels 6...
Meta Robots = NoIndex, or already indexed : Geen inhoud geindexeerd
7:http://www.xxxxxx.com/pcs/philboard_...50&recordnum=0
(tijd : 00:01:39)

So the bot still spiders them all.
Isn't there a way to make phpinclude/phpexclude to not follow links?