|
06-09-2006, 12:49 PM | #1 |
Green Mole
Join Date: Jun 2006
Location: Massachooosets
Posts: 1
|
Blocking particular hosts or domains?
Is there an easy way I can blog particular hosts or domains from being index by the spider? I run it and it does my site ok, but then it runs off and starts hitting another host on the same domain name and I get a bunch of stuff I don't want.
thanks! |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Maximum Hosts? | pgzn | The Mole Hole | 0 | 07-13-2006 04:35 PM |
Blocking domains | richwilson | How-to Forum | 0 | 03-29-2006 07:02 AM |
Less hosts than I put | noel | Troubleshooting | 1 | 11-06-2005 02:08 PM |
Limiting the search to certain hosts | lighthouse | Mod Requests | 1 | 03-11-2004 03:30 PM |
Indexing links inside hosts | bazarin | How-to Forum | 3 | 02-23-2004 10:35 AM |