|
08-29-2004, 04:37 AM | #1 |
Green Mole
Join Date: Aug 2004
Posts: 4
|
crawl my website only
Hi everyone
New guy here. I am not sure if I am not asking the right question when searching the troubleshooting area so here goes: I want to crawl only http://www.mydomain.com I do not want to index enteral links. My current result are. Most ..not all of my site gets indexed. However spider goes to another site that I link to and never seems to return to finish indexing my site. I have tried wating for 3-4 hours for it to return for it does not. I know how many page I have and they are all linked 296 pages I only want to spider/index my 296. Any advice is welcome. Hula |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
never ending crawl | oehk | Troubleshooting | 0 | 12-12-2006 06:34 AM |
CRAWL - SPDIER A WHOLE WEBSITE | mahesr | The Mole Hole | 0 | 11-01-2006 10:43 PM |
How do I crawl for email addresses on each website? | shai200 | How-to Forum | 0 | 10-18-2006 11:01 AM |
No results after the crawl | GunMuse | Script Installation | 8 | 04-12-2005 06:57 PM |
Crawl for illegal content | losttoy | How-to Forum | 0 | 12-24-2004 08:03 AM |