|
02-03-2004, 12:28 PM | #1 |
Green Mole
Join Date: Feb 2004
Posts: 3
|
Crawl mutiple urls
I would like to crawl more then one url at a time.
Can Dig do this? Jeff |
02-03-2004, 03:13 PM | #2 |
Purple Mole
Join Date: Dec 2003
Posts: 106
|
You can run two instances of the script from the shell (see http://www.phpdig.net/navigation.php?action=doc#toc8) or you could open two browser windows and crawl a different site in each.
__________________
Foundmyself.com artist community, art galleries |
02-03-2004, 03:47 PM | #3 |
Green Mole
Join Date: Feb 2004
Posts: 3
|
Well i could write a macro too, but i was woundering if it could do a lot more then the one or two, more on the order of 2 - 3 hundred.
|
02-03-2004, 06:47 PM | #4 |
Orange Mole
Join Date: Sep 2003
Location: Corbin KY
Posts: 45
|
I've uses the 2-4 browser way, but I would like to see if you could make a macro and do more...
__________________
David J Harmon Cyberkopia.NETwork Geeks Style http://cyberkoipia.net |
02-03-2004, 07:59 PM | #5 |
Green Mole
Join Date: Feb 2004
Posts: 3
|
creat a file called url.txt on your desktop, have the urls line spaced
http//www.msn.com http://dogpile.com so on so on let me know how it works out it will tie up the pc your on, that's why i don;'t want this way jeff |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
never ending crawl | oehk | Troubleshooting | 0 | 12-12-2006 06:34 AM |
CRAWL - SPDIER A WHOLE WEBSITE | mahesr | The Mole Hole | 0 | 11-01-2006 10:43 PM |
No results after the crawl | GunMuse | Script Installation | 8 | 04-12-2005 06:57 PM |
crawl my website only | hula | Troubleshooting | 0 | 08-29-2004 04:37 AM |