phpdig add some underscores to URLs

cjones · 12-10-2004, 04:09 AM

In phpdig when i type a address to dig it for some reason it adds a underscore to it for example http://waix.bur.st becomes http://waix.bur.st____/. I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains. What is going on here?

Thanks,
cjones

cjones · 12-10-2004, 05:34 AM

it ok fixed, but now phpdig cant even find links in http://waix.bur.st, even though there are 100 links
it returns
SITE : http://waix.bur.st/
Exclude paths :
- @NONE@
No link in temporary table

--------------------------------------------------------------------------------

links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !

wats wrong?

Charter · 12-10-2004, 01:35 PM

>> I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains.

What update was that? With PhpDig 1.8.4 the only changes needed are those in this thread. If you want to go external, then look for the following in the robot_functions.php file:

PHP Code:


			
// be careful setting this to true as indexing

// could take a very, VeRy, VERY looooong time

//       return true;

and set PHPDIG_IN_DOMAIN to true in the config file.

cjones · 12-10-2004, 04:25 PM

it was that files.zip that was released, anyway do you know why it can index http://proud.id.au/waix and not http://waix.bur.st?

Should do a complete fresh install?

Charter · 12-10-2004, 04:30 PM

Note that attachments and posts have been made over numerous versions of PhpDig, so such things may not be relevant to the current version. Make sure to check this thread periodically for v.1.8.4 updates, and try a fresh install and see what happens.

cjones · 12-12-2004, 08:58 PM

ok, i upgraded to v1.8.5 and i looked in robot_functions.php and i cant find the PHPDIG_IN_DOMAIN line, does this mean phpdig automatically does it?

fresh install cleared the underscore errors and indexing errors, its just that external domain line i cant find

byw, the new version is great

Charter · 12-12-2004, 09:00 PM

Check the config file.

cjones · 12-13-2004, 06:36 AM

thanks, found it and fixed

sorry about hogging your time but i have 1 more problem.

i get this at the end of spidering

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 246

--------------------------------------------------------------------------------
SITE : http://waix.waia.asn.au/
Exclude paths :
- @NONE@

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371
Duplicate of an existing document
1:http://waix.waia.asn.au/lg
(time : 00:00:06)

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371
Duplicate of an existing document
2:http://waix.waia.asn.au/
(time : 00:00:11)

Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356
No link in temporary table

i kept the connect.php file when i upgraded to v1.8.5 because me and my hoster have a real hassle with the mysql server because he knows the settings that i dont. i know i can read the file but its much easier this way

bug or stuffup by me or mysql fault?

thank you very much

Charter · 12-13-2004, 08:13 AM

Update the database tables 1.8.3 -> 1.8.4 -> 1.8.5.

cjones · 12-13-2004, 04:15 PM

do you mean i have to downgrade to 1.8.4, updatedb, install 1.8.5 and then updatedb?

vinyl-junkie · 12-13-2004, 07:45 PM

If you run the sql updates for 1.8.4 and 1.8.5, that's all you'll have to do to your database itself. The rest of the upgrade is just replacing the phpdig files. No downgrading necessary to accomplish that.

Hope this helps.

12-10-2004, 04:09 AM	#1
cjones Green Mole Join Date: Dec 2004 Posts: 13	phpdig add some underscores to URLs In phpdig when i type a address to dig it for some reason it adds a underscore to it for example http://waix.bur.st becomes http://waix.bur.st____/. I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains. What is going on here? Thanks, cjones

12-10-2004, 01:35 PM	#3
Charter Head Mole Join Date: May 2003 Posts: 2,539	>> I recenlty applied that update that changes the spider.php and robotfunctions.php so it can index external domains. What update was that? With PhpDig 1.8.4 the only changes needed are those in this thread. If you want to go external, then look for the following in the robot_functions.php file: PHP Code: `// be careful setting this to true as indexing // could take a very, VeRy, VERY looooong time // return true;` and set PHPDIG_IN_DOMAIN to true in the config file. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

12-10-2004, 04:30 PM	#5
Charter Head Mole Join Date: May 2003 Posts: 2,539	Note that attachments and posts have been made over numerous versions of PhpDig, so such things may not be relevant to the current version. Make sure to check this thread periodically for v.1.8.4 updates, and try a fresh install and see what happens. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

12-12-2004, 09:00 PM	#7
Charter Head Mole Join Date: May 2003 Posts: 2,539	Check the config file. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

12-13-2004, 08:13 AM	#9
Charter Head Mole Join Date: May 2003 Posts: 2,539	Update the database tables 1.8.3 -> 1.8.4 -> 1.8.5. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

12-10-2004, 05:34 AM	#2
cjones Green Mole Join Date: Dec 2004 Posts: 13	it ok fixed, but now phpdig cant even find links in http://waix.bur.st, even though there are 100 links it returns SITE : http://waix.bur.st/ Exclude paths : - @NONE@ No link in temporary table -------------------------------------------------------------------------------- links found : 0 ...Was recently indexed Optimizing tables... Indexing complete ! wats wrong?

12-10-2004, 04:25 PM	#4
cjones Green Mole Join Date: Dec 2004 Posts: 13	it was that files.zip that was released, anyway do you know why it can index http://proud.id.au/waix and not http://waix.bur.st? Should do a complete fresh install?

12-12-2004, 08:58 PM	#6
cjones Green Mole Join Date: Dec 2004 Posts: 13	ok, i upgraded to v1.8.5 and i looked in robot_functions.php and i cant find the PHPDIG_IN_DOMAIN line, does this mean phpdig automatically does it? fresh install cleared the underscore errors and indexing errors, its just that external domain line i cant find byw, the new version is great

12-13-2004, 06:36 AM	#8
cjones Green Mole Join Date: Dec 2004 Posts: 13	thanks, found it and fixed sorry about hogging your time but i have 1 more problem. i get this at the end of spidering Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 246 -------------------------------------------------------------------------------- SITE : http://waix.waia.asn.au/ Exclude paths : - @NONE@ Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356 Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371 Duplicate of an existing document 1:http://waix.waia.asn.au/lg (time : 00:00:06) Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356 Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 371 Duplicate of an existing document 2:http://waix.waia.asn.au/ (time : 00:00:11) Warning: mysql_num_rows(): supplied argument is not a valid MySQL result resource in /home/cjones/public_html/phpdig/admin/spider.php on line 356 No link in temporary table i kept the connect.php file when i upgraded to v1.8.5 because me and my hoster have a real hassle with the mysql server because he knows the settings that i dont. i know i can read the file but its much easier this way bug or stuffup by me or mysql fault? thank you very much

12-13-2004, 04:15 PM	#10
cjones Green Mole Join Date: Dec 2004 Posts: 13	do you mean i have to downgrade to 1.8.4, updatedb, install 1.8.5 and then updatedb?

12-13-2004, 07:45 PM	#11
vinyl-junkie Purple Mole Join Date: Jan 2004 Posts: 694	If you run the sql updates for 1.8.4 and 1.8.5, that's all you'll have to do to your database itself. The rest of the upgrade is just replacing the phpdig files. No downgrading necessary to accomplish that. Hope this helps.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
I: PHPDIG can not index 2+ URLs.. ?	PL_90	Script Installation	0	10-22-2007 08:51 AM
phpdig seems to guess some urls and spider it	manute	Troubleshooting	7	04-29-2004 02:49 AM
Add Url Script	blueuniverse	Mod Requests	4	03-01-2004 01:34 PM
PhpDig crop the URLs at (	gaam	Troubleshooting	2	02-11-2004 05:32 AM
Points, underscores, ampersands and slashes	renehaentjens	Mod Requests	1	12-08-2003 02:00 PM