HELP! Yes..another site not being indexed post.

benjamintr · 07-27-2005, 08:18 PM

I've read through as many messages as I could find here, and yet still, no matter what I do, I get this message when trying to index ANY site -- not just the site I'm trying to use PHPDIG on:

SITE : http://www.url.com/
Exclude paths :
- @NONE@
1:http://www.url.com/
(time : 00:00:05)
No link in temporary table

I'm modified the config file, I've changed the link depth and links per page, I've entered in URL's manually. What else can I do at this point? I'm ready to give up.

Charter · 07-29-2005, 08:59 AM

Is allow_url_fopen set to on?

benjamintr · 07-31-2005, 12:55 PM

I just checked again. Yes, it's ON.

What's next?

Charter · 07-31-2005, 01:16 PM

Are the following directories set to 777 permissions?

Code:

    > [PHPDIG_DIR]/text_content
    > [PHPDIG_DIR]/includes
    > [PHPDIG_DIR]/admin/temp

Do you see any error messages onscreen if you uncomment error_reporting(E_ALL); in the config file, and then try to index?

benjamintr · 08-01-2005, 01:47 PM

It's a windows server, but I've chmod'd everything.

Unfortunately, I don't see any error messages after uncommenting error reporting.

...?

Charter · 08-02-2005, 06:23 PM

Do you see anything in the server access or error log? One thing noticed was that domain.com gets redirected to 123.123.123.123 and this might be an issue, as PhpDig is coded to stay in the domain given for index. You can try changing this by editing the phpdigCompareDomains function in the robot_functions.php file. Also, PhpDig doesn't follow links in 'heavy' JavaScript, but this thread might be useful. Check out this thread too.

benjamintr · 08-15-2005, 03:05 PM

I'm a little confused... This happens no matter what URL I tell it to crawl.

Does the phpdig code need to be on the same site as the domain URL?

Charter · 08-19-2005, 08:03 AM

No, PhpDig does not need to be on the same server as the domain, but if your OS/setup is, for example, a CGI loadbalanced cluster of servers, it may not possible to index sites on the cluster as there cannot be a connection back to the loadbalanced address. Presumably not every site you've tried is on the same server, so it seems like some sort of setting issue but I'm not sure. Slap in a bunch of echo "A"; echo "B"; etcetera into spider.php and see what prints onscreen. Hopefully that will provide a clue.

07-27-2005, 08:18 PM	#1
benjamintr Green Mole Join Date: Jul 2005 Posts: 6	HELP! Yes..another site not being indexed post. I've read through as many messages as I could find here, and yet still, no matter what I do, I get this message when trying to index ANY site -- not just the site I'm trying to use PHPDIG on: SITE : http://www.url.com/ Exclude paths : - @NONE@ 1:http://www.url.com/ (time : 00:00:05) No link in temporary table I'm modified the config file, I've changed the link depth and links per page, I've entered in URL's manually. What else can I do at this point? I'm ready to give up.

07-29-2005, 08:59 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Is allow_url_fopen set to on? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

07-31-2005, 01:16 PM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Are the following directories set to 777 permissions? Code: > [PHPDIG_DIR]/text_content > [PHPDIG_DIR]/includes > [PHPDIG_DIR]/admin/temp Do you see any error messages onscreen if you uncomment error_reporting(E_ALL); in the config file, and then try to index? __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

08-02-2005, 06:23 PM	#6
Charter Head Mole Join Date: May 2003 Posts: 2,539	Do you see anything in the server access or error log? One thing noticed was that domain.com gets redirected to 123.123.123.123 and this might be an issue, as PhpDig is coded to stay in the domain given for index. You can try changing this by editing the phpdigCompareDomains function in the robot_functions.php file. Also, PhpDig doesn't follow links in 'heavy' JavaScript, but this thread might be useful. Check out this thread too. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

08-19-2005, 08:03 AM	#8
Charter Head Mole Join Date: May 2003 Posts: 2,539	No, PhpDig does not need to be on the same server as the domain, but if your OS/setup is, for example, a CGI loadbalanced cluster of servers, it may not possible to index sites on the cluster as there cannot be a connection back to the loadbalanced address. Presumably not every site you've tried is on the same server, so it seems like some sort of setting issue but I'm not sure. Slap in a bunch of echo "A"; echo "B"; etcetera into spider.php and see what prints onscreen. Hopefully that will provide a clue. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

07-31-2005, 12:55 PM	#3
benjamintr Green Mole Join Date: Jul 2005 Posts: 6	I just checked again. Yes, it's ON. What's next?

08-01-2005, 01:47 PM	#5
benjamintr Green Mole Join Date: Jul 2005 Posts: 6	It's a windows server, but I've chmod'd everything. Unfortunately, I don't see any error messages after uncommenting error reporting. ...?

08-15-2005, 03:05 PM	#7
benjamintr Green Mole Join Date: Jul 2005 Posts: 6	I'm a little confused... This happens no matter what URL I tell it to crawl. Does the phpdig code need to be on the same site as the domain URL?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Meta Robots = NoIndex, or already indexed : No content indexed	jerrywin5	How-to Forum	2	04-06-2005 02:50 PM
My First Post	Elvis	The Mole Hole	11	09-28-2004 03:24 AM
First Post	jebwebb	The Mole Hole	1	09-21-2004 08:26 PM
first post....	rob1	The Mole Hole	0	09-18-2004 03:00 PM
How do I get site indexed automatically?	debklein	How-to Forum	2	04-27-2004 01:10 PM