htaccess

Tanasja · 10-03-2003, 07:41 AM

Q: Is it possible with PhpDig to search in files that are protected by .htaccess?

Charter · 10-05-2003, 10:51 AM

Hi. If you want to search files protected by .htaccess, you could try to crawl the following:

Code:

username:password@domain.com

but personally I wouldn't recommend it.

Tanasja · 10-10-2003, 03:02 AM

Can you tell me why not?

Charter · 10-11-2003, 05:53 AM

Hi. I wouldn't do it because other people may be able to read the username and password if sent via plain text. If you are trying to crawl files in a .htaccess protected directory, maybe remove the .htaccess file, make the crawl, and then restore the .htacess file. That way the contents can be searched but when a user clicks a related link, they would get the prompted for a username and password. However, if the files in the .htaccess protected directory are for members only, and you do a crawl like suggested above, then it could be possible for non-members to read your protected content if they can find the files in the text_content directory.

Tanasja · 10-11-2003, 07:29 AM

Thanks for your help so far.
I will keep on thinking for a solution.
Suggestions still welcome...

10-03-2003, 07:41 AM	#1
Tanasja Green Mole Join Date: Oct 2003 Location: Amsterdam Posts: 9	htaccess Q: Is it possible with PhpDig to search in files that are protected by .htaccess?

10-05-2003, 10:51 AM	#2
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. If you want to search files protected by .htaccess, you could try to crawl the following: Code: username:password@domain.com but personally I wouldn't recommend it. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

10-11-2003, 05:53 AM	#4
Charter Head Mole Join Date: May 2003 Posts: 2,539	Hi. I wouldn't do it because other people may be able to read the username and password if sent via plain text. If you are trying to crawl files in a .htaccess protected directory, maybe remove the .htaccess file, make the crawl, and then restore the .htacess file. That way the contents can be searched but when a user clicks a related link, they would get the prompted for a username and password. However, if the files in the .htaccess protected directory are for members only, and you do a crawl like suggested above, then it could be possible for non-members to read your protected content if they can find the files in the text_content directory. __________________ Responses are offered on a voluntary if/as time is available basis, no guarantees. Double posting or bumping threads will not get your question answered any faster. No support via PM or email, responses not guaranteed. Thank you for your comprehension.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Spider Indexing and htaccess directories	webmaster_k	Troubleshooting	0	10-01-2007 11:50 AM
Can't get PHPDig to index an htaccess protected site	mlerch@mac.com	Troubleshooting	28	02-25-2004 04:13 PM

10-10-2003, 03:02 AM	#3
Tanasja Green Mole Join Date: Oct 2003 Location: Amsterdam Posts: 9	Can you tell me why not?

10-11-2003, 07:29 AM	#5
Tanasja Green Mole Join Date: Oct 2003 Location: Amsterdam Posts: 9	Thanks for your help so far. I will keep on thinking for a solution. Suggestions still welcome...