View Single Post
Old 09-19-2003, 12:24 PM   #5
Rolandks
Purple Mole
 
Rolandks's Avatar
 
Join Date: Sep 2003
Location: Kassel, Germany
Posts: 119
Hmm, Monitor-Log is only possible if i start this 2 sec before i dig.

This is wrong - IMHO !!
robot_functions.php Line 286

Code:
  $request =
  "HEAD $path HTTP/1.1\n"
  ."Host: $host$sport\n"
  .$cookiesSendString
  .$auth_string
  ."Accept: */*\n"
  ."Accept-Charset: ".Dig-Spider_ENCODING."\n"
  ."Accept-Encoding: identity\n"
  ."User-Agent: Dig-Spider/".Dig-Spider_VERSION." (PHP; MySql)\n\n";
The Header(lines) of the HEAD Requests are NOT split by CRLF only
with LF ('\n')? LF is wrong in RFC - Each header ends with a CRLF !!

See:
http://www.w3.org/Protocols/rfc2616/...c2.html#sec2.2

Quote:
HTTP/1.1 defines the sequence CR LF as the end-of-line marker for all
protocol elements except the entity-body (see appendix 19.3 for
tolerant applications). The end-of-line marker within an entity-body
is defined by its associated media type, as described in section 3.7.

CRLF = CR LF
-Roland-

Last edited by Rolandks; 09-19-2003 at 12:58 PM.
Rolandks is offline   Reply With Quote