hc-httpclient-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Albretch Mueller <lbrt...@gmail.com>
Subject Re: why are so different the response headers as reported by wget and httpclient?
Date Tue, 07 May 2013 04:38:14 GMT
 a full wire log shows:

$ java -Dorg.apache.commons.logging.Log=org.apache.commons.logging.impl.SimpleLog
-Dorg.apache.commons.logging.simplelog.showdatetime=true
-Dorg.apache.commons.logging.simplelog.log.org.apache.http=DEBUG
-Dorg.apache.commons.logging.simplelog.log.org.apache.http.wire=ERROR
HC_DownMetaHTTPHeaders02Test

...

// __ |http://download.ted.com/talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD|
// __ httpGet.getRequestLine(): |GET
http://download.ted.com/talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD
HTTP/1.1|

// ___ after (new
HttpGet(http://download.ted.com/talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD)):
|00 hours, 00 mins, 00 seconds 000 (ms)|
// __ aHost: |download.ted.com|
// __ aRqLn: |GET
http://download.ted.com/talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD
HTTP/1.1|
// __ RqstHdrs.length: |7|[Lorg.apache.http.Header;@ca8d94|

2013/05/07 00:31:06:169 GMT [DEBUG] BasicClientConnectionManager - Get
connection for route {}->http://download.ted.com
2013/05/07 00:31:06:172 GMT [DEBUG] DefaultClientConnectionOperator -
Connecting to download.ted.com:80
2013/05/07 00:31:06:193 GMT [DEBUG] RequestAddCookies - CookieSpec
selected: best-match
2013/05/07 00:31:06:193 GMT [DEBUG] RequestAddCookies - Cookie
[version: 0][name: symfony][value: 1cqnumd1nhgttffc2lkb08u8t2][domain:
.ted.com][path: /][expiry: null] match
[download.ted.com:80/talks/LuisVonAhn_2011X-480p.mp4]
2013/05/07 00:31:06:193 GMT [DEBUG] RequestAuthCache - Auth cache not
set in the context
2013/05/07 00:31:06:207 GMT [DEBUG] RequestTargetAuthentication -
Target auth state: UNCHALLENGED
2013/05/07 00:31:06:207 GMT [DEBUG] RequestProxyAuthentication - Proxy
auth state: UNCHALLENGED
2013/05/07 00:31:06:207 GMT [DEBUG] DefaultHttpClient - Attempt 1 to
execute request
2013/05/07 00:31:06:208 GMT [DEBUG] DefaultClientConnection - Sending
request: GET /talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD
HTTP/1.1
2013/05/07 00:31:06:208 GMT [DEBUG] headers - >> GET
/talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD HTTP/1.1
2013/05/07 00:31:06:209 GMT [DEBUG] headers - >> Host: download.ted.com
2013/05/07 00:31:06:209 GMT [DEBUG] headers - >> Connection: keep-alive
2013/05/07 00:31:06:210 GMT [DEBUG] headers - >> User-Agent:
Mozilla/5.0 (X11; Linux i686; rv:10.0.4) Gecko/20100101 Firefox/10.0.4
Iceweasel/10.0.4
2013/05/07 00:31:06:210 GMT [DEBUG] headers - >> Accept: text/html,
text/*;q=0.9, image/jpeg;q=0.9, image/png;q=0.9, image/*;q=0.9,
*/*;q=0.8
2013/05/07 00:31:06:210 GMT [DEBUG] headers - >> Accept-Encoding:
gzip, deflate, x-gzip, x-deflate
2013/05/07 00:31:06:213 GMT [DEBUG] headers - >> Accept-Charset: utf-8,*;q=0.5
2013/05/07 00:31:06:213 GMT [DEBUG] headers - >> Accept-Language: en-US,en;q=0.9
2013/05/07 00:31:06:213 GMT [DEBUG] headers - >> Cookie:
symfony=1cqnumd1nhgttffc2lkb08u8t2
2013/05/07 00:31:06:213 GMT [DEBUG] headers - >> Cookie2: $Version=1
2013/05/07 00:31:06:595 GMT [DEBUG] DefaultClientConnection -
Receiving response: HTTP/1.1 302 Moved Temporarily
2013/05/07 00:31:06:595 GMT [DEBUG] headers - << HTTP/1.1 302 Moved Temporarily
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << Server: nginx
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << Date: Tue, 07 May
2013 04:31:21 GMT
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << Content-Type: text/html
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << Transfer-Encoding: chunked
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << Connection: keep-alive
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << X-Cache: MISS
2013/05/07 00:31:06:596 GMT [DEBUG] headers - << Location:
http://video.ted.com/talk/podcast/2011X/None/LuisVonAhn_2011X-480p.mp4
2013/05/07 00:31:06:596 GMT [DEBUG] DefaultHttpClient - Connection can
be kept alive indefinitely
2013/05/07 00:31:06:596 GMT [DEBUG] DefaultRedirectStrategy - Redirect
requested to location
'http://video.ted.com/talk/podcast/2011X/None/LuisVonAhn_2011X-480p.mp4'
2013/05/07 00:31:06:596 GMT [DEBUG] DefaultHttpClient - Resetting
target auth state
2013/05/07 00:31:06:596 GMT [DEBUG] DefaultHttpClient - Redirecting to
'http://video.ted.com/talk/podcast/2011X/None/LuisVonAhn_2011X-480p.mp4'
via {}->http://video.ted.com
2013/05/07 00:31:06:596 GMT [DEBUG] BasicClientConnectionManager -
Releasing connection
org.apache.http.impl.conn.ManagedClientConnectionImpl@15005d
2013/05/07 00:31:06:596 GMT [DEBUG] BasicClientConnectionManager -
Connection can be kept alive indefinitely
2013/05/07 00:31:06:597 GMT [DEBUG] BasicClientConnectionManager - Get
connection for route {}->http://video.ted.com
2013/05/07 00:31:06:597 GMT [DEBUG] DefaultClientConnection -
Connection 0.0.0.0:43290<->54.242.198.180:80 closed
2013/05/07 00:31:06:597 GMT [DEBUG] DefaultClientConnectionOperator -
Connecting to video.ted.com:80
2013/05/07 00:31:06:612 GMT [DEBUG] RequestAddCookies - CookieSpec
selected: best-match
2013/05/07 00:31:06:612 GMT [DEBUG] RequestAddCookies - Cookie
[version: 0][name: symfony][value: 1cqnumd1nhgttffc2lkb08u8t2][domain:
.ted.com][path: /][expiry: null] match
[video.ted.com:80/talk/podcast/2011X/None/LuisVonAhn_2011X-480p.mp4]
2013/05/07 00:31:06:612 GMT [DEBUG] RequestAuthCache - Auth cache not
set in the context
2013/05/07 00:31:06:613 GMT [DEBUG] RequestTargetAuthentication -
Target auth state: UNCHALLENGED
2013/05/07 00:31:06:613 GMT [DEBUG] RequestProxyAuthentication - Proxy
auth state: UNCHALLENGED
2013/05/07 00:31:06:613 GMT [DEBUG] DefaultHttpClient - Attempt 2 to
execute request
2013/05/07 00:31:06:613 GMT [DEBUG] DefaultClientConnection - Sending
request: GET /talk/podcast/2011X/None/LuisVonAhn_2011X-480p.mp4
HTTP/1.1
2013/05/07 00:31:06:613 GMT [DEBUG] headers - >> GET
/talk/podcast/2011X/None/LuisVonAhn_2011X-480p.mp4 HTTP/1.1
2013/05/07 00:31:06:614 GMT [DEBUG] headers - >> Host: download.ted.com
2013/05/07 00:31:06:614 GMT [DEBUG] headers - >> Connection: keep-alive
2013/05/07 00:31:06:614 GMT [DEBUG] headers - >> User-Agent:
Mozilla/5.0 (X11; Linux i686; rv:10.0.4) Gecko/20100101 Firefox/10.0.4
Iceweasel/10.0.4
2013/05/07 00:31:06:614 GMT [DEBUG] headers - >> Accept: text/html,
text/*;q=0.9, image/jpeg;q=0.9, image/png;q=0.9, image/*;q=0.9,
*/*;q=0.8
2013/05/07 00:31:06:614 GMT [DEBUG] headers - >> Accept-Encoding:
gzip, deflate, x-gzip, x-deflate
2013/05/07 00:31:06:615 GMT [DEBUG] headers - >> Accept-Charset: utf-8,*;q=0.5
2013/05/07 00:31:06:615 GMT [DEBUG] headers - >> Accept-Language: en-US,en;q=0.9
2013/05/07 00:31:06:615 GMT [DEBUG] headers - >> Cookie:
symfony=1cqnumd1nhgttffc2lkb08u8t2
2013/05/07 00:31:06:615 GMT [DEBUG] headers - >> Cookie2: $Version=1
2013/05/07 00:31:06:629 GMT [DEBUG] DefaultClientConnection -
Receiving response: HTTP/1.1 404 Not Found
2013/05/07 00:31:06:632 GMT [DEBUG] headers - << HTTP/1.1 404 Not Found
2013/05/07 00:31:06:632 GMT [DEBUG] headers - << Server: Footprint 4.8/FPMCP
2013/05/07 00:31:06:632 GMT [DEBUG] headers - << Mime-Version: 1.0
2013/05/07 00:31:06:633 GMT [DEBUG] headers - << Date: Tue, 07 May
2013 04:31:21 GMT
2013/05/07 00:31:06:633 GMT [DEBUG] headers - << Content-Type: text/html
2013/05/07 00:31:06:633 GMT [DEBUG] headers - << Content-Length: 632
2013/05/07 00:31:06:633 GMT [DEBUG] headers - << Expires: Tue, 07 May
2013 04:31:21 GMT
2013/05/07 00:31:06:633 GMT [DEBUG] headers - << Connection: close

// __ httpResponse.getStatusLine().toString(): |HTTP/1.1 404 Not Found|

2013/05/07 00:31:06:634 GMT [DEBUG] BasicClientConnectionManager -
Releasing connection
org.apache.http.impl.conn.ManagedClientConnectionImpl@cb03c4
2013/05/07 00:31:06:634 GMT [DEBUG] DefaultClientConnection -
Connection 0.0.0.0:52042<->4.27.18.254:80 shut down

// __ request line: |GET
http://download.ted.com/talks/LuisVonAhn_2011X-480p.mp4?apikey=TEDDOWNLOAD
HTTP/1.1|

// __  7 response headers received from server:
// __ Server: Footprint 4.8/FPMCP
// __ Mime-Version: 1.0
// __ Date: Tue, 07 May 2013 04:31:21 GMT
// __ Content-Type: text/html
// __ Content-Length: 632
// __ Expires: Tue, 07 May 2013 04:31:21 GMT
// __ Connection: close

---------------------------------------------------------------------
To unsubscribe, e-mail: httpclient-users-unsubscribe@hc.apache.org
For additional commands, e-mail: httpclient-users-help@hc.apache.org


Mime
View raw message