hc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Archie Cobbs (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HTTPCLIENT-1738) CLONE - "deflate" encoding issue : java.util.zip.ZipException: invalid block type
Date Wed, 20 Apr 2016 21:40:25 GMT

    [ https://issues.apache.org/jira/browse/HTTPCLIENT-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250766#comment-15250766
] 

Archie Cobbs commented on HTTPCLIENT-1738:
------------------------------------------

Note: I couldn't reopen HTTPCLIENT-1550 so I had to clone it instead into this issue.

The bug still occurs, although in a slightly different form.

I have a test case, but unfortunately it requires creating an Athena developer account to
get access to their API. However, I've captured the problem using trace-level debugging (note
the quoted `Authorization` token is transient and no longer works).

Test program:
{noformat}

import org.apache.http.impl.client.*;
import org.apache.http.impl.*;
import org.apache.http.*;
import org.apache.http.client.methods.*;
import org.apache.http.util.*;

public class Test {
    public static void main(String[] args) throws Exception {

        String[] websites = new String[]{
            "https://api.athenahealth.com/preview1/195900/appointments/changed?departmentid=blah&ignorerestrictions=true&leaveunprocessed=true"
        };
        
        try (CloseableHttpClient client = HttpClients.createDefault()){
            for (String website : websites) {
                System.out.println("getting " + website + "...");
                HttpGet request = new HttpGet(website);
                if (website.startsWith("https"))
                    request.setHeader("Authorization", "Bearer sz2aunzxswk2bb525hddhyap");
                try(CloseableHttpResponse response = client.execute(request)){
                    System.out.println(EntityUtils.toString(response.getEntity()));
                }
            }
        }
    }
}
{noformat}

Trace of problem:
{noformat}
[archie@retina] 581 ./run.sh 
getting https://api.athenahealth.com/preview1/195900/appointments/changed?departmentid=blah&ignorerestrictions=true&leaveunprocessed=true...
DEBUG: CookieSpec selected: default
DEBUG: Auth cache not set in the context
DEBUG: Connection request: [route: {s}->https://api.athenahealth.com:443][total kept alive:
0; route allocated: 0 of 2; total allocated: 0 of 20]
DEBUG: Connection leased: [id: 0][route: {s}->https://api.athenahealth.com:443][total kept
alive: 0; route allocated: 1 of 2; total allocated: 1 of 20]
DEBUG: Opening connection {s}->https://api.athenahealth.com:443
DEBUG: Connecting to api.athenahealth.com/107.20.227.47:443
DEBUG: Connecting socket to api.athenahealth.com/107.20.227.47:443 with timeout 0
DEBUG: Enabled protocols: [TLSv1]
DEBUG: Enabled cipher suites:[TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,
TLS_RSA_WITH_AES_128_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA,
TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_RC4_128_SHA,
TLS_ECDHE_RSA_WITH_RC4_128_SHA, SSL_RSA_WITH_RC4_128_SHA, TLS_ECDH_ECDSA_WITH_RC4_128_SHA,
TLS_ECDH_RSA_WITH_RC4_128_SHA, TLS_ECDHE_ECDSA_WITH_3DES_EDE_CBC_SHA, TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA,
SSL_RSA_WITH_3DES_EDE_CBC_SHA, TLS_ECDH_ECDSA_WITH_3DES_EDE_CBC_SHA, TLS_ECDH_RSA_WITH_3DES_EDE_CBC_SHA,
SSL_DHE_RSA_WITH_3DES_EDE_CBC_SHA, SSL_DHE_DSS_WITH_3DES_EDE_CBC_SHA, SSL_RSA_WITH_RC4_128_MD5,
TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
DEBUG: Starting handshake
DEBUG: Secure session established
DEBUG:  negotiated protocol: TLSv1
DEBUG:  negotiated cipher suite: TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA
DEBUG:  peer principal: CN=api.athenahealth.com, O="Athenahealth, Inc.", L=Watertown, ST=Massachusetts,
C=US
DEBUG:  peer alternative names: [api.athenahealth.com]
DEBUG:  issuer principal: CN=DigiCert SHA2 High Assurance Server CA, OU=www.digicert.com,
O=DigiCert Inc, C=US
DEBUG: Connection established 10.10.199.93:64053<->107.20.227.47:443
DEBUG: Executing request GET /preview1/195900/appointments/changed?departmentid=blah&ignorerestrictions=true&leaveunprocessed=true
HTTP/1.1
DEBUG: Proxy auth state: UNCHALLENGED
DEBUG: http-outgoing-0 >> GET /preview1/195900/appointments/changed?departmentid=blah&ignorerestrictions=true&leaveunprocessed=true
HTTP/1.1
DEBUG: http-outgoing-0 >> Authorization: Bearer sz2aunzxswk2bb525hddhyap
DEBUG: http-outgoing-0 >> Host: api.athenahealth.com
DEBUG: http-outgoing-0 >> Connection: Keep-Alive
DEBUG: http-outgoing-0 >> User-Agent: Apache-HttpClient/4.5.2 (Java/1.7.0_45)
DEBUG: http-outgoing-0 >> Accept-Encoding: gzip,deflate
DEBUG: http-outgoing-0 >> "GET /preview1/195900/appointments/changed?departmentid=blah&ignorerestrictions=true&leaveunprocessed=true
HTTP/1.1[\r][\n]"
DEBUG: http-outgoing-0 >> "Authorization: Bearer sz2aunwxswk2ef525hddhyap[\r][\n]"
DEBUG: http-outgoing-0 >> "Host: api.athenahealth.com[\r][\n]"
DEBUG: http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]"
DEBUG: http-outgoing-0 >> "User-Agent: Apache-HttpClient/4.5.2 (Java/1.7.0_45)[\r][\n]"
DEBUG: http-outgoing-0 >> "Accept-Encoding: gzip,deflate[\r][\n]"
DEBUG: http-outgoing-0 >> "[\r][\n]"
DEBUG: http-outgoing-0 << "HTTP/1.1 400 Bad Request[\r][\n]"
DEBUG: http-outgoing-0 << "Content-Encoding: gzip[\r][\n]"
DEBUG: http-outgoing-0 << "Content-Type: application/json[\r][\n]"
DEBUG: http-outgoing-0 << "Date: Wed, 20 Apr 2016 21:34:46 GMT[\r][\n]"
DEBUG: http-outgoing-0 << "nnCoection: close[\r][\n]"
DEBUG: http-outgoing-0 << "Pragma: No-cache[\r][\n]"
DEBUG: http-outgoing-0 << "Server: Apache[\r][\n]"
DEBUG: http-outgoing-0 << "Vary: Accept-Encoding[\r][\n]"
DEBUG: http-outgoing-0 << "X-Mashery-Message-ID: 9bb66bde-ce50-41c7-97a2-2c65a7241142[\r][\n]"
DEBUG: http-outgoing-0 << "X-Mashery-Responder: prod-j-worker-us-east-1d-125.mashery.com[\r][\n]"
DEBUG: http-outgoing-0 << "Content-Length: 129[\r][\n]"
DEBUG: http-outgoing-0 << "Connection: keep-alive[\r][\n]"
DEBUG: http-outgoing-0 << "[\r][\n]"
DEBUG: http-outgoing-0 << "[0x1f][0x8b][0x8][0x0][0x0][0x0][0x0][0x0][0x0][0x3][0x2][0x0][0x0][0x0][0xff][0xff][0x1f][0x8b][0x8][0x0][0x0][0x0][0x0][0x0][0x0][0x3][0x15][0xcb][0xc1][\r][0x83]0[0xc]F[0xe1];SX>#[0x6][0xe8][0xbd][0x1b]t[0x1][0x83][0x5]K!D[0x8e]AT[0x88][0xdd][0x9b]^[0x9f][0xbe]7[0xc]7+B,C7[0xb4]&[0x9][0xfc][0xe2][0xf7]U[0xb1][0x84][0x95]D[0xf1][0xad]
+[0x81][0x4][0x1f]i>[0x82]N[0xc9]GO[0x8d][0xe6],+[0x8f][0xc][0xf7][0xdd][0xfb][0xf3]YA*!T}?M[0xa1]c[0xa5]s[0xd3][0x89][0x9f][0x1f]7"[0x97][0xd5]i[0x0][0x0][0x0]"
DEBUG: http-outgoing-0 << HTTP/1.1 400 Bad Request
DEBUG: http-outgoing-0 << Content-Encoding: gzip
DEBUG: http-outgoing-0 << Content-Type: application/json
DEBUG: http-outgoing-0 << Date: Wed, 20 Apr 2016 21:34:46 GMT
DEBUG: http-outgoing-0 << nnCoection: close
DEBUG: http-outgoing-0 << Pragma: No-cache
DEBUG: http-outgoing-0 << Server: Apache
DEBUG: http-outgoing-0 << Vary: Accept-Encoding
DEBUG: http-outgoing-0 << X-Mashery-Message-ID: 9bb66bde-ce50-41c7-97a2-2c65a7241142
DEBUG: http-outgoing-0 << X-Mashery-Responder: prod-j-worker-us-east-1d-125.mashery.com
DEBUG: http-outgoing-0 << Content-Length: 129
DEBUG: http-outgoing-0 << Connection: keep-alive
DEBUG: Connection can be kept alive indefinitely
DEBUG: Connection [id: 0][route: {s}->https://api.athenahealth.com:443] can be kept alive
indefinitely
DEBUG: Connection released: [id: 0][route: {s}->https://api.athenahealth.com:443][total
kept alive: 1; route allocated: 1 of 2; total allocated: 1 of 20]
DEBUG: Connection manager is shutting down
DEBUG: http-outgoing-0: Close connection
DEBUG: Connection manager shut down
Exception in thread "main" java.util.zip.ZipException: invalid block type
	at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:164)
	at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:116)
	at org.apache.http.client.entity.LazyDecompressingInputStream.read(LazyDecompressingInputStream.java:73)
	at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283)
	at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325)
	at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177)
	at java.io.InputStreamReader.read(InputStreamReader.java:184)
	at java.io.Reader.read(Reader.java:140)
	at org.apache.http.util.EntityUtils.toString(EntityUtils.java:247)
	at org.apache.http.util.EntityUtils.toString(EntityUtils.java:291)
	at Test.main(Test.java:22)
{noformat}

> CLONE - "deflate" encoding issue : java.util.zip.ZipException: invalid block type
> ---------------------------------------------------------------------------------
>
>                 Key: HTTPCLIENT-1738
>                 URL: https://issues.apache.org/jira/browse/HTTPCLIENT-1738
>             Project: HttpComponents HttpClient
>          Issue Type: Bug
>         Environment: Windows
>            Reporter: Archie Cobbs
>            Priority: Minor
>
> When trying to GET any nzb files from http://nzbindex.nl with a httpclient request, a
ZipException is raised.
> {code:title=JunitTestFailing.java}
> 	@Test
> 	public void testDeflateIssueFailing() throws ClientProtocolException, IOException {
> 		HttpGet httpget = new HttpGet("http://nzbindex.nl/download/72441827/BackTrack5R3.Gnome.iSO.32bit-LiNUX-0171-bt5r2gis32.par2.nzb");
> 		HttpClient client = HttpClientBuilder.create().build();
> 		HttpResponse response = client.execute(httpget);
> 		HttpEntity entity = response.getEntity();
> 		byte[] data = EntityUtils.toByteArray( entity );
> 		Assert.assertEquals( data.length, 423548 );
> 	}
> {code}
> The complete stack trace I get is this:
> {code}
> java.util.zip.ZipException: invalid stored block lengths
> 	at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:164)
> 	at java.io.FilterInputStream.read(FilterInputStream.java:107)
> 	at org.apache.http.client.entity.DeflateInputStream.read(DeflateInputStream.java:144)
> 	at org.apache.http.client.entity.LazyDecompressingInputStream.read(LazyDecompressingInputStream.java:68)
> 	at org.apache.http.util.EntityUtils.toByteArray(EntityUtils.java:136)
> 	at hclient.HTTPClientTest.testDeflateIssueFailing(HTTPClientTest.java:39)
> {code}
> A workaround I found is to set the Accept-Encoding header to only accept gzip, as follows:
> {code:title=JunitTestWorking.java}
> 	
> 	@Test
> 	public void testDeflateIssueWorking() throws ClientProtocolException, IOException {
> 		HttpGet httpget = new HttpGet("http://nzbindex.nl/download/72441827/BackTrack5R3.Gnome.iSO.32bit-LiNUX-0171-bt5r2gis32.par2.nzb");
> 		httpget.setHeader("Accept-Encoding", "gzip");
> 		HttpClient client = HttpClientBuilder.create().build();
> 		HttpResponse response = client.execute(httpget);
> 		HttpEntity entity = response.getEntity();
> 		byte[] data = EntityUtils.toByteArray( entity );
> 		Assert.assertEquals( data.length, 423548 );
> 	}
> {code}
> Thanks



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org


Mime
View raw message