Mailing-List: contact dev-help@hc.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "HttpComponents Project" <dev@hc.apache.org>
Date: Sat, 10 Jun 2017 15:17:18 +0000 (UTC)
From: "Nicholas DiPiazza (JIRA)" <jira@apache.org>
To: dev@hc.apache.org
Message-ID: <JIRA.13078871.1497107796000.46108.1497107838123@Atlassian.JIRA>
In-Reply-To: <JIRA.13078871.1497107796000@Atlassian.JIRA>
References: <JIRA.13078871.1497107796000@Atlassian.JIRA> <JIRA.13078871.1497107796234@jira-lw-us.apache.org>
Subject: [jira] [Created] (HTTPCLIENT-1854) Cannot peek contents of
 org.apache.http.conn.EofSensorInputStream
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sat, 10 Jun 2017 15:17:25 -0000

Nicholas DiPiazza created HTTPCLIENT-1854:
---------------------------------------------

             Summary: Cannot peek contents of org.apache.http.conn.EofSensorInputStream
                 Key: HTTPCLIENT-1854
                 URL: https://issues.apache.org/jira/browse/HTTPCLIENT-1854
             Project: HttpComponents HttpClient
          Issue Type: Bug
    Affects Versions: 4.5.2
            Reporter: Nicholas DiPiazza


I am trying to peek at an input stream contents from HttpClient, up to 64k bytes.

The stream comes from an HttpGet, nothing unusual about it:

{code}
HttpGet requestGet = new HttpGet(encodedUrl);
HttpResponse httpResponse = httpClient.execute(requestGet);
int status = httpResponse.getStatusLine().getStatusCode();
if (status == HttpStatus.SC_OK) {
  return httpResponse.getEntity().getContent();
}
{code}

The input stream it returns is of type org.apache.http.conn.EofSensorInputStream

Our use-case is such that we need to "peek" at the first (up to 64k) bytes of the input stream. I use an algorithm described here How do I peek at the first two bytes in an InputStream?

{code}
PushbackInputStream pis = new PushbackInputStream(inputStream, DEFAULT_PEEK_BUFFER_SIZE);
    byte [] peekBytes = new byte[DEFAULT_PEEK_BUFFER_SIZE];
    int read = pis.read(peekBytes);
    if (read < DEFAULT_PEEK_BUFFER_SIZE) {
      byte[] trimmed = new byte[read];
      System.arraycopy(peekBytes, 0, trimmed, 0, read);
      peekBytes = trimmed;
    }
    pis.unread(peekBytes);
{code}

When I use a ByteArrayInputStream, this works with no problem.

When using the org.apache.http.conn.EofSensorInputStream I only get a small number of bytes at the beginning of the stream. usually around 400 bytes. When I expected up to 64k bytes.

I also tried using a BufferedInputStream where I read up to the first 64k bytes then call a .reset() but that doesn't work either. Same issue.

Why might this be? I do not think anything is closing the stream because if you call IOUtils.toString(inputStream) I do get all the content.

See https://stackoverflow.com/questions/44474191/is-it-possible-to-peek-httpclients-org-apache-http-conn-eofsensorinputstream


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org