Mailing-List: contact httpclient-user-help@jakarta.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "HttpClient User Discussion" <httpclient-user@jakarta.apache.org>
Received-SPF: neutral (herse.apache.org: local policy)
Subject: Re: have question about buffer size
From: Oleg Kalnichevski <olegk@apache.org>
To: HttpClient User Discussion <httpclient-user@jakarta.apache.org>
In-Reply-To: <200611082227.18063.paranoid_@ukr.net>
References: <20061108161758.34492.qmail@web32815.mail.mud.yahoo.com>
	 <200611082227.18063.paranoid_@ukr.net>
Content-Type: text/plain
Date: Thu, 09 Nov 2006 12:11:19 +0100
Message-Id: <1163070679.4930.13.camel@localhost.localdomain>
Mime-Version: 1.0
Content-Transfer-Encoding: 7bit

On Wed, 2006-11-08 at 22:27 +0200, Paranoid wrote:
> > Why should this be a problem? Over the network,
> > maximum segments you get are (after removing
> > framing/chunking overhead) probably that 1440 bytes in
> > size, and httpclient is then returning you as much
> > data as it can efficiently give at any given time.
> > You just keep on reading all the data, piece by piece.
> > That's how streams work; they present an abstraction
> > over what may be (and often is) packet-based transport
> > channel.
> 
> some peaces are about 55 KB size, and first read is 75 KB. so why are all 
> other about 1.4 KB?

There can be many factors affecting the content stream fragmentation and
the way it is being transferred across the wire. I suggest that you
install a traffic analyzer such as Ethereal and look at the packets sent
by the target server. If you are absolutely convinced the content gets
fragmented somewhere inside HttpClient, I'll dig into the code and try
to pinpoint the problem.

Oleg

> and after - saving inputStream into FileOutputStream load CPU for great 
> number... this time it is really a problem... tested with different buffer 
> sized, and with greater buffer size have lower CPU load.
> P.S.: speed of downloading about 5 MB/s...


---------------------------------------------------------------------
To unsubscribe, e-mail: httpclient-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: httpclient-user-help@jakarta.apache.org