Mailing-List: contact commons-dev-help@jakarta.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Jakarta Commons Developers List" <commons-dev@jakarta.apache.org>
Received-SPF: pass (hermes.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
  b=qQ5jHg2jeRTWL3wMH/GByEE7wc9LSSwv27ybPljSkJb+KTqFkLFhKWp8OlHfUN6y91LYwPpRj9F3QNZMXr6THJqK+zw8TrO1qgLK8G86Qpp49tb9v7TqBtTq41MGS15VVZ7Pc56Qsh1hP73NBRgUO5ddyAO8Mz0hhHrsQ6p5ugQ=
  ;
Message-ID: <20050609214808.75711.qmail@web30902.mail.mud.yahoo.com>
Date: Thu, 9 Jun 2005 14:48:08 -0700 (PDT)
From: Matt Benson <gudnabrsam@yahoo.com>
Subject: Re: [VFS] OutOfMemory Exception on large files
To: Jakarta Commons Developers List <commons-dev@jakarta.apache.org>
In-Reply-To: <42A81C07.6050400@ops.co.at>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: 8bit


--- Mario Ivankovits <mario@ops.co.at> wrote:

> Hi Torsten!
> >Michael came up with a workaround. Instead of
> >using a ByteArrayOutputStream we use a temp
> >file and a FileOutputStream.
> Nice idea!
> 
> >He is currently looking into a Piped version.
> >Or what do you think how should we solve this?
> >  
> I think a Piped version is the correct solution.
> 
> But please have a look at the perfomance also.
> As I said the jdk Piped*Stream use an internal
> buffer of 1k. When I try 
> to use the piped version in jsch (sftp) it gets dog
> slow.
> I blamed the JDK implementation of the pipe for
> this, though I havent 
> investigated into this any further.
> But maybe we also nead our own implementation of
> Pipe-Streams.

FYI it looks a little hacky perhaps but Ant's codebase
has org.apache.tools.ant.util.LeadPipeInputStream that
a) doesn't die just because its writing Thread has
died, and b) allows you to specify (or change while in
use) the buffer size.

-Matt


__________________________________ 
Discover Yahoo! 
Have fun online with music videos, cool games, IM and more. Check it out! 
http://discover.yahoo.com/online.html

---------------------------------------------------------------------
To unsubscribe, e-mail: commons-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: commons-dev-help@jakarta.apache.org