Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Sat, 7 Apr 2012 01:07:19 +0000 (UTC)
From: "Tim Broberg (Commented) (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: 
 <1696533261.870.1333760839301.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <665958450.377.1333753815816.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (HADOOP-8258) Add interfaces for compression
 codecs to use direct byte buffers
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HADOOP-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249108#comment-13249108 ] 

Tim Broberg commented on HADOOP-8258:
-------------------------------------

It's certainly trying to address the same thing, but then I haven't addressed the (arguably more important) stream layer at all yet.

I'm not proud, feel free to kill whichever one you think is the weakling, but do please review the proposed interface. I'm actually writing some code to it now, so any weaknesses you can find in the interface sooner rather than later would be appreciated.
                
> Add interfaces for compression codecs to use direct byte buffers
> ----------------------------------------------------------------
>
>                 Key: HADOOP-8258
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8258
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, native, performance
>    Affects Versions: 3.0.0
>            Reporter: Todd Lipcon
>
> Currently, the codec interface only provides input/output functions based on byte arrays. Given that most of the codecs are implemented in native code, this necessitates two extra copies - one to copy the input data to a direct buffer, and one to copy the output data back to a byte array. We should add interfaces to Decompressor/Compressor that can work directly with direct byte buffers to avoid these copies.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira