hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8258) Add interfaces for compression codecs to use direct byte buffers
Date Sat, 07 Apr 2012 00:23:19 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249086#comment-13249086
] 

Todd Lipcon commented on HADOOP-8258:
-------------------------------------

Ah, thanks, sorry I missed that. Do you think this JIRA should just be marked as duplicate?
I can reproduce the comments into the other one.
                
> Add interfaces for compression codecs to use direct byte buffers
> ----------------------------------------------------------------
>
>                 Key: HADOOP-8258
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8258
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, native, performance
>    Affects Versions: 3.0.0
>            Reporter: Todd Lipcon
>
> Currently, the codec interface only provides input/output functions based on byte arrays.
Given that most of the codecs are implemented in native code, this necessitates two extra
copies - one to copy the input data to a direct buffer, and one to copy the output data back
to a byte array. We should add interfaces to Decompressor/Compressor that can work directly
with direct byte buffers to avoid these copies.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message