hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Broberg (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8258) Add interfaces for compression codecs to use direct byte buffers
Date Sat, 07 Apr 2012 00:19:19 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249085#comment-13249085

Tim Broberg commented on HADOOP-8258:

Please see HADOOP-8148 for an attempt at this for compressors and decompressors. Compression
streams could still use a similar treatment.
> Add interfaces for compression codecs to use direct byte buffers
> ----------------------------------------------------------------
>                 Key: HADOOP-8258
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8258
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, native, performance
>    Affects Versions: 3.0.0
>            Reporter: Todd Lipcon
> Currently, the codec interface only provides input/output functions based on byte arrays.
Given that most of the codecs are implemented in native code, this necessitates two extra
copies - one to copy the input data to a direct buffer, and one to copy the output data back
to a byte array. We should add interfaces to Decompressor/Compressor that can work directly
with direct byte buffers to avoid these copies.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message